How appium tool's regression suite is executed

This might look dummy question, but i never come across how a tool’s(especially open source tools) regression suite is executed?

For ex consider Appium releases their builds frequently. Before they release the build(may be BETA version also) how their Dev/Test teams make sure that their tool is not breaking with respect to different OS, Mobile OS and mobile device configurations.

Can someone please point me right pointers.