Clicking on an element thats not in view via XPATH in ios (NATIVE APP)

So i have this Calendar in my app that im testing for ios. Lucky for me (i think) that the whole calendar is loaded and visible to appium. Best way i went about this is to grab all the dates xpath using findelements put them in a list and iterate through the list till i find the one matching my criteria. Appium finds the match and proceeds to click it. What happens is that it will scroll to the location automatically and then crash. Giving me some BS exception.

org.openqa.selenium.WebDriverException: An unknown server-side error occurred while processing the command. (WARNING: The server did not provide any stacktrace information)

BUT… if i try to click on a date thats already in view from the initial loading of the calendar…so no scrolling needed, it works fine. What im thinking i need to do is scroll to the element first then try to click it. Im not 100% sure on how to do that tho.