Automating the video player controls

I am trying to automate the video player controls on the android app using Appium(Java). When I try to pause/forward/backward using the buttons, the elements are not identified by appium. Sometimes it’s working but it took more time ~4 to 5 mins. Please help me to solve it.