Garforth fell to a home defeat after seeing early chances saved, including a penalty kick.
Ben Whelan scored a brace for the visitors, sending them back to East Yorkshire on a high.