It wasn't being too fast and spinny, it was that you did the same thing with his serve every time (push long) which allowed him to comfortably third ball every time because he knew exactly what was coming, and you couldn't create the same advantage with your serve.
Edit: Didn't realize what...