I personally think the idea of watching the ball actually hit your rubber is a myth. Rather, you're kinda looking at the ball or the region the ball is in. I think it's partly watching the ball and partly using your peripheral vision.
Are you getting nice & warm before you play? The warmup simple counter hitting corner to corner professionals do before a match. I love that drill. I think it gets your feel going and your consistency going (ie - not hitting the edge of the racket). Furthermore, your hitting a high number of balls in a short time-span. Do you do this regularly when you train?
On a side note, our work here has a monthly skill challenge. This month it's juggling (no i'm not kidding and I guess there are benefits for your brain activity related). Anyways, you do this a little every day and it's amazing how much better you get quickly. All I know is that you're largely tossing & catching balls without really looking at them specifically. I've got to imagine it's a great eye-hand coordination training tool. Maybe give it a go. IDK... If nothing else, it's kinda fun.