By watching the ball, you should see the racket on contact and what is done to the ball. But while watching the ball, you do need to widen your scope so you also see your opponent.
It is also important, while watching the ball "into your racket" on your shot, to be watching your opponent. What I said about Waldner....there have been countless times where I saw my opponent break towards one side or the other before I had made contact. And I have been able to adjust my shot accordingly. This does not always mean directing my shot to the side away from where my opponent is heading. If an opponent is moving towards one wing and has committed towards that wing, hitting the ball straight at their body, at the switching point is very effective and only requires a minor adjustment.
So, for much of the time: when you are in the process of taking your shot, when your ball is moving towards your opponent, when your opponent is about to make his own shot, some amount of your sight and attention should be on what your opponent is doing.
And I know, it is easier said than done. But trying to work on this is a first step. At some point these things just happen without you needing to think about them. But at first it is effing hard to get in. I can remember so many times, working on these kinds of skill sa dn after one or two shots, realizing I was not paying attention to those details at all.
Our nervous system and our brain processing skills take a while to catch up to our physical coordination skills. And the mind is very hard to get control over at first. So, doing the work without thinking there is a rush.
I have also noticed that, in times when I have taken brakes from playing and training, I have improved my TT skills simply because not working on the physical stuff gave my brain a little time to catch up on all the stuff I was trying to force in.

It is a long slow process, especially if you are working on improving as an adult.