The server cannot serve if the receiver is not ready.
When he starts his antics, put your bat on the table and wait. He will then notice that you are not ready. You will ask, "are you going to serve in a reasonable time?" If he says anything nasty, just tell him that you won't be receiving until...