Probably not enough brushing, and thus the contact with the ball is too solid.
Stop trying to generate a lot of spin with your current serve motions, and concentrate instead on barely grazing the ball with the topsheet (and not the sponge!!!), making sure that the contact point is as far away...