It is up to you. You can always play it unboosted and see how you like it.
then take it off and boost it later if you really enjoy it. When you boost it, the sponge will expand so you will be able to put it back on the blade without much issues. In fact, you might need to cut some edges off as...