Yes, if you’d prefer to go back to your old voicemail service, you can remove Visual Voicemail by dialling 12152. This means you should go back to just receiving text notifications.
You can then restore Alert & Deliver or Icon Notifications if you dial 121. Press 4 and then 3 on the keyboard. You’ll then hear the options to change your notifications.