To stop IE from being the default browser, you make Mozilla the default browser. Usually when you load up Mozilla it should ask if you want to make it your default browser, then click yes.
If you do not need all that comes with Mozilla, such as the E-mail client, composer..
You may want to use Firefox instead. It's developed by Mozilla.org, and it's fast.