How to Delete Favorites Permanently. You might think it would be easy to delete your Internet Explorer favorites, but it may take you a few steps to get rid of them all. Windows 8 comes with two ...