I've been testing Freespoke(https://freespoke.com/) and sometimes use Webcrawler(http://www.webcrawler.com/). There's always Captain Caveman(http://websearchpro.captaincaveman.nl/?id=search_engines&subid=browse&index=A) and Start Page(https://www.startpage.com/). I really would like to make my own webcrawler, but I'm not sure I can pull it off and need more storage too.