Well like I said I'll look into them, but my long term plan is to build my own.
Right on. I did a rough calculation that a 1 billion page search index would be about 60TB and cost $2700/mo to host on Amazon, not that Amz is a good idea. I'm gonna look into getting a YaCy node going for the reddit alternative I help with. I wish decentralized Reddit was here already.
Man I used to be a fan of the decentralized idea until I saw the reality of it in action. The reality is pedophilia and all that other shit. So now I just don't know its why I haven't gone that route here.
Which reddit alt are you helping with? Is it a free speech platform?
Edit Also I have a bit of a different idea on how to manage doing a search engine. That should allow me to do it a little less resource intensive.
Yeah the decentralized route is tough. I think Mastodon and NotABug are doing alright though, and have good ideas for how to address stuff like that.
I help with one that starts with an S and rhymes with Reddit... it's kind of a free speech platform, most here would probably say No. It is heavy on conspiracy content at least.
Also I have a bit of a different idea on how to manage doing a search engine. That should allow me to do it a little less resource intensive.
Sweet. Open source that beast and maybe we'll chat again someday. I'm starting to think this search problem is just as big as having free speech sites in the first place. Like what's the point of it all if Google can just erase your existence? Anyway best of luck.
(post is archived)