There are really only two usable search engines actually indexing the entire Internet: Google and Bing. Yandex also does but I’ve never seen it recommended for anything other than Russian language content (the company itself seems to be falling down a mineshaft at the moment). Baidu also does some although every Chinese exchange student I talked to about it (admittedly not many) advised only using it when Google is blocked. Every other engine is just wrapping Google or Bing (yes that includes Yahoo and DDG)
This is the kind of ugly truth of the search engine business. It’s a duopoly at least in part because the indicies are expensive to scrape, build, and run. You need to continuously run a large number of servers loading web pages and often running scripts. You need to be large enough to negotiate with content providers not to block you. Keep in mind paying them may bankrupt you as your margins will be thin. Google has a huge advantage here they own a good chunk of the online advertising industry and can afford to throw money around in a way a search only company wouldn’t be able to (this is why the European and Canadian link tax schemes ironically cement the existing monopolies). You need to continuously run large linear aglebra transforms on the results (PageRank is expensive). You need to store all your indicies on large expensive servers with a lot of memory as hitting disk may take too long. Results need to be fast and you will make next to nothing on each search.
DDG gets its results from other search engines. Bing is one of them.
There was also a big thing about DDG allegedly selling user data to Microsoft, which the living brain donors of 4chan probably interpreted as DDG being a different front-end to Bing.
It wasn’t exactly selling, but it also wasn’t alleged. They made an exception for Microsoft’s tracking scripts in their tracking script blocking settings on their phone apps and extensions in exchange for utilizing bing as a backend. Here is the blog post where they walked it back after backlash.
Nobody else has mentioned this but there have been several times that Bing censored something and it propagated to DDG, most notably when Microsoft censored Tank Man (intended for China, probably) but then Tank Man also was censored on DDG.
Partly because of these incidents, I could never consider DDG reliable.
My understanding is that they outsource the search part to bing’s search back-end. Saying DDG is just Bing is like saying two butchers are the same because they get their meat from the same supplier.
Some people get paid good money for outsourcing their back end. Some also get paid for outsourcing other peoples’ back ends, but that is generally frowned upon.
Looking over their Wikipedia page, DDG looks like they’re reasonably independent.
Why is everyone saying they’re just Bing?
There are really only two usable search engines actually indexing the entire Internet: Google and Bing. Yandex also does but I’ve never seen it recommended for anything other than Russian language content (the company itself seems to be falling down a mineshaft at the moment). Baidu also does some although every Chinese exchange student I talked to about it (admittedly not many) advised only using it when Google is blocked. Every other engine is just wrapping Google or Bing (yes that includes Yahoo and DDG)
This is the kind of ugly truth of the search engine business. It’s a duopoly at least in part because the indicies are expensive to scrape, build, and run. You need to continuously run a large number of servers loading web pages and often running scripts. You need to be large enough to negotiate with content providers not to block you. Keep in mind paying them may bankrupt you as your margins will be thin. Google has a huge advantage here they own a good chunk of the online advertising industry and can afford to throw money around in a way a search only company wouldn’t be able to (this is why the European and Canadian link tax schemes ironically cement the existing monopolies). You need to continuously run large linear aglebra transforms on the results (PageRank is expensive). You need to store all your indicies on large expensive servers with a lot of memory as hitting disk may take too long. Results need to be fast and you will make next to nothing on each search.
DDG gets its results from other search engines. Bing is one of them.
There was also a big thing about DDG allegedly selling user data to Microsoft, which the living brain donors of 4chan probably interpreted as DDG being a different front-end to Bing.
It wasn’t exactly selling, but it also wasn’t alleged. They made an exception for Microsoft’s tracking scripts in their tracking script blocking settings on their phone apps and extensions in exchange for utilizing bing as a backend. Here is the blog post where they walked it back after backlash.
Nobody else has mentioned this but there have been several times that Bing censored something and it propagated to DDG, most notably when Microsoft censored Tank Man (intended for China, probably) but then Tank Man also was censored on DDG.
Partly because of these incidents, I could never consider DDG reliable.
The whole tank man stuff is fucking stupid
My understanding is that they outsource the search part to bing’s search back-end. Saying DDG is just Bing is like saying two butchers are the same because they get their meat from the same supplier.
With all due respect, I don’t know enough about butchering but it sounds far less complicated than what we’re talking about
Outsourcing back ends is one of the key parts of being a butcher.
Some people get paid good money for outsourcing their back end. Some also get paid for outsourcing other peoples’ back ends, but that is generally frowned upon.
When they’re frowning are they doing that at a fur coat and gold chain?