Idea for the next search engine: the crawlers simulate a human browsing the page. Each pop-up/tracker/MB-of-useless-javascript between the crawler and the content means that the query score is divided by 2.
The social network of the future: No ads, no corporate surveillance, ethical design, and decentralization! Own your data with Mastodon!