Looking for a self hosted, web search trends monitor. I have looked at Plausible Analytics, OpenSearch, Matomo, and some other website analytics platforms, but I’m not necessarily wanting to monitor a specific website(s). Rather, I want to monitor what people are searching for on the internet.
Is such a thing possible?
How do you plan to get this data? Most search companies don’t share it.
Well, I’ve seen datasets from places like Common Crawl, Web Data Commons, Yahoo’s Webscope which can be integrated into something like MeiliSearch. I’m going in kind of blind on this, and I don’t know if it can be pulled off with the datasets that are publicly available. It’s just something that has captured my imagination, and so I am on a fishing trip.