Cached Chrome Top Million Websites

1

ClickHouse

If you are interested in the research on technologies used on the Internet, I recommend playing with the "Minicrawl" dataset. It contains data about ~7 million top websites, and for every website, it also contains: - the full content of the main page; - the verbose output of curl, containing various timing info; the HTTP headers, protocol info... Using this dataset, you can build a service similar to https://builtwith.com/ for your research. Data: https://clickhouse-public-datasets.s3.amazonaws.com/minicrawl/data.native.zst (129 GB compressed, ~1 TB uncompressed). Description: <a href="https://github.com/ClickHouse/ClickHouse/issues/18842">https://github.com/ClickHouse/ClickHouse/issues/18842</a> You can easily try it with clickhouse-local without downloading: <pre><code> $ curl https://clickhouse.com/ | sh.

#Databases #Relational Databases #Data Warehousing 43 social mentions

2

BuiltWith

If you are interested in the research on technologies used on the Internet, I recommend playing with the "Minicrawl" dataset. It contains data about ~7 million top websites, and for every website, it also contains: - the full content of the main page; - the verbose output of curl, containing various timing info; the HTTP headers, protocol info... Using this dataset, you can build a service similar to https://builtwith.com/ for your research. Data: https://clickhouse-public-datasets.s3.amazonaws.com/minicrawl/data.native.zst (129 GB compressed, ~1 TB uncompressed). Description: <a href="https://github.com/ClickHouse/ClickHouse/issues/18842">https://github.com/ClickHouse/ClickHouse/issues/18842</a> You can easily try it with clickhouse-local without downloading: <pre><code> $ curl https://clickhouse.com/ | sh.

#Market Research #Sales Automation #Sales 158 social mentions

3

Poki

#Games #Online Games #Parse Server 38 social mentions

4

Hacker News Search

It's a tough thing to balance, but generally, bringing in someone's personal details as ammunition in an internet argument is not ok on HN (https://hn.algolia.com/?dateRange=all&page=0&prefix=false&sort=byDate&type=comment&query=%22personal%20details%22%20by:dang). I'm not saying those are never relevant, but [editing...].

#Search Engine #Web Search #Internet Search 1904 social mentions