Machine Learning Times
Machine Learning Times
Elon Musk Predicts Artificial General Intelligence In 2 Years. Here’s Why That’s Hype
 Originally published in Forbes, April 10, 2024 When OpenAI’s...
Survey: Machine Learning Projects Still Routinely Fail to Deploy
 Originally published in KDnuggets. Eric Siegel highlights the chronic...
Three Best Practices for Unilever’s Global Analytics Initiatives
    This article from Morgan Vawter, Global Vice...
Getting Machine Learning Projects from Idea to Execution
 Originally published in Harvard Business Review Machine learning might...

4 years ago
Google Just Published 25 Million Free Datasets

Originally published in Medium, January 23, 2020

Note: Google’s new dataset search tool was publicly released on January 23rd, 2020.

Here’s what you need to know about the largest data repository in the world.

Google recently released datasetsearch, a free tool for searching 25 million publicly available datasets.

The search tool includes filters to limit results based on their license (free or paid), format (csv, images, etc), and update time.

The results also include descriptions of the dataset’s contents as well as author citations.

Google’s dataset aggregation methodology differs from other dataset repositories like Amazon’s open data registry. Unlike other repositories that curate and host the datasets themselves, Google does not curate or provide direct access to the 25 million datasets directly.

Instead, Google relies on the dataset publishers to use the open standards of to describe their dataset’s metadata. Google then indexes and makes that metadata searchable across publishers.

Since publishers are still required to host the datasets themselves, for-profit publishers that conform to standards will also have their datasets indexed by Google. In my anecdotal experience, I found about half of the datasets in the search results were from for-profit aggregators, with an even higher percentage when searching for market-related datasets.

Other popular dataset publishers on the platform include government agencies and research institutions. Google claims that US government agencies alone have published over 2 million datasets.

To continue reading this article click here.