• 2 days ago
Need reliable data for a personal project or a specific task at work? Explore six useful places to find datasets, from Kaggle’s downloadable project data and Google Dataset Search’s web-wide results to FiveThirtyEight’s article data, U.S. government records, GitHub repositories, and NASA’s detailed open data.

This practical data analytics guide explains how to search, assess, and download datasets for projects, research, and analysis. Whether you’re learning data analysis, building a portfolio project, or looking for public data on a particular topic, these dataset sources offer a useful starting point.

Category

📚
Learning
Transcript
00:00What's going on, everybody?
00:01Welcome back to another video.
00:02Today, we're gonna be talking about
00:04the best places to find datasets.
00:11Now, why do we need to find datasets at all?
00:14Well, you may just be wanting to build a personal project
00:17and you don't have the data for it,
00:19so you want data on a country or a product
00:21or just really anything you could want.
00:23This is where a dataset would come in handy
00:26where you can just download it and use it.
00:27You may also need a dataset for your actual job,
00:30and this happened all the time for me.
00:31I would need a dataset on some very specific data,
00:34but my company just doesn't have that data,
00:36so I would go out and I'd search for it and I'd find it
00:39and I would use it in the actual work I was doing.
00:41So let's jump onto my screen.
00:42I'm gonna show you some of my favorite websites
00:44for getting datasets.
00:45All right, so I'm gonna start with some
00:46of the more popular ones I think you might recognize or know,
00:49and then we'll get to some of the ones
00:50that probably are a little bit more nuanced
00:52or you may never have heard of.
00:54The first one is, of course, Kaggle.
00:56This one is fantastic.
00:57I've gotten a ton of datasets from Kaggle.
00:59It's open source.
01:00Anybody can post datasets here,
01:01and what's great is you can just download it
01:03right from here.
01:04So if we come in here, we'll go over to,
01:07I don't know, this earthquake dataset,
01:10and then we'll come down
01:11and it'll give a little description of it,
01:13and then you can have this earthquake dataset right here.
01:15You just click on it, you download it,
01:17and you have the actual data.
01:18It's as simple as that.
01:19What's really great is you can actually
01:21just search these datasets.
01:22So if we go back, let's say I want one on sales.
01:26So I type in sales,
01:27and then we have all these different datasets on sales.
01:30Now, some of these are very old,
01:32four, five, six, eight years old,
01:34but they're still really good.
01:36And if you're just trying to build a product
01:37or just a project, these could be perfectly fine.
01:40I really recommend Kaggle for people who are just trying
01:43to build projects because they have such a wide variety
01:45of actual datasets.
01:46The next place to find datasets is Google Dataset Search.
01:50Now, this is a little bit different than Kaggle,
01:52and let's try this out.
01:53You can still search for datasets,
01:55and let's just try the coronavirus COVID-19.
01:58It prompted us to do it, so why not?
02:00What this is gonna do is it's gonna search the web
02:03and find datasets for you.
02:05So then you can come over here
02:07and you can see it's a CSV, it's a zip file.
02:10We have a PDF,
02:11and they even can source in Kaggle datasets as well.
02:15But then you can come in here
02:16and you can say it have found datasets,
02:19and it's gonna explore them.
02:20So you can find these datasets at these locations.
02:23So it's often not as straightforward.
02:26You have to do a little bit more digging than Kaggle,
02:28but typically you're getting more reliable sources of data.
02:32So with this, if you're looking
02:34for an actual COVID-19 dataset,
02:36things like Data World is another kind of reputable place
02:39to find datasets.
02:41Although I think you may have to pay for some of them
02:43on some of these websites,
02:44but you can find datasets from the entire internet,
02:46not just one website.
02:48And that's what this is really, really good for.
02:50So you may have to search around and kind of find it
02:52and then click on these links
02:53and then download it from those websites.
02:55But this is kind of an all-in-one place to search,
02:59which is really helpful.
03:00Again, just a little bit different than Kaggle.
03:02Now the next website is called FiveThirtyEight.
03:04Now, if you've never heard of them,
03:06they're an analytical news website.
03:08So it's like a data-driven website for news.
03:11I follow them every so often.
03:13I think they're pretty cool,
03:14but they also have open access to the data that they use
03:17for their news articles,
03:19which is just really, really cool.
03:20So you can come over here,
03:23and let's say I wanted to do NHL predictions.
03:26So hockey.
03:27I'll click on this link,
03:29and it's gonna actually download all of the data in here.
03:32Now you can click in here as well,
03:34and you can actually look at the data
03:36that you're about to download.
03:37And so you can just download a lot of these free data sets,
03:40and they're pretty wide and varied.
03:43But you can kind of look through
03:45and find some really, really interesting data sets.
03:47And if you find the news article,
03:49you can actually go and look at the exact data that they use,
03:52and you can kind of verify
03:53what they're posting and talking about.
03:55The next website for finding data sets is data.gov.
03:58Now this one is for people in the US,
04:00although anybody can use it,
04:01but there should be one very similar to this
04:04for almost any local government or agency
04:07for most countries as well.
04:09So this one is just one that I've used,
04:12but you can come in here.
04:13It can prompt you to search for things.
04:15I'll search for healthcare.
04:17And what it's gonna do is it's gonna find
04:19all the data sets that they have on healthcare.
04:22They'll tell you if it's a CSV,
04:23if it's an API, that's not an API,
04:26but sometimes they'll have PDFs, APIs, JSON, XML.
04:29And then you can click into these,
04:31like this licensed healthcare facility listing.
04:34This isn't a data set that I'm interested in,
04:36but then you can go and just download it.
04:38Click on this and download that data set.
04:40This is definitely more government data.
04:43So for this website,
04:44it's more US-specific, state-specific,
04:48local government-specific,
04:49or federal government-specific,
04:51but they have really, really good stuff.
04:53I've used a lot of data from this website.
04:54The next place that we're gonna look is GitHub.
04:57Now, GitHub isn't typically known for data sets,
05:00but I personally put a ton of data sets in here for free
05:03for all my YouTube stuff.
05:04And so do a lot of other people.
05:05As you can see, if you search for a data set in GitHub,
05:08there's 276,000 repositories that have data set in them.
05:13So if you wanna search for something like healthcare data set,
05:17or something like that,
05:20you can scroll down and you can find stuff for that.
05:22So this one's NHSR data sets.
05:26It looks like this one's for the R community,
05:29but we can also use that.
05:30So you just find their working files.
05:32And now here's some mortality rates with a CSV.
05:36So this one is a little bit more tricky.
05:38You have to really kind of understand how GitHub works,
05:40but I found a lot of great data sets from GitHub
05:43from people who are doing projects similar to mine.
05:45So if you have a project that you wanna build,
05:47you may be able to find the entire project
05:49with code and everything on GitHub,
05:52but also be able to download that data set as well.
05:54Now, the last one I'm gonna show you
05:55is kind of a nuanced one, right?
05:57This is pretty specific,
05:58but one that I personally am super interested in.
06:01And there's another kind of government one.
06:03This is data.nasa.gov.
06:06So NASA has their own portal for their data.
06:09So you can come in here, go to their data sets,
06:12and now you can see all of their data
06:14that they have just available for free.
06:17Most of this is NASA specific, as you could guess it,
06:20but it's also super interesting stuff.
06:23The data in here is extremely specific
06:26and very, very detailed.
06:27So if you're looking for really specific data sets,
06:30this is not where I'd go.
06:31I'd go to Kaggle just for sample data sets.
06:34This one is like real data,
06:35thousands and millions of rows of actual data
06:38that you could use to build a product,
06:41or, you know, do some real research for NASA.
06:44Again, you may not use this data at all,
06:46but if you have a really specific niche
06:48that you're looking for,
06:49something like Google data set search
06:51might be the exact thing,
06:53because then you can find websites like this
06:54for your specific data and niche.
06:56So there you go.
06:57Those are some of my favorite websites to get data sets.
06:59I have used all of those many times
07:01for a lot of different things.
07:02And some of those websites I've even found
07:04through Google data set search,
07:07just trying to find specific data.
07:08And then I'm like, whoa,
07:09this is a great place to find a ton of other data.
07:12And so, you know, as you go down that rabbit hole,
07:14you'll find, you just kind of find data where it is
07:17and you find different ways and websites
07:19to actually collect and get those data sets.
07:21So I hope that this was helpful.
07:23I hope that these websites help you get really good data sets
07:25for your projects or your work.
07:27If you liked this video,
07:28be sure to like and subscribe below
07:29and I'll see you in the next video.

Recommended