00:00What's going on, everybody?
00:01Welcome back to another video.
00:02Today, we're gonna be talking about
00:04the best places to find datasets.
00:11Now, why do we need to find datasets at all?
00:14Well, you may just be wanting to build a personal project
00:17and you don't have the data for it,
00:19so you want data on a country or a product
00:21or just really anything you could want.
00:23This is where a dataset would come in handy
00:26where you can just download it and use it.
00:27You may also need a dataset for your actual job,
00:30and this happened all the time for me.
00:31I would need a dataset on some very specific data,
00:34but my company just doesn't have that data,
00:36so I would go out and I'd search for it and I'd find it
00:39and I would use it in the actual work I was doing.
00:41So let's jump onto my screen.
00:42I'm gonna show you some of my favorite websites
00:44for getting datasets.
00:45All right, so I'm gonna start with some
00:46of the more popular ones I think you might recognize or know,
00:49and then we'll get to some of the ones
00:50that probably are a little bit more nuanced
00:52or you may never have heard of.
00:54The first one is, of course, Kaggle.
00:56This one is fantastic.
00:57I've gotten a ton of datasets from Kaggle.
00:59It's open source.
01:00Anybody can post datasets here,
01:01and what's great is you can just download it
01:03right from here.
01:04So if we come in here, we'll go over to,
01:07I don't know, this earthquake dataset,
01:10and then we'll come down
01:11and it'll give a little description of it,
01:13and then you can have this earthquake dataset right here.
01:15You just click on it, you download it,
01:17and you have the actual data.
01:18It's as simple as that.
01:19What's really great is you can actually
01:21just search these datasets.
01:22So if we go back, let's say I want one on sales.
01:26So I type in sales,
01:27and then we have all these different datasets on sales.
01:30Now, some of these are very old,
01:32four, five, six, eight years old,
01:34but they're still really good.
01:36And if you're just trying to build a product
01:37or just a project, these could be perfectly fine.
01:40I really recommend Kaggle for people who are just trying
01:43to build projects because they have such a wide variety
01:45of actual datasets.
01:46The next place to find datasets is Google Dataset Search.
01:50Now, this is a little bit different than Kaggle,
01:52and let's try this out.
01:53You can still search for datasets,
01:55and let's just try the coronavirus COVID-19.
01:58It prompted us to do it, so why not?
02:00What this is gonna do is it's gonna search the web
02:03and find datasets for you.
02:05So then you can come over here
02:07and you can see it's a CSV, it's a zip file.
02:10We have a PDF,
02:11and they even can source in Kaggle datasets as well.
02:15But then you can come in here
02:16and you can say it have found datasets,
02:19and it's gonna explore them.
02:20So you can find these datasets at these locations.
02:23So it's often not as straightforward.
02:26You have to do a little bit more digging than Kaggle,
02:28but typically you're getting more reliable sources of data.
02:32So with this, if you're looking
02:34for an actual COVID-19 dataset,
02:36things like Data World is another kind of reputable place
02:39to find datasets.
02:41Although I think you may have to pay for some of them
02:43on some of these websites,
02:44but you can find datasets from the entire internet,
02:46not just one website.
02:48And that's what this is really, really good for.
02:50So you may have to search around and kind of find it
02:52and then click on these links
02:53and then download it from those websites.
02:55But this is kind of an all-in-one place to search,
02:59which is really helpful.
03:00Again, just a little bit different than Kaggle.
03:02Now the next website is called FiveThirtyEight.
03:04Now, if you've never heard of them,
03:06they're an analytical news website.
03:08So it's like a data-driven website for news.
03:11I follow them every so often.
03:13I think they're pretty cool,
03:14but they also have open access to the data that they use
03:17for their news articles,
03:19which is just really, really cool.
03:20So you can come over here,
03:23and let's say I wanted to do NHL predictions.
03:26So hockey.
03:27I'll click on this link,
03:29and it's gonna actually download all of the data in here.
03:32Now you can click in here as well,
03:34and you can actually look at the data
03:36that you're about to download.
03:37And so you can just download a lot of these free data sets,
03:40and they're pretty wide and varied.
03:43But you can kind of look through
03:45and find some really, really interesting data sets.
03:47And if you find the news article,
03:49you can actually go and look at the exact data that they use,
03:52and you can kind of verify
03:53what they're posting and talking about.
03:55The next website for finding data sets is data.gov.
03:58Now this one is for people in the US,
04:00although anybody can use it,
04:01but there should be one very similar to this
04:04for almost any local government or agency
04:07for most countries as well.
04:09So this one is just one that I've used,
04:12but you can come in here.
04:13It can prompt you to search for things.
04:15I'll search for healthcare.
04:17And what it's gonna do is it's gonna find
04:19all the data sets that they have on healthcare.
04:22They'll tell you if it's a CSV,
04:23if it's an API, that's not an API,
04:26but sometimes they'll have PDFs, APIs, JSON, XML.
04:29And then you can click into these,
04:31like this licensed healthcare facility listing.
04:34This isn't a data set that I'm interested in,
04:36but then you can go and just download it.
04:38Click on this and download that data set.
04:40This is definitely more government data.
04:43So for this website,
04:44it's more US-specific, state-specific,
04:48local government-specific,
04:49or federal government-specific,
04:51but they have really, really good stuff.
04:53I've used a lot of data from this website.
04:54The next place that we're gonna look is GitHub.
04:57Now, GitHub isn't typically known for data sets,
05:00but I personally put a ton of data sets in here for free
05:03for all my YouTube stuff.
05:04And so do a lot of other people.
05:05As you can see, if you search for a data set in GitHub,
05:08there's 276,000 repositories that have data set in them.
05:13So if you wanna search for something like healthcare data set,
05:17or something like that,
05:20you can scroll down and you can find stuff for that.
05:22So this one's NHSR data sets.
05:26It looks like this one's for the R community,
05:29but we can also use that.
05:30So you just find their working files.
05:32And now here's some mortality rates with a CSV.
05:36So this one is a little bit more tricky.
05:38You have to really kind of understand how GitHub works,
05:40but I found a lot of great data sets from GitHub
05:43from people who are doing projects similar to mine.
05:45So if you have a project that you wanna build,
05:47you may be able to find the entire project
05:49with code and everything on GitHub,
05:52but also be able to download that data set as well.
05:54Now, the last one I'm gonna show you
05:55is kind of a nuanced one, right?
05:57This is pretty specific,
05:58but one that I personally am super interested in.
06:01And there's another kind of government one.
06:03This is data.nasa.gov.
06:06So NASA has their own portal for their data.
06:09So you can come in here, go to their data sets,
06:12and now you can see all of their data
06:14that they have just available for free.
06:17Most of this is NASA specific, as you could guess it,
06:20but it's also super interesting stuff.
06:23The data in here is extremely specific
06:26and very, very detailed.
06:27So if you're looking for really specific data sets,
06:30this is not where I'd go.
06:31I'd go to Kaggle just for sample data sets.
06:34This one is like real data,
06:35thousands and millions of rows of actual data
06:38that you could use to build a product,
06:41or, you know, do some real research for NASA.
06:44Again, you may not use this data at all,
06:46but if you have a really specific niche
06:48that you're looking for,
06:49something like Google data set search
06:51might be the exact thing,
06:53because then you can find websites like this
06:54for your specific data and niche.
06:56So there you go.
06:57Those are some of my favorite websites to get data sets.
06:59I have used all of those many times
07:01for a lot of different things.
07:02And some of those websites I've even found
07:04through Google data set search,
07:07just trying to find specific data.
07:08And then I'm like, whoa,
07:09this is a great place to find a ton of other data.
07:12And so, you know, as you go down that rabbit hole,
07:14you'll find, you just kind of find data where it is
07:17and you find different ways and websites
07:19to actually collect and get those data sets.
07:21So I hope that this was helpful.
07:23I hope that these websites help you get really good data sets
07:25for your projects or your work.
07:27If you liked this video,
07:28be sure to like and subscribe below
07:29and I'll see you in the next video.