00:00WebMD will show you 400 doctors. It will not let you keep the list. No export, no API, just infinite
00:07scroll, and whatever you're willing to copy by hand.
00:10So, a tamper monkey script. It sits in the corner of the page, collapses when you don't need it, and
00:16remembers your settings.
00:17One button. It scrolls, waits for the cards to load, reads them, and keeps going.
00:23And it knows when to stop. Four quiet scrolls with no new cards, and that's the end of the data.
00:29No guessing.
00:30No runaway loop. Then, one click. Name, specialty, rating, years of experience, phone, booking link, NPI, and the full bio.
00:40Every row, already deduplicated. Auto-save on, and it writes as it goes.
00:45Off, and nothing leaves the tab until you say so.
00:49800 lines, so I never touch that page again. It's in the comments.
Comments