DEV Community

#webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Turning Google Search into an API with 35 Lines of JSON

Turning Google Search into an API with 35 Lines of JSON

1
Comments
3 min read
Fetching age-restricted Instagram reels by URL

Fetching age-restricted Instagram reels by URL

Comments
1 min read
I asked Google 2,560 times: clustering 10,102 search suggestions

I asked Google 2,560 times: clustering 10,102 search suggestions

Comments
3 min read
How to Track Shopify Price Drops and Restocks with Python

How to Track Shopify Price Drops and Restocks with Python

Comments
7 min read
How to get Morrisons prices as rows, and match them without barcodes

How to get Morrisons prices as rows, and match them without barcodes

Comments 1
5 min read
How to Get Route Tolls and Fuel Costs with ViaMichelin Scraper

How to Get Route Tolls and Fuel Costs with ViaMichelin Scraper

Comments
7 min read
Turn Any Website into LLM-Ready Markdown with Firecrawl and Python

Turn Any Website into LLM-Ready Markdown with Firecrawl and Python

Comments
3 min read
Eleven Reads of Amazon's Electronics Top 27 Inside Four Hours Returned the Same Ranks. The Ratings Counts Moved Anyway

Eleven Reads of Amazon's Electronics Top 27 Inside Four Hours Returned the Same Ranks. The Ratings Counts Moved Anyway

Comments
6 min read
How to Scrape Standvirtual Car Listings into JSON with Python

How to Scrape Standvirtual Car Listings into JSON with Python

Comments
7 min read
OpenAI has 34 open "Forward Deployed" jobs. Palantir has 70.

OpenAI has 34 open "Forward Deployed" jobs. Palantir has 70.

Comments
8 min read
Babbel has a 4.5 on Google Play. Its last 20 German reviews average 1.9.

Babbel has a 4.5 on Google Play. Its last 20 German reviews average 1.9.

Comments
7 min read
AWS WAF challenge: you need the script URL, not just the token

AWS WAF challenge: you need the script URL, not just the token

Comments
3 min read
Your comment timeline is using the wrong clock

Your comment timeline is using the wrong clock

Comments
6 min read
Building a Reliable FMCSA Carrier Data Scraper with Python and Playwright

Building a Reliable FMCSA Carrier Data Scraper with Python and Playwright

Comments
5 min read
How to Pull a Competitor's Google Ads into Python (Google Ads Transparency Center)

How to Pull a Competitor's Google Ads into Python (Google Ads Transparency Center)

Comments
4 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.