Join the Discord to discuss all things Python and Web with our growing community! discord.gg/C4J2uckpbR
In this video I go through how to implement rotating proxies using requests with Python. We look at scraping some free proxies and writing a script to see if they work. Although free proxies aren't any use for actual web scraping projects the principles are the same.
Code here: github.com/jhnwr/rotatingproxies
Proxies: nodemaven.com/?a_aid=JohnWatsonRooney
If you are new, welcome! I am John, a self taught Python (and Go, kinda..) developer working in the web and data space. I specialize in data extraction and JSON web API's both server and client. If you like programming and web content as much as I do, you can subscribe for weekly content.
:: Links ::
My Patrons Really keep the channel alive, and get extra content www.patreon.com/johnwatsonrooney (NEW free tier)
I Host almost all my stuff on Digital Ocean m.do.co/c/c7c90f161ff6
I rundown of the gear I use to create videos www.amazon.co.uk/shop/johnwatsonrooney
Proxies I use nodemaven.com/?a_aid=JohnWatsonRooney
Scraper API I use www.scrapingbee.com/?fpr=jhnwr
:: Disclaimer ::
Some/all of the links above are affiliate links. By clicking on these links I receive a small commission should you chose to purchase any services or items.
コメント