I wrote about ScrapingBee a couple of years ago, where I gave a brief intro about the service. ScrapingBee is a cloud-based scraping service that provides both headless and lightweight, typical HTTP request-based scraping services. Recently, I discovered that they are providing some cool features that other online services are not providing as such. What are those features? I thought to explore and explain them with a real use case. I used Python to automate the Daraz group’s shopping website, a famous e-commerce website service in Asian countries like Pakistan, Nepal, Bangladesh, and Sri Lanka. I am automating DarazPK since I am in Pakistan. You can view the demo below:…
-
-
ScrapingBee API Python Tutorial: How to Use Render JS, Proxies & Headers
Learn how to use cloud based Scraping API to scrape web pages without getting blocked.In this post, I am going to discuss another cloud-based scraping tool that takes care of many of the issues you usually face while scraping websites. This platform has been introduced by ScrapingBee, a cloud-based Scraping tool. What is ScrapingBee If you visit their website, you will find something like this: ScrapingBee API handles headless browsers and rotates proxies for you. As it suggests, it is offering you all the things to deal with the issues you usually come across while writing your scrapers, especially the availability of proxies and headless scraping. No installation of web drivers for Selenium, yay! Development ScrapingBee is based on REST API hence it can…