Skip to main content

5 posts tagged with "proxy"

View All Tags

Residential vs Datacenter Proxies in Web Scraping

ScrapingAnt Team

ScrapingAnt Team

ScrapingAnt

Residential vs Datacenter Proxies in Web Scraping

Web scraping software has made it extremely helpful for a business to base its advertising system according to the gathered information and make informed decisions. Web scraping software can operate efficiently and safely only with the use of a reliable proxy. In fact, proxies are a significant part of a decent web scraping project. Adding proxies to your scraping programs offers various advantages, however, choosing the best proxy for your scraping project might be a difficult task.

6 Puppeteer Tricks to Avoid Detection and Make Web Scraping Easier

Oleg Kulyk

Oleg Kulyk

Co-Founder @ ScrapingAnt

6 Puppeteer Tricks to Avoid Detection and Make Web Scraping Easier

As you know, Puppeteer is a high-level API to control headless Chrome, and it's probably one of the most popular web scraping tools on the Internet. The only problem is that an average web developer might be overloaded by tons of possible settings for a proper web scraping setup.

I want to share 6 handy and pretty obvious tricks that should help web developers to increase web scraper success rate, improve performance and avoid bans.

How to use a proxy in Playwright

Oleg Kulyk

Oleg Kulyk

Co-Founder @ ScrapingAnt

How to use a proxy in Playwright?

Playwright is a high-level API to control and automate headless Chrome (Chromium), Firefox and Webkit. It can be considered as an extended Puppeteer, as it allows using more browser types to automate modern web apps testing and scraping. Playwright API can be used in JavaScript & TypeScript, Python, C# and, Java. In this article, we are going to show how to set up a proxy in Playwright for all the supported browsers.

How to use rotating proxies with Puppeteer

Oleg Kulyk

Oleg Kulyk

Co-Founder @ ScrapingAnt

How to use rotating proxies with Puppeteer?

Puppeteer is a high-level API to control headless Chrome. Most things that you can do manually in the browser can be done using Puppeteer, so it quickly became one of the most popular web scraping tool in Node.js and Python. Many developers use it for a single page applications (SPA) data extraction as it allows executing client-side Javascript. In this article, we are going to show how to set up a proxy in Puppeteer and how to spin up your own rotating proxy server.