ScrapingBee Features

We've used ScrapingBee for almost two months now and the speed and success rate of their proxies have been great, we scrape a variety of Ecommerce stores, including ASOS, Nike and Zalando that do heavy bot throttling and prevention, and with the premium proxies we se great success rate, and the standard proxies are decent and fast for the sitres that don't require very stealthy proxies. I really like that you can use this service with "proxy mode", instead of having to integrate the hTTP api, this made it really easy to "drop in" to our existing application with minimal configuration. The support is quite responsive and they fixed a simple Dashboard UI fix a few minutes after being made aware of it.

The concurrency limit is 10 for the lowest paid plan, and 40 for the "business" plan, this might be a bit low for our use case, and limits throughput a bit, but I hear from the grapevines that there will be higher or more customisable plans in the future, however, if you need very high concurrency, this might not fit the bill for you.

ScrapingBee is really easy to setup and to start with. They have good documentation available. We are using the product already for years, and there has been almost no down-time in those years. Also there request builders are really easy to use, and you can each language you prefer. In general they have a lot of options, to build the perfect request you need to get the data from any service you want, without getting blocked. Overall I would say the best and most easy scraping service you will find.

The request costs of some endpoint with specific parameters are pretty high, which makes that you need a bigger plan earlier. Pricing plans is also high for us, but not compared to other services who are offering the same.

The API is easy to use and documented in detail. It also proved to be very similar to other tools in the market which I consider an advantage as it reduces vendor lock-in. It comes with a shallow learning curve and all the tools you need to monitor your progress, especially if you are familiar with how APIs work. It also offers a lot of useful & flexible options that allow you to customize how you used the tool and the burn rate of your credits. Also responses proved to be very quick from websites. The pricing is absolutely competitive after comparing it with other similar options. Before using ScrapingBee I didn't think it would be possible to scale our web crawling operations in such an easy way.

The only disadvantage I could find is that a few websites still manage to block crawling attempts or recognize ScrapingBee's default US servers as Canadian IP addresses which can complicate our web crawling attempts. I have also found that you need some trial and error to decode the error codes returned by the tool and understand the root cause of any issues we come across.

It just works: and its parsing meta-language is wonderfully powerful. Most importantly, the support I've received has been superlative: in my first attempt to implement a parser (using the meta-language) I failed, and a support engineer wrote the whole parser for me. Then I realised the scraping API was missing a really useful parameter: the support engineer updated the API to add the missing parameter (and generically so it supports all available parameters) within about 48 hours. It almost feels like Scraping Bee's support engineers are on my own team!

Nothing missing for me. I can't think of any downsides.

The web interface is great you can try out various queries right in the browser and get full cost control. Also sending XHR requests and basically a complete browser dump in the scraping response is unmatched in the industry

The pricing is a bit too high. I understand that it is expensive to run such a large network, but geo location + javascript makes a request 5 times more expensive which can get really price fast. Also I find it misleading that the prices are listed without VAT, it wasn't obvious to me.

Support is amazing so far. 24 hour response times. The API has also been quote reliable.

Pricing is definitely on the high side, with a $50/mo minimum. There's not much room to scale workflows slowly between the limited free trial and the first pricing tier. I would have liked a lower tier with fewer calls to be able to scale with for the first couple months...

What I liked most about ScrapingBee was its ease of use. Setting up my web scraping projects has never been this straightforward. The intuitive and user-friendly interface allowed me to create scraping tasks within minutes, even without extensive technical expertise. Moreover, ScrapingBee's rotating proxies ensured a consistent availability of data, greatly enhancing the reliability of my scraping operations.

What I liked least about ScrapingBee is that it comes with a cost. While I understand the need to pay for such a high-quality service, it can be a financial consideration for small projects or individual users. However, the quality of the service more than compensates for this drawback, and I believe it's well worth the investment for professional or business projects.

It was very simple to understand the documentation, the API and therefore to implement ScrapingBee in our services. The service works very realible and the dashboard gives us clear information about potential sources for error and any problems that may occur.

The pricing structure could be a bit more granular in my opinion. There are huge price gaps within the different packages.

If I could give 6 stars for customer support, I would. [SENSITIVE CONTENT] are always just minutes away, promptly resolving any questions or problems encountered. The API documentation is extensive and well-made, making deployment easy. Beautiful request success rate > 95%.

Can't think of anything. It could only be better if the service was completely free, haha!

Team works very hard -- even social platform blockers on API scraping requests, they are able to solve in due's time. We have some record scrape times with ScrapingBee (3 seconds) which is amazing!

Just the nature of scraping from social, it's unpredictable if we would get blocked in the future. The team should react and use preventative measures to address changes in the market.

ScrappingBee has many features that will fulfill any web scraping project. Not only allows for classical tasks like getting specific fields of the page, but also allows for more complex ones such as the screenshot and bypassing blockages of websites like facebook and google. It's been great and I feel like I'm using 10% of its full potential. Also, the customer support is absolutely fantastic. Any time that I have a question about it, I get a reply in almost immediately. They have also changes features on request!

In some cases, it's not possible to set the country code of a request but only in cases where you need to specifically set them on the website. But I haven't explored the geo location of a request which might help in those scenarios.

Scrapingbee gives lot of customization available in free trial and lowest tiers. Many of the other APIs I explored do not even try advanced features in free trial which makes very difficult to try out API. Over and above that, the API works perfectly and gave me the best results among the other ones I tried. The sample code provided for Ruby is also very helpful.

Nothing as such. The API works great across a wide variety of URLs (not 100% but perhaps > 90%).

The ability to scrap information on node / react based sites.

The price, but because our exchange rate is kind of high right now.

The customer support is unparalleled. Also stupid simple API docs: an idiot like me was up and running in minutes. A++ would highly recommend.

The docs aren't as comprehensive as I'd like, but overall not much to complain about. Every time I think I have an issue, it turns out to be my own human error.

Fantastic API – very clean, simple, and powerful. Excellent IP rotation with workers around the world, enabling powerful data acquisition. Brilliant JavaScript rendering, and the ability to disable it as needed.

At times, the documentation is a bit too verbose, leading to reading fatigue. I spent slightly too much time learning just how simple and clean the API actually is. The cost is at a premium; however, the value is worth it.

- easy to use, the sdks for python are very well documented - multiple ip rotations, is really important because when hitting websites as 4xx or 5xx errors occur often

Currently have not found any cons in regards to the usage that I have.

- easy to use - easy to implement - really good at bypassing captcha - has a ton of data extraction options - saved us a couple of weeks in development - at least

- sometimes it fails to parse reddit pages

I've tested different services before knowing Scrapingbee and haven't changed it since. Scraping responses have very low response times (maybe the lowest among all others).The API service has never known degradation or processing delays since I've been using it. Their usage documentation is very simple, examples are offered in any programming language, you just need to add to your code what the ScrapingBee...

Read more

There is nothing that I can suggest to increase the quality of service, it's the best in entire market.

It has a well-documented, fairly easy-to-use API that covers a whole range of scraping situations. (I talk more about that below). You can choose Javascript rendering or not, residential or data-center proxies, screenshots, etc. I was never blocked once during my scraping. They are a small, responsive startup. I did run into a reproducible bug with their data extraction API, but they clearly made it a priority and had a new release fixing the problem the very next day. (Since they're in France, time zones worked out well and that was really first thing the next morning for me.)

It would have been nice to be able to get a screenshot and the data on the page at the same time. At present, you can only get one or the other, so I had to run it twice.

Speed. Performance. So far good. I hope it stays good.

Only 5 simultaneous requests. Ideally i want about 100 simultaneous requests. Webscrapingapi used to have 20 simultaneous requests, but their speed and performance was bad.

I set up ScrapingBee to rotate proxy IP addresses when scraping tens of thousands of pages from search engines and eCommerce websites. These are typically more difficult to scrape, but even the cheaper rotating proxies on ScrapingBee have rarely been blocked. If they are (occasionally) blocked, I only pay for successful returns, so I have not encountered any downside.

I have only had one issue where ScrapingBee accidentally assigned proxies from the wrong country, rendering my html in a different language. But this was a brief issue and has never happened since.

- Easy setup - Good customer support - Low number of failed scraping attempts - Easy API

- Credits don't roll over to the next month - Pricing for premium proxies is a bit high - No automatic price extraction for big stores like Amazon

What I liked most about ScrapingBee is its simplicity and effectiveness. The API handles the complexities of web scraping, such as managing headless browsers and dealing with JavaScript-rendered content, which makes it very user-friendly. Additionally, ScrapingBee's speed and reliability, even when scraping heavy or dynamic websites, are commendable.

What I liked least about ScrapingBee is the cost. While the service is powerful and feature-rich, the pricing can be a bit high for smaller projects or individual developers. Another downside is that the free tier is quite limited, making it difficult to fully evaluate the service without committing to a paid plan. There were also occasional issues with scraping particularly complex websites, though these were relatively rare.

Scraping Bee is reliable and easily integrates with our systems. Great technical support!

We have found no Cons with Scraping Bee.