Scrapfly Reviews

The most impressive aspects of Scrapfly include its competitive pricing, intuitive user interface, comprehensive logging features, and straightforward API.

No significant downsides have been observed with Scrapfly to date.

It's the cheapest while not sacrificing quality. Works fast and easy to use API. API player and logs are good. Anti-Protection bypass is fully automatic, no need to redo the request.

Screenshots are the weakest part for me - they miss some parts of the website render. Anti-scraping protection could be a little smarter and try to find proxies that incur less cost per request. I manually select countries for proxies for some websites while automatic mode is happy to use proxies from countries that lead to all the anti-bot protections and the highest cost for the request.

It is useful to collect data and use the data

It is a bit difficult to use but can be used easily

The documentation is extensive and the APIs are mostly intuitive/simple/quick setup. Really enjoyed the product thus far

There was one instance where I couldn't figure out why I wasn't getting a valid scrape returned with render_js flag enabled and I emailed support with some sample responses. The support wasn't particularly helpful (maybe because I wasn't giving them enough to go off of? but not sure) and I ended up investing the time to figure it out myself. Not a huge deal just one thing that came to mind

The price, success rate and uptime. It was trivial changing over from another provider.

Compared to previous competitors, I haven't found anything to complain about.

After hitting a dead end with a data extraction project using the usual out-of-the-box Python tools, Scrapy, etc, I turned to Scrapfly. Not only can the Scrapfly SDK execute Javascript, but it can also work around common anti-scraping measures. With Scrapfly I'm able to quickly and reliably extract the data I need.

There are no real cons. Understanding the Python SDK took a bit, but once I had it up and running, it worked very similarly to other Python data extraction libraries.

JS Scenarios are handy, GeoLocation is available for basic-tier subcriptions, Support team is very helpful.

ASP (Anti-Scraping Protection) has some problems with Cloudflare.

Best in class LinkedIn scraping, robust, and fits the price points.

Design maybe improved. Although this is not a major drawback.

Excellent, dev-friendly usage, pretty fair prices

Limit of free credits for PoC/testing could be a bit higher

easy to run and create tabular data from output

Would be useful if account scraper for instagram automatically scraped all images in a multi-post (not just the first image)

The API works flawlessly - it does take some initial setup and more so than drag/drop scraper websites, but once you have set up your project it works brilliantly. The reporting is excellent and the free tier is generous too.

My only issue was the expense of the Discovery plan. Going from free plan to this when only requiring a little more in the way of monthly credits seemed a little steep. It would be nice to have a stepping stone at $10 a month or so.

You're able to scrape web pages without having to deal with any of the associated technical complication, all through an API

I set to use only datacenter IP range, but it still uses residential and I can't work out why

I found Scrapfly to be reliable with anti-bot solutions when trying to scrape real estate websites. They have good documentation and examples on how to implement in a handful of languages. Though there is an obvious bias towards Python, they make it easy to figure out for other languages. Their dashboards for monitoring usage are also helpful. The biggest thing I look for is scraping reliability and Scrapfly delivers.

The API player can be hard to work with because it resets the example whenever you toggle between the different programming languages, which can be a bit frustrating.

I specifically appreciate the ability to get past bot blockers and rerouted of Ips.

Limited abilities to access web pages that require Javascript to load certain data points. When a page is not loaded, the api returns a success in certain instances. Our program needs to run redundancies to handle pages that don't load properly.

Pros: Ease of Use from API Number of Proxies Data extracted that were pull from the environment vs just the render of the page.

Cost for using advanced proxies Not a difference on spend on test mode vs production mode. I could see a rate limiting as a solution to this.

Very easy to set up and test. Once I knew it worked as expected it was easy to upgrade and use as needed. They even had a blog post describing my exact use case which saved me ~4 hours of dev time.

No complaints so far... it does what is expected at the level of success I expected.

With the SDK it was easy to use python to setup and execute web scraping projects. It handled many of the problems I normally have with web page scraping automatically. Support was great in answering a few of the issues I had initially. I appreciated the free tier which let me get everything working first before paying for the next tier to get the actual data I needed.

For what I needed the product worked better than expected. I actually didn't encounter anything I didn't like, that is why I can safely recommend others to try it for their own project.

Thank you for sharing your experience with Scrapfly's SDK. Our support team was happy to help you with any initial problems. Thank you for recommending Scrapfly. Best regards, Scrapfly team

It helps pass site protections like cloudflare and emulate javascript sites render. Clear and easy usage of API. Many useful features which close most of requirements. Reasonable price compared to competitors. Great support team.

We don't have any troubles with integration

The documentation and logging helps me trouble shoot errors and makes it an ease to use, as a developer. They have also helped me access a lot of publicly available data from places that have sophisticated bot blockers.

It might be pricey, but I'm not sure. I also want to know more about how they source residential IPs. If I find out it's unethically sourced, that would be the only reason why I'd churn.

Simple API, easy to use once I got the hang of it. Responses were fast and they really offer a lot with the basic memberships. The anti-scrape protection is great.

The concurrent connections is what slows me down. I really wanted a lot to run but that costs more.

1. Great prices2. Good stats3. The API Player tool is divine

I'd probably update the usage examples. For example, in the Node JS section there is an example of a very outdated approach and, moreover, this particular code does not work at all :))

Quite a simple module to setup and use, I quite like how beautifulsoup is built in and the console has some really good monitoring. KB and help guides are also very helpful when encountering errors.

I wish it had a similar feature to webdriverwait function to wait for a page to load before scraping.

Their antiscraping protection is top tier. Makes dealing with complex scraping enviroments a breeze.

Their documentation is lacking. The python SDK has a lot of advanced features which have no user friendly documentation. The DX could be improved but it's still the best we've found in the market.

that it allows us to scrape websites with systems in place to prevent it. Service runs every day so we always have the most up-to-date data that we need for our clients

We have no complaints at this time

Lots of examples, good support. Have never had any issues with using it. Any questions are answered quickly.

It's not the cheapest, but worth it if you want quality. The add on API call costs seem expensive, but the monthly fees are reasonable.