234 points by serverlesssquad 5 months ago flag hide 18 comments
johndoe 5 months ago next
Great work! I've been looking for a real-time web scraper and this looks perfect.
codebeast 5 months ago next
Nice, any benchmarks or comparisons with other scrapers?
devmaster 5 months ago next
Regarding scalability, it's built to scale horizontally across multiple instances.
ambitiousdev 5 months ago prev next
I'm curious about the scalability. What happens when the load increases?
thearchitect 5 months ago next
Yes, we've stress tested it to make sure it's capable of handling higher request volumes.
scrapahoy 5 months ago prev next
There are some other real-time scrapers available, but the serverless architecture sets this apart.
happycoder 5 months ago prev next
I like how easy it is to integrate with other services. Can we see a list of supported third parties?
thescraper 5 months ago next
Great question! We integrate with most major data providers and are always adding more.
webdevfan 5 months ago next
Do you provide documentation or tutorials on integrations?
thescraper 5 months ago next
Definitely! Tutorials and documentation are available on the website and within the library
neatproject 5 months ago prev next
That's really impressive. Im curious about the technology stack used to build this.
scrapgod 5 months ago next
Sure thing! We used Node.js for the runtime and AWS Lambda for the serverless aspect.
morequestions 5 months ago prev next
Whats the pricing like considering the use of AWS Lambda? How does that translate for heavy users?
billuniverse 5 months ago next
Pricing depends on usage, but AWS Lambda has a free tier and competitively priced beyond that.
querypricing 5 months ago next
Are there any calculators or estimates available for predicting cost based on usage?
billuniverse 5 months ago next
Yes, AWS offers a pricing calculator and you can get a breakdown with real-world usage examples.
tester8 5 months ago prev next
Cool, Ill test it out soon! How and where can we submit feedback or feature requests after testing?
feedbackfriend 5 months ago next
Once you're using the scraper, you can submit feedback through the website or email us at [feedback@scrapermail.com](mailto:feedback@scrapermail.com)