Takes about 8 hrs to setup properly. But once you do set your Nvidia card with Linux, you just never update your OS and cry to sleep every night.

You are right. You would need a team of skilled scrapers and network engineers though would know how to get around rate limiters with some kind of external load balancer or something along those lines.

Creating a web scraper vs actually maintaining one that is effective and works is two different things. It’s very easy to fight web scraping if you know what you are doing.

Jerboa is pretty good tbh.