Hi there,
The requirements look quite clear and straightforward to implement so no questions. I am planning to use python3 to implement the crawler. If you instead prefer py2 branch just let me know please.
As a side note, the website is using cloudflare but it looks like that's only for cdn, no ddos precautions. I ran some tests and even after several consecutive requests there wasn't anything related to that. Still, in case that shows up after a real load we just need to utilize nodejs to bypass cloudflare protection in addition to python.
I expect this to be ready in 24h, thanks.