Amazon scraping

od Verz1Lka
Amazon scraping

Script for regular Amazon scraping for windows.\nTask: Extracting all products for some sellers.\nDetails: \n- Crawling Amazon Links\n- Insert and update data into MSSQL database.\n- Checking for duplicate\n- Avoid security (changing User-Agent, use TOR for hide IP, avoid captcha)

image of username Verz1Lka Flag of Russian Federation Novosibirsk, Russian Federation

O mně

Analysis of the source code of the sites, analysis of ajax queries, compilation of xpath queries. Analysis of means of protection of sites from parsing, emulation of requests, cookies, headers. Developing a spider, using python, scrapy, selenium. Designing a database, exporting data to a database (mysql, mongo, postgress). Failover spider failover at any stage, storing data. Rotation of the proxy, bypass captcha, include recaptcha. The biggest scrap results: Speed - 1000+ pages per minute Results - 10M Objects in the database Famous sites: google, facebook, booking, tripadvisor, linkedin, amazon, wallmart

$55 USD/hod.

109 recenze
6.5

Zkratky