AWS Lambda web page scraping and integrate into existing python script

Dokončeno Zveřejněno před 5 lety K zaplacení v momentě doručení
Dokončeno K zaplacení v momentě doručení

Hey guys, I'm using Selenium on my server to do some website scraping, and wish to switch to do it serverless with using Cheerio instead.

Create a web page scraper in lambda based on this framework:

[login to view URL]

Your script will need to be able to take the user's credentials and log into a website. This will require handling multiple redirects and intermittently occurring errors. After logging in it must scrape a bit of data from the first page. Then it must perform a POST request, and grab some cookies. Then it must open a URL and submit the cookies from the previous step. It must scrape the data from this page, formatting the output identically to the way the current scraper does. It must repeat these last two steps twice.

Once that's done, a change to the python script on my server should be made to call the lambda function rather than selenium and get the results from it.

Freelancer must be willing to start immediately and have excellent reviews. If you read this message me and tell me that you are ready to start today.

Amazon Web Services JavaScript Node.js Python Sběr dat z webových stránek

Identifikační číslo projektu: #17204619

O projektu

13 nabídek Projekt na dálku Aktivní před 5 lety

Uděleno uživateli:

lockbox

Hi there, So .. cheerio - nodejs? Not python? I am indeed ready to start today. May i ask about target website URL? Btw. should it use serverless framework? (asking because of linked medium resource). Kind reg Další

$400 USD za 0 dní
(23 recenzí)
5.6

13 Freelnceři na tento projekt zveřejňují nabídky v průměru $511

chirgeo

Hi. I see what you need. Let me know and I guess we can start. Can you share the code which you already have with selenium? Thx, waiting for details.

$1111 USD za 10 dní
(123 Recenzí)
7.4
schoudhary1553

Hello, I can help with you in your project AWS Lambda web page scraping and integrate into existing python script. I have more than 5 years of experience in Amazon Web Services, Javascript, node.js, Python, Web Scra Další

$500 USD za 10 dní
(58 Recenzí)
6.5
kkc264043kkc

Can do your job. Can start right now only. Can follow all the steps as you have described. these are my skill related to web scraping and web crawling Have done scraping in Nodejs, CasperJS Phantomjs, python. Další

$444 USD za 3 dní
(45 Recenzí)
6.0
lightingdavid

Hello. As a professional web scraper i have good skills in Python. Contact me please. Thanks...........................................

$555 USD za 10 dní
(63 Recenzí)
5.7
Angel521

hi I am really interested in your project I have full experience of web scraping by using python and c# I could scrape your website as you want I could satisfy you Everything will be done well if you work with me Další

$388 USD za 5 dní
(28 Recenzí)
5.7
humrobo

Hi, Hope you doing well, I read your job details an understand your requirements. I can create a web page scraper in lambda based on this framework. I am having 6+ year experience in AWS, Javascript, node.js, Další

$555 USD za 10 dní
(12 Recenzí)
4.5
sayanprogrammer2

HI I am Xpert P. I am senior Developer and I am Expert in Amazon Web Services, Javascript, node.js, Python, Web Scraping. I have completed 200+ based projects in programming with 100% client satisfaction .I have Workin Další

$250 USD za 5 dní
(0 Recenzí)
0.0