Find Jobs
Hire Freelancers

Ruby (on Rails) expert for Web Scraper / Web Scraping Job needed

$250-750 USD

Zavřený
Zveřejněno skoro před 5 roky

$250-750 USD

Zaplaceno při doručení
Intro. I am looking for a multi-talented Ruby (on Rails) expert in web scraping. You are going to build an entire webapplication with Ruby (on Rails) - using the newest Rails 6.0.0 version and the latest compatible Ruby version. You will find all the links to Frameworks, Templates, Gems etc. below. Target website. The first website will be AirBnB's room / housing listings. Please take a very careful look at a few of those listings. AirBnB's is randomly generating id and name HTML-attributes to protect their site from scraping. The structure seems to stay the same though. You will always be presented with 300 search results - even in cities like New York City. To see all listings you have to adjust the price (increase, decrease). In addition to that, use the map to get all the results (zoom in and out, move the map). Backend. • You will use the Kimura framework for scraping jobs (link below) • You will create a "command script" that triggers an AWS EC2 server to be setup, configured and destroyed for every single scraping job (see tutorial / links below). This server will function as a proxy. You are going to use Terraform for that. • Authorization through CanCanCan (Guest, User, Manager, Admin) • Authentication through Devise (Basic User table with login is enough) • Historization of all listings through Papertrail Scraping job. The scraping job needs to run when triggered (e.g. if I want to have a new city to be scraped). Also, the job needs to re-scrape an existing listing - the old version can be saved through Papertrail, or you just create a new listing and reference the old with the new one. Frontend. I will provide you with a Bootstrap admin template that needs to be used for the frontend. This Bootstrap admin template is built on top of the Bootstrap framework, SASS, jQuery, HTML5, and CSS. So you need to know how to work with those! Links. [login to view URL] (Ruby Framework) [login to view URL] (Create AWS servers tutorial) [login to view URL] (EC2 proxies) [login to view URL] [login to view URL] [login to view URL]
IČ projektu: 20015968

O projektu

11 nabídky
Vzdálený projekt
Aktivní před 5 roky

Chcete si vydělat nějaké peníze?

Výhody podávání nabídek na Freelancer

Stanovte si rozpočet a časový rámec
Získejte za svou práci zaplaceno
Načrtněte svůj návrh
Registrace a podávání nabídek je zdarma
11 freelanceři nabízejí v průměru $523 USD za tuto práci
Avatar uživatele
Nice to meet you. I've read the task description and can develop definitely. I'll provide you with the highly skill to complete this task in time. I'll also do my best for you. Please contact with me. Thank you very much.
$555 USD v 10 dnech
4,8 (12 recenze)
5,0
5,0
Avatar uživatele
Dear Customer! I have built many scrapers. This is my favorite type of job. I am absolutely confident I can complete your project easily and on time. Ready to begin immediately and finish as soon as possible. Please contact to discuss in more details. Thank you.
$500 USD v 14 dnech
3,9 (17 recenze)
5,5
5,5
Avatar uživatele
Dear Sir. Glad to meet you. I'm Web developer specializing in web scraping crawling and indexing web pages. Skills: python, scrapy, selenium, requests, beautifulsoup, mechanize, lxml, urllib2, automation, bots, spiders I worked with 50+ differenct individuals/startups/companies and helped them archive their goals. Here's what you will get by working with me: * Working only on projects that I can deliver 100% * Ridiculous quality of work * Smart suggestions on increasing results/revenue and decreasing costs * Responsibility for tasks/project I work on * Reliability * Short response time * Good sense of humor ;) Hope I could awake you interest in me. Thank you for your attention. Shuaixing.(call me Shuaixing L.)
$500 USD v 7 dnech
4,9 (7 recenze)
4,6
4,6

O klientovi

Pochází z UNITED KINGDOM
Wem, United Kingdom
0,0
0
Členem od čvn 16, 2019

Ověření klienta

Díky! Poslali jsme vám e-mailem odkaz pro získání kreditu zdarma.
Při odesílání e-mailu se něco pokazilo. Zkuste to prosím znovu.
Registrovaných uživatelů Zveřejněných projektů
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Načítání náhledu
Bylo uděleno povolení ke geolokaci.
Vaše doba přihlášení vypršela a byli jste odhlášeni. Přihlaste se znovu.