Developer for Data Scraping Project

Dokončeno Zveřejněno před 5 lety K zaplacení v momentě doručení
Dokončeno K zaplacení v momentě doručení

We need a dev who can create a program to scrape electrical permit data from a number of jurisdictions (state and city) in Washington and Oregon and dump the data into a CSV. We need to be able to run the script as needed, probably monthly or quarterly.

We will give you the websites where the data is stored, and you’ll take it from there.

Washington

L&I - [login to view URL]

MyBuildingPermit - [login to view URL]

Seattle - [login to view URL]

Spokane - [login to view URL]

Spokane runs on top of Accela. A number of places in Oregon also use the Accela platform which does have API access. Maybe this is the better place to get data rather than a web scrape

Oregon

A lot of Jurisdictions - [login to view URL] (click search, building permits) We only need Electrical permits and/or only one permit per address whichever has the most solar info.

Portland - [login to view URL]

We are interested in searching by:

A list of contractors (by name, contractor license #). We have this list.

If we add a new contractor to our “watch list” then we’ll need to go back and collect previous records for them across all jurisdictions.

Jurisdiction (all or selected)

Date range

Requirements

We need access to the code to maintain

Documentation in code (language not important)

We need some sort of UI for non-programmers to run the program

Must be able to run locally on a Windows computer

Must be able to search by (see above list)

Run reports as desired in aggregate or individually

Must be able to add a competitor to list and refresh the data pulled from various jurisdictions

Output should be a CSV file with the following data fields (where available):

Contractor ID/License

Contractor Name

Date Issued

Final Date

Expiration Date

Permit ID

Permit/Record Type

Project Title/Name (if available)

Project Description

Address

Jurisdiction

Status/Action

Permit url (if available)

Job Value (looks to be available for Oregon permits)

Dolování dat Excel JavaScript PHP Python Softwarová architektura Sběr dat z webových stránek

Identifikační číslo projektu: #17076248

O projektu

22 nabídek Projekt na dálku Aktivní před 5 lety

Uděleno uživateli:

abedin94

hi, This is Pro Scraper Script writer Sid. I have scraped numerous site like adidas, yelp, aliexpress, ebay, SERP result and so on. Can do this very comfortably.

$252 USD za 2 dní
(121 recenzí)
6.5

22 Freelnceři na tento projekt zveřejňují nabídky v průměru $785

schoudhary1553

Hello, I can help with you in your project data scraping. I have more than 5 years of experience in Data Mining, Excel, PHP, Software Architecture, Web Scraping. We have worked on several similar projects before! W Další

$750 USD za 10 dní
(409 Recenzí)
8.1
seaanddream

Hi, my name is Selim. I will write a java code for you, with a simple UI, where you will be able to set your options before each run... I read your "Developer for Data Scraping Project" project descriptions carefully Další

$590 USD za 10 dní
(386 Recenzí)
8.2
hardcode4u

Hello, Hope you are doing well. I am an expert PHP developer having an experience of 9 years. I have done a scraper tool for Gumtree before and can do for you as well. We can have a chat for further discussio Další

$750 USD za 25 dní
(165 Recenzí)
8.1
Vlzinch

Hi! I’m experienced Python developer, and web-scraping is one of my main fields of knowledge, so I’m 100% confident that I can create crawlers to get the information from list of sites you've mentioned. Please con Další

$941 USD za 10 dní
(96 Recenzí)
8.0
augurstech

Dear Employer Hope you are doing well Coming to your project scope you can hire our exp developer for scraping electrical permit data from a number of jurisdictions (state and city) in Washington and Oregon and dump Další

$1411 USD za 20 dní
(203 Recenzí)
8.9
zekovicm

Hi there, As an Web Scraping expert i would like to scrape that data into csv for you. Please feel free to contact me to discuss further details. Best regards, Miljan

$705 USD za 7 dní
(192 Recenzí)
7.8
micheal4299

You can also check my portfolio: https://www.freelancer.com/u/micheal4299 I also have experience in working on similar projects. Let me know if you are interested in working with me. Thanks!

$750 USD za 12 dní
(77 Recenzí)
7.6
JinDongZhe

Hi,dear. i`m laravel and data scrabbing expert. I studied your requirements and i am very interested in discussion further regarding website. As i will provide you the website as per your requirements where you can Další

$555 USD za 10 dní
(101 Recenzí)
7.4
Venkat2011sri

Dear Hiring Manager, I am writing to apply for the position of Creating Tool. I possess seven years of experience as a virtual assistant and enjoy the variety of work the job brings each day. I can do this task with Další

$300 USD za 5 dní
(186 Recenzí)
7.1
axiomswb

I have expertise in web-scraping. Client's satisfaction is my first priority and believe in long-term relationship with clients. Thank you..

$250 USD za 10 dní
(75 Recenzí)
6.4
Harun1986

Hello, I have best web scraping skills and I can scrap all directory and any protected website. Please take a sample of your attached website. I will following all the details. Waiting for showing for the sample. Thank Další

$588 USD za 10 dní
(211 Recenzí)
6.7
shawnwilliams85

Hi I would love to discuss your needs further. I am a full stack developer with 10+years experience and extensive experience building optimized web applications for small to large scale businesses. I strive to off Další

$1764 USD za 10 dní
(46 Recenzí)
6.5
jkaranm

Hi, My name is Janis and I have been here in freelancer since 2014. One of the preferred freelancer because of the good standing and have good feedback from previous employers. I was asked by the freelancer staff Hele Další

$750 USD za 10 dní
(41 Recenzí)
6.4
AhmedSalahA

I will start with you no problem and talk to me because I need send to you some example and check my profile you will know I can do your project

$1176 USD za 20 dní
(79 Recenzí)
6.4
vw7209238vw

Hi, I have large experience scraping, please contact for details. Can review my profile and comments from my clients as a reference.

$705 USD za 15 dní
(76 Recenzí)
6.5