Build a python script to collect YouTube Data (will need captcha solving service)

$250-750 USD

Dokončeno

Zveřejněno

přibližně před rokem

$250-750 USD

Zaplaceno při doručení

We need a Python script to extract data from YouTube by performing searches on a list of root YouTubes for different countries and languages. The script will utilize the YouTube API to obtain video and channel information, and Google Translate API to translate the search queries into the appropriate languages. Before each search, the user will be prompted to change their VPN to the target country manually. The script should accomplish the following tasks: We start with a list of countries with root YouTube websites and the corresponding language for that country We have a list of queries 1. Select country from provided list 2. For each country, translate the queries into the target language using the Google Translate API. 3. Prompt the user to change their VPN to the target country manually. 4. Perform a YouTube search using the translated query and the target country's region code. 5. Extract the search result URLs. 6. For each search result, fetch the following information from returned videos: • Video title • Video views • Channel name • Channel subscribers • Channel email (captcha solving will be required) a captcha service recommendation would be needed 7. Save the extracted information into an output file. 8. Repeat the process for the next country in the list, until all countries are complete. Requirements for this task include: • Proficiency in Python programming • Experience with web scraping and working with APIs • Familiarity with YouTube API and Google Translate API • Knowledge of data storage solutions such as CSV, JSON, or SQL databases • Strong problem-solving skills and attention to detail The script should be thoroughly tested to ensure its accuracy and reliability. Additionally, the code should be well-documented, and instructions on how to use the script should be provided we have included the sample data, and sample code.

Python

Web Scraping

PHP

Software Architecture

Google App Engine

IČ projektu: 36254837

O projektu

16 nabídky

Vzdálený projekt

Aktivní před rokem

Chcete si vydělat nějaké peníze?

E-mailová adresa

Výhody podávání nabídek na Freelancer

Stanovte si rozpočet a časový rámec

Získejte za svou práci zaplaceno

Načrtněte svůj návrh

Registrace a podávání nabídek je zdarma

Uděleno:

@robartint

Hello I am a professional python developer. My main specializations are automation, web scrapers and bots development. I have already developed over 200 scrapers. From the simplest (for example, a competitor's price collector) to complex parsers (with authorization, bypassing captcha, rotating ips and others) which can collect millions of products from amazon. I have done web scrapers for: - Amazon - Instagram - Facebook - Google - Twitter - LinkedIn - Pinterest - Walmart - And many others For scraping I use: - Python - Requests - BeautifulSoup - Selenium - Scrapy - Pyautogui - Undetected Chromedriver - Rotating ips I can bypass: - CloudFlare - IP blocking - Captcha - Authorization required - Other limitations Django / PostgreSQL For big scraping projects I usually use Django with PostgreSQL. This allows us to store information in a database for further processing and use. I also set up an administration area which allows us to check the data and set up scraper configs. If you need a professional solution in this area - I am ready to cooperate. I am ready to make a sample script before we start Regards, Oleg

$250 USD v 7 dnech

4,9

(10 recenze)

4,1

16 freelanceři nabízejí v průměru $534 USD za tuto práci

@chirgeo

Hello! My name is George and I am a web crawler expert. I am confident that my experience with building Python scripts and working with APIs puts me in a great position to help build your YouTube Data extraction script. I have built my own custom web scraping tool and have worked on many different projects that integrate with multiple APIs. I also have a strong background in data storage solutions and problem-solving skills. Here are my five questions for your project: 1. What type of output file (CSV, JSON, SQL) do you need the data to be stored in? 2. Do you have an idea already of how constantly the script will be used (e.g. once a day, twice a week, etc.)? 3. Are there any specific format requirements for the instructions that need to be provided? 4. What type of environment will the Python script be ran in (local or remote via terminal or web-based UI, etc)? 5. Are there any other specific requirements/features you would like the script to have? I look forward to hearing from you and hope to be able to help you build your YouTube Data extraction script. Best, George

$750 USD v 3 dnech

5,0

(154 recenze)

7,9

@liveexperts123

Hi there,I'm biddin on your project "Build a python script to collect YouTube Data (will need captcha solving service) " I have read your project description and i'm an expert in Python and machine learning therefore i can do this project for you perfectly.I still have a few questions. please leave a message on my chat so we can discuss the budget and deadline of the project. Thanks. .. .

$750 USD v 6 dnech

4,7

(99 recenze)

7,8

@ayesha0124

Hi there, I have read the brief details of the project u posted and I believe i can help u as I have great experience doing projects with Software Architecture, Google App Engine, Web Scraping, Python and PHP. Please send me msg to discuss in detail. Regards, Ayesha

$750 USD v 9 dnech

5,0

(23 recenze)

6,7

@Devrits

Hey! I am skilled Python developer with skills including Python, Software Architecture, PHP, Web Scraping and Google App Engine. - web scraping, data mining, data extraction, data transformation, - writing scripts and utilities, - image / file downloading. - scraping info from websites into SQL-like DB or any other format (txt, CSV, EXCEL, JSON etc). - file transformation. Web scraping technologies: - Selenium Webdriver - create autotest, scraping information from different websites - Scrapy - a gathering of information variety of websites like amazon, airbnb, etc (python) - Xpath - analysis and using XPath to navigate in an XML document - beautiful soup + requests - collecting information from the given websites. Skillset: - Java – advances (new tools implementation, web applications creation, bug fixing, code review) - JavaScript – basic (new script creation, support existing solution). - Groovy – basic (creation simple CRUD web application using Grails Framework). - Python (knowledge: PyGame, Django, scrapy, beautiful soup) - Spring (Core, MVC, Security, JPA) – new application creation, support existing web applications. - Oracle SQL – creating new scripts, support and tuning existing scripts. - HTML + CSS – simple page creation / support existing Please contact me to discuss more about this project. Thank you

$250 USD v 4 dnech

4,5

(64 recenze)

6,9

@kozaktr

Hi. I am a senior web scraping expert. I have done many web scraping projects and I have full experience in this field. I am very strong in Python & Selenium & Beautiful Soup & C#, and can deliver perfect result on time. https://www.freelancer.com/u/kozaktr If you let me try, I can prove my skills. Can we chat to discuss more details for your project? Regards. Marsel

$300 USD v 2 dnech

4,8

(55 recenze)

6,5

@simonklemp

Hello Brian, I hope this message finds you well. I will be able to help you with your project. I read through the description and it sounds like I am just the right person for it. I have the right skill set with sophisticated experience in Python, Web Scraping, and Software Architecture. As a next step I would like to discuss some further questions with you. Either over the chat or a call, whatever you prefer. For my references and qualifications: I graduated in Computer Science with highest grades from one of the most reputable universities in Germany. Currently, I am enrolled in the Master's program. During my studies, I already published a paper on the subject of Artificial Intelligence. Further, I managed to get a lot of hands-on experience by working in several companies that operate in the field of Computer Science. As a native German speaker who was living in Canada for a year, my level in English is proficient/fluent. Further, I am in the preferred Freelancer program, making me part of the top 3% on the platform. Many successful past projects can be seen on my profile page. I am looking forward to working with you and if you have any further questions I would be happy to answer them. Best regards, Simon

$550 USD v 5 dnech

5,0

(23 recenze)

6,0

@hussainmuzammal4

✅ ⭐✅ ⭐✅ ⭐✅ ⭐✅⚡⚡⚡⚡⚡⚡╰┈➤╰┈➤╰┈➤ I have been working here since the 2020(الحمد لله) ,Thanks for posting and sharing your project.I have experience in this work ,let be handle this task to me ,i am willing to start Now Just contact/Text☎ Why you Choose me On time⚡⚡⚡⚡⚡⚡ On Desire On Solution Thanks⚡⚡⚡⚡⚡⚡⚡⚡⚡⚡⚡⚡ Muzammal Hussain

$250 USD v 1 dni

4,9

(11 recenze)

4,1

@waltergutierrez3

Hello, sir. I am confident with website development and python scraping. I have good experience of over 10 years in this field and I have done a few projects similar to yours successfully. I understood your requirements fully but I have some questions to know clearly in more detail. if you work with me, it is best choice and you will get satisfied result. I am available to start work immediately. we can discuss in more detail via private chatting. Best regards.

$500 USD v 7 dnech

5,0

(3 recenze)

3,0

@richdeveloperwan

hi, I read your project details and I am interested in your project. I have much experience in scraping data from different site and am very familiar to python script too. I can extract all data you want. Feel free to contact to discuss your project. Thank you.

$500 USD v 7 dnech

5,0

(1 recenze)

3,1

@synfini

Hello, this is Caleb from US who is a full-stack software engineer with overall 7 years of experience in development. I have carefully read your job description and I am convinced that I own a technology that can satisfy this requirement. I am also open to all questions and interviews for this. Looking forward to hearing from you Thanks for your time. Caleb.

$1 000 USD v 7 dnech

5,0

(2 recenze)

2,8

@vanshika2022

Hi There, Good day! Hope you are doing fine. ⭐ I will work with milestone only and release money as per good work progress. ⭐ I have gone through your initial project requirement and understand your project details.⭐ ⭐ I would like to ask question before start your work then we will decide budget and deadline.⭐ Let's have a quick conversation on the details to proceed further with this project. We look forward to work with you:)

$500 USD v 7 dnech

5,0

(1 recenze)

0,8

@filipniktreci

Hi, Dear I would like to grab this opportunity and will work till you get 100% satisfied with our work. I am an expert which have many years of experience on PHP, Software Architecture Please come over chat and discuss your requirement in a detailed way. Thank You

$500 USD v 7 dnech

0,0

(0 recenze)

0,0

@ztob

Hi, I'm Andrew and I am an experienced web crawler expert. I have extensive Python programming experience, and I deeply understand the challenges associated with Google Translate API, YouTube API, web scraping, data extraction and storage. I believe I am the perfect candidate for this task, given that we have built a custom web scrapping tool for similar purpose in the past. In order to ensure the accuracy and reliability of the script, I will perform rigorous testing, and well document the code to provide clear and e

$750 USD v 3 dnech

0,0

(0 recenze)

0,0

@abhishekj449446

I have understood your requirements and will be delighted to work with you. I have worked on Selenium and BeautifulSoup for web scraping and can deliver you the result on time.

$700 USD v 14 dnech