Scrape data with Golang (goquery)

Hi there! My name is George and I am an experienced web crawler developer. I've already written custom web scrapers and I understand the complexity of the task. I could get the job done with Golang and goquery, however I'd like to learn more about the task specifics: 1. What is the exact text corpus to scrape, and how do you intend to specify tweets to scrape? 2. Is the output data format to be limited to just extracting characters after / from the tweet? 3. What is the expected GET request's response upon successful

Hi dear respected Client! I've already done most time twitter scraper tools that i can also show you for demo purpose. Btw I am an expert in web autoamtion and web scraping using Python & Go, Also if you want i can show you demo of below: 1) tool search for word (.com after) between 2 dates 2) redirect to extract url from twitter 3) get status of HTTP request 4) generate report. If you're interested please message me. Thanks

Hi Good evening , I have read the brief details on your job listing . I see you have been looking for someone experienced with Data Integration, Golang, HTTP, Web Scraping and Linux. Its been 8 years since I have been working on freelancer.com, I have 9 years of experience doing similar jobs. I would request you to check my profile and review projects, feedbacks of projects related to those skills. Questions: 1. These are all the requirements of your job or do you have more? If yes, Please provide detailed requirements in chat and let me review and get back with queries. 2. Do you currently have anything done or this job has to be done from scratch? 3. What is the timeline to get this job done? 4. Are you open to use 3rd party APIS for it even if they are paid? Why Choose Me? 1. I have done more than 250 major projects only on freelancer.com. 2. I have not received a single bad feedback since last 5-6 years. 3. You will find 5 star feedback on last 100+ major projects which shows my clients are happy with my work. Portfolio: https://www.freelancer.com/u/AwaisChaudhry Timings: 9am - 9pm Eastern Time (I work as a full time freelancer) Please initiate the chat so we could discuss it in detail and we will continue from there. Thanks! Awais

Top 1% in Freelancer.com Hi, Greetings! ✅checked your project details: ✅Completed Time: In project deadline We have worked on 850 + Projects. I have 6 + years of the experience in same kind of projects. If you are looking for a true Freelancer, I am the Right person for you. I am available almost 24-7 and am very responsive. I feel proud that I am a trusted Freelancer who pleases almost every single client. You can rest assure, your work will be delivered well in advance of others, with passion and accuracy. I guarantee you instant communication & responses when you need me. Why choose me? I think every client is the reason for my success. I only take projects which I am sure I can do quickly. My Portfolio Items: https://www.freelancer.com/u/schoudhary1553 I would really like to work with you on this project. If interested, Kindly contact me via chat for further details and discussion.. Thank you Sandeep

Hi there, Do you want to scrap data or you already have scrapped data which you want to further customize? Please share more detailed required features list and provide more detailed specs Kindly click on the chat button to discuss further and for now you can ignore the bid price, as we need more detailed requirements. Look forward to hearing from you thru' chat. Regards, Yasir LEADconcept

Hi! I am skilled Python computer programmer with skills including Golang, Linux, Web Scraping, Data Integration and HTTP. - web scraping, data mining, data extraction, data transformation, - writing scripts and utilities, - image / file downloading. - scraping info from websites into SQL-like DB or any other format (txt, CSV, EXCEL, JSON etc). - file transformation. Web scraping technologies: - Selenium Webdriver - create autotest, scraping information from different websites - Scrapy - a gathering of information variety of websites like amazon, airbnb, etc (python) - Xpath - analysis and using XPath to navigate in an XML document - beautiful soup + requests - collecting information from the given websites. Skillset: - Java – advances (new tools implementation, web applications creation, bug fixing, code review) - JavaScript – basic (new script creation, support existing solution). - Groovy – basic (creation simple CRUD web application using Grails Framework). - Python (knowledge: PyGame, Django, scrapy, beautiful soup) - Spring (Core, MVC, Security, JPA) – new application creation, support existing web applications. - Oracle SQL – creating new scripts, support and tuning existing scripts. - HTML + CSS – simple page creation / support existing Please send a message to discuss more about this project. Thanks

We will Scrape data with Golang I am writing this proposal in order to work for you in Software and Web Development. We are highly trained professional developers seeking to freelance and earn online. Having a flair in programming and development I have been excellent with JAVA,C#,C/C++ and PHP programming language along with MySQL with XAMPP Server. I also build application for Cloud computing and High performance computing as I also have knowledge regarding Hadoop, MPI, OpenMP (distributed frameworks) and also have build applications in CUDA C++ and OpenCL. I also have experience with the most famous framework ASP.NET. My most expertise are in JAVA where I have built countless projects for semester projects and Final year project. You may find many developers in this field however we assure that you will not be able to find a team like us. We not only ensure the code is quality wise but we also assure that the code we write are optimised and we ensure that the program performs right operation under right environment i.e. we create programs that are defect free. You may also find freelancers that cost low but they do not put their 100% which then shows in the software and leads to an unhappy customer. We ensure reasonable price are put as tag on the job and we ensure in order to give the write product.

Hi, I'm a Python and Golang , I can scrape data from any web or directory using automated and manual techniques. Our services include: Web scraping / Data mining from any website and any amount of data Data collection from Business directories e-commerce / woo-commerce / WordPress product listing Product Data Scraping from any e-commerce site with images downloaded to a folder Data extraction from a pdf along with OCR Custom UI development with Python and Golang with Buttons and Fields. Scrape the data from the Login required websites and can resolve the captcha. Output file format include CSV / excel / JSON.

Hello,I have experience in web automaton. Can provide a python script to simulate this. Please contact me on chat to discuss about it.

Hello I am a professional python developer. My main specializations are automation, web scrapers and bots development. I have already developed over 200 scrapers. From the simplest (for example, a competitor's price collector) to complex parsers (with authorization, bypassing captcha, rotating ips and others) which can collect millions of products from amazon. I have done web scrapers for: - Amazon - Instagram - Facebook - Google - Twitter - LinkedIn - Pinterest - Walmart - And many others For scraping I use: - Python - Requests - BeautifulSoup - Selenium - Scrapy - Pyautogui - Undetected Chromedriver - Rotating ips I can bypass: - CloudFlare - IP blocking - Captcha - Authorization required - Other limitations Django / PostgreSQL For big scraping projects I usually use Django with PostgreSQL. This allows us to store information in a database for further processing and use. I also set up an administration area which allows us to check the data and set up scraper configs. If you need a professional solution in this area - I am ready to cooperate. I am ready to make a sample script before we start Regards, Oleg

Hello, I hope this finds you well. I have just seen your project requiring; Linux Web Scraping Golang HTTP Data Integration I believe that my 10-year experience in this field is what you need right away. Avoid the headache of looking further. Let's save time and focus on the real task. My proposed timelines and budget are just placeholder and an open for negotiation to increase or decrease as per the full requirements at hand. Allow me to prove how better my review can be. Smile all the way! Click the message button, so initiate the conversation. Regards, Fridah

Hello, I'm a Go developer, what you require can be done with either goquery or the standard net/http package, to have complete control over the queries, every part would be parameterized, that way it can be edited and adapt to changes on the DOM structure or just target different elements. I can write the program for you using the latest version of Go.

Hi there! I have more than 10 years of experience as a Data Base Administrator and Analytics Engineer. I'd love to work together on your project. I'm so responsible and kind, I'll always send you the files on time and with the best quality. Send me a message and I'll start working on your project. Yours truly, Giovanni. . ))((.

Hey there, I can help you with your project, I have been working with Golang from past few years and have completed many projects professionally and personally, also I have been working with scraping projects as well. We can connect for further discussion to clear requirements.

Dear Client. Thank you for posting this project, and I'm very happy to bid on your project. I've read carefully your project details. I have rich experiences related to this project. Your satisfaction with the project is my top priority! If you give me a chance to work with you, then I will do my best to reach your requirements. I'm waiting for your kind response. Please send msg over chat. Let's go. I will do my best for you. Best Regards.

We have extensive experience in web scraping and have successfully delivered similar projects in the past. We are confident that we can deliver a high-quality solution to meet your requirements. Our proposed solution includes the following features: Customizable data scraping: The web scraping will be customized according to your requirements, allowing you to extract the desired data from tweets and websites. Integration with the http package: We will integrate the http package to make a GET request to the URL, allowing us to test the status of the HTTP request and extract the characters from the tweet or site. Reporting functionality: Our solution will include the ability to generate a report explaining the status of a successful HTTP request and providing a box to write a description in case the page does not exist. Flexible date range selection: We will develop the solution to allow you to scrape tweets between two dates, enabling you to extract the desired data based on the date range. We understand the importance of timely delivery and open communication throughout the project. Our team will provide regular updates and be available to address any concerns or questions that you may have.

Hello Amjad A., I've just seen your interesting proposal. I am delighted to tell you that my qualifications are well matched with your needs and I consider myself worthy enough to get the job. If you want a job get done right, you have to select the right person. I'm well versed in Linux, Web Scraping, Golang, HTTP, Data Integration and have strength in architecting project from scratch. Also, I'm well versed in both expo and bare flow. Beyond the coding chops, I'm an excellent communicator and team player, I’m passionate about writing and sharing what I’ve learned both with my teammates and the broader web community. I really value the ability to not only perform web development work but also help others improve their craft, because I’ve gained so much from others sharing their skills and knowledge. I'm fully available for the project and I can start work immediately. Let's schedule a time to chat and I'd love to share my past experience and learn more about the project. Thank You

Hey there, I have 4 years of working experience in web technologies and I have a strong working knowledge of every possible framework which is in the market. In terms of client-end I know: Web Scraping, Linux, HTTP, Golang and Data Integration Also I have done tons of work on freelancing career. I am waiting anxiously for a positive response from your side. And I have read your requirements as well. Thanks and regards, Shamshad

Hello, this is Caleb from US who is a full-stack software engineer with overall 7 years of experience in web application development. I am able to start your project work right away and would like to discuss further details about your project stuff via chat. Thanks for your time. Caleb.

Hello there, Thank you for taking out time to read this proposal. I understand that you are looking for an expert to assist with your project and I genuinely hope I can help. My skills as a software engineer/architect with more than ten years of expertise and a major in information technology will be advantageous for your project and help you save time and stress. I am more confident in my abilities after reading the description of your project and I am comfortable with meeting your needs, I have a team (Electrosoft Technologies) capable of executing FE and BE efficiently. With my proficiency, I can guarantee you a great outcome that makes the best use of your technology and also meets your timeline. I would be delighted to collaborate with you and turn your ideas into a successful project. Could you please strike up a dialogue so we can discuss this in great depth? Thank you, Martin.