Aggregator crawlerpráce
Project Title: Cab Aggregator Requirements: - Ride-sharing cab service - Single platform for both drivers and passengers - Flutter framework for development (Android, iOS, and web) - Less than 50 anticipated drivers and passengers on the platform Ideal Skills and Experience: - Proficiency in Flutter framework for multi-platform development - Experience in developing ride-sharing applications - Strong understanding of real-time tracking and location-based services - Knowledge of payment gateway integration for seamless transactions - Ability to implement user-friendly interfaces for both drivers and passengers - Familiarity with managing and optimizing large amounts of data for efficient service matching and scheduling I dont want to Spam my inbox, check attached image, if u can a...
Project Title: Solidity Integration with SyncSwap Description: I am looking for an intermediate-level Solidity developer to integrate our project with the SyncSwap platform. The main feature we want to integrate is the Aggregator Swap Functionality offered by SyncSwap using Solidity. The integration should be completed within a week. Requirements: - Intermediate-level experience with Solidity - Familiarity with the SyncSwap platform and its Swap Functionality - Ability to integrate our project with SyncSwap within a month Skills: - Solidity - Ethereum - Smart Contract Development - API Integration Network: (ZkSync Era Testnet) Please provide examples of previous Solidity integrations and experience working with
I need a solution that logs(or not) in to given web site (e-commerce web site) and crawls chosen content(products) in a CSV file. Showld be also downloaded the images of the products and in the CSV file to have properly addressed these images. This CSV file later will be used to import these products with their images, titles, prices etc .. to another e-commerce web site.
...pages) from following link: If the keyword parameter is missing, it should scrap all the products under fragrance category. We should be able to schedule crawling. When a crawling session starts, it should create a separate folder under given bucket with timestamp in the directory name. This is to make sure that if we have two instances of crawler running, they should not produce inconsistent results. During a single crawl, it should not have duplicated entries provided there are no duplicates on the original website. Output format: S3 supported. Those are high-level requirements from my side but don’t hesitate to share your suggestions if the solution can be implemented in better way. Ideal skills and experience: - Proficient in
...pages) from following link: If the keyword parameter is missing, it should scrap all the products under fragrance category. We should be able to schedule crawling. When a crawling session starts, it should create a separate folder under given bucket with timestamp in the directory name. This is to make sure that if we have two instances of crawler running, they should not produce inconsistent results. During a single crawl, it should not have duplicated entries provided there are no duplicates on the original website. Output format: S3 supported. Those are high-level requirements from my side but don’t hesitate to share your suggestions if the solution can be implemented in better way. Ideal skills and experience: - Proficient in
I want a program that will give me a list of fixtures for all major football leagues, a teams current place in the table, their place in the table based on their last 6 games, and their opponents points per game, in an excel spread sheet so I can manipulate the data. I currently get this information from a website called , but it is laborious to transfer the data into spreadsheet format.
Example: Shiprocket, NimbusPost Features 1. Integration with Shopify, Woocommerce to fetch orders. 2. Integration with courier companies like Bluedart, DTDC, Xpressbees, etc. 3. Ability to book orders by comparing prices. 4. Ability to process NDR 5. A Billing Section where entries need to be made for each order placed 6. A report section where user can download excel file 7. A settings section where user can add warehouse details, KYC, Bank details, label settings,
...on Facebook and Instagram channels. Moreover, the content generation process will prioritize SEO considerations. Objectives: 1. WordPress Blog Creation - Set up a WordPress website with a user-friendly interface and responsive design. - Evaluate and review at least three templates for suitability, aesthetics, and functionality. 2. Content Aggregation and Blog Creation - Implement a crawler capable of extracting content from up to five specified URLs. - Develop a mechanism to curate, filter, and generate blog posts from the gathered content. - Create a process to automate the publication of generated posts on the WordPress site. 3. Automated Social Media Posting - Integrate the blog with Facebook and Instagram APIs for automated post sharing. - Implement a...
takes in information from the user about the sentence to find and then scrapes the library location to find meaning words and sentence that is grammatically correct. and Then places the result sentences in a single large text file.
...relationships. Each profile picture should be clickable to provide more information about that family member. - User account creation: Users should be able to create accounts on the website in order to contribute and edit the family tree. - No mobile responsiveness required: The website does not need to be mobile-responsive. - The website should include a discussion area that will be a simple news aggregator type of format. Ideal skills and experience for this project include: - Strong web development skills, including proficiency in HTML, CSS, and JavaScript. - Experience with building interactive websites and incorporating user account creation functionality. - Knowledge of database management systems to handle the storage and retrieval of family tree data. The budget for t...
I am looking for a skilled website designer and developer to create an aggregator platform. Ideal skills and experience for this job include: - Strong knowledge of website design and development - Familiarity with creating aggregator platforms - Ability to create a user-friendly and visually appealing website I am open to suggestions for the color scheme and design style of the website. Key features required for the website include: - User registration and login functionality - Shopping cart for users to make purchases - Contact form for users to get in touch with us Additionally, I would like to have a calling and chatting feature on the website to enhance user engagement. If you have the necessary skills and experience for this project, please submit your proposal...
We're on the lookout for a skilled developer who can take on an exciting project involving the creation of a script for tracking data related to music artists and their songs. *************************************************************** IF YOU DON'T KNOW ABOUT WHERE TO FIND THE DATA ... IF YOU ARE NOT A PYTHON/DOCKER/PHP EXPERT ... IF YOU ARE NOT ABLE TO MAKE CRAWLER ... IF YOU DON'T KNOW FROM AWS SERVER ... DON'T SEND OFFER *************************************************************** I have already a database with a table with artist and another one with a table with songs. REQUIREMENT: For Artists: Concert Date Management: The script should fetch and SAVE the scheduled concert date for each artist. Date, location, country Daily Follower Tracking: I...
Hi, I am looking for a full aggregator site. Similar to , , So multiple offerings and target markets around insurance products. This project will be awarded by 30 November 2023 What else would you like to know? Kind regards Ian
We're on the lookout for a skilled developer who can take on an exciting project involving the creation of a script for tracking data related to music artists and their songs. *************************************************************** IF YOU DON'T KNOW ABOUT WHERE TO FIND THE DATA ... IF YOU ARE NOT A PYTHON/DOCKER/PHP EXPERT ... IF YOU ARE NOT ABLE TO MAKE CRAWLER ... IF YOU DON'T KNOW FROM AWS SERVER ... DON'T SEND OFFER *************************************************************** I have already a database with a table with artist and another one with a table with songs. REQUIREMENT: For Artists: Concert Date Management: The script should fetch and SAVE the scheduled concert date for each artist. Date, location, country Daily Follower Tracking: ...
API Integration Brief for Introduction to the Integration: , operating as an innovative crypto casino, is engaging with an API integration that functions as a liaison among the casino, game aggregators, and game providers. This integration wi...expects a beta version within the first two months and a final version ready for deployment within three months from the start date. Developer Expertise: In-depth knowledge of blockchain and cryptocurrency, especially Ethereum smart contracts and the EVM. Familiarity with gambling regulations and the ability to ensure the platform's compliance. Prior experience with SoftSwiss API or similar game aggregator APIs is highly advantageous. Website example -
I'd like a quote for setting up a news aggregator for me. The aggregator will be self hosted and will need to be able to scrape web sites without a RSS feed. I've attached details of the job in the attached document. The timescale is flexible. Please let me have a price but no silly numbers, please.
I'm seeking a highly experienced Ruby on Rails developer with expertise in web app development. Key Requirements: Minimum 2 years of experience in Ruby on Rails development. Some experience in Hotwire Strong problem-solving skills Knowledge of web application security best practices. Good at communicating in English. It is an...with expertise in web app development. Key Requirements: Minimum 2 years of experience in Ruby on Rails development. Some experience in Hotwire Strong problem-solving skills Knowledge of web application security best practices. Good at communicating in English. It is an absolute must that you are reliable and meet the agreed deadlines. It would be bonus if you have experience in building web crawler/scraper solutions. This job is 15-20 hours on a...
Looking to create a site crawler, the site is using java. Prefer someone with Video Gaming experience specifically Fifa Ultimate team
We require a skilled data analyst to create a detailed Google Sheets table for calculating the profitability of an online game store specializing in sales of games, including denominations for PUBG, prepaid services, and gift cards. The table should consider various economic indicators, including quarterly revenue, development budget, product catalog, payment system commissions, aggregator commissions, approximate site traffic, and average purchase value. Key Requirements: Creation of a structured table for inputting initial data on revenues, expenses, average purchase value, and other economic indicators. Development of formulas for the automatic calculation of net profit, taking into account all variable and fixed costs, as well as the average purchase value. Inclusi...
K zobrazení podrobností se zaregistrujte nebo přihlaste.
...uction%29 Milestones MS1: update docker compose to use latest stable versions running locally on your docker environment (and ours) MS2: record video how to add new websites and how to curate them MS3: implement deduplication MS4 (optional): provide REST api call from java springboot to add new domains to the crawler + UI MS5 (optional): implement screenshoting of the visited pages Your background is: - multiple years of experience with docker/docker compose - multiple years of experience with web scraping If you are a good fit, you are open to get more tasks about implementing solutions fully on your own (e.g. with your team) Budget? will not be disclosed, place your best bid to get considered What is
...solving our requirements in Java. Goal is to have later offline browsable scraped content of a section of websites. Your job will be to implement the crawler to scrape based on a URL regex and to scrape the visited pages into a folder per page. after the first run, the scraper shall check for changes on the page and persist the changed pages in new folders. Typically each website-domain contains about 20 subpages, which are relevant to us. Depending on the choosen path, you will require a specific solution like selenium, jsoup and so on. Import is, that the content is offline browsable incl. the images! Milestones MS1: Implement a simple crawler on a shared page which is downloading the sites for offline use. It creates also screenshots of the visited pages, so that if...
...to develop a blog aggregator for technology blogs, with the following requirements: 1) Aggregating content from various technology blogs on a daily basis 2) Aggregating and monitoring trending hashtags from social media platforms various technology channels and pages on a daily basis 3) Aggregated content sources, channels and pages should be editable for me to add new ones in future 4) Providing a user-friendly interface for easily accessing and browsing the aggregated content 5) Allowing users to filter and search for specific topics or keywords within the aggregated content 6) Implementing a notification system to alert users of new content or updates 7) Integrating social media sharing options for users to share interesting articles or posts 8) Ensuring the aggregator...
Hi Ikaro F., I noticed your profile and would like to offer you my project. We can discuss any details over chat.
Application Name: AI Crawler Objective: The application is designed to automatically crawl selected web pages from a list and generate concise descriptions that answer the question, "why our solution could fit well into a company's needs." The response would include the quoted name of the client company for personalization, along with formatting and the ability to control the usage time of artificial intelligence. Features and Characteristics: Web Page Crawling: - Allowing users to load a list of URLs for crawling. - Integration with a Paid API for Natural Language Processing: - Enabling users to configure and use a paid service for advanced text analysis using artificial intelligence. Answer Generation for a Question: - Allowing users to specify the question for...
We want for our website a crawler who can take all results from a results website to our website every day.
...techniques - Familiarity with Python or other programming languages commonly used for web scraping - Experience in gathering text data from websites - Ability to organize and export data in csv, json, and sqlite formats Here is all the information required to decide if this is a job for you and to submit a proper quote. Here are the details of what I require I would like a GUI based webscaper/crawler using python, scrapy and playwright. But if there is a big difference in price with implementing a GUI I am comfortable using command line tools as well. I need to search these websites. 1. (US) 2. (Australia) 3. (Canada) 4. (New Zealand) 5. (UK) 6. I need to be able to search for businesses, I then need to be
I am looking for an experienced software developer to create a mobile application from scra...software developer to create a mobile application from scratch for my business. This project requires knowledge of a programming language such as Python, Java or C++. As this project is starting completely from scratch so previous experience in similar projects is beneficial but not mandatory. The goal of this software development project is to create a mobile application that will be used a aggregator to provide services. The successful developer will need to consider user experience, client requirements and scalability in their design and development. If you feel you would be a great match for this project, then I would love to have a chat about my specific requirements and discuss furthe...
Hello, I am looking for an experienced app developer to help me create an aggregator Android app. I do not have a design for the app yet, so I am open to suggestions and need help creating a design. The end goal is to produce a reliable, user-friendly app that effectively serves its purpose. The successful applicant must be experienced in developing apps for the Android platform, have a good eye for design, and be able to provide a superior end-product. If this project interests you, please let me know, and we can discuss further details. Candidates who have an interest in stock market will be given priority Thank you!
Here is the crude scope of work (1) Merchant Onboarding (2) KYC Management (3) Entire Merchant Management (4) Reports (5) Payout Calculations (6) Settlement We will look up to you to finetune the specs and deliver a fully functional platform. Again, please apply only if you have done it before or have been a part of the team that has done it.
I am looking to have information extracted from large amount of domains , what ever you use web crawler bs4 its up to you , scraping workflow: 1-first you get all categories from domains within the regex that i will provide o you 2- get all products urls from the category using regex i will provide to you 3- get product image, title , price , description , also metatags of the product page with property keywords and description challenges : you might be stopped by 429 and also 403 due to ip geolocation
Key Features: Payment System Integration: Seamless integration of multiple payment gateways to ensure smooth transactions for users across...range of games on our platform. Brief Overview: We are looking to develop a gaming marketplace platform that emphasizes user convenience and a wide range of game offerings. The platform should be robust, scalable, and user-friendly. One of the main features we want to implement is the ability for users to make quick purchases. Additionally, the integration of multiple payment systems and game aggregator APIs is crucial for the success of this project.
I am looking for a skilled developer who can create an ecommerce website using .net core and React. The website should have advanced ecommerce functionality with custom features. Design: - Although I do not have a specific design in mind, I have some ideas that I would like to discuss with the developer. Its basically an ecommerce website with aggregator model. Following are the Main key features I am looking for, 1. Payment Gateway 2. SMS and Whatsapp Services 3. Multi Vendor and multi products management 4. Ecommerce activities, order management, pricing, discounts, coupons etc 5. Logistics details communication 6. Generating and Exporting reports to xls 7. User, Admin & multi Vendor logins. 8. OTP based Login 9. Cart and Wishlist management 10. Coupons, rewards, reviews m...
I have purchased several codecanyon scripts 1. For travel agency: 2. For php scraping: My site is I need to put travel agency script integrating the php script to feed the database. Maybe it require some customization. The sources for scrapping would be and in the future several other pages under protected login password For now I only need properties published in Steps required: 1. Install the purchased scripts in my hosting 2. Fill db with scrapped info Deadline: 2 days.
I am looking for a Job Websites Crawler and Automation Developer to create a system that can scrape job postings from various websites and automate the application submission process. Features needed for the job websites crawler: - Basic job scraping capabilities - Full automation with automatic submission - No preference for specific websites to crawl Ideal skills and experience for this project: - Proficient in web scraping and data extraction techniques - Familiarity with job posting websites and their structures - Experience in developing automation scripts and tools - Strong programming skills, preferably in languages such as Python or JavaScript - Ability to handle large amounts of data and implement advanced filtering options If you are a developer who can create a...
I am looking for a skilled freelancer who can create a website similar to cryptopanic. The ideal candidate should have experience in WordPress and be able to deliver the project within a tight timeline of 1-2 weeks. Features: - News Aggregator: The website should aggregate news related to cryptocurrencies and football and display them in a user-friendly format. Like cryptopanic but with only agregate news from RSS I have fixed price of 150$ maximum I will reject other offers. Preferred Platform: WordPress, but we can use others Timeline: 1-2 weeks If you have the necessary skills and experience, please submit your proposal with examples of similar projects you have worked on.
Cześć, Szukam kogoś, kto będzie w stanie wykonać dla mnie stronę internetową od podstaw. Wytyczne: - strona w formie katalogu - każdy produkt będzie miał tytuł, opis, kilka zdjęć oraz kilka krótkich dodatkowych informacji - potrzebny crawler, który będzie pobierał automatycznie dane tekstowe oraz zdjęcia z innej strony - zarządzanie treścią z poziomu panelu administracyjnego
A website that will include the following pages, sections and features: Vide...would use some sort of emulator similar to This is on my wishlist but not a must if it will cost too much or be too much work for the initial site. The website's design should be visually appealing, user-friendly, and optimized for both desktop and mobile devices. It should prioritize user experience, ensuring that visitors can easily navigate between the review aggregator, hot takes, online store, and retro arcade sections. I want to be able to customize the site themes easily without editing code (changing the theme to Halloween during October as an example). I also want the whole site to be searchable and the search to display which area of the site the search result is from.
I am looking for a Python developer to create a web crawler that targets Google and extracts stock price and volume information. The crawler should be set to run daily. Use the files I provided as a target for Google finance crawler to get the data and save it. The project specification must be read first. Ideal Skills and Experience: - Proficiency in Python - Experience with web scraping and crawling - Knowledge of working with APIs and extracting data from websites - Familiarity with Google search results and stock market data
I am looking to hire a freelancer to create a web crawler for me. The web crawler will need to scrape data from a specific list of websites that I will provide. Whether the web crawler is built from scratch or existing tools are used to construct it is up to the freelancer; either solution is acceptable. The main purpose of the crawler will be to scrape text from the websites. If you have prior experience building web crawlers and have the necessary skill set to complete this project, I would greatly appreciate it! The website to be consulted is:
I am looking for a talented casino game developer to create a roulette game for the web. I have a demo you have to build similar using API or aggregator or whatever your preference is. You must have a experience gaming ap
1. Optimize .png, .jpg, .gif, and .mp4 assets on an Ubuntu server. 2. Transform .png and .jpg files into .webp format. 3. Enhance the crawler to avoid redownloading .png and .jpg assets that have been optimized to .webp. 4. Update the frontend to incorporate .webp images instead of .png and .jpg formats. 5. Remove redundant .MP4 files from the same collection, keeping one copy and displaying it for all the deleted duplicates.
I am looking for a freelancer to update the IPFS Image Crawler by making performance improvements. Specifically, I would like to reduce the system resource usage. The crawler downloads images such as .png .jpg and saves them to the database. Must update the images to .webp and also if videos are repeated display only 1. Skills and Experience: - Strong knowledge of IPFS and image crawling - Experience in optimizing system resource usage - Proficiency in programming languages such as Python or JavaScript - Familiarity with web scraping and data extraction techniques - Attention to detail and ability to troubleshoot and fix bugs Requirements and Limitations: - The freelancer should be mindful of specific limitations regarding system resources - The goal is to minimize resource...
I am looking for a freelancer to develop a web crawler for my project. Here are the details: Websites to crawl: - Specific websites (provided upon hiring) Information extraction: - Extract all available information from the websites Crawler frequency: - Run on a regular schedule Ideal skills and experience for the job: - Strong knowledge and experience in web crawling and data extraction - Proficiency in programming languages such as Python or Java - Familiarity with web scraping frameworks like Scrapy or Beautiful Soup - Understanding of data storage and management techniques - Attention to detail and ability to handle large datasets p.s. I wanna create a website and need information of another website so that i can provide my client immediate information If yo...
I am looking for a web crawler to gather specific information from otcmarkets.com. The ideal candidate will have experience in web scraping and data extraction. Requirements: - The web crawler should gather 10-K, 10-Q, or 8-K filings that have recently been published in the SEC filings section. - The crawler should target only expert market companies on the website - The information should be gathered on a daily basis, ensuring the latest data is always available. Skills and Experience: - Proficiency in web scraping and data extraction techniques. - Knowledge of SEC filings and financial reports. - Familiarity with and its structure. - Strong attention to detail to ensure accurate data collection. If you have prior experience in developing web crawlers and are inte...
We are looking for an experienced web developer to help us create a webapp for a German freelancer job aggregator. The goal of this project is to fetch and display job posts from various online portals and marketplaces, such as , , freelancer.de, and (more will be added, after good work!), while allowing users to filter job posts by category (developer, designer, texter) and getting email notification for new job posts based on their setting. Key Project Features: Data Scraping with Filters: Develop a script or command to scrape job posts from target websites with the ability to filter by category (developer, designer, texter). Implement a cron job in Laravel to automatically update job posts daily. Send E-Mail to (premium) user if a new job posts have
Looking for a freelancer with experience in flashloan arbitrage using the Balancer platform. - The project involves finding the optimal amount input for flashloan arbitrage opportunities. - the optimal amount input should be written in js. with library. - and the DEX for the arbitrage should be using 1 inch dex aggregator. - The desired profit margin for each opportunity is 10%. - All transactions will be conducted in Ethereum. Ideal Skills and Experience: - Experience in flashloan arbitrage using the Balancer platform. - Knowledge of Ethereum and smart contracts. - Understanding of arbitrage strategies and profit calculations.
I am looking for a skilled freelancer to help me create an insurance aggregator website focused on auto insurance. Skills and experience required: - Web development and design - Knowledge of insurance industry and aggregator websites - Ability to create a user-friendly and visually appealing website Specific requirements: - Design: Although I don't have a specific design in mind, I have a rough idea of what I want the website to look like. The freelancer should be able to take my rough idea and create a visually appealing design. - Functionalities: While I don't have any specific functionalities in mind, I have a rough idea of the features I want to include on the website. The freelancer should be able to understand my vision and implement the necessary functiona...
Project Description: Social Media Aggregator I am looking for a skilled developer to create a social media aggregator that will gather content from Twitter, Facebook, TIKTOK ,YOUTUBE and Instagram,. Requirements: - The aggregator should be able to collect both posts and comments from the selected social media platforms. - It should also have the capability to perform specific actions such as posting and liking on the aggregated content. Ideal Skills and Experience: - Strong knowledge of API integration for Twitter, Facebook, and Instagram. - Experience in developing social media aggregators or similar projects. - Proficiency in programming languages such as Python, PHP, or JavaScript. - Familiarity with database management and data processing. - Excellent problem-s...
