Webcrawler and search engine for ecommerce sites - proof of concept -- 2

I need to (quickly) create a Proof of concept, website scraper / search engine as a proof of concept. Ultimately, I need to create something “like” this search website https://www.comparecbd.com. I don’t care what sites to scrape from but I need to scrape at least 5 sites. I have been looking at a tool like Scrapy (but not limited to) to scrap data from various ecommerce sites but I need someone to install and create the scraper server and bot to extract product data from a small selection of ecommerce websites and put it into a local database that is searchable from a simple webserver like any other comparison website (like [login to view URL]) I appreciate the project is not doing anything new, and the server-side tools are all freely available but I need someone to build it / put it together AND document the process. I really don’t have a big budget for this as I need to show that this can be done using freely available, open source tools and without a high price that was offered to me for a complete development. IF it works well and I can expand on it, there could be reason to take it to the next level but not this early stage. The scraped data needs to be added to a local database including images. This is demonstrated in the documentation on the scrapy tutorials (there are many). The database can then be searched and then display a simple results page (like any sites – including image and link to the original source of the product. I have looked at the following tools but I don’t really care as long as it works without spending a lot of time or money. Web Scraping in Python using Scrapy (with multiple examples) [login to view URL] How do you build a search engine from scratch? What’s the best technology stack for this? [login to view URL]’s-the-best-technology-stack-for-this How to Build a Basic Web Crawler to Pull Information From a Website [login to view URL] I have some more guidance based on my research into open source solutions for scaping, Indexing and searching (like a typical web-based search engine). There is a chance, if I can demonstrate something clever, to build on this later but for now, I need to show a functioning, bare bones search / results system. SUPER IMPORTANT - Based on the sample site to guide the design, [login to view URL], I also need help to define the database tables to store the scraped data from the various seller sites (choose any 5 sites to scrape from). The idea is to use google cloud platform to host the “Search Engine” site after scraping and indexing the various ecommerce sites. I will add additional sites to the list of sites scraped. I need also the option to “scrape now” or automatically scrape each hour to update the database. Lastly – I need to stress that this needs to be a quick and inexpensive project – I don’t have too much time to go through the typical dance to engage me as big, high value client. I just need to build a server, install the tools, create the bots (as per the examples available) and finish with a searchable database as a proof of concept. There are numerous examples of like sites and many tools, guides etc. I would like to show something working next week. Also, if you have better ideas or know of better tools / platform – please work with them. Thanks for understanding the budget and the time restraints – I need to choose today/tomorrow. Stay home – stay safe – stay strong