Find Jobs
Hire Freelancers

Migrate a database to support data warehousing, OLAP and big data

$30-250 AUD

Probíhající
Zveřejněno přibližně před 5 roky

$30-250 AUD

Zaplaceno při doručení
This project aims to transform an existing database to support analytical processing (OLAP) for a data-warehouse that holds a huge amount of data and streams more data on daily basis. The analytical tasks are mostly statistical such as mean, variance, normalization, standardization, max, min, median. The challenge here is that the nested queries and the big data make the response time too slow and consumes lots of computational power that takes the server down. The requirement here is : 1. Propose a solution to make these reports more efficient in a way that allows the site to load in less than a second 2. evaluating the performance of current queries 3. Install and configure the necessary needed software to the server (if any) 4. Migrate the database from the current DBMS (MySQL) to the new DBMS 5. Migrate the views and nested queries in the current database to be efficiently implemented in the new database 6. Review each SQL statements to and propose how it can be optimized to run in the most efficient way 7. Create and optimize materialized views + triggers as needed 8. optimize the performance of the migrated database The deliverable: A new database to be used by the website with response time less than 3 seconds. I will just change the connection string in my site to connect to the new database and it should load the same data from the same views as fast as it can. The new database should be able to handle huge amounts of data (more than 30 million records) Obviously, MySQL does not support nested select statements, so many queries are just created to be used by the end queries for business. The business queries used by the site are listed at the end of the attached document. These queries must be created by the same names in the new database. The other internal queries used implicitly by the main queries can be traced through the code or listed from MySQL Before awarding the project, I will have a chat with each applicant to discuss the proposed solutions, the data warehousing experience and query optimization method.
IČ projektu: 18770030

O projektu

18 nabídky
Vzdálený projekt
Aktivní před 5 roky

Chcete si vydělat nějaké peníze?

Výhody podávání nabídek na Freelancer

Stanovte si rozpočet a časový rámec
Získejte za svou práci zaplaceno
Načrtněte svůj návrh
Registrace a podávání nabídek je zdarma
18 freelanceři nabízejí v průměru $415 AUD za tuto práci
Avatar uživatele
Hello, I have checked the project requirements. We can discuss further in more details on this task. Thanks.
$250 AUD v 5 dnech
5,0 (25 recenze)
6,2
6,2
Avatar uživatele
Hello, I can work on this project. I have much experience working with Data Warehousing. I worked on Target's Store-BI DTK Toolkit with Data Stage as ETL processes, Hyperrol as Multi-Dimmension Data Cubes (OLAP engine) that help reports, and j2ee for the BI reports (200+ report pages with 5000+ online management users) , Database uses IBM DB2 and Oracle. (Target Stores have about 1800+ Brick-Mortar retail stores located throughout the United States) Best Regards, An Ho
$155 AUD v 3 dnech
4,7 (2 recenze)
3,7
3,7
Avatar uživatele
I have more than 18 years of experience working on highly regulated environments and supporting large scale database installations. I am here to help you. Please contact me to learn more details about the project. I have careful reviewed the attachment. The
$1 666 AUD v 15 dnech
4,8 (1 recenze)
2,9
2,9
Avatar uživatele
Hi, I have 8 years of experience and working on hadoop, spark, nosql, java, BI tools(tableau, powerbi), cloud(Amazon, Google, Microsoft Azure)... Done end to end data warehouse management projects on aws cloud with hadoop, hive, spark and presodb. Worked on multiple etl project like Kafka, nifi, flume, mapreduce, spark with XML/JSON., Cassandra, mongodb, hbase, redis, oracle, sap hana, ASE.... Many more. Let's discuss the required things in detail. I am committed to work done and strong in issue resolving as well. Thanks
$55 AUD v 1 dni
5,0 (2 recenze)
3,0
3,0
Avatar uživatele
We DataLamp, is a Big Data company which works in Java, Data-Pipeline, BI/Visualisation/Reporting & Recommendation solutions. We also provide optimisation in existing architectural design for better performance. We have done projects in which we were supposed to optimise data warehouse response time. Last project to optimise queries of data warehouse was of a telecommunication in which we optimise the queries response time to 1-3 sec which was 30-40 sec. Would look forward to your reply where our solution architect will interact with you. Regards DataLamp
$277 AUD v 3 dnech
5,0 (1 recenze)
1,0
1,0
Avatar uživatele
Hi, I have 7+ year of experience in database development and BI implementation. Mostly I worked with Pentaho business suits and most of RDBMS databases. According to my personal experience I suggest you to choose HP vertica db. It has columnar storage support which provides high throughput in aggregating/ analytical queries. It is free till 1tb of storage. Let's have a call for understanding your requirement. I am sure that we will have a good and mutual beneficiary conversation.  Hoping to talk with you soon. Thanks.
$890 AUD v 10 dnech
5,0 (1 recenze)
1,1
1,1
Avatar uživatele
Hello We are team of smart developers working in IT industry from past 7-years have developed 200+ simple and complex Mobile phone apps for Android & iPhone, Hybrid app and many Websites in RubyOnRails,WordPress , Dot Net and PHP with a wide range of different features and technologies. Our area of expertise includes Android, iPhone, RubyOnRails, AngularJs, Dot Net , Postgresql, SQl Server, PHP, HTML, Graphics designs etc. Supportive - 24 full-time employees - Full-time customer care - Unlimited design options and revisions - 110% satisfaction guarantee Specialization - Website designing ( E-commerce, Static and Dynamic, Cryptocurrency) -CRM design - Logo design - Illustration - Packaging - Print Design - Animated Videos - brochure design We offer customized and high-quality design services at affordable prices. We promise quick turnaround times, great customer service and 100% original designs ! Thank you!
$250 AUD v 3 dnech
0,0 (0 recenze)
0,0
0,0
Avatar uživatele
Hi I am data engineer with 4+ years of experience. I have worked on analytics solutions using both clouds and on premises. I have experience in bi, dwh and big data. Relevant Skills and Experience Proposed solutions 1. Optimize the way we store data that is store in unnormalized way to make retrieval fast 2. Offload the data processing and bring back the data in prepared form for query
$500 AUD v 10 dnech
0,0 (0 recenze)
0,0
0,0
Avatar uživatele
Hello , I’m excited to share with you the proposal for this project. As I understand about your project it's truly challenging. I'll assure you that this project will complete within promise day. I’m truly excited to be working with you on your new logo redesign. I look forward to your response. All the best, Soumya
$166 AUD v 9 dnech
0,0 (0 recenze)
0,0
0,0
Avatar uživatele
- 7.8 Years of onshore and offshore experience in EIM Technology, specializing in OLAP, ETL, Informatica, IBM DB2, Tableau, Quality Centre, Microsoft Sql Server, JIRA, Data Analysis, Alteryx. - Having a good understanding of Data Warehousing fundamentals including Dimensional Modeling. - Experience for 2 big 4 companies.
$277 AUD v 3 dnech
0,0 (0 recenze)
0,0
0,0
Avatar uživatele
Hello, Hope you are doing great ! As per your requirements, I saw a 50+ Tables where your destination source will fetch the data and you require a Analytical Database for this perpose. I having a 2+ years of experience in Data warehouse and Analytics as well as I'm a System Architect and have a experience of GCP platform. I have a solutions for your requirements. Regards Rahul Singh
$333 AUD v 10 dnech
0,0 (0 recenze)
0,0
0,0
Avatar uživatele
I have gone through your requirement and I have done similar projects in past. The requirement is similar to what I am doing right now. we have a MySQL OLTP which we have migrated to postgresql. We have build DWH with dimensions and few facts based on reports also build aggregation and summary tables instead of using procedures. The ETL tool which I have been using is pentaho community edition. I hope I am pretty much fit to your requirement.
$777 AUD v 15 dnech
0,0 (0 recenze)
0,0
0,0
Avatar uživatele
I will improve your system for the lowest possible price for you! I am researching working with big data as a project in my life and would really love to work on this project to endue more knowledge of subclosed data! ~Greetings from a bigdata fan Joeri m. van Velzen
$35 AUD v 0 dni
0,0 (0 recenze)
0,0
0,0

O klientovi

Pochází z AUSTRALIA
Geelong, Australia
4,9
37
Ověřená platební metoda
Členem od úno 14, 2006

Ověření klienta

Díky! Poslali jsme vám e-mailem odkaz pro získání kreditu zdarma.
Při odesílání e-mailu se něco pokazilo. Zkuste to prosím znovu.
Registrovaných uživatelů Zveřejněných projektů
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Načítání náhledu
Bylo uděleno povolení ke geolokaci.
Vaše doba přihlášení vypršela a byli jste odhlášeni. Přihlaste se znovu.