Closed

We have a requirement on Data Migration project. Need to do migration of OLAP data warehouse system from on-Premise to Google Cloud -Big query Next year

We have a requirement to do migration OLAP data warehouse system from on-Premise to Google Cloud -Big query Next year .

Requirement:

Data Size: 70 TB

Data: Structure data

Source DB: DB2/SQL/Oracle (Relation DB-OLAP) :ROW based DB

Target -Bigquery: No Relation DB , No SQL ,Columnar DB

Cloud Storage Layer: Google Bucket

CLoud Data warehouse : Bigquery

Data validation Requirment: How to validate file in google bucket vs data in Bigquery based on time stamp.

Use Case: Fraud Detection

Real time: Real time Initiala and detal load

Industry: Finance

Source: Bigquery - building Data Lake (No SQL)

Approach: Extract-> Load ->Transform

Technology: Data flow -Apache Beam using Java (Confirmed by client and Recommended by Google [login to view URL]

[login to view URL])

Language : Java (preferred) /Python

- How to migrate data from Source to target in real time ?

- How do data validate ,verification using Java/Python and generate report for data quality check like Row count, Cloumn count, Field value validation

- Special character, Non English text, sign ,blank value

- Data Modeling in Non Sql Big query Star schema to Data vault schema

- Data Masking and Data Encryption

- Data governance integration Informatica Axon and Colibra

- Data Migration Strategy

- Data Ingestion Strategy

- Date Quality and Data Verification Strategy

- List of Data Validation and verification approach and scenario

- List of data Transformation scenario

- Data Integration strategy

- Atunity VS Goldengate vs Talend vs Informatica vs IBM infostage vs MS BI SSIS vs Oracle ODI for Extract and Load comparison

Skills: Java, Python, Informatica Powercenter ETL, SQL, Oracle

See more: google talk application make asp net code project, query sql distance google map, top websites cloud google app engine ec2, django hosting cloud google, big traffic google adsense, we want a secure web application where we can add edit and remove delete the data as per our need anytime, we want a secure web application where we can add edit and remove/ delete the data as per our need anytime, why we need project manager, we need at least one year experience field market research interviewer recruiter for a full time job sandton, we looking for ecommerce ONLINE STORE website with 35000 products directly from our 3rd party data feeds , We are opening a flower shop called the cuckoo flower shop and need a simple but effective logo The cuckoo is a bird but also t, We have other coder who is currently doing some modifications, so when the project start the pages might not look same that they, We are looking for Turkish language transcribers who can help to do that? Project ID: 14285054, query bigquery from google sheets, billing at https console cloud google com billing, console.cloud.google.com free, console cloud google com freetrial, access cloud google, https cloud google com security overview whitepaper, what's next for big bang theory cast

About the Employer:
( 2 reviews ) Hyderabad, India

Project ID: #23128632

12 freelancers are bidding on average ₹30324 for this job

dineshrajputit

Hi, I have 8 years of experience and working on hadoop, spark, nosql, java, BI tools(tableau, powerbi), cloud(Amazon, Google, Microsoft Azure)... Done end to end data warehouse management projects on aws cloud with ha More

₹33333 INR in 10 days
(5 Reviews)
4.0
NIKHIL54785

Hi, this is NIKHIL I am a Team Leader of experienced web & mobile developers with a Bachelor of software from the Pacific National University(PNU) and more than 8+ years of experience in Developing. We have a solid ex More

₹25000 INR in 7 days
(0 Reviews)
0.0
solaashu700

I am a Database Engineer, ETL developer with 5 years of experience in Data Integration and Database management. With vast knowledge on Informatica’s PowerCenter, B2B Product Suite, Data Quality, PowerExchange Connector More

₹25000 INR in 15 days
(0 Reviews)
0.0
mohamedZX3

hey there, I am a data science, I can help you in Need to do a migration of OLAP data warehouse system from on-Premise to Google Cloud -Big query Next year.

₹25000 INR in 7 days
(0 Reviews)
0.0
snehpandya

Hi Google Cloud Expert here, I have more then 2 years of experience in Google Cloud Platform and all its platform. It would be great working with the project Thanks Sneh Pandya

₹65000 INR in 7 days
(0 Reviews)
0.0
shivampathania

I have 8+ years of experience as Business Intelligence Developer and Data Analyst in Development ,Staging and Production Environments. Strong Communication & Individual Contributor ( SQL SERVER 2008/2012,SSIS, SSRS, PO More

₹25000 INR in 10 days
(0 Reviews)
0.0
asmangesh27

hi i have work experience on oracle and I go through your requirements I can manage it.

₹27777 INR in 15 days
(0 Reviews)
0.0
DReddyM

Hi, Thank you for considering my Proposal. About me, I have worked with a MNCs for nearly 20 years and for the past 2 years, I am working independently for myself. I have over 8 years experience working in Java and ne More

₹25000 INR in 7 days
(0 Reviews)
0.0
₹27777 INR in 10 days
(0 Reviews)
0.0
roopali3105

I am a software professional. Currently, I am on a break and will be able to complete this project within timelines.

₹35000 INR in 15 days
(0 Reviews)
0.0
PK453

based on the requirement,i can complete within time [login to view URL] having good knowledge in etl tool like informatica

₹25000 INR in 7 days
(0 Reviews)
0.0
tushar1044

Hello Sir, I have 8+ years’ experience of DBA work supporting Microsoft SQL server DB's. I am already supporting 24*7 on call DBA support services. If you need any references of my clients so I will happy to give you r More

₹25000 INR in 7 days
(0 Reviews)
0.0