data engineer

• Architect and maintain our data Infrastructure on AWS, including:

• Data Lake (Redshift)

• Cluster computing resources (Apache Spark)

• Distributed messaging and streaming platforms (Apache Kafka)

• Distributed storage (S3)

• Design and implement data applications on cluster computing and streaming engines

• Design and implement data processing microservices and pipelines

• Integrate with our vendors to collect and ingest second-party data into our data lake

• Work with data scientists to enhance our software with the latest in machine learning algorithms and predictive models

• Collaborate to ensure the integrity and cleanliness of data sources, and to support the requirements of downstream data consumers

• Mentor and guide team members

• Establish and communicate team standards and best practices

• Collaborate in a cross-functional squad with business stakeholders, product managers and engineers from other teams to create data-enabled features in both internal and customer-facing applications

Skills: Big Data Sales, Data Mining, Hadoop, Map Reduce, Python

See more: Loading data from various sources into Oracle Database, Data Engineer, Big Data Engineer, data entry,video upload,virtual assistant,web search,phone support,Microsoft office,data processing,excel,general office,call ce, Imagine you\ re a data engineer , data engineer, data engineer careers, data engineer jobs, freelance big data engineer, big data engineer freelance, fill in a spreadsheet with data from various sources, collecting online data from various sources, guide data entry, forex data sources json

About the Employer:
( 0 reviews ) United States

Project ID: #15792464

10 freelancers are bidding on average $1041 for this job


I have read your project details. I have to ask a few questions. Can you please message me via chat so we can discuss all the details to elicit all the requirements and hence start the development? Relevant Skills and More

$1250 USD in 20 days
(4 Reviews)

Hi, I have read your description and I having more than 6 years of experience in machine learning, speech processing and NLP I believe that I am the most suitable candidate for this kind of work. I have done a lot of More

$1444 USD in 20 days
(6 Reviews)

Hi, I have more than 3+ years of experience in hadoop technologies contact me for more details Relevant Skills and Experience review profile Proposed Milestones $833 USD - Project fee

$833 USD in 20 days
(8 Reviews)

Hello, .I specialise in web development. I live in Oxford. Your project looks exciting to me and I’ve got the skills required Relevant Skills and Experience Big Data, Data Mining, Hadoop, Map Reduce, Python Proposed More

$1250 USD in 20 days
(1 Review)

Hello, I am applying for this job because I've a keen interest in BigData technology and I’m considering your job post for me with the required capabilities. I have learned Apache Flink, R programming, Hadoop and its More

$833 USD in 30 days
(9 Reviews)

I am expert Software Architect and ready to maintain your data Infrastructure on AWS. I have reviewed all above points in your job description and ready to discuss further ASAP. Relevant Skills and Experience I have 5 More

$1000 USD in 20 days
(2 Reviews)

Hi I have read your requirements. I can do your project.I'll wait for your [url removed, login to view] can discuss the project. I'll do in your estimated budget. Thank you

$888 USD in 8 days
(1 Review)

I have just started for looking opportunity on freelancer, kindly provide a first chance to show case my skills.

$833 USD in 30 days
(0 Reviews)

hi, I do hadoop, spark, dwh and nosql admin+development. have done 10+ poc and 5 projects in last 6 years. let me know if we can discuss.

$833 USD in 20 days
(1 Review)

Dear Client, We have gone through the requirement and understood it very well. We have 4+ years of experienced Data Scientists, Big Data Engineers who can help you in doing this project up. Our resources have exp More

$1250 USD in 20 days
(0 Reviews)