data engineer

• Architect and maintain our data Infrastructure on AWS, including:

• Data Lake (Redshift)

• Cluster computing resources (Apache Spark)

• Distributed messaging and streaming platforms (Apache Kafka)

• Distributed storage (S3)

• Design and implement data applications on cluster computing and streaming engines

• Design and implement data processing microservices and pipelines

• Integrate with our vendors to collect and ingest second-party data into our data lake

• Work with data scientists to enhance our software with the latest in machine learning algorithms and predictive models

• Collaborate to ensure the integrity and cleanliness of data sources, and to support the requirements of downstream data consumers

• Mentor and guide team members

• Establish and communicate team standards and best practices

• Collaborate in a cross-functional squad with business stakeholders, product managers and engineers from other teams to create data-enabled features in both internal and customer-facing applications

Skills: Big Data Sales, Data Mining, Hadoop, Map Reduce, Python

See more: data engineer indeed, data engineer job, data engineer skills, data engineer vs data architect, data engineer vs data analyst, data engineering courses, data engineering salary, data engineer certification, Loading data from various sources into Oracle Database, Data Engineer, Big Data Engineer, data entry,video upload,virtual assistant,web search,phone support,Microsoft office,data processing,excel,general office,call ce, Imagine you\ re a data engineer , data engineer, data engineer careers

About the Employer:
( 0 reviews ) United States

Project ID: #15792464

10 freelancers are bidding on average $1041 for this job


I have read your project details. I have to ask a few questions. Can you please message me via chat so we can discuss all the details to elicit all the requirements and hence start the development? Relevant Skills and More

$1250 USD in 20 days
(4 Reviews)

Hi, I have read your description and I having more than 6 years of experience in machine learning, speech processing and NLP I believe that I am the most suitable candidate for this kind of work. I have done a lot of More

$1444 USD in 20 days
(6 Reviews)

Hi, I have more than 3+ years of experience in hadoop technologies contact me for more details Relevant Skills and Experience review profile Proposed Milestones $833 USD - Project fee

$833 USD in 20 days
(8 Reviews)

Hello, .I specialise in web development. I live in Oxford. Your project looks exciting to me and I’ve got the skills required Relevant Skills and Experience Big Data, Data Mining, Hadoop, Map Reduce, Python Proposed More

$1250 USD in 20 days
(1 Review)

Hello, I am applying for this job because I've a keen interest in BigData technology and I’m considering your job post for me with the required capabilities. I have learned Apache Flink, R programming, Hadoop and its More

$833 USD in 30 days
(9 Reviews)

I am expert Software Architect and ready to maintain your data Infrastructure on AWS. I have reviewed all above points in your job description and ready to discuss further ASAP. Relevant Skills and Experience I have 5 More

$1000 USD in 20 days
(2 Reviews)

Hi I have read your requirements. I can do your project.I'll wait for your [login to view URL] can discuss the project. I'll do in your estimated budget. Thank you

$888 USD in 8 days
(1 Review)

I have just started for looking opportunity on freelancer, kindly provide a first chance to show case my skills.

$833 USD in 30 days
(0 Reviews)

hi, I do hadoop, spark, dwh and nosql admin+development. have done 10+ poc and 5 projects in last 6 years. let me know if we can discuss.

$833 USD in 20 days
(1 Review)

Dear Client, We have gone through the requirement and understood it very well. We have 4+ years of experienced Data Scientists, Big Data Engineers who can help you in doing this project up. Our resources have exp More

$1250 USD in 20 days
(0 Reviews)