• Having 6+ years of experience as a Hadoop/Pyspark Developer.
• Having extensive knowledge on Hadoop technology experience in Storage, writing Queries, processing, and analysis of data.
• Experience on migrating on Premises ETL process to Hadoop Layer.
• Experience in optimizing Hive SQL queries and Spark Jobs.
• Implemented various frameworks like Data Quality Analysis and Data Validation with the help of technologies like Bigdata, Spark, Python.
• Primary technical skills in Pyspark, HDFS, YARN, Hive, Sqoop, Impala, Oozie.
• Good exposure on advanced topics Like Analytical Functions, Indexes, Partition Tables.
• Experience with creation of Technical document for Functional Requirement, Impact Analysis, Technical Design documents, Data Flow Diagram.
• Quick learner and up to date with industry trends, Excellent written and oral communications, analytical and problem-solving skills and good team player, Ability to work independently and well-organized.