Migrate project from spark 1.6 to 2.3 version

Hello I am working in Bigdata/Hadoop technologies for years. I worked in Hadoop, Mapreduce, Spark (Streaming & MLLib), Kafka, ELK Stack, Cassandra, MongoDB, Postgre. I implemented above using Java Scala and Python. Have worked Shell, Perl and Python I worked in Amazon AWS Ubuntu environment ans also Google Cloud Platform Ubuntu. Can we talk further on this? Thank you!

Hi, I have 8 years of experience and working on hadoop, spark, nosql, java, BI tools(tableau, powerbi), cloud(Amazon, Google, Microsoft Azure)... Done end to end data warehouse management projects on aws cloud with hadoop, hive, spark and presodb. Worked on multiple etl project like springboot, angular, node, PHP, Kafka, nifi, flume, mapreduce, spark with XML/JSON., Cassandra, mongodb, hbase, redis, oracle, sap hana, ASE.... Many more. Let's discuss the required things in detail. I am committed to work done and strong in issue resolving as well. Thanks

Highly effective Big Data Engiener with over 25 years of experience. I have extensive Spark experience both in PySpark and Scala also in MLLib. I checked your Scala code and should be able to convert it to PySpark. TECHNICAL SKILLS • Big Data (Hortonworks and Cloudera) – Spark(PySpark, Scala), Kafka, Hive,Impala, NiFi, HDFS, Sqoop, Ranger, Yarn, Solr, SAM, Schema Registry, SuperSet • Language: Python, Scala, R, JavaScript • Data Visualization – Tableau, PowerBI, OBIEE, DOMO • Plunk & ELK Stack – ElasticSearch, Logstash, Filebeat, Kibana • AWS – S3, RefShift, DynamoDB, Athena, Kinesis, EMR, Aurora, Glue • Azure – Data Warehouse, Polybase, SQL Server, HDInsight, SSIS, SSAS • ETL – Informatica Power Centre, Informatica Big Data Management (BDM), SSIS • Data Science & Engineering – R / RStudio / SparkR Packages: dplyr, ggplot2, stringr, plyr, carrat, SparkR, NLP, tibble, TensorFlow, curl, Python / PySpark, MLLib • Libraries: MLLib, NumPy, SciPy, Pandas, Matplotlib, Seaborn, SciKit-Learn • DBMS / OLAP – Oracle, SQL Server, TeraData, MySQL, Postgres, Essbase, SSAS • Data Modelling – Kimball, Vault • Machine Learning / Statistical Modelling - Linear Regression, ?Logistic Regression, Classification and Regression Trees, Naive Bayes, ?K-Nearest Neighbors

Hi; I'm Scala developer, I have an experience on both Spark 1.X and 2.X and also I'm Scala developer with Kafka (Streams API). I had accomplished the same task of migration from 1.6 to 2.0.0 on my job. feel free to contact me on chat to give you some example of my work with Spark and Scala. Kind regards Ayoub

Hi, I am a bigdata developer and a module lead in reputed MNC.i an into the IT industry for more then 12 years. I have tonnes of experience in developing projects using Java,Apache Spark,Hive,Kafka,Scoop,Pig,Scala,aws and managing cluster on aws cloud. I have a very good experience in upgrading project form spark 1.6 to 2.3 because i did the same migration in my project. I have my youtube channel to on AWS . I have delivered multiple projects and lectures on setting up apache Spark on AWS EMR... I can be the best suitable person for your requirements Let me know your view Regards,

I have over 7 years experience in Hadoop technologies. I have worked with big MNC's from USA as well as India. I have both developer as well as architect experience and currently well equipped with Hortonworks and Cloudera Distributions. I have hands on production experience on Apache Nifi, Kafka, Hive, Sqoop, Spark (Scala), Shell, Flume and HBase technologies. Willing to start asap. My bid amount might be little high, but I bring in the best of experience to your work and I have experience both as a developer and an architect and it is always mandatory to write/design the code in the right way to run smoothly without any issues in production.

Hi , i am a big data developer working with a us based client. i have a huge experience working with spark 1.6 as well as spark 2.3 . i know very well which fucntion is supported in 1.6 and not in 2.3 . I have migrated like over 100 script from 1.6 to 2.3 so i have the same kind of experience you are looking for

I am a software engineer with experience in building scalable application primarily using Java, Scala, and Python. I am passionate about helping my clients build scalable, reactive, and data-driven applications. 1. Experience in developing a full-stack application, solution designing, front end, and back end design 2. Expert in big data technologies like Apache Spark, Elastic Search 3. Capable of crafting real-world problems with OOP designs 4. Effective working with Remote team 5. Experienced in Agile, CI/CD and Scrum 6. Expert in designing highly available and scalable application 7. Solid programming knowledge with Design Patterns 8. Machine Learning Enthusiast working with interest in Deep Learning. Programming Languages • Scala • Java • Python Techniques • CI/CD • Agile • Pair Programming • REST APIs Frameworks • Spring Boot • Spring JPA Tools • Docker • Jenkins • Logstash • Beats • Kibana • Swagger • GIT Big Data • Apache Spark • Cassandra • Elastic Search • Hadoop • HBase Data Bases • Mongo DB • MySQL • Postgre SQL Front End Technologies • React JS • Redux • D3.JS • Angular JS • HTML5 • CSS3 Cloud Platforms • Google Cloud • AWS • Azure Miscellaneous • Single Sign-On • OAuth Like to see you on Coffee !!

I have done migration projects in Spark with Scala which matches this requirement Working experience of 5+ years in multiple Bigdata stacks

Hi I am a Data Engineer in one of the reputated organization. And have worked on same kind of task. I will convert the code spark 1x to 2x also will document it properly.

Can deliver the project in time based on the amount of code and data abstractions that are needed to be changed when migrating Let me know if interested Best regards Hari

• Having strong Startup experience as a Big Data Developer. • Good working knowledge on understanding the complex processing needs of big data and has experience developing codes and modules to address those needs. Worked on big data projects for Nokia, Verizon, Telefonica. • Worked in Nokia AVA (Automation Virtualized Analytics) a cloud-based platform. • Hands on experience to develop Big Data pipelines & deploying in cloud using Apache Spark, Scala and Cassandra. • Strong working Knowledge in Big data technologies Apache Cassandra, Apache Ignite and Apache Hive

I can surely help ! But not only for money , I would like to get connected with you and work together when it is required. Just give it a try ! You won’t be unhappy.

Hello, I am currently working as a data engineer as a spark developer with hadoop eco system on yarn. I am having deep knowledge on architecture of spark and hadoop. With that i also have worked with open source git github and azure devops for code management. I used spark with scala and python in my project. Looking foward to work with you.