Finding outliers – A Network or system log analysis using MapReduce

hi I am a big data engineer with 2 years of industry experience. I have rich literature background, I have used Amazon public data sets for hadoop. can do this job for you. looking forward for your response thanks

Hi, I am Amit. I have experience in Hadoop and MapReduce. Do you want a MapReduce application only. Or you want a Spark Application using MLib, which will identify Real time outliers from the network logs. Please confirm if Spark Application can also be written or you need only MapReduce Application. Thanks, Amit

Hi there, I have been working in the Hadoop framework for over 3 years now. Hadoop has changed a lot from what it was in the initial years. From a mere low cost solution for large dataset storing via HDFS and analysis via MapReduce to a myriad of applications that is constantly evolving. The most used tools in the Hadoop ecosystem now a days are Spark (in memory proccessor that is slated to be the replacement of Mapreduce), Hive (the default database for the hadoop ecosystem tools), Impala, R, pig, Hbase etc. But the actual set of big data tools depends on the exact requirement of the project and the expected outcome. I am currently working in a few big data projects in my company and can surely help you to in your project as a Big Data Architect. I will use Hive to do your project. Hive can injest logs ang we can query the same using HQL. More details on chat. I don't have a single Hadoop reveiw in my profile. I have been an active freelancer from 2009 to 2012, but inactive for the last 5 years. Now I have decided to make a comeback. I have extensive experience in the Hadoop ecosystem and if you award me this project I can get my FIRST Hadoop review here in Freelancer.com .Looking forward to hear from you Thanks, Souvik

Over 5.6 yrs of Programming Experience in IT Industry Including Big Data Hadoop/Apache Spark With Scala and Oracle Database Technologies. * Expertise in Functional Programming Language like Scala. * Hands on Experience With Big Data Ecosystem Components like HDFS, MapReduce, Hive, Pig, Sqoop, Hbase, Zookeeper, Apache Spark. * Excellent Understanding of HDFS Architecture, MapReduce1 and YARN Architecture Framework. * Experience in Running Spark on Standalone, YARN Cluster Manager. * Strong Knowledge on Apache Spark Architecture, RDD-Pair RDD. * Experience in Working With Spark SQL.

Data Engineer with many experiences with Hadoop ecosystem. I can do it easily and make sure you will love it.

IT professional with more than 10 years of experience and 3 years of experience with Big Data project and more than 4 years of experience with Data Warehouse projects in major companies. Solving data issues and create ETL process in Hadoop is my expertise.