Hadoop jobs

software testing web testing map reduce Hadoop

need someone with knowledge of Hadoop, map reduce, sql, python, data mining

The MTBF of a Hadoop node and an enterprise storage server is three and six years respectively [6], [20]. Based on these values, Table I compares the probability of data loss per day in HDFS and NAS filers using Equations 3. We compare the HDFS cluster with 1000 nodes to a filer with 100 nodes assuming that they can offer the same storage capacity. This is valid assumption given recent trends in storage capacity. Enterprise systems can easily support more than 240 TB of storage [24], while a typical Hadoop node has 12 TB to 24 TB of storage. Filers can offer probability of data loss with one replica of 4.4 ∗ 10−2 , compared to HDFS with 3 replicas, which has a 6.44 ∗ 10−2 probability of data loss. Given the high number of disks in a sin...

Require a developer

The MTBF of a Hadoop node and an enterprise storage server is three and six years respectively [6], [20]. Based on these values, Table I compares the probability of data loss per day in HDFS and NAS filers using Equations 3. We compare the HDFS cluster with 1000 nodes to a filer with 100 nodes assuming that they can offer the same storage capacity. This is valid assumption given recent trends in storage capacity. Enterprise systems can easily support more than 240 TB of storage [24], while a typical Hadoop node has 12 TB to 24 TB of storage. Filers can offer probability of data loss with one replica of 4.4 ∗ 10−2 , compared to HDFS with 3 replicas, which has a 6.44 ∗ 10−2 probability of data loss. Given the high number of disks in a sin...

The MTBF of a Hadoop node and an enterprise storage server is three and six years respectively [6], [20]. Based on these values, Table I compares the probability of data loss per day in HDFS and NAS filers using Equations 3. We compare the HDFS cluster with 1000 nodes to a filer with 100 nodes assuming that they can offer the same storage capacity. This is valid assumption given recent trends in storage capacity. Enterprise systems can easily support more than 240 TB of storage [24], while a typical Hadoop node has 12 TB to 24 TB of storage. Filers can offer probability of data loss with one replica of 4.4 ∗ 10−2 , compared to HDFS with 3 replicas, which has a 6.44 ∗ 10−2 probability of data loss. Given the high number of disks in a sin...

I need to implement the my customized replication policy algorithm in hadoop by changing its default replication policy.

Just configuration setup and fixing bug. I have source code

Hi Utkarsh K., I noticed your profile and would like to offer you my project. We can discuss any details over chat. I need to do some hadoop project

working on big data hadoop .

...(Virtualization (Hyper Visors/ VM Ware, Hyper V), X86 Architecture, Operating Systems (Windows, Red Hat Linux). Applications (SAP, Oracle, Oracle RAC, and Other Enterprise Applications) Storage, High Performance Computing, and sales skills are important. • Experience with enterprise applications and databases, including the sizing, configuration and delivery. • Familiarity with Big Data architectures, Hadoop distributions and data analytics. • Converged infrastructure configuration, integration and management. • Cloud solutions for private, public and hybrid and the opportunity to provision and migrate workloads among cloud architectures. • Excellent written and verbal communications skills in English • Good listening and strong presentati...

design and implementation of security packet filtering to detect dos attacks or some firewall rules using hadoop and mapreduce using bigdata

hadoop security kerberos knox ranger data masking and encryption and acls

...between various components on Hadoop/spark stack. (example, taking a model definition in Java and scoring a dataset using Spark RDD on a cluster and storing output in a downstream application. Work closely with product and Analytic managers, user interaction designers, and other software engineers to develop new product offerings and improve existing ones. Requirements Core competency in Big Data and distributed systems, including data storage and management, searching, scheduling, logging, serialization, and modeling technologies Proficiency in Core Java or Scala and Spark or Hadoop environments Familiarity with dependency injection, Concurrency, Guice/Spring Familiarity with JDBC API / Databases like MySQL, Oracle, Hadoop ...

Looking for an Expert in: · Build Custom Data Pipelines in Python that Clean, Transform and Aggregate data from many different sources · Big Data Technologies such as: MapReduce, Hadoop, Spark, HBase, Hive, Elastic Search · Data Structures and Data Processing Algorithms and Frameworks · Data Migration, high throughput Data Pipelines · Massively Parallel Processing using Python Tools · Ability to analyze Performance Issues in Big Data Environment · Data Modelling, Data Transfer and Storage, Partitioning, Indexing and caching Techniques Well experienced with: · Large Scale Data Modelling from Big Data perspective · Big Data Structures in Py...

hadoop architect/administartion must have (knox/ranger/kerberos/SSO/aws ) building clusters on AWS (REAL TIME) networking /loadbalancers/ AD INTEGRATION

hadoop administration

Looking for an Expert in: · Build Custom Data Pipelines in Python that Clean, Transform and Aggregate data from many different sources · Big Data Technologies such as: MapReduce, Hadoop, Spark, HBase, Hive, Elastic Search · Data Structures and Data Processing Algorithms and Frameworks · Data Migration, high throughput Data Pipelines · Massively Parallel Processing using Python Tools · Ability to analyze Performance Issues in Big Data Environment · Data Modelling, Data Transfer and Storage, Partitioning, Indexing and caching Techniques Well experienced with: · Large Scale Data Modelling from Big Data perspective · Big Data Structures in Py...

Looking for an Expert in: · Build Custom Data Pipelines in Python that Clean, Transform and Aggregate data from many different sources · Big Data Technologies such as: MapReduce, Hadoop, Spark, HBase, Hive, Elastic Search · Data Structures and Data Processing Algorithms and Frameworks · Data Migration, high throughput Data Pipelines · Massively Parallel Processing using Python Tools · Ability to analyze Performance Issues in Big Data Environment · Data Modelling, Data Transfer and Storage, Partitioning, Indexing and caching Techniques Well experienced with: · Large Scale Data Modelling from Big Data perspective · Big Data Structures in Python &middo...

...to work for you in Software and Web Development. We are highly trained professional developers seeking to freelance and earn online. Having a flair in programming and development I have been excellent with JAVA,C#,C/C++ and PHP programming language along with MySQL with XAMPP Server. I also build application for Cloud computing and High performance computing as I also have knowledge regarding Hadoop, MPI, OpenMP (distributed frameworks) and also have build applications in CUDA C++ and OpenCL. I also have experience with the most famous framework ASP.NET. My most expertise are in JAVA where I have built countless projects for semester projects and Final year project. You may find many developers in this field however we assure that you will not be able to find a team like us. We...

...to work for you in Software and Web Development. We are highly trained professional developers seeking to freelance and earn online. Having a flair in programming and development I have been excellent with JAVA,C#,C/C++ and PHP programming language along with MySQL with XAMPP Server. I also build application for Cloud computing and High performance computing as I also have knowledge regarding Hadoop, MPI, OpenMP (distributed frameworks) and also have build applications in CUDA C++ and OpenCL. I also have experience with the most famous framework ASP.NET. My most expertise are in JAVA where I have built countless projects for semester projects and Final year project. You may find many developers in this field however we assure that you will not be able to find a team like us. We...

Free Lance / Visiting --- Hadoop Trainer to deliver training at our premises at one of the Top B Cities of Central India on Per Month Basis. Stay arrangements will be provided.

A website which has four option to start <1>docker container <2>httpd server <3>ssh server <4> Hadoop cluster <5>LVM Creation and mount A full fresh autonomous website

need remote support for Hadoop project

We need Free Lance Hadoop Consustant to work as Trainer on Per Month Basis.

Strong Java, hadoop (MapReduce, hdfs, hbase), shell scripting

Setting up Data Science Lab and Train candidates on data science and analytics. Looking for experts in Machine Learning, Probabilistic Modeling, Deep Learning, Natural Language Processing, Data Visualization, Scala for functional programming, Hadoop, Big Data and Experimental Design, and Functional Analysis, Linear Algebra, Convex Optimization, Differential Equations, Calculus, Algorithms, Distributed Computing, Databases (SQL & NoSQL),

Building an application using Hadoop/Spark for analytics. Looking for expert Spark programmers using different APIs.

W are looking for developers to work on our projects. The skills required are Big Data, Cloud Computing, Data Science and Machine Learning. I am happy to pay a fixed priced and my budget is $250 - $550 USD. Special Skills Needed: Hadoop, Cloudera, Yarn, Impala. NOTE: We need Inhouse developer from Sri Lanka for a contract basis project and If he/she passed the interview three months salary will be paid in advanced while signing job Agreement. No Rookies, Only professionals with minimum 4 Years experience in any of these frameworks, Portfolio must.

I need to implement the my customized replication policy algorithm in hadoop by changing its default replication policy.

...a Map Reduce job that implements the K-nearest neighbor data mining technique. You specify 3 parameters for the job, which are the input file, output and test data file. The logic of what I have done so far doesn't seem to be working properly. I've attached the code done for far and would like someone to help in getting it to work. It is important that this code is tested with Hadoop 1.1.2 as the version of Hadoop has a particular significance to the work being done. The code has some issues with the reducer function and its cleanup. The implementation is based on the concept provided by the following paper: The input file and test file are included in the project. The work has been developed using eclipse as a java project. The names of the

I am looking for some one who can explain couple of hadoop projects

hadoop , hive, hbase, spark

the package is for each course that has been given over here and i want trainers who will be ready to work in est timing based and they should be good at English

looking for the proxy. in Hadoop admin, if I get the job I will continue support with you as well................................................................

Requirement: To configure JupyterHub Notebook with multiple user login option. Users should be automatically sync up with LDAP Environment: 1. We have a Kerberised cluster and SSL enabled for Cloudera & Hadoop services at Level 1-3 2. We have LDAP integrated to the cluster 3. Now We want JupyterHub to work in such a way that users in LDAP must run their Spark jobs in secured cluster through JupyterHub 4. I have heard about Livy which can solve Kerberos authentication issue Now I am in a confusion whether to use LDAP authenticator or Livy I have seen some of the sources in websites and even i have seen Bloomberg Data Conference video about Livy But none of them are so clear to fulfill my requirement Neither they have any instructions about the setup

Course Authoring Expert for undertaking development of final SCORM modules using graphics, audio, text, etc.

the package is for each course that has been given over here and i want trainers who will be ready to work in est timing based and they should be good at English

I need proxy on Hadoop, Scala, Spark, Java

hadoop

Hi Satya, I noticed your profile and would like to offer you my project. We are a cross-channel marketing company working with a nice tech stack (Cassandra, Hadoop, Flink, Redis, ElasticSearch, Spring etc). I would need a great Java Dev that can help us fix some issues on our platform. Cheers, Markus Email: @ Skype:

We are currently hiring freelance trainer for Hadoop Development. You will be paid batch wise. We are an IT Staffing firm.

Simulating a multi(10+) node hadoop cluster, using yarn scheduler load simulator (), and running different types of workloads (heavy load, light load, burst etc) and study the effects of scheduling algorithm (there are three) on the statistics such as turn around time, waiting time, total run time etc. Deliverables:- VDI with hadoop and Yarn SLS installed, Instructions on how to install, configure, and run workloads on Yarn SLS All the readings obtained by running different types of workloads on different scheduling algorithms.

Need a 10-12 page technical paper written (in APA format with citations and references) in Data Analytics. Specific topic can be discussed, but expect to be knowledgable with any one of Data Mining, R, Python, Big Data Technologies (like Hadoop, Pig,Hive), etc.

we are building a POC on Big Data Cloud using Hortonwoks distribution. we are looking for developers to contribute in building the POC. looking for freelancers having skills in the Java / Hadoop/ Nosql with minimum 1 year experience. Live project to work on Big Data / Hadoop and gain good exposure on to best technology in the industry.

Need the theoretical solution of the attached problem. Please refer attached for details. Willing to pay $40 for the solution. but need it in next 20 hours maximum.

Need the theoretical solution of the attached problem. Please refer attached for details. Willing to pay $40 for the solution. but need it in next 24 hours maximum.

Below are the questions that I wish to ask in the technical round of the interview. So I wish to have a perfect solution before I put these in front of the candidates. question 1 is related to Map Reduce question 2 is related to Graph Algorithms question 3 is related to Streaming Data Processing question 4 is related to Recommender Systems

hadoop

Simulating a multi(10+) node hadoop cluster, using yarn scheduler load simulator, and running different types of workloads (heavy load, light load, burst etc) and study the effects of scheduling algorithm (there are three) on the statistics such as turn around time, waiting time, total run time etc. Deliverables:- VDI with hadoop and Yarn SLS installed, Instructions on how to install, configure, and run workflows on Yarn SLS All the readings obtained by running different types of workloads on different scheduling algorithms.