Twitter Data Analysis with Spark and Hive

After having collected at least 1 hour's worth of data, schedule an hourly EMR job via Data Pipeline. Generate the following reports for every hour and store them on S3 using Spark AND one other application of your choice (e.g. Java MR, Hive, Pig, etc.):

Top 10 popular users (those with the most number of followers) who have tweeted in the last hour

Top 10 popular languages used across the globe in the last hour

Top 10 trending individual hashtags across globe in the last hour

Skills: Big Data Sales, Hadoop, Java, Python, Software Architecture

See more: proposal data analysis project, resume data analysis, hive data analysis, hadoop spark hive pig, hive vs pig vs spark, twitter data analysis project, twitter sentiment analysis using spark github, twitter data analysis using hive, twitter data analysis using flume and hive, twitter sentiment analysis using spark streaming, twitter data analysis, airline data analysis with spark, music data analysis using spark, twitter data analysis using python, twitter data analysis using hadoop, learning spark: lightning-fast big data analysis, twitter sentiment analysis using hive, twitter data analysis using mapreduce, twitter data analysis using python github, twitter data analysis using r

About the Employer:
( 0 reviews ) Dallas, United States

Project ID: #19986536

17 freelancers are bidding on average $208 for this job


Hi there, I have read your project description and i'm confident i can do this project for you perfectly.I still have a few questions. please leave a message on my chat so we can discuss the budget and deadline of the More

$666 USD in 8 days
(60 Reviews)

I have experience using R for statistical analysis and machine learning and have worked on various data science projects such as recommender systems with NLP components, data mining with associative rules, etc. I also More

$140 USD in 7 days
(34 Reviews)

Hi I am data engineer and aws certified solutions architect with 4+ years of industry experience. I have been working on analytics solutions using both clouds and on premises. Expertise in data lakes Relevant Skills a More

$250 USD in 3 days
(33 Reviews)

Have 10 years of IT experience with more than 4.5 years of experience in hadoop technologies like hive,pig,spark,sqoop,map reduce and [login to view URL] have very good experiemcence in Java,scala,Python and shell scripting. More

$166 USD in 1 day
(11 Reviews)

First:- Chatbot --> This can be integrated by any Facebook page, Slack etc. Its main aim is to reduce the human effort. For example, if this Chatbot is integrated with company page so it can easily answer you some b More

$155 USD in 3 days
(2 Reviews)

Hi, I have experience in Spark,AWS Data pipeline.EMR. I can create the program as per the below requirement. Looking forward to work on it. Thanks, Amit

$120 USD in 3 days
(13 Reviews)

Hi, I have 8 years of experience and working on hadoop, spark, nosql, java, BI tools(tableau, powerbi), cloud(Amazon, Google, Microsoft Azure)... Done end to end data warehouse management projects on aws cloud with ha More

$140 USD in 7 days
(5 Reviews)

I have read the description of your project and i am up for this task, I have done several data Analysis projects using twitter data. I am an experienced python developer and i have strong skills in SPARK and HIVE. All More

$140 USD in 4 days
(2 Reviews)

Hi , I have good experience in twitter data analysis. I recently worked on project sentiment analysis using AWS and pyspark . I have good understanding about the AWS, Spark and hive . Please provide opportunity to More

$255 USD in 5 days
(1 Review)

Based on the project details, my experience aligns completely to the use case. I have a few questions with respect to type of data and the deployment methodology. We can discuss the same

$200 USD in 4 days
(1 Review)

I would like to disucss the requirement and then would like to suggest the optimal tech/design suited for these kind of application.

$250 USD in 20 days
(0 Reviews)

I've 7+ years of experience in Web Development/Web design , Mobile App Development(IOS/android), Graphic design, Logo Design, UI/UX design Business Cards & Stationery, Flyers & Brochures, Packaging Design, Web & Mobil More

$155 USD in 3 days
(0 Reviews)
$166 USD in 5 days
(0 Reviews)

I am a professionally qualified hands on IT specialist with proven commercial experience of working as a Data Engineer within the Banking (fin-tech), Tel-co, Energy and Health-care sectors. A self-motivated individual, More

$250 USD in 30 days
(0 Reviews)

Hi Sir, I can do this using Spark as well as Hive. Please consider me for this project. Thanks, Kavita

$180 USD in 4 days
(0 Reviews)

I have good experience in these types of applications. I would like to work in your project. Thanks

$200 USD in 7 days
(0 Reviews)

Having experience on Hive for analysis purpose . Further performed analysis on Twitter data in the past as well

$111 USD in 7 days
(0 Reviews)