Analysis and extraction of youtube data with python



1: We have to write the code in python for extracting the data which should be done in hadoop environment from youtube.


2: We have to load the file from local to hdfs and create hive and impala tables.

3: Now load the data of hive and impala.


4: Segmentation: Load the data from Hive or Impala using pyspark

5: Create dataframe

6: Build Analysis like:

A: Number of users who see videos related to money deposit in banks.

B: Number of users who transfer money within same banks and to external bank accounts.

C: Segmentation: Find the location, age, number of comments, likes, feedback of users who see the videos.

It will be better if you setup cloudera environment from there we can do everything in python.

Skills: Hadoop, Hive, Python, Spark

See more: hi paid and real data entry online job payment via bank transfer of paypal, python data analysis, python data analysis yahoo finance, python data analysis chart, python data analysis html graph, python data scrape, python data entry, use python data website, data web extraction php developer, python data website, python data scraping websites, project data market research analysis, swot analysis nation trust bank sri lanka, python data extraction, upload data youtube, free money transfer bank, data encodingdata extraction

About the Employer:
( 0 reviews ) United States

Project ID: #12697400

7 freelancers are bidding on average $228 for this job


Hi, I am competitive to this kind of task, can take good care of this project. In fact, I already done related to this job before. Let me know the best of your time so we can discuss further based on your requirements More

$199 USD in 3 days
(19 Reviews)

i am good in hadoop , spark , hive , sqoop and python . i would like to start this work as soon as possible . hope we can proceed

$155 USD in 3 days
(12 Reviews)

Hello, I am applying for this job because I've a keen interest in BigData technology and I’m considering your job post for me with the required capabilities. I have learned Hadoop and its components Hive, Pig, Sqoop, More

$89 USD in 15 days
(5 Reviews)

Hello, I can complete your requirement in given time. I am experineced python developer. Looking for your answer. Thanks, Jigar

$200 USD in 5 days
(2 Reviews)

I have 9 years of exeperience in IT industry with more than 2.5 years of experience in hadoop technologies like Hive,Pig,Sqoop,Map Reduce,Hbase and Spark

$200 USD in 3 days
(1 Review)

PYTHON EXPERTS WITH 6+ YEARS EXPERIENCED! Hello, Thank you for sharing opportunities. we are a team of 70 full time freelancers having expertise on PHP and all CMS like WORDPRESS, PRESTASHOP, OPENCART, JOOMLA, S More

$533 USD in 5 days
(0 Reviews)
$222 USD in 4 days
(0 Reviews)