Find Jobs
Hire Freelancers

I need help with Spark

$10-30 USD

Cancelled
Posted about 5 years ago

$10-30 USD

Paid on delivery
There are two csv files available “[login to view URL]” & “[login to view URL]”. I need to create a notebook and produce this output from a couple csv files. I am looking for the code that would help me accomplish #3 and #4. Create a RDD for each file: Create RDD to access department department = [login to view URL]("/FileStore/tables/[login to view URL]") [login to view URL](5) #Create RDD to access employee employee = [login to view URL]("/FileStore/tables/[login to view URL]") [login to view URL](15) Filter out header rows: filter out header department csv header = [login to view URL]() department1 = [login to view URL](lambda row : row != header) [login to view URL](1) filter out header employee csv header = [login to view URL]() employee1 = [login to view URL](lambda row : row != header) [login to view URL](1) 3 Provide a output that has employee count by department ID 4 Provide a output that has top two department name with most employee ID. Lastly, here are the header names for "Emp" table: 'empno,ename,job,mgr,hiredate,sal,comm,deptno And for the "Dept" table: 'deptno,dname,location', I am definitely not a programmer and have tried multiple codes without luck. I would also like to have an attached explanation of what has been done and why it is needed so I can help wrap my mind around it.
Project ID: 18980924

About the project

1 proposal
Remote project
Active 5 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
1 freelancer is bidding on average $30 USD for this job
User Avatar
Hello there, I have reviewed your project requirements and understood your requirements as mentioned above. We are working here as team and have more then 5+ years of experience in this field. We have skills mentioned below: PHP FRAMEWORKS,HTML,CSS,WORDPRESS,WOOCOMMERCE,ECOMMERCEAJAX,BOOTSTRAP,CODEIGNITER, PRESTASHOP,JOOMLA,MAGENTO,DRUPAL,SHOPIFY,PAYMENT GATEWAY INTEGRATION. We believe in quality work with ontime delivery. Kindly initiate chat to discuss more. Thanks Shraboni
$30 USD in 1 day
5.0 (1 review)
1.3
1.3

About the client

Flag of UNITED STATES
Saint Paul, United States
0.0
0
Member since Mar 18, 2019

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.