Find Jobs
Hire Freelancers

Snr big data engineer - 6 month contract

$5000-10000 USD

Closed
Posted almost 3 years ago

$5000-10000 USD

Paid on delivery
• Responsible for the building, deployment, and maintenance of mission critical analytics solutions that process data quickly at big data scales • Contributes design, code, configurations, and documentation for components that manage data ingestion, real time streaming, batch processing, data extraction, transformation, and loading across multiple game franchises. • Owns one or more key components of the infrastructure and works to continually improve it, identifying gaps and improving the platform’s quality, robustness, maintainability, and speed. • Cross-trains other team members on technologies being developed, while also continuously learning new technologies from other team members. • Interacts with engineering teams across WB and ensures that solutions meet customer requirements in terms of functionality, performance, availability, scalability, and reliability. • Performs development, QA, and dev-ops roles as needed to ensure total end to end responsibility of solutions. • Works directly with business analysts and data scientists to understand and support their usecases JOB REQUIREMENTS • 5+ years of experience coding in Java, Python, or Scala, with solid CS fundamentals including data structure and algorithm design • 4+ years contributing to R&D and production deployments of large backend data processing and analysis systems • 3+ years of hands-on implementation experience working with a combination of the following technologies: Hadoop, Map Reduce, Pig, Hive, Impala, Spark, Kafka, Storm, SQL and NoSQL data warehouses such as Hbase and Cassandra. • 3+ years of experience standing up and automating the deployment of solutions in AWS using the AWS CLI, with a focus on EMR, EC2, S3, EBS, Redshift, Dynamo, VPCs • Knowledge of SQL and MPP databases (e.g. Vertica, Netezza, Greenplum, Aster Data) • Knowledge of professional software engineering best practices for the full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations. • Experience participating in an Agile software development team, e.g. SCRUM • Experience designing, documenting, and defending designs for key components in large distributed computing systems • A consistent track record of delivering exceptionally high quality software on large, complex, cross-functional projects • Demonstrated ability to learn new technologies quickly and independently • Demonstrated ability to achieve stretch goals in a very innovative and fast paced environment • Ability to handle multiple competing priorities in a fast-paced environment • Excellent verbal and written communication skills, especially in technical communications • Strong inter-personal skills and a desire to work collaboratively • Undergraduate degree in Computer Science or Engineering from a top CS program required. Masters preferred. • Experience with supporting data scientists and complex statistical usecases highly desirable
Project ID: 30372875

About the project

Remote project
Active 3 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs

About the client

Flag of MALAYSIA
SUBANG JAYA, Malaysia
5.0
4
Payment method verified
Member since Aug 29, 2016

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.