BACK

Data/DevOps Engineer

Cupertino
,
California
Data Analysis / Data Engineering / BI
Published:
January 12, 2021
Job ID:
56741
Remote Work Option:
Yes

The Data Engineer will join the Data Infrastructure team that powers analytics, experimentation, and ML feature engineering to create a virtual assistant.

Must Have:

  1. 5+ years of Java or Scala programming experience as their primary language
    1. Built Spark Data pipelines on Big Data systems (ideally PB of data) 
  2. Experience with unit/integration testing and post-release validation. 

Plus:

  1. Strong Data Structure foundation 

The Data Engineer’s primary responsibility will be to maintain an application which will require a proficiency in Spark with the ability to write Map Reduce jobs, work with Hive and various other big data technologies, and properly use the data being processed. Building pipelines and being a strong programmer is a must, as the Spark applications are developed in Scala. Performance tuning of the Spark application will be vital to make it run efficiently. This Spark application is complex and will require the candidate to have an advanced understanding of its functions so that the performance tuning can be done accordingly. Next they will look for potential optimizations to the application.

#LI-KF1

Apply for “Sr. Java Engineer” position

Apply for “Sr. Java Engineer” position

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Suspendisse varius enim in eros elementum tristique. Duis cursus, mi quis viverra ornare, eros dolor interdum nulla, ut commodo diam libero vitae erat. Aenean faucibus nibh et justo cursus id rutrum lorem imperdiet. Nunc ut sem vitae risus tristique posuere.