opportunities

Spark Infrastructure Engineer

Seattle
,
Washington
Infrastructure/Networking/Solutions Architecture
Published:
September 29, 2020
Job ID:
70222
Managing Branch:
This is some text inside of a div block.

ABOUT THIS FEATURED OPPORTUNITY 

This team is responsible for providing data as an asset to the entire organization, and creating a streamline of processing power to allocate the data to its proper destination. They design and build various tools and services to process the necessary data to all teams in the company in a real-time format using the virtual assistant. This team's main responsibility is to understand the use cases in which data engineers desire to use the tools and services that were created to make the data streaming process more efficient, and to support the process as a whole. 

 

THE OPPORTUNITY FOR YOU  

The main responsibility of Spark Infrastructure Engineer is to build the Spark infrastructure and provide support and maintenance on the Spark cluster on top of Kubernetes

 

KEY SUCCESS FACTORS

Must-have requirements:

·         At least 5 years working in data infrastructure area; not as a Data Engineer or Spark Application Developer but someone designing the infrastructure

·         Experience in provisioning and operationally supporting Spark cluster on top of Kubernetes (EKS preferred)

·         Experience working with AWS

·         Experience using "infrastructure as code" tools like Terraform, or Pulumi

 Nice-to-have requirements:

·         Hadoop knowledge and experience

·         Batch processing related technologies and data formats, e.g. Hive, Iceberg, Hudi, Avro, Parquet, etc.

·         Apache Spark committer, familiar with the internals of Spark

#LI-CF2

Apply for “Sr. Java Engineer” position

Apply for “Sr. Java Engineer” position

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Suspendisse varius enim in eros elementum tristique. Duis cursus, mi quis viverra ornare, eros dolor interdum nulla, ut commodo diam libero vitae erat. Aenean faucibus nibh et justo cursus id rutrum lorem imperdiet. Nunc ut sem vitae risus tristique posuere.