BACK

AWS Data Engineer

Santa Clara
,
California
Data Analysis / Data Engineering / BI
Published:
June 6, 2022
Job ID:
289289
Employment Type:
Permanent
Pay Rate:
$
160000.00
/hr
Base Salary:
$
160000.00
Remote Work Option:
Yes

The Team:
At the Digital Insights practice, we help our clients by building technology solutions that addresses business challenges and improve business outcomes with data-driven insights. As we continue expand our big data team, we are looking for Technical Lead Data engineers who are passionate about technology and want to build a career working on the latest technology platforms.
Position Overview:

AWS Data Engineer is proficient in the development of all aspects of data processing including data warehouse architecture/modeling and ETL processing. The position focuses research on development and delivery of analytical solutions using various tools including Confluent Kafka, Kinesis, Glue, Lambda, Snowflake and SQL Server. AWS Data Engineer must be able to work autonomously with little guidance or instruction to deliver business value.

Position Responsibilities
• Partner with business stakeholders to gather requirements and translate them into technical specifications and process documentation for IT counterparts (on-prem and offshore)
• Highly proficient in the architecture and development of an event driven data warehouse; streaming, batch, data modeling, and storage
• Advanced database knowledge; creating/optimizing SQL queries, stored procedures, functions, partitioning data, indexing, and reading execution plans
• Skilled experience in writing and troubleshooting Python/PySpark scripts to generate extracts, cleanse, conform and deliver data for consumption
• Expert level of understanding and implementing ETL architecture; data profiling, process flow, metric logging and error handling
• Support continuous improvement by investigating and presenting alternatives to processes and technologies to an architectural review board
• Develop and ensure adherence to published system architectural decisions and development standards
• Multi-task across several ongoing projects and daily duties of varying priorities as required
• Interact with global technical teams to communicate business requirements and collaboratively build data solutions
Requirements
• 8+ years of development experience
• Expert level in data warehouse design/architecture, dimensional data modeling and ETL process development
• Advanced level development in SQL/NoSQL scripting and complex stored procedures (Snowflake, SQL Server, DynomoDB, NEO4J a plus)
• Extremely proficient in Python, PySpark, and Java
• AWS Expertise – Kinesis, Glue (Spark), EMR, S3, Lambda, and Athena
• Streaming Services – Confluent Kafka and Kinesis (or equivalent)
• Hands on experience in designing and developing applications using Java Spring Framework (Spring Boot, Spring Cloud, Spring Data etc)
 

With Japanese Roots Going Back Over 100 Years, Our Culture Is Founded On The Values Of Our Parent Company spirit

We are proud to say we are an equal opportunity employer and welcome all applicants for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.

Wa – Harmony, Trust, Respect

Makoto – Sincerity, Fairness, Honesty, Integrity

Kaitakusha-Seishin – Pioneering Spirit, Challenge

The Team:
At the Digital Insights practice, we help our clients by building technology solutions that addresses business challenges and improve business outcomes with data-driven insights. As we continue expand our big data team, we are looking for Technical Lead Data engineers who are passionate about technology and want to build a career working on the latest technology platforms.
Position Overview:

AWS Data Engineer is proficient in the development of all aspects of data processing including data warehouse architecture/modeling and ETL processing. The position focuses research on development and delivery of analytical solutions using various tools including Confluent Kafka, Kinesis, Glue, Lambda, Snowflake and SQL Server. AWS Data Engineer must be able to work autonomously with little guidance or instruction to deliver business value.

Position Responsibilities
• Partner with business stakeholders to gather requirements and translate them into technical specifications and process documentation for IT counterparts (on-prem and offshore)
• Highly proficient in the architecture and development of an event driven data warehouse; streaming, batch, data modeling, and storage
• Advanced database knowledge; creating/optimizing SQL queries, stored procedures, functions, partitioning data, indexing, and reading execution plans
• Skilled experience in writing and troubleshooting Python/PySpark scripts to generate extracts, cleanse, conform and deliver data for consumption
• Expert level of understanding and implementing ETL architecture; data profiling, process flow, metric logging and error handling
• Support continuous improvement by investigating and presenting alternatives to processes and technologies to an architectural review board
• Develop and ensure adherence to published system architectural decisions and development standards
• Multi-task across several ongoing projects and daily duties of varying priorities as required
• Interact with global technical teams to communicate business requirements and collaboratively build data solutions
Requirements
• 8+ years of development experience
• Expert level in data warehouse design/architecture, dimensional data modeling and ETL process development
• Advanced level development in SQL/NoSQL scripting and complex stored procedures (Snowflake, SQL Server, DynomoDB, NEO4J a plus)
• Extremely proficient in Python, PySpark, and Java
• AWS Expertise – Kinesis, Glue (Spark), EMR, S3, Lambda, and Athena
• Streaming Services – Confluent Kafka and Kinesis (or equivalent)
• Hands on experience in designing and developing applications using Java Spring Framework (Spring Boot, Spring Cloud, Spring Data etc)
 

With Japanese Roots Going Back Over 100 Years, Our Culture Is Founded On The Values Of Our Parent Company spirit

We are proud to say we are an equal opportunity employer and welcome all applicants for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.

Wa – Harmony, Trust, Respect

Makoto – Sincerity, Fairness, Honesty, Integrity

Kaitakusha-Seishin – Pioneering Spirit, Challenge

Apply for “Sr. Java Engineer” position

Apply for “Sr. Java Engineer” position

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Suspendisse varius enim in eros elementum tristique. Duis cursus, mi quis viverra ornare, eros dolor interdum nulla, ut commodo diam libero vitae erat. Aenean faucibus nibh et justo cursus id rutrum lorem imperdiet. Nunc ut sem vitae risus tristique posuere.