The Data Engineer will join the Data Infrastructure team that powers analytics, experimentation, and ML feature engineering to create a virtual assistant.
Must Have:
Plus:
The Data Engineer’s primary responsibility will be to maintain an application which will require a proficiency in Spark with the ability to write Map Reduce jobs, work with Hive and various other big data technologies, and properly use the data being processed. Building pipelines and being a strong programmer is a must, as the Spark applications are developed in Scala. Performance tuning of the Spark application will be vital to make it run efficiently. This Spark application is complex and will require the candidate to have an advanced understanding of its functions so that the performance tuning can be done accordingly. Next they will look for potential optimizations to the application.
Lorem ipsum dolor sit amet, consectetur adipiscing elit. Suspendisse varius enim in eros elementum tristique. Duis cursus, mi quis viverra ornare, eros dolor interdum nulla, ut commodo diam libero vitae erat. Aenean faucibus nibh et justo cursus id rutrum lorem imperdiet. Nunc ut sem vitae risus tristique posuere.