eBay

Here are the Job Details:

Position: Senior Spark SQL Data Engineer

Location: San Jose, California, 95131

Duration: 6 months

Summary

Client is undergoing a large-scale move to Spark on Hadoop and is looking for a Senior Spark SQL Data Engineer. The person working in this role will be embedded within critical internal customer teams to help them transition from Teradata to the Spark environment. This will be done by translating and optimizing existing queries to run efficiently on Spark based on expert knowledge and a solid understanding of the underlying Hadoop data structures.

Roles & Responsibilities

You should have proven expertise in Spark SQL. In addition, you will have deep expertise in an Ubuntu Linux environment, hands on development, scripting, and systems skills. As well, you will have previously conducted extensive query performance tuning on Spark.

Preferred Qualifications

• We would prefer you are fluent in Bash, Perl and/or Python script development
• Knowledgeable in Open Source technologies in the Hadoop ecosystem
• Phenomenal analytical skills are a requirement

• Expertise in Spark SQL
• Expertise in Hadoop
• BSCS and at least 8 years of related Hadoop work experience, focusing recently on Spark

All your information will be kept confidential according to EEO guidelines.