Based out of Silicon Valley, our client leverages disruptive technology in data and digital to give clients competitive advantage. Our service model caters to clients in a slew of domains such as consulting, ideating, the art of the possible, rapid prototyping. Big Data Analytics and Digital Experiences such as IoT, Wearables, UX, Mobile,IP-led solutions and engineered software solutions. Our 2,500 odd employees serve more than 350 global clients, a significant number of whom are Fortune 500

Title                                             : Spark Developer

Location                                     :  Los Angeles, CA

Nature of employment              : Full time, Permanent position or Contract (w2 or Corp-Corp) is also fine

Job Description:

·       Should lead and guide a team of Spark developers Implantation of Spark Core, Sparks and Spark Streaming

·       Experience on Apache Kafka Integration with Apache Spark Implementing security for Spark Applications

·       Solid understanding of big data environments

·       Working with Spark in combination Hadoop Ecosystem

·       Proven experience processing and aggregating over billions of rows

·       Good working knowledge on Hive

·       Experience publishing RESTful API s to enable real-time data consumption

·       Solid hands-on experience with Spark Core, Spark Streaming, SparkSQL for real-time data processing (at least one year proven experience)

·       Developing Hive UDFs in Python or Java and integrating with Spark

·       Integrating Spark with RDBMS (at least two mandatory)

·       Working with Apache Kafka Should be able to fine tune performance of Spark applications

·       Build and maintain performant, fault-tolerant, scalable distributed software systems

·       Demonstrated success working with cross-functional teams Well-versed in the development challenges inherent with highly scalable, highly available, and highly resilient systems

Spark

All your information will be kept confidential according to EEO guidelines.