Cloud Data Engineer

  • Full-time

Company Description

Twitter serves the public conversation because conversation is a force for good in the world. The opportunity to help the world connect, debate, learn, and solve problems is what draws us to careers at Twitter, and it’s what keeps us here.

The Core Ads Engineering team has an incredibly large part to play in the company's ambitious goal to hit $10b in total revenue and we’re looking to grow our Engineering teams across the internal pillars to help drive our internal execution, vision, culture and fun. We are looking for partners to help scale the org; to be principled, engaging, and up-level teams.

Current Teams Hiring:

As data engineers in Revenue Science, our mission is to build real-time and offline solutions to make data accessible and reliable while leveraging the largest-scale data processing technologies in the world -- and then apply them to the Revenue’s most critical and fundamental data problems.

Learn more about some of the challenges we tackle on this team:

Job Description

You are passionate about data and driven to take the data organization challenges at the scope of entire Twitter’s Revenue.

As a member of the Data Engineering team, you will build and own mission-critical data pipelines that are ‘source of truth’ for Twitter’s fundamental revenue data, as well as modern data warehouse solutions, while collaborating closely with Ads Data Science team.

You will be a part of an early stage team and have a significant stake in defining its future with a considerable potential to impact all of Twitter’s revenue and hundreds of millions of users.

You will be among the earliest adopters of bleeding-edge data technologies, working directly with Revenue Science and Revenue Platforms teams to integrate your services at scale.

Your efforts will reveal invaluable business and user insights, leveraging vast amounts of Twitter revenue data to fuel numerous Revenue teams including Ads Analytics, Ads Experience, Ads Data Science, Marketplace, Targeting, Prediction, and many others.

Qualifications

  • Strong programming and algorithmic skills
  • Experience with data processing (such as Hadoop, Spark, Pig, Hive, MapReduce etc).
  • Proficiency with SQL (Relational, Redshift, Hive, Presto, Vertica)


Nice to have:

  • Experience writing Big Data pipelines, as well as custom or structured ETL, implementation and maintenance
  • Experience with large-scale data warehousing architecture and data modeling
  • Proficiency with Java, Scala, or Python
  • Experience with GCP (BigQuery, BigTable, DataFlow)
  • Experience with Druid or Apache Flink
  • Experience with real-time streaming (Apache Kafka, Apache Beam, Heron, Spark Streaming)
  • Ability in managing and communicating data warehouse project plans to internal clients

Additional Information

We are committed to an inclusive and diverse Twitter. Twitter is an equal opportunity employer. We do not discriminate based on race, color, ethnicity, ancestry, national origin, religion, sex, gender, gender identity, gender expression, sexual orientation, age, disability, veteran status, genetic information, marital status or any legally protected status.

San Francisco applicants: Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Privacy Policy