Senior Data Engineer - Consumer Product
- Full-time
Company Description
Twitter serves the public conversation because conversation is a force for good in the world. The opportunity to help the world connect, debate, learn, and solve problems is what draws us to careers at Twitter, and it’s what keeps us here.
Job Description
Who We Are:
Twitter users generate many terabytes of data every day; Twitter engineers run hundreds of experiments; Twitter Data Engineers build data pipelines and data processes that calculate metrics and scale increasingly sophisticated models of users and content.
The Data Science team at Twitter is at the intersection of all this data and strives to make it actionable to all business units around Twitter. Data Engineers work alongside Data Scientists analyze this data via observational analyses, trend analyses, modeling, and new measurement strategies. We also implement metrics to track the impact of new product experiments and more generally find ways to make very large scale data approachable to guide our decisions.
What You’ll Do:
Twitter has very large and complex datasets. As a Twitter Data Engineer you will build datasets and make them accessible to our partner teams by writing great production code to simplify the complexity. Your work will enable Product Managers and other decision-makers across the company to bring together insights and inform our product and strategy. In every decision that you influence, you will see the product improve and be more valuable to Twitter users.
We are trying to improve Twitter. To improve something, we need to be able to measure it. As a Data Engineer you will enable better measurements and ensure measurement accuracy so that we know where we are doing well and where we want to improve.
As such, you will:
Design, develop, and launch extremely efficient and reliable data pipelines to move data and to provide intuitive analytics to our partner teams.
Make Twitter-scale data more discoverable and easy to use for Data Scientists and Analysts across the company.
Collaborate with other engineers and Data Scientists to discover the best solutions.
Support your colleagues by reviewing code and designs.
Diagnose and solve issues in our existing data pipelines and envision and build their successors.
Who You Are:
You want to be part of a community of the most talented, forward-thinking Data Scientists and Engineers in the industry. You are a strong Scala or Java developer. You demonstrate clear and concise communication and data-driven decision-making.
You are passionate about learning or growing your expertise in some or all of the following:
Data Pipelines
Data Warehousing
Statistics
Metrics Development
Qualifications
B.S. and/or M.S. in Computer Science or a related technical field, or equivalent experience
4+ years of experience in either data infrastructure or backend systems
Strong understanding of SQL
Broad knowledge of the data infrastructure ecosystem
Experience with Hadoop or other MapReduce-based architectures
Experience working with large data volumes
Good understanding of one or more of the following: Scala, C++, or Java
Experience with any of the following is a plus:
Scalding
Full Stack Development
Presto or Hive
Spark
Additional Information
We are committed to an inclusive and diverse Twitter. Twitter is an equal opportunity employer. We do not discriminate based on race, ethnicity, color, ancestry, national origin, religion, sex, sexual orientation, gender identity, age, disability, veteran, genetic information, marital status or any other legally protected status.
San Francisco applicants: Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records