Software Engineer, Health Data and Measurement
- Full-time
Company Description
Are you an engineer who’s passionate about defending online users against abuse, spam, and manipulation?
Health is Twitter’s top priority and we need your help.
We build and maintain the large-scale, low latency distributed systems that power Twitter’s real-time feature computation, rule engine, and data exploration tools that keep spam, abuse, and adversarial accounts off of Twitter.
If you want to work on a team that does some of the most interesting technical work at Twitter, protects people from real harm, and has executive-level visibility, then this is the team for you.
Job Description
Who We Are
The mission of the Health team at Twitter is to keep our users safe from negative experiences in a highly adversarial environment. This aligns with our company's #1 priority: growing the collective health, openness, and civility of public conversation.
The Health Data and Measurement team is responsible for measuring unhealthy activity on Twitter, users’ perceptions of such activity, and the impact of Twitter’s work to reduce unhealthy activity. The team is also responsible for designing, implementing and maintaining data pipelines, and driving data best practices around the organization.
We use human computed labels at scale and in a fully automated manner for measurement. The team closely partners with many teams in the Health org to understand and serve our growing measurement needs. We work on some of the world’s most highly-scaled distributed systems, handling hundreds of millions of tweets, engagements, and ML powered decisions each day.
This team is foundational to making the most out of our data and to help the Health org set the direction, and measure and accelerate its pace of progress towards improving the Health of the public conversation.
Qualifications
What You’ll Do
Here are some examples of what you’ll find yourself doing daily:
Lead development of the Health metrics platform so that metrics reach the highest levels of suitability, usability, and trustworthiness.
Evolve the metrics platform to a point where adding new metrics becomes self-serve.
Drive the organization’s trust in our metrics methodology
Ensure the organization’s metrics needs are fully met on an ongoing basis
Ensure datasets and data pipelines reach the highest levels of discoverability, ease of use and availability.
Directly contribute to the design and code of data pipelines operating on production data
Improve approaches to efficiently handle ever-increasing volume of data
Lead end-to-end design and implementation of common components that accelerate and improve our ability to write efficient and reliable data pipelines
Maintain efficiency and reliability of production of the critical datasets
Evaluate and propose the best tooling and processes for data access and analysis
Provide design and review support to the engineering teams working on data processing
Continuously evaluate team’s processes to maintain a positive and efficient engineering culture
Who You Are
You have experience in the full life-cycle of building new metrics from scratch - from customer need, to selecting the right statistical approach to measurement, to the implementation of the metric from massive data, to educating the customer on how best to use the metric.
You have familiarity with the standard statistical underpinnings of measurement: sampling methodologies, computing confidence intervals, inter-annotator agreement.
You have experience working in an environment that supports data analysis, experimentation, and Machine Learning modeling or its integration into a product.
You possess a proven understanding of backend and distributed systems and strong experience working with MapReduce-based architectures.
You have a broad knowledge of the data infrastructure ecosystem and experience in working with large scale data.
You are familiar with standard software engineering methodology, e.g. unit testing, code reviews, design documentation.
You enjoy working in a collaborative environment and interact effectively with others.
You ground your decisions with data and reasoning and can adapt to new information to make informed choices.
You bring thoughtful perspectives, empathy, creativity, and a positive attitude to solve problems at scale.
You’re willing to be mentored and to mentor others.
Additional Information
We are committed to an inclusive and diverse Twitter. Twitter is an equal opportunity employer. We do not discriminate based on race, ethnicity, color, ancestry, national origin, religion, sex, sexual orientation, gender identity, age, disability, veteran, genetic information, marital status or any other legally protected status.
San Francisco applicants: Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records