The Twitter Service organization creates meaningful connections with our customers that promote healthy exchange in the public conversation. We do this by developing customer support solutions at scale in a rapidly changing and global environment. Whether we're optimizing operations, guarding the ability of customers to safely use Twitter through investigation of and  enforcement against those who violate our terms, or driving content and support channel strategies, we're with our customers every step of the way.

The Human Computation team’s mission is to scale and streamline production of high-quality labeled data and context-based insights & measurement, in support of Machine Learning, offline metrics, and all other human-in-the-loop initiatives across Twitter. Our work directly impacts the quality and consumption of our most popular products, helping to prevent the abuse and misuse of Twitter, and delighting our ever expanding global user base. 

We’re looking for a Sr. Data Analyst who has a proven track record of building and maintaining data pipelines, drawing business-critical insights from large data sets, developing rater quality heuristics, modeling agent cost and efficiency, and expertise in human-in-the-loop data analysis. The right person would have experience driving projects/initiatives for Human Computation/ Data Annotation and working cross-functionally (across Engineering, Product, Research, Legal, Operations) in support of large company objectives. They would also have experience working with outsourced partners, and effectively navigating a challenging, fast-paced, and dynamic daily working environment. 

Responsibilities:

• Independently drive goals and initiatives related to data, annotated data quality, and associated systems to ensure support for Machine Learning projects and accurate qualitative measurements.

• Design and implement new data schemas on BigQuery, and manage the centralized labeled data store to ensure it is PDP compliant, easily discoverable, and reusable. 

• Build automated mechanisms to measure the quality, and dashboards to present metrics and insights for Human Computation’s data operations. 

• Serve as the data strategy consultant for Machine Learning and other data/insights needs across Twitter, by identifying opportunities to reuse existing data. 

• Translate patterns & insights into recommended areas for exploration, and drive the development of various data initiatives that are essential to run our service effectively, efficiently, and at scale. 

• Experiment with internal and external 3rd party tools and document processes with potential team-wide relevance. 

• Review and provide feedback on technical design documents, and write clear & concise technical documentation and obtain buy-in from leadership across a wide variety of stakeholder teams. 

• Coach and mentor junior members of the team, set goals, and drive accountability for their deliverables. 

• Review and/or process sensitive and potentially disturbing content including but not limited to pornographic images, child pornography, vulgar language, hate speech, violent threats, & other graphic images.

• MS in Computer Science or related field.

• Minimum 5+ years of experience with Human Computation/human-in-the-loops systems or quantitative analysis, large scale data extraction, and statistics. 

• Hands-on experience utilizing SQL, Spark, Scalding, R and Python and other proprietary data extraction and analysis tools.

• Proficient in data visualization tools (e.g, Tableau, Zeppelin) to share ongoing insights and build monitoring mechanisms for important metrics.

• Strong written and visual communication skills for documenting and sharing methodologies and processes for wider utilization.

• Experience leading and coaching junior data analysts. Prior people management experience is a plus. 

Who you are:

• You are a self-starter with a passion for making an impact & driving innovative change.

• You are accountable for your role, your work, and your commitments

• You are able to grasp business problems and design technical data-based solutions that are implementable, efficient, and scalable

• You are comfortable in interpreting complex data signals and presenting to technical and non-technical audiences.  

• Experienced in performing analysis on big data sets and coming up with actionable insights.

• Active, passionate Twitter user with a strong interest in social media. Interest in Twitter’s products and mission, and about the role machine learning could play towards advancing them.

• Empathetic to and mindful of the unique challenges on the rater side of HITL.

We are committed to an inclusive and diverse Twitter. Twitter is an equal opportunity employer. We do not discriminate based on race, color, ethnicity, ancestry, national origin, religion, sex, gender, gender identity, gender expression, sexual orientation, age, disability, veteran status, genetic information, marital status or any legally protected status. All of your information will be kept confidential according to EEO guidelines.

Notice (Colorado Equal Pay for Equal Work Act)

The expected salary range for this role to be performed in Colorado is USD$146,000.00 - USD$204,000.00. Starting pay for the successful applicant will depend on a variety of job-related factors, which may include education, training, experience, location, business needs, or market demands. This range may be modified in the future.

This job is also eligible for participation in Twitter’s Performance Bonus Plan and Equity Incentive Plan subject to the terms of the applicable plans and policies.

Twitter offers a wide range of benefits to U.S.-based employees, including medical, dental, and vision insurance, 401(k) program with employer match, generous time off for vacation, sick time, and parental leave. Twitter's benefits prioritize employee wellness and progressive support to our diverse workforce.