Twitter is what’s happening and what people are talking about right now. For us, life's not about a job, it's about purpose. We believe real change starts with conversation. Here, your voice matters. Come as you are and together we'll do what's right (not what's easy) to serve the public conversation.

Who We Are:

We believe in the power of bringing multiple perspectives together. The Machine Learning Ethics, Transparency & Accountability research team operates at the intersection of Machine Learning, Social Science, Policy, Legal and User Research in collaboration with numerous partners from across Twitter.

Twitter is looking for an experienced individual to lead a new practice within META to conduct risk assessments and audits of our algorithmic systems at Twitter. The Machine Learning Ethics, Transparency & Accountability research team, known as META, sits within Cortex, Twitter’s centralised Machine Learning organisation, where it is responsible for investigating the fairness and transparency of Twitter’s automated algorithmic decision making system and addressing the harms they may introduce.

Our Mission:

Twitter’s ML systems are fair, transparent, and accountable. We have easy to use tools, well established investigation methodologies and frameworks to understand and mitigate the bias in our products powered by ML. 

What You’ll Do:

As ML Ethics Red Team lead at Twitter META, you will be growing a new practice within the company. The team’s remit is to conduct technical audits of our models at Twitter to ensure we proactively identify and address algorithmic harms. This team is new, and the right lead will be able to deliver the following: 

• Standardized and thorough sociotechnical assessments for our models at Twitter

• Successful collaboration with ML developer teams to conduct and complete assessments in a timely manner

• Document and catalog ethical issues discovered during assessments

• Ensure identified risks and harms are appropriate addressed

• Research and apply new and novel tactics, techniques, and procedures that are applicable to ML ethics considerations

• Collaborate with META engineers to build tooling to automate portions of assessments

• Identify and hire the right team  

• Author an annual model risk report

In addition, the lead will be working with META’s Director, Dr. Rumman Chowdhury, to build our bias bounty program. This role holds significant opportunities to shape the Responsible ML industry.

Who You Are:

We’re looking for an experienced technical leader with domain expertise in ML. You should have both a solid technical understanding of risk assessment or audit work, either in ML Ethics or a related field. You also have experience building and growing a team. ML Ethics as an applied industry is in it’s developmental infancy. A successful candidate is comfortable with developing new and revolutionary products, sometimes the first in industry. 

As the Machine Learning Ethics, Transparency & Accountability research team is a part of our centralised Machine Learning organisation, you should also be experienced with cross-functional collaboration with product leaders, ML Engineers, legal, risk & compliance and related functions.

If this sounds like it might be you, you probably have:

• Technical expertise in Machine Learning, including expertise in ML ethics, fairness & transparency 

• A validated ability to collaborate cross-functionally with distributed teams.

• Experience in applied audit or assessment work in algorithmic systems or in a related field

• Excellent interpersonal skills which allow you to excel at being an advocate for your teams and charter across Twitter

• A demonstrated ability to simplify and present technical concepts to non-technical partners to explain impact and drive support

• A strong growth mentality

Requirements:

• 2+ years of prior audit or assessment experience within the field of Machine Learning ethics, fairness & transparency, or a related industry

• 8-10 years of ML experience

• Outstanding written and verbal communication skills.

All your information will be kept confidential according to EEO guidelines. 

Equal Opportunity Statement

We are committed to an inclusive and diverse Twitter. Twitter is an equal opportunity employer. We do not discriminate based on race, color, ethnicity, ancestry, national origin, religion, sex, gender, gender identity, gender expression, sexual orientation, age, disability, veteran status, genetic information, marital status or any legally protected status

We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.

Notice (Colorado Equal Pay for Equal Work Act)

The expected salary range for this role to be performed in Colorado is USD$217,000.00 - USD$304,000.00. Starting pay for the successful applicant will depend on a variety of job-related factors, which may include education, training, experience, location, business needs, or market demands. This range may be modified in the future.

This job is also eligible for participation in Twitter’s Performance Bonus Plan and Equity Incentive Plan subject to the terms of the applicable plans and policies.

Twitter offers a wide range of benefits to U.S.-based employees, including medical, dental, and vision insurance, 401(k) program with employer match, generous time off for vacation, sick time, and parental leave. Twitter's benefits prioritize employee wellness and progressive support to our diverse workforce.