Twitter is a growing organization that faces interesting new challenges as it evolves. The IT Enterprise Applications Team focuses on the building blocks of applications and tools that improve the productivity of employees across the company.

Who We Are

At Twitter, our IT Enterprise Applications team focuses on implementing, developing, and supporting applications to help our internal customers meet their operational/business needs. We are responsible for establishing processes for continual improvement, guiding administration, and partnering with multiple stakeholders on a project-to-project basis. Our mission is to keep our business running effectively while maintaining a healthy application environment.

What You’ll Do

In this role, you will implement large-scale, complex pipelines and put data security first when designing processes. We are looking for an experienced data engineer with a strong background in working with complex data and driving technology stack decisions. You will partner with business and engineering teams to build mission-critical data pipelines and products that meet government/privacy regulations worldwide. 

• Understand and articulate enterprise architecture, evaluation, design, integration, documentation, and development.

• Write data pipelines using SQL(e.g. bigquery, presto) and scripting languages (e.g., Scala, Python, R)

• Manage security and privacy requirements, address data quality issues, and drive a rigorous governance process

• Understand the business and translate data needs into technical requirements. 

• Outline, develop, and launch extremely efficient and reliable data pipelines tailor-made to address the needs of the customers

Who You Are

We are looking for qualified engineers with a proven background in data pipeline tools, data analysis, ETL, and data modeling skills. You have excellent interpersonal communication skills, possess a broad range of database-related experience, are team-oriented, and thrive in a fast-paced environment. You are passionate about learning and growing your expertise in data engineering best practices and technology.

Qualifications 

• 4+ years industry experience in data engineering or adjacent roles

• Strong understanding of SQL

• Solid experience with a high-level programming language (e.g., Python, Go, Java, Scala, C#, C++, etc.)

• Experience working with large data volumes

• Experience working with cloud data providers such as AWS, Google Cloud, Azure, etc.

• Experience with orchestration tools like Airflow, Autosys, etc.

• Eager and able to understand the business and present possible solutions to data-related issues in a concise way

• Assisting in data analysis to drive proactive planning for future development

• Participating in data modeling & system architecture exercises

Additionally, an ideal candidate would have:

• A strong analytical nature with a focus on performance optimization

• Experience working with GDPR/CCPA/Privacy regulations

• Experience working with Hadoop infrastructure 

• Hands-on experience with database / systems administration

• Familiarity with systems-automation tools such as puppet or chef

• Ability to communicate effectively with business partners, engineers, and analysts

• A positive attitude and interest in working as part of a team

We are committed to an inclusive and diverse Twitter. Twitter is an equal opportunity employer. We do not discriminate based on race, color, ethnicity, ancestry, national origin, religion, sex, gender, gender identity, gender expression, sexual orientation, age, disability, veteran status, genetic information, marital status or any legally protected status. All of your information will be kept confidential according to EEO guidelines.