Sr. Data Engineer - Google Cloud Platform
- Full-time
Company Description
At Twitter our Business Intelligence team focuses on implementing and supporting applications to help our internal customers meet their operational needs. We are responsible for establishing processes for continual improvement, crafting data and reporting solutions that scale and partnering with multiple business teams on a project-to-project basis. Our mission is to keep our business running efficiently while maintaining a balanced application environment.
Job Description
Who You Are:
To continually strengthen our growing team, we are looking for an experienced Data Architect specializing in Google Cloud Platform with experience in designing and building data frameworks, architecture design, development, capacity and performance planning, security and data access, documentation of deployed frameworks, ongoing evaluations of core technologies. Lead efforts cross functionally in adhering to standards and best practices. You will lead and help shape our journey of migrating to GCP. You will partner with business and engineering teams to prioritize requests and deliver results against time-sensitive priorities. You are equally comfortable working with business partners to define requirements and using a broad range of data and BI tools. You thrive in a fast-paced collaborative environment. Come help us better serve Twitter's 100's of millions of users with an opportunity to tackle outstanding data and business challenges!
Qualifications
Required skills:
BA/BS in Computer Science or related field
7+ years of data engineering or business intelligence experience of which 5+ years in architecting big data solutions using GCP
Experience in large implementations of Google Cloud Platform - Compute Engine, Dataproc, Hadoop, BigQuery, Datastore, Cloud Run, Cloud Run, Cloud Data Fusion, Dataflow, etc.
Demonstrated ability with Vertica, MySQL, Google BigQuery or other database systems
Ability writing advanced SQL
Experience programming in Python, Java, Scala, Scalding, Terraform or modern programming languages
AirFlow, DataFlow and other scheduling tools
Outstanding communications and interpersonal skills
Desired skills:
Google Cloud Platform certified
Migrating large data sets with complex data pipelines to GBQ
Deep understanding of Access control and Data Security
Ability to lead Data/BI/Analytics project and deliver results with customer first approach
Experience in custom ETL design, implementation and maintenance
Experience working in Cloud or on prem Big Data and analytics platforms
Experience designing and implementing real time data pipelines
Additional Information
All your information will be kept confidential according to EEO guidelines.
Here’s all the legal good stuff: We are committed to an inclusive and diverse Twitter. Twitter is an equal opportunity employer. We do not discriminate based on race, ethnicity, color, ancestry, national origin, religion, sex, sexual orientation, gender identity, age, disability, veteran, genetic information, marital status, or any other legally protected status.
San Francisco applicants: pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
Notice (Colorado Equal Pay for Equal Work Act)
The expected salary range for this role to be performed in Colorado is USD$146,000.00 - USD$204,000.00. Starting pay for the successful applicant will depend on a variety of job-related factors, which may include education, training, experience, location, business needs, or market demands. This range may be modified in the future.
This job is also eligible for participation in Twitter’s Performance Bonus Plan and Equity Incentive Plan subject to the terms of the applicable plans and policies.
Twitter offers a wide range of benefits to U.S.-based employees, including medical, dental, and vision insurance, 401(k) program with employer match, generous time off for vacation, sick time, and parental leave. Twitter's benefits prioritize employee wellness and progressive support to our diverse workforce.