Staff Software Engineer - Real Time Storage
- Full-time
Company Description
Twitter is what’s happening and what people are talking about right now. For us, life's not about a job, it's about purpose. We believe real change starts with conversation. Here, your voice matters. Come as you are and together we'll do what's right (not what's easy) to serve the public conversation.
Job Description
Who We Are
Twitter’s storage infra organization (~70 people) is made up of 4 teams - Blobstore, Graph, Manhattan and Cache. We’re currently hiring for Manhattan and Graphstore in EMEA and Blobstore in the US.
Manhattan:
Twitter’s globally distributed, real-time communications network generates trillions of events and petabytes of data per day. Manhattan provides the key-value storage layer that enables products and services at Twitter to be fast, highly scalable, and always available.
Graphstore:
Graph Storage stores relationships between users or tweets, such as follows, blocks, mutes, favourites, retweets, replies, and so forth. We have ~8 trillion edges and hit 65M QPS each day. Our goal is to enable our customers to think Graph, providing them with storage infrastructure that can scale to their needs.
Blobstore:
The Blobstore team stores and serves petabytes of blob data, including the media uploaded by our users. This is critical for Twitter's success, and an opportunity to directly make a positive impact on the experience of every Twitter user.
What You'll Do
Today, Twitter operates in 2 on-premise data centers. As part of the Twitter strategy, we would like to run a cloud data center for real-time serving needs. In addition to that, we are focussed on delivering storage on compute on-premise (migrating from Apache Mesos to Kubernetes), which will save run-the-business costs, and reduce our overall cost of operation.
You will help us with the strategy and delivery of both initiatives as well as help define the roadmap for the team and product. You will also be a technical lead for the UK team, providing technical review and mentoring to other engineers.
Qualifications
6+ years experience developing and architecting large scale distributed systems
experience leading initiatives, mentoring other engineers, and leveling-up teams
strong software engineering practices (e.g. coding, unit testing, code reviews, design documentation)
BS, MS, or Ph.D. in Computer Science or similar technical field
previous experience with storage systems, either as a developer or a power user
experience with Kubernetes, Aurora/Mesos or similar cloud infrastructure frameworks is a plus
Additional Information
We are committed to an inclusive and diverse Twitter. Twitter is an equal opportunity employer. We do not discriminate based on race, ethnicity, color, ancestry, national origin, religion, sex, sexual orientation, gender identity, age, disability, veteran, genetic information, marital status or any other legally protected status.
San Francisco applicants: Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.