Staff Software Engineer, Real Time Storage (Blobstore Team)

  • Full-time

Company Description

Twitter is what’s happening and what people are talking about right now. For us, life's not about a job, it's about purpose. We believe real change starts with conversation. Here, your voice matters. Come as you are and together we'll do what's right (not what's easy) to serve the public conversation.

Job Description

Who We Are

Twitter’s storage infra organization (~70 people) is made up of 4 teams - Blobstore, Graph, Manhattan and Cache. We’re currently hiring for Manhattan and Graphstore in EMEA and Blobstore in the US.

Manhattan:

Twitter’s globally distributed, real-time communications network generates trillions of events and petabytes of data per day. Manhattan provides the key-value storage layer that enables products and services at Twitter to be fast, highly scalable, and always available.

Graphstore:

Graph Storage stores relationships between users or tweets, such as follows, blocks, mutes, favorites, retweets, replies, and so forth. We have ~8 trillion edges and hit 65M QPS each day. Our goal is to enable our customers to think Graph, providing them with storage infrastructure that can scale to their needs.

Blobstore:

The Blobstore team stores and serves petabytes of blob data, including the media uploaded by our users. This is critical for Twitter's success, and an opportunity to directly make a positive impact on the experience of every Twitter user.

What You'll Do

Today, Twitter operates in 2 on-premise datacenters. As part of Twitter strategy, we would like to run a cloud datacenter for real-time serving needs. In addition to that, we are focussed on delivering storage on compute on premise (migrating from Apache Mesos to Kubernetes), which will save run-the-business costs, and reduce our overall cost of operation.

You will help us with strategy and delivery of both initiatives, focussing on running storage on Kubernetes and migration to the cloud. You will work closely with Twitter’s compute team. 

Qualifications

  • 6+ years experience developing and architecting large scale distributed systems

  • Experience building strategy and delivering on migrating large scale distributed systems to the cloud

  • Experience with Kubernetes, Aurora/Mesos or similar cloud infrastructure frameworks

  • Experience leading initiatives, mentoring other engineers, and leveling-up teams

  • Strong software engineering practices (e.g. coding, unit testing, code reviews, design documentation)

  • BS, MS, or Ph.D. in Computer Science or similar technical field

  • Previous experience with storage systems, either as a developer or a power user

Additional Information

We are committed to an inclusive and diverse Twitter. Twitter is an equal opportunity employer. We do not discriminate based on race, ethnicity, color, ancestry, national origin, religion, sex, sexual orientation, gender identity, age, disability, veteran status, genetic information, marital status or any other legally protected status. 

San Francisco applicants: Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.

Privacy Policy