Senior Staff Software Engineer - Search

  • Full-time

Company Description

Twitter Search is the search engine for Twitter: it’s a product tens of millions of people employ every day hundreds of millions of times to find the most relevant content on Twitter and beyond. Built on top of a super real-time search engine that contains more than a trillion tweets and hundreds of millions of users, it has a tough mission to bring the most relevant tweets, users and other entities to the user based on their search query and the context.

Job Description

Search is the key component and platform for upcoming Twitter products. We are looking for an outstanding engineer with a deep background in Search and information retrieval to help us roadmap and build out a future generation of information retrieval system in Twitter. Search Engines have been around for many years, but new challenges are coming up in this era of the new Internet, where information is produced, propagated and consumed in more diverse ways than ever before. Here are some of the questions we tried to answer and you can help:

  • What would be a new modern software architecture to collect, store, understand and serve the hybrid content on a social media platform to satisfy users’ information needs?

  • How do we create an open platform that not only accelerates our own development but also empowers others to also build products on top of Search?

  • How do we address the ever-increasing production and operation needs of the machine learning components in the system? How should we utilize machine learning for the infrastructure itself?

  • How do we create a way to build an open Internet-scale system with evolution in design, allowing it to deal with future growth, expansions, splits, and retirements naturally?

 

Who We Are 

Twitter Search is a group of distributed teams. Our diverse and dynamic member engineers, data scientists, product managers span across San Francisco, New York and London. We work closely together in multiple initiatives and projects and collectively operate and maintain a large Twitter Search system, and collaborate with a wide range of teams in Twitter.

What you Will Do

  • Work across teams and functions -- software engineers, ML engineers, data scientists, researchers, and product managers to understand user problems and build engineering solutions, create roadmaps. Lead and drive the communication, building consensus and plan.

  • Architect, design, implement, deploy and maintain multi-component online and offline services, pipelines, platforms and software libraries to serve the business needs of Twitter Search, driving the engineering life cycle.

  • Work with ML engineers and related teams to integrate ML components into the system and solve their performance issues.

  • Improve existing systems, identify performance bottleneck and tech debt, deal with legacy systems and drive to simplify and modernize them, accelerating the developments.

  • Provide mentorship to more junior engineers, conduct code reviews, design reviews. Help design training materials and programs to elevate the engineering ability of one or more teams.

  • Help design processes, protocols and establish best practices for development and operation, to improve efficiency and stability.

  • Work with ML Engineers, data scientists and PMs to design, conduct and analyze experiments and test product hypotheses.

  • Work with organization leadership to help establish long-term vision, strategy and roadmap for one or more teams.

  • Serve as a bridge between Twitter and the industry, bring the state-of-the-art practice and expand the engineering scope of Twitter Search and Twitter overall.

  • Conduct interviews and help setting up or improving the rubrics for engineers of different levels.

Qualifications

Who You Are

  • 10+ years or equivalent of experience working and leading the engineer efforts in Internet-scale consumer products, preferably in Search Engine, Recommendation System, NLP, or other Information Retrieval related fields. Has experience working on Search Engine components or similar systems, this includes ingestion/crawling, indexing, query processing, retrieval, ranking and presentation.

  • Has experience technically leading one or more teams on multiple projects, managing development life cycles over multiple quarters. Has good communication skills.

  • Has experience architecting and developing Internet-scale systems with multiple components in microservice architecture, collaborating with multiple teams and

  • Has experience integrating significant Machine Learning components into the system and successfully and efficiently productionizing them. Knowledge in ML fundamentals preferred.

  • Has experience maintaining a production system with significant traffic and understanding performances issues.

  • Has experience mentoring other engineers at Senior and above levels.

  • Has experience doing interviews and hiring engineers at Senior and above levels.

 

Additional Information

We are committed to an inclusive and diverse Twitter. Twitter is an equal opportunity employer. We do not discriminate based on race, ethnicity, color, ancestry, national origin, religion, sex, sexual orientation, gender identity, age, disability, veteran, genetic information, marital status or any other legally protected status.

San Francisco applicants: Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records

By clicking the link above or any third-party link within this posting, you are leaving this site and going to a third-party website where the third-party website's terms and privacy policy apply

Privacy Notice