Staff Engineer - ML Platform Cortex

  • Full-time

Company Description

Twitter is what’s happening and what people are talking about right now. For us, life's not about a job, it's about purpose. We believe real change starts with conversation. Here, your voice matters. Come as you are and together we'll do what's right (not what's easy) to serve the public conversation.

Job Description

 

Twitter is what’s happening and what people are talking about right now. For us, life's not about a job, it's about purpose. We believe real change starts with conversation. Here, your voice matters. Come as you are and together we'll do what's right (not what's easy) to serve the public conversation.

Cortex empowers internal teams to efficiently leverage ML by providing a platform and by unifying, educating, and advancing the state of the art in ML technologies within Twitter.

We win when our customers win by helping our users stay informed, share and discuss what matters; by serving the public conversation. We’re building an AI-first company and every major initiative is increasingly dependent on the successful application of machine learning. Cortex is at the nexus of this evolution. Our team of ML software engineers is constructing one of the strongest machine learning platforms in the world, based on the latest ML industry practices, deep learning, engineering excellence, and powered by Twitter data at scale.

You will join one of the Cortex Platform teams. We develop tools and infrastructure that standardizes machine learning development at Twitter on a common platform. This allows ML engineers in our customer teams to do their work better and faster and with a more modern stack that follows broad industry trends.

More specifically, Cortex Platform’s vision is to maximize the velocity of ML Practitioners. We believe our new vision has the potential for a 10x productivity improvement of ML Practitioners within two years.

In this role, we are hiring for 3 different focus areas within Cortex ML Platform:

  • ML Data: Enabling teams at Twitter to quickly experiment with new features, data management and data preparation. Providing tools to help customers understand their datasets, and providing better data engineering capabilities. Product: Feature Store.

  • ML Experimentation: Enabling teams to quickly test and iterate on their ML hypotheses via ML training capabilities, first class notebook solution and an ML pipeline solution. Providing ML infrastructure for offline workloads. Product: ML Notebooks, ML Training jobs, ML Pipelines, Kubeflow

  • ML Serving: Enabling teams at Twitter to serve ML models at high scale in production while ensuring performance, reliability and ease of use. Product: ML Prediction Services, Hosted Services

What you’ll do

We’re looking for a team member to join Cortex Platform in a Staff engineer capacity. Across the industry to date, ML tooling and ML workflows remain fragmented and highly bespoke. Unifying and consolidating the toolchain along the ML lifecycle and thereby establishing standard methodologies for ML engineers and modelers we believe can deliver order-of-magnitude gains in productivity. If this sounds like you, come join us and turn this industry-leading opportunity into a company-wide competitive advantage!

We expect a fair amount of uncertainty and ambiguity. You are not only comfortable with ambiguity but view it as an opening to quickly explore a multitude of options. You bring the knowledge and experience to build out validated ideas into full-fledged products for our ML customer teams. Keeping a portfolio of product ideas at different stages of maturity in flight and producing a steady cadence of robust product innovation is your primary M.O.

 

Qualifications

 

Who you are

Do you identify with the majority of the following traits? Yes? We believe they will make you successful in this role.

  • You have a passion for machine learning and developer tools.

  • You’re an innovator and entrepreneur with a track record of discovering “product-market fit” for seed-stage ideas and growing them into viable products.

  • You bring partners together across organizational and functional boundaries.

  • You’re able to articulate a clear vision and enroll the team and partners into it, both in spoken and written form, while remaining open to a constructive dialogue.

  • You lead by example with technical strength and rigor in process (such as formulating and testing product hypotheses).

  • You are sufficiently organized to keep an emerging product effort with lots of uncertainties on track.

  • You multiply the effect of contributors by inspiring and growing them on and off the team across different levels of seniority, skills and geographical boundaries.

  • You’re motivated by delivering impactful products that accelerate the feature engineering efforts of our customers.

  • You’ve got a working knowledge of Python, plus experience with a compiled language, such as Scala or Java.

By nature of the problem domain, we expect you to have experience in:

  • 7+ years in building and delivering working software through an iterative, agile process.

  • 2+ years in Sr/Staff engineering capacity with demonstrated leadership skills. (This role does not include people management responsibilities.)

  • 7+ years of work experience in software engineering in the areas of distributed data processing or distributed low latency systems.

  • 2+ years experience with ML problems and tools either through first-hand modeling or close collaboration with modeling engineers or data scientists.

  • Entrepreneurial experience is a distinct plus.

  • M.S. or Ph.D. degree in computer science or a related field or equivalent work experience.

Additional Information

All your information will be kept confidential according to EEO guidelines. We are committed to an inclusive and diverse Twitter. Twitter is an equal opportunity employer. We do not discriminate based on race, color, ethnicity, ancestry, national origin, religion, sex, gender, gender identity, gender expression, sexual orientation, age, disability, veteran status, genetic information, marital status or any legally protected status.

We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.

Privacy Policy