Web Scraping Engineer - REMOTE - CONTRACT

  • London, United Kingdom
  • Contract

Company Description

Lyst is a technology platform that revolutionises the way people shop for fashion. We connect millions of consumers globally with the world’s leading fashion designers and stores, giving them a simpler, more engaging and more effective shopping experience. Lyst has grown over 300% every year since launch in 2011 and has raised over $60M from top-tier investors including Accel, DFJ, Balderton and the teams behind LVMH, Michael Kors and Oscar de la Renta.

Job Description

Lyst are looking to engage full stack python and javascript developers to work on our partner integrations team. You’ll work on our web scraping architecture; building spiders, payment processors and integrations with our partners across the world. This is a contract role, we are looking for people that can commit a minimum of 40 hours a week and the rate is €15 an hour.

Our remote web crawling team is one of Lyst’s best kept secrets, this remote team supports and assists the onboarding of our new partners across the globe. Working closely with our commercial partnerships team and large engineering team here in London, you will be building the scrapers (spiders) that push new products, stock availability and price changes automatically on to Lyst's platform.

Our spiders are written in Python using the Scrapy framework, with javascript on the front-end. We are working on projects that improve infrastructure, automate common tasks, improve our understanding of the data, system vital signs and the fashion world. The team communicates on Slack and we use Jira to help us manage the tasks and deliver work on time. You can find out a lot more about how we work and more of the projects we work on here: developers.lyst.com


We’re looking for engineers who are excited by the technical problems that Lyst faces as we grow and are interested in working on the huge challenges we are facing.


  • Using Python in a production environment
  • Working as part of a remote team
  • Working on large web applications
  • Working in an English speaking environment

Ideal experience

  • Experience writing web scrapers, (Ideally in Scrapy )
  • Understanding of front end architecture
  • Working with productivity tools like Jira, confluence and Slack

If you are based in US or Asian timezones that would be ideal as this team is 

Additional Information

You will be challenged, supported and have the opportunity to learn a lot. You will work a fast paced, autonomous environment with like minded people who are passionate about what they do. Your willingness to learn and your ability to suggest improvements will allow you to grow as Lyst does and become a key member of our team.

We care deeply about helping the tech industry become a more inclusive and diverse place and we work hard to lead by example. Our workplace is dynamic, diverse and highly collaborative. You will join a huge multinational team of engineer based accross multiple timezones that love to work with each other and meet up from time to time.

All your information will be kept confidential according to EEO guidelines.