Python Engineer (Data Engineering)
- Full-time
- Remote worker, any location: Yes
- Contract Type: Permanent
Company Description
YouGov is an international market research and data analytics group.
Our mission is to supply a continuous stream of accurate data and insight into what the world thinks, so that companies, governments and institutions can better serve the people and communities that sustain them.
We have the best data and the best tools. We continuously challenge conventional approaches to research, and we disrupt our industry to ensure that our clients always get the best solutions.
We are driven by a set of shared values. We are fast, fearless and innovative. We work diligently to get it right. We are guided by accuracy, ethics and proven methodologies. We respect and trust each other, and bring these values into everything that we do.
Each day, our highly engaged proprietary global panel of over 15 million people provides us with thousands of data points on consumer opinions, attitudes and behaviours. We combine this continuous stream of data with our research expertise to provide insights that enable intelligent decision-making and informed conversations.
With operations in the UK, North America, Mainland Europe, the Nordics, the Middle East, India and Asia Pacific, YouGov has one of the world’s largest research networks.
The Culture
Diversity and inclusion are fundamental to YouGov. We are committed to giving the world a voice by capturing the opinions of all groups, including the ones that are often under-represented in research. We are also committed to making sure that our products and tools are free from any bias, as accuracy is key to what we do. None of the above can be done without having a truly diverse workforce, in an inclusive workplace. We are very keen on attracting and retaining the best talent. And best talent also means a diverse pool of talent, with various backgrounds and perspectives.
Supporting the wellbeing of our staff, including maintaining a good work and life balance, is important to us. We support flexible working arrangements where appropriate for a role, with many locations offering a hybrid office-and-remote working approach.
As an Equal Opportunity Employer, qualified applicants will receive consideration for employment without regard to race, colour, religion, sex, sexual orientation, gender perception or identity, national origin, age, marital status, veteran status, disability status, or any other characteristic protected by law. All employment decisions are made on the basis of occupational qualifications, merit, and business need.
Job Description
Your mission is to build high-quality, automated data pipelines and infrastructure to serve YouGov’s syndicated data products, including YouGov Profiles — one of the largest market research datasets in the world.
Working inside the Syndicated Data Infrastructure team, you will collaborate with data-minded people to convert vast troves of raw consumer data into meaningful insight by developing automated ETL applications, streaming data processors, RESTful microservices and browser-based user interfaces.
Day to day you will:
Build new features for our automated data infrastructure and the associated web interfaces, for example to support new sources of data
Optimise ETL and web applications to increase performance, reliability and visibility
Support existing data pipelines, ensuring every deliverable reaches its intended destination
Collaborate with other teams to design appropriate, automated solutions for new data delivery and integration needs
Qualifications
You must:
Love writing beautiful, idiomatic Python
Be comfortable in the modern realm of test-driven, version-controlled software development
Have experience in building substantial ETL pipelines and web applications
Enjoy solving complex technical problems
Be eager to develop new skills and expertise
Be proactive, positive and professional
Experience with the following technologies is desirable:
Luigi, Flask, SQLAlchemy, Pandas
Docker, Kubernetes
JavaScript, HTML, CSS
SQL, Postgres
Redis, RabbitMQ
Amazon S3, EC2, Redshift
Airflow, dbt
Snowflake
Additional Information
This role can be based in the UK or any EU country in which we have an entity (Spain, Italy, Poland to name a few) and is 100% remote.
To find out how we collect and use your personal data when you apply for a role at YouGov, please read our privacy notice at https://jobs.yougov.com/privacy