Senior Data Engineer

  • Full-time

Company Description

Wizikey is a subscription-based Communication SaaS that helps businesses identify and connect with relevant media influencers. With Wizikey’s data intelligence, companies can create campaigns, target and engage influencers and journalists, measure and optimize to scale their brand-building efforts. With Wizikey, companies can scale their communication efforts to over 10 countries & get actionable competitive intelligence.

 

Job Description

Wizikey is looking for a Senior Data Engineer. Your primary focus will be on building solutions to integrate multiple data sources in Wizikey, manage that data and use it to power real-time analytics and intelligent insights in the product. Right now we have 4 data integrations using APIs and scrapping or a combination of both. We want to take it to 10 within a year. You will make sure that the team is using the right infrastructure and tools that helps in rapid development and easy maintainance. You will ensure that Wizikey is using and managing all the data in the most efficient and reliable way. You will coordinate with the rest of the team working on different layers of the infrastructure. We are looking for someone who shares the passion for developing high-quality software and is a great team player.

Our Engineering Culture

  • We don’t expect to be perfect, but we are always proactively seeking out ways to help ourselves and our teams to minimize pain points within our infrastructure and code base.
  • We have a team that focuses a lot on developer experience with the best tools, coding practices, design systems, etc.
  • We give autonomy and freedom to our engineer to turn their ideas into reality.
  • We are not afraid of failing when we are experimenting with different technologies, development methodologies, and tooling.
  • We build strong relationships with team members.


What you will be doing:

  • Building scalable, highly performant infrastructure to integrate a variety of raw data sources in Wizikey using APIs or scrapping or a combination of both.
  • Creating and maintaining optimal data pipeline architecture.
  • Developing batch & real-time solutions to power real-time analytics and intelligent insights in the product
  • Building prototypes, and proofs of concept for solutions.
  • Creating frameworks and tools for analytics and data scientist team members that assist them in building and optimizing our product.
  • Implementing complex analytical projects with a focus on collecting, managing, analyzing, and visualizing data.
  • Be in constant communication with team members and other relevant parties and convey results efficiently and clearly.

Qualifications

Skills & Qualifications:

  • You are an enthusiastic Software Engineer with a keen interest in data engineering and loves to play data
  • You have 3+ years of data engineering experience that includes handling a lot of different types of data using relevant tools.
  • You have performed software development in a production environment using a mainstream object-oriented programming language (Java, Python, Scala, etc.).
  • You have experience with ETL/ELT pipelines using both batch and real-time solutions.
  • You emphasize a lot on good practices like code quality, testing, following best practices and modularization on large codebases.
  • You have experience of working with AWS and its tools.

Would be a plus if you have:

  • Experience with big data tools like Hadoop, Spark, Kafka, or similar
  • Experience with relational SQL and NoSQL databases
  • Experience with data pipeline and workflow management tools such as Airflow
  • Experience with stream-processing systems such as Spark-Streaming or similar

Additional Information

"Wizikey encourages and celebrates entrepreneurial culture. When you set out to create a new industry, you need to build a team of immensely talented folks from Technology and Communications and give them the freedom to experiment, learn and keep building. And with every addition of talent, this gets new fuel and the magic happens. And that is why we call ourselves Wizards"