Big Data Engineer

  • Full-time

Company Description

About Wizikey: 

Wizikey is a SaaS-based reputation management platform for business to discover, identify and connect with the relevant influencers - journalists, social influencers, academicians, et al. With inbuilt intelligence solutions, Wizikey helps businesses to save time, create meaningful relationships and give a much-needed voice to their brand. Explore it further at www.Wizikey.com.

Job Description

We are looking for a Big Data Engineer that will work on collecting, storing, processing, and analyzing of huge sets of data. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. You will also be responsible for integrating them with the architecture used across the company.

 

Responsibilities and expectations

  • Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities

  • Help in hiring more people with the required set of skills

  • Able to Integrate multiple data sources and databases into One System

  • Cleansing, and verifying the integrity of the data

  • Enhancing data collection procedures to include information that is relevant for the business requirements

  • Creating automated anomaly detection systems and constant tracking of Its performance

  • Implementing ETL processes

  • Monitoring performance and advising any necessary infrastructure changes

  • Defining data retention policies

Qualifications

Skills and Qualifications

  • 3 to 5 years of software development and programming experience

  • A thorough understanding of software architecture, practices and data structures

  • Extensive experience with Python or Java and their ecosystem

  • Should have the ability to analyze complex technical information

  • Comfortability designing and implementing database structures to solve real-world problems effectively

  • An awareness of current issues affecting the industry and its technologies

  • Proficiency in distributed system tech like Hadoop/spark/elasticsearch/cassandra etc is a plus

  • Should able to understand end to end data architecture and designs and have worked on handling/processing terabytes of data

  • Experience or understanding of machine learning or data science will be a plus

Additional Information

Band: Wizikey: Band  A