Big Data Engineer

  • Contract

Job Description

  • Translate business requirements and source system understanding into technical solutions using Opensource Tech Stack, Big Data & Java etc.
  • Work with business partners directly to seek clarity on requirements
  • Define solutions in terms of components, modules and algorithms
  • Design, develop, document and implement new programs  and subprograms, as well as enhancements, modifications, and corrections  to existing software. 
  • Create technical documentation and procedures for installation and maintenance.  
  • Write Unit Tests covering known use cases using appropriate tools
  • Integrate test frameworks in development process
  • Refactor existing solutions to make it reusable and scalable
  • Work with operations to get the solutions deployed
  • Take ownership of production deployment of code
  • Collaborating with and/or lead cross functional  teams, build and launch applications and data platforms at scale, either for revenue generating or operational purposes
  • Come up with Coding and Design best practices
  • Thrive in self-motivated internal-innovation driven environment
  • Adapting fast to new application knowledge and changes

Qualifications

• Master/Bachelor degree in Computer Science, Electrical Engineering, Information Systems or other technical discipline; advanced degree preferred.
• Minimum of 2+ years of software development experience (with a concentration in data centric initiatives), with demonstrated expertise in leveraging standard development best practice methodologies.
• Minimum 1+ years of experience in Python, Pandas and SQL
• Strong knowledge of Database concepts and Python.
• Expert on SQL skills for data manipulation (DML) and validation (SQL Server, DB2, Oracle).
• Expertise in Object Oriented Programming Language – Java / Python.
• Experience using CI/CD Process, version control and bug tracking tools.
• Experience in handling very large data volume in low latency and batch mode.
• Experience with automation of job execution, validation and compares of the data files on Hadoop Env at the field level.
• Experience in leading a small team and be a team player.
• Strong communication skills with proven ability to present complex ideas and document in a clear and concise way.
• Quick learner; self-starter, detailed and in-depth.

Additional Information

All your information will be kept confidential according to EEO guidelines.