Data Engineer (AWS)

  • Full-time
  • Verisk Business: Opta

Company Description

We help the world see new possibilities and inspire change for better tomorrows. Our analytic solutions bridge content, data, and analytics to help business, people, and society become stronger, more resilient, and sustainable.

Job Description

We are looking for a passionate Data Engineer to join our growing team of analytics experts. You will be responsible for expanding and optimizing our data pipeline architecture, as well as optimizing data flow and collection for interdepartmental teams. The optimal candidate will be an experienced data pipeline builder, someone who enjoys optimizing data systems and building them from the ground up. The Data Engineer will support our cross-functional teams (software developers, data analysts and data scientists) on several data initiatives. You must be self-directed and comfortable supporting the data needs of multiple teams, systems and products.  

As a Data Engineer with Opta, you will be an integral part of one of Canada's leading analytics companies. Our mission is simple:  We help to drive profitable growth for our clients by creating business value from information. The right candidate will be excited by the prospect of optimizing Opta’s data architecture to support our next generation of products and data initiatives. 

Responsibilities: 

  • Design, building and operationalize the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using AWS ‘big data’ technologies 

  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. 

  • Create and maintain data pipeline architecture 

  • Assemble large, complex data sets that meet functional / non-functional business requirements 

  • Work with stakeholders including the Product, Data and IT teams to assist with data-related technical issues and support their data infrastructure needs 

  • Work with data and analytics experts to strive for greater functionality in our data systems 

Qualifications

  • 3+ years of experience as a Data Engineer or in a similar role 

  • Experience building and optimizing ‘big data’ data pipelines, architectures and data sets. 

  • Experience in building large-scale data systems with high performance, great usability and highly satisfied customers 

  • Experience with AWS cloud services: Athena, Glue, Lambda, EMR, RDS, Redshift 

  • Experience working with infrastructure management tools like CloudFormation or Terraform 

  • Experience with distributed systems and NoSQL databases 

  • Experience with big data tools: Hadoop, Spark, Kafka, NiFi etc. 

  • Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc. 

  • Experience gathering business requirements, formulating metrics and building highly scalable pipelines 

  • Ability to create collaborative relationships with cross-functional teams while managing expectations, managing concerns and risks, and communicating progress 

  • Excellent oral and written communication skills including the ability to communicate effectively with both technical and non-technical stakeholders 

  • Proven ability to meet tight deadlines, multi-task, and prioritize workload 

  • A work ethic based on a strong desire to exceed expectations. 

  • Excellent understanding of software development life cycle and/or agile development environment 

Environment/Working Conditions: 

  • Innovative, forward thinking and execution oriented. 

  • Positive team dynamics and culture. 

  • All prospective employees must pass a background check. 

 

#LI-MV1

Additional Information

In 2022, Verisk received Great Place to Work® Certification for our outstanding workplace culture for the sixth year in a row and second-time certification in the UK, Spain, and India. We’re also one of the 38 companies on the UK’s Best Workplaces™ list and one of 18 companies on Spain’s Best Workplaces™ list.

For over fifty years and through innovation, interpretation, and professional insight, Verisk has replaced uncertainty with precision to unlock opportunities that deliver significant and demonstrable impact. From our historic roots in risk assessment, we’ve grown to provide analytic insights that help transform industries focused on some of the world’s most critical areas. Today, the insurance industry relies on Verisk to be, and to make the world, more productive, resilient, and sustainable.

Verisk works in collaboration with our customers and at the intersection of people, data, and advanced technologies. Through proprietary platformed analytics, advanced modeling, and interpretation, we deliver immediate and sustained value to our customers and through them, to the individuals and societies they serve, with greater speed, precision, and scale.

We’re 9,000 people strong, committed to translating big data into big ideas. We help others see new possibilities and empower certainty into big decisions that impact individuals and societies. And we relentlessly and ethically pursue innovation to help move our customers, and the world, toward better tomorrows.

Everyone at Verisk—from our chief executive officer to our newest employee—is guided by The Verisk Way, to Be Remarkable, Add Value, and Innovate.
• Be Remarkable by doing something better each day in service to our customers and each other
• Add Value by delivering immediate and sustained results that drive positive outcomes
• Innovate by redefining what’s possible, embracing challenges, and pushing boundaries

Verisk Businesses

Underwriting Solutions — provides underwriting and rating solutions for auto and property, general liability, and excess and surplus to assess and price risk with speed and precision

Claims Solutions — supports end-to-end claims handling with analytic and automation tools that streamline workflow, improve claims management, and support better customer experiences

Property Estimating Solutions — offers property estimation software and tools for professionals in estimating all phases of building and repair to make day-to-day workflows the most efficient

Extreme Event Solutions — provides risk modeling solutions to help individuals, businesses, and society become more resilient to extreme events.

Specialty Business Solutions — provides an integrated suite of software for full end-to-end management of insurance and reinsurance business, helping companies manage their businesses through efficiency, flexibility, and data governance

Marketing Solutions — delivers data and insights to improve the reach, timing, relevance, and compliance of every consumer engagement

Verisk Maplecroft — provides intelligence on sustainability, resilience, and ESG, helping people, business, and societies become stronger

At Verisk you can build an exciting career with meaningful work; create positive and lasting impact on business; and find the support, coaching, and training you need to advance your career. We have received the Great Place to Work® Certification for the 7th consecutive year. We’ve been recognized by Forbes as a World’s Best Employer and a Best Employer for Women, testaments to our culture of engagement and the value we place on an inclusive and diverse workforce.  Verisk’s Statement on Racial Equity and Diversity supports our commitment to these values and affecting positive and lasting change in the communities where we live and work.

Verisk Analytics is an equal opportunity employer.

All members of the Verisk Analytics family of companies are equal opportunity employers. We consider all qualified applicants for employment without regard to race, religion, color, national origin, citizenship, sex, gender identity and/or expression, sexual orientation, veteran's status, age or disability.

http://www.verisk.com/careers.html

Unsolicited resumes sent to Verisk, including unsolicited resumes sent to a Verisk business mailing address, fax machine or email address, or directly to Verisk employees, will be considered Verisk property. Verisk will NOT pay a fee for any placement resulting from the receipt of an unsolicited resume.

HR CCPA Privacy Notice.pdf

 

 

Privacy Policy