Senior Data Engineer

  • Full-time
  • Verisk Business: Wood Mackenzie

Company Description

Wood Mackenzie is the global leader in data, analysis and consulting across the energy, chemicals, metals, mining, power and renewables sectors.

Founded in 1973, our success has always been underpinned by the simple principle of providing trusted research and advice that makes a difference to our customers. Today we have over 2,000 customers ranging from the largest global energy companies and financial institutions to governments as well as smaller market specialists.

Our teams are located around the world. This enables us to stay closely connected with customers and the markets and sectors we cover. Collectively this allows us to offer a compelling combination of global commodity analysis with detailed local market knowledge.

We are committed to supporting our people to grow and thrive. We value different perspectives and aspire to create an inclusive environment that encourages diversity and fosters a sense of belonging. We are committed to creating a workplace that works for you and encourage everyone to get involved in our Wellness, Diversity and Inclusion, and Community Engagement initiatives. We actively support flexible working and are happy to consider alternative work patterns, taking into account your needs and the needs of the team or division that you are looking to join. 

Hear what our team has to say about working with us:

https://www.woodmac.com/careers/our-people/

We are proud to be a part of the Verisk family of companies! 

At the heart of what we do is help clients manage risk. Verisk (Nasdaq: VRSK) provides data and insights to our customers in insurance, energy and the financial services markets so they can make faster and more informed decisions.   

Our global team uses AI, machine learning, automation, and other emerging technologies to collect and analyze billions of records. We provide advanced decision-support to prevent credit, lending, and cyber risks. In addition, we monitor and advise companies on complex global matters such as climate change, catastrophes, and geopolitical issues.  

But why we do our work is what sets us apart. It stems from a commitment to making the world better, safer and stronger.  

It’s the reason Verisk is part of the UN Global Compact sustainability initiative. It’s why we made a commitment to balancing 100 percent of our carbon emissions. It’s the aim of our “returnship” program for experienced professionals rejoining the workforce after time away. And, it’s what drives our annual Innovation Day, where we identify our next first-to-market innovations to solve our customers’ problems.   

At its core, Verisk uses data to minimize risk and maximize value. But far bigger, is why we do what we do. 

At Verisk you can build an exciting career with meaningful work; create positive and lasting impact on business; and find the support, coaching, and training you need to advance your career. We have received the Great Place to Work® Certification for the fifth consecutive year. We’ve been recognized by Forbes as a World’s Best Employer and a Best Employer for Women, testaments to our culture of engagement and the value we place on an inclusive and diverse workforce.  Verisk’s Statement on Racial Equity and Diversity supports our commitment to these values and affecting positive and lasting change in the communities where we live and work.  

Job Description

This role will be responsible for the implementation of high-quality data pipelines that enables high quality data from various sources to flow through our organization. If you are looking to work for a company that matters, a company which has a significant and growing impact in the world, and if having a sense of purpose and contribution is important to you, we want to hear from you.

What you'll do…


Gathering data requirements, such as how long the data needs to be stored, how it will be used and what people and systems need access to the data.

Maintaining metadata about the data, such as what technology manages the data, the schema, the size, how the data is secured, the source of the data and the ultimate owner of the data.

Ensuring security and governance for the data, using centralized security controls, encrypting the data, and auditing access to the data.

Storing the data, using specialized technologies that are optimized for the particular use of the data, such as a relational database, a NoSQL database, Hadoop, or Amazon S3.

Processing data for specific needs, using tools that access data from different sources, transform and enrich the data, summarize the data and store the data in the storage system.

To address these responsibilities, you will be required to perform different tasks. Some examples include:

•    Acquisition: Sourcing the data from different systems
•    Cleansing: Detecting and correcting errors
•    Conversion: Converting data from one format to another
•    Disambiguation: Interpreting data that has multiple meanings
•    De-duplication: Removing duplicate copies of data

Qualifications

•    Excellent programming skills, particularly in one or more of SQL, R, Python,
•    Experience with SQL and NoSQL (e.g., SQLServer, Postgres, Aurora, Hadoop, HBase and/or Neo4j) databases
•    Extensive experience with modern ETL tools (e.g. EMR, AWS Glue, AWS Step Functions, Kafka etc.)
•    Experience contributing along side Principle Engineers, to the Architectural conceptualization, design, implementation, and maintenance of modern data pipelines.
•    Effective communication (written and oral) skills
•    Hands on expertise with agile methodologies and comprehensive understanding of modern patterns and practices (e.g. XP, Scrum)
•    Experience coaching, and mentoring individuals and teams.
•    Solid knowledge of modern cloud architectures (e.g., microservices, serverless, event driven architectures) and technologies specifically AWS.
•    Proven knowledge of continuous delivery and approaches to continuous integration (Jenkins, Docker, Cloudformation/Terraform)
 

#LI-DJ1

Additional Information

Verisk Analytics is an equal opportunity employer.

All members of the Verisk Analytics family of companies are equal opportunity employers. We consider all qualified applicants for employment without regard to race, religion, color, national origin, citizenship, sex, gender identity and/or expression, sexual orientation, veteran's status, age or disability.

http://www.verisk.com/careers.html

Unsolicited resumes sent to Verisk, including unsolicited resumes sent to a Verisk business mailing address, fax machine or email address, or directly to Verisk employees, will be considered Verisk property. Verisk will NOT pay a fee for any placement resulting from the receipt of an unsolicited resume.

Consumer Privacy Notice

Privacy Policy