AWS Data Engineer (Can be Remote)

  • Full-time

Company Description

About Element 84 

Element 84 is here to help accelerate and scale projects that have a positive impact on people and the planet. We solve challenging problems across a wide range of industries, but our super power is cloud-based geospatial data processing, remote sensing, and Earth science systems. We were founded by husband-and-wife engineers in 2010 and have grown into a skilled group of practitioners building high-performance systems for the biggest corporate and government clients in the world. Our main office is located in Alexandria, VA but we support a large remote workforce from Michigan to Texas and Pennsylvania to California.

A Few Other Things You Should Know

  1. Element 84's values are: We Invest in Each OtherWe are Reliable, and Our Work Benefits our World.
  2. Element 84 works on meaningful projects that are challenging—from a technical, people, and team perspective. We make an impact on large projects through our leadership and expertise, both formal and informal.
  3. Element 84 pays well but we care more about working on projects that matter.
  4. Element 84 values life outside of work. We offer parental leave for everyone and support each other through family challenges like medical problems, adoptions, and new babies.
  5. Element 84 has had a flexible work schedule since our founding in 2010.
  6. Element 84 has made a commitment to diversity. We expect the entire team to share that same commitment. 

About You

You are curious about the world, are constantly learning, driven to lead (formally or informally), and have a strong work ethic. You're interested in solving impactful problems in science, medicine, and other projects that have a societal good. You can work independently or with a team, prioritize your projects, and be effective without micromanagement.

Job Description

About The Job

Element 84 is hiring an AWS Data Engineer to work on meaningful projects in the public and private sector. We're a small company with big roles, and you'll be able to make an impact on day one.

The Element 84 Cloud Based Metrics team develops data pipelines to supply geospatial data archive centers with relevant metrics collection dashboards to aid in their transition to the cloud. The Cloud Based Metrics team is an established and high performing agile team working in the Scaled Agile Framework methodology.

This requirement is for a software engineer to assist in the development and maintenance of data pipelines for a Cloud Based Metrics System, facilitating data through the ingest process to dashboard visualizations, utilizing AWS services and the ELK stack (Elasticsearch, Logstash and Kibana).

You'll care about writing. Our team is remote and written communication is essential. In addition to caring about a well-crafted email and a succinct conference abstract, you understand that good writing is good design and engineering.

All candidates must be able to pass a National Agency Clearance with Inquires (NACI) screening.  Applicants must be currently authorized to work in the United States on a full-time basis. At this time, Element 84 will not sponsor applicants for work visas for this position.

Qualifications

Here are things we've worked on recently to give you an idea of how you might spend your day:

  • Tracked down an issue preventing log data from being ingested into our pipelines.
  • Added a new Logstash pipeline to enable a user with unique log data to be ingested into Elasticsearch
  • Upgraded AWS Open Distro Elasticsearch and leveraged reporting plugin to create new query-based monitors to alert users
  • Updated AWS Lambdas to push/pull data to/from sources

Here are the guidelines we're looking at to gauge experience and skillset:

Required Skills:

  • Ability to effectively scope work from end user’s data reporting goals. 
  • Ability to administer Elasticsearch cluster including cluster/shard sizing, reindexing and debug common problems arising from running a self managed multi-tenant cluster.
  • Ability to write data pipelines to parse logs using Logstash plugins.
  • Ability to create graphs and dashboards in Kibana to meet end user reporting requirements and debug problems with data visualization. 
  • Experience with AWS services such as Cloudformation, EC2, Kinesis, Lambda, SQS, Cloudwatch and S3.
  • Experience with NodeJS.

Desired Skills:

  • Familiarity with log formats from various AWS services such as S3 server access , Cloudfront distribution, Lambda execution, ELB, Container execution etc. 
  • Experience with Kibana Query Language, Lucene Query Language, and/or Querydsl
  • Desire to become an AWS Certified architect / engineer.
  • Bachelor's degree in a related field (preferred)

Additional Information

Benefits

Paying attention to who we are as a company–people, family members, friends, and colleagues–is our primary focus at Element 84. There are lots of ways to run a company and for us, it's wanting to come to work, being around people we enjoy, taking on big things with people you trust, and sharing our achievements as a team.

  • You’ll get credit when things go right and we’ll have your back when things go wrong.
  • We only take on work that is challenging and right for us. There are projects we will turn down and the team has a say.
  • We may be a small company, but we have big company benefits meant to support the idea that we're here for the long term and happiness comes from much more than where you work. 
  • We have an extraordinary retention rate because we hire extraordinary people. We hope that’s you.

Element 84 is an equal opportunity employer, with a company culture that values diversity.

We embrace inclusivity and believe that diversity of thought, perspective, and experience helps us reach higher and think bigger. Element 84 is committed to hiring the best person for the team and does not discriminate on the basis of race, color, religion, creed, sex, sexual orientation, gender identity, marital status, national origin, age, veteran status, disability, or any other protected class.