Big Data Engineer - Hadoop

  • Full-time

Company Description

CapTech is a national IT management consulting firm that bridges the gap between business and technology. We partner with some of the world's most successful companies to design, develop, and manage technical and digital solutions that delight customers, drive insights, and meet strategic objectives.

At CapTech, you’ll experience a flat organizational structure based upon a culture of mutual respect. Here, your career path isn’t set in stone, and you have unlimited potential for growth and the resources to help you achieve your career goals. If you are creative, technically insightful, driven–and have a passion for the work that we do, then you might be a future CapTecher.  

For over five years, we have been in the Top 10 of Consulting Magazine’s Best Firms to Work For, including #2 for IT Firms and #5 for Work/Life Balance. We are also recognized by Vault.com’s Top 50 Consulting Firms and have been on the Inc. 5000 list of fastest growing companies for over 10 years.

Job Description

The Big Data Engineer role falls into the Data & Analytics practice area at CapTech, through which our consultants provide a broad spectrum of services to help our clients define and implement a strategy to deliver lasting and mission-critical analytic capabilities.  Our Big Data Engineers are data pipeline builders and data wranglers, implementing modern data architectures to deliver data to data analysts and scientists at a large scale.  By partnering with clients to fully understand both their business philosophy and IT strategy, CapTech consultants maintain the vision that data pipelines should be built to help the organization make better decisions by providing the right data at the right time.    

Specific responsibilities for the Data Engineer position include: 

  • Design, develop, and implement advanced data pipelines that bring together data from disparate sources, making it available to data scientists, analysts, and other users using a variety of programming languages (Java, Scala, Python, etc).
  • Understand the challenges being addressed by an engagement and collaborate with team members and clients to deliver a technical solution that meets the unique needs of our clients.
  • Create quality deliverables to communicate technical solutions to appropriate audiences.
  • Learn continuously, leveraging CapTech’s training resources and self-directed training, sharing knowledge and skills with others.
  • Provide mentoring and leadership to more junior resources.
  • Some of our technologies might include: Hadoop Ecosystem, HBase, Hive, Spark, Kafka, HDInsight, EMR, Elasticsearch, and Kinesis as well as various datastores such as Cassandra, MongoDB, Redis, Snowflake, Redshift, HDFS, S3, Aurora, Azure Storage, and Azure Data Warehouse

Qualifications

Specific qualifications for the Senior Big Data Engineer position include:

  • Bachelor's degree in Computer Science, Software Engineering, MIS or equivalent combination of education and experience
  • Demonstrated growth over 3+ years’ experience working as a data engineer.
  • Development experience with Big Data/NoSQL platforms, Hbase, MongoDB or Apache Cassandra.
  • Expert knowledge of SQL and NoSQL tools.
  • Knowledge of MapReduce and MapReduce generating tools like Pig or Hive.
  • Knowledge of Spark and associated platforms such as Hive.
  • Experience with message buses or real-time event processing platforms is a plus.
  • Java development experience.
  • Scripting language experience (Perl, Python etc.).
  • Understanding of NoSQL data modeling.
  • Knowledge of how to assess the performance of data solutions, how to diagnose performance problems, and tools used to monitor and tune performance.

Additional Information

We offer challenging and impactful jobs with professional career paths. All CapTechers can keep their hands on technology no matter what position they hold. Our employees find their work exciting and rewarding in a culture filled with opportunities to have fun along the way.

At CapTech we offer a competitive and comprehensive benefits package including, but not limited to:

  • Competitive salary with performance based bonus opportunities
  • Single and Family Health Insurance plans, including Dental coverage
  • Short-Term and Long-Term disability
  • Matching 401(k)
  • Competitive Paid Time Off
  • Training and Certification opportunities eligible for expense reimbursement
  • Team building and social activities
  • Mentor program to help you develop your career

At this time, CapTech cannot transfer nor sponsor a work visa for this position. Applicants must be authorized to work directly for any employer in the United States without visa sponsorship.

Candidates must be eligible to work in the U.S. for any employer directly (we are not open to contract or “corp to corp” agreements). 


CapTech is an equal opportunity employer. 

CapTech is a Drug-Free work place.

Candidates must have the ability to work at CapTech’s client locations. 

All positions include the possibility of travel.
CapTech has not contracted/does not contract with any outside vendors in its recruitment process. If you are interested in this position, please apply to CapTech directly.

Privacy Policy