Big Data Engineer

  • Full-time

Company Description

Locus Robotics is a leader in the rapidly growing eCommerce order fulfillment optimization space. Our solution helps warehouse owners attain 2-3X efficiency improvement over cart-picking operations, by empowering pickers to work collaboratively with our robots. All this is accomplished while integrating with the operator’s Warehouse Management System, utilizing and optimizing existing facility infrastructure.

Job Description

The Locus Data Science Team (DST) is responsible for providing data management, access, and analysis to interested stakeholders - both within and outside Locus. The DST will provide access to deeper analysis, modeling, and predictive analytics based on large and complex datasets. The Big Data Engineer role is fundamental to extending Locus capabilities relating to machine learning and data-driven optimization of system performance.

Responsibilities:

  • Big picture thinking on big data challenges at a fast-growing company looking to maximize the insight from its data.
  • Implement and maintain a complete data ecosystem, from data lakes, to Spark cluster, to models, dashboards, and other data products. 
  • Provide support to, and discuss requirements from, internal customers to determine data products that they require.

Qualifications

  • BSc or MSc involving computer science, artificial intelligence, informatics, data, or other relevant engineering disciplines. 
  • 8+ years of experience in software development for enterprise application with demonstrated focus on data engineering related topics such as ETL, big data storage, data warehouse, data lake environment, big data processing, etc. 
  • 5+ years’ experience with big data tools and applications.
  • Python programming essential, and competent Java or Scala and/or JavaScript programming a plus. ·
  • Experience building data pipelines; extensive experience with data processing and ETL/ELT techniques. 
  • Experience with cloud computing and native cloud data application development in Azure and/or AWS.
  • Good working knowledge of tools in the PyData ecosystem - pandas, polars, sklearn, numpy.
  • Proven experience with Spark, and/or DataBricks, and/or or Dask for big data processing. 
  • Strong understanding of SQL Engines and able to conduct advanced performance tuning (including query optimization, normalization, and denormalization rules).
  • Confident and familiar with NoSQL data storage, particularly MongoDB.
  • Familiarity with data exploration / data visualization through Power BI a plus. 
  • Experience supporting production applications, workloads and data pipelines in the cloud. 
  • Experience with stream-processing systems such as Kafka, Storm, Spark-streaming, etc. is a big plus. 
  • Experience with NATS Jetstream an advantage.
  • Strong attention to detail and high commitment to quality and accuracy.
  • Experience working in an agile software development environment and agile methodology.

Additional Information

Locus Robotics is an Equal Opportunity Employer

By clicking the link above or any third-party link within this posting, you are leaving this site and going to a third-party website where the third-party website's terms and privacy policy apply

Privacy Notice