Senior Data Engineer - TimescaleDB
- Full-time
Company Description
At KMS Technology, we are dedicated to delivering cutting-edge solutions and services that empower businesses to achieve their goals. Our team is composed of highly skilled professionals who are passionate about technology and innovation. We provide a dynamic and collaborative work environment where you can grow your career and make a significant impact.
Job Description
We're looking for a highly skilled Senior Data Engineer to join our team. This critical role involves managing massive volumes of high-velocity, high-cardinality data generated by real-time processing systems, primarily in the Computer Vision domain. The ideal candidate possesses deep expertise in TimescaleDB for efficient storage and querying, proficiency with cloud-based object storage, and familiarity with the specialized NVIDIA ecosystem, including DeepStream, GPUs, and Trident, to ensure data integrity and flow from the edge to the analytics platform.
Responsibilities:
Data Architecture & Storage
Design, build, and optimize high-throughput data pipelines using modern tools to ingest streaming data from various sources into our core data platform.
Serve as the subject matter expert for TimescaleDB, managing schema design, performance tuning, compression policies, and data retention strategies for petabytes of time-series data.
Architect and manage the tiered storage strategy, leveraging cloud-based storage solutions (e.g., S3, GCS) for cold storage and archival of raw and processed data.
Ensure data models are scalable and optimized for both real-time operational queries and large-scale analytical processing.
Real-Time & Computer Vision Integration
Collaborate with ML and Computer Vision teams to integrate the data pipeline with NVIDIA DeepStreamapplications, managing metadata and telemetry extracted from video streams.
Develop solutions that utilize NVIDIA GPUs effectively, particularly concerning how derived data is ingested and processed immediately after the visual inferencing stage.
Familiarity with NVIDIA Trident storage orchestration is desirable for managing persistent volumes in Kubernetes environments hosting vision applications.
Implement data quality checks and validation processes to ensure the high integrity of timestamps and measurement data from the edge devices.
Engineering Excellence & Collaboration
Apply expert-level proficiency in a major programming language (Python or Scala preferred) for ETL/ELT pipeline development and tooling.
Drive the adoption of best practices, including Infrastructure as Code (IaC) and comprehensive monitoring (e.g., Prometheus/Grafana) for the data platform components.
Provide technical guidance and mentorship to junior team members, fostering a culture of high performance and technical rigor.
Qualifications
Minimum of 5+ years of professional experience in Data Engineering, focusing on high-volume data platforms or distributed systems.
Expert proficiency with TimescaleDB (PostgreSQL), including experience managing production instances, hypertable partitioning, and continuous aggregates.
Demonstrated experience designing and managing large-scale data lakes or warehouses utilizing cloud-based object storage (AWS S3, Azure Blob Storage, or GCP Cloud Storage).
Deep experience with streaming platforms (e.g., Apache Kafka, Flink) and real-time data ingestion patterns.
Proficiency in modern programming languages (e.g., Python, Scala, or Go) for data processing and pipeline orchestration.
Preferred Skills & Domain Knowledge
Familiarity with the NVIDIA Computer Vision stack, including concepts related to DeepStream, NVIDIA GPUs, or edge-to-cloud data flow.
Experience or strong understanding of the requirements for storing and retrieving high-dimensional time-series data (e.g., sensor data, telemetry, and machine learning metadata).
Experience with containerization and orchestration (Docker, Kubernetes) in the context of data processing jobs.
Familiarity with database security protocols and compliance requirements for sensitive data.
Additional Information
Perks you enjoy at KMS Mexico
- Mexican law benefits
- 15 days of PTO (in year zero, from the first year onwards it is 3 days per year).
- 5 days' leave for the death of immediate family members, negotiable.
- Major Medical Expenses Insurance with coverage for immediate dependents (spouse and children).
- Annual performance bonus (≈10% of annualized salary).
- Annual salary adjustment.
- Employee Referral Bonus.
- Paid Certifications / Courses
- Coursera License.
- 5% Savings Fund.
- 5% Grocery Vouchers.