Senior Data Cloud Engineer (Full Stack) (REF1234M) + Sign on Bonus 5000 Eur

  • Full-time
  • Location: Remote from Slovakia
  • Company: Deutsche Telekom IT and Telecommunications Slovakia
  • Language: English
  • Job category: Technical positions

Company Description

Our brand Deutsche Telekom IT Solutions Slovakia entered the life of Košice region in 2006 under the name of T-Systems Slovakia and ever since has been inextricably linked with the region when became one of the founding members of Košice IT Valley. We have managed to grow from scratch to the second largest employer in the eastern part of the country with more than 3900 employees. Our goal is to proactively find new ways to improve and continuously transform into the type of company providing innovative information and communication technology services.

Job Description

Our mission:

As a dynamic, flat and international organization, we shape the future of Deutsche Telekom IT in integrated teams consisting of all relevant competencies – it goes without saying that Telekom customers are also part of these teams.

Our Focus:

Architectural Evolution: We're dedicated to transitioning from monolithic systems to a decoupled API architecture, improving efficiency, reliability, and enabling scalability.
 
Cloud Transition: Our work involves utilizing top-tier cloud solutions including AWS, Azure, and Google Cloud, as well as our private cloud for sensitive data. We're in the process of migrating from on-premise setups to a more robust, scalable cloud infrastructure.
 

WHAT WILL YOU DO?  

  • AIOps Integration:
    • Collaborate with AIOps teams to integrate data engineering solutions into AI-driven processes.
    • Implement data pipelines that feed into machine learning models for predictive analytics.
    • Ensure seamless communication between data infrastructure and AIOps platforms.
  • Real-Time Data Processing:
    • Develop and maintain real-time data processing solutions using technologies such as Spark Streaming.
    • Implement and optimize data streaming processes for immediate insights and actions.
    • integrate real-time data into automated decision-making
  • Machine Learning Integration:
    • Work closely with data scientists to integrate machine learning models into AIOps workflows.
    • Implement data features and preprocessing steps necessary for machine learning model input.
    • Optimize data processing to support the training and inference phases of machine learning models.
  • Data Orchestration, Monitoring and Anomaly Detection:
    • Design and implement ETL and ELT processes for efficient data movement and transformation.
    • Utilize tools like Prefect, Airflow, and MLFlow for orchestrating data workflows.
    • Implement monitoring solutions to track the health and performance of data pipelines.
    • Develop and deploy anomaly detection algorithms to identify irregular patterns in data.
  • Data Storage and Retrieval:
    • Manage and optimize storage solutions for both structured and unstructured data.
    • Implement data retrieval interfaces such as AWS Athena for efficient data access.
    • ensure data availability and accessibility for analysis
  • Cloud Services and Infrastructure:
    • Utilize AWS services like EMR, MSK, Kinesis, and others for scalable data processing.
    • Optimize cloud infrastructure to support both data engineering and AIOps requirements.
    • leverage cloud capabilities for enhanced operational efficiency

Your Qualifications:

Big Data Stack

  • real-time processing (Spark Stream).
  • Proficiency in Spark, parallelization (Dask, Pandarallel, Ray).
  • Familiarity with message brokers such as RabbitMQ and Kafka.
  • Expertise in storage solutions including S3 and Hadoop.
  • Hands-on experience with AWS services: AWS EMR, AWS MSK, AWS Kinesis.

ETL vs. ELT, Data Orchestration

  • Medium to senior experience in ETL vs. ELT methodologies.
  • Expertise in data orchestration tools such as Prefect, Airflow, MLFlow, and AWS Lambda.
  • Proficient in AWS services: AWS Glue, AWS Lambda, AWS Step Functions, AWS EventBridge.

Data Lake / Document-based DB, Tabular DB

  • experience with Tabular DBs (SQL, MySQL, PostgreSQL) and Document-based DBs (MongoDB).
  • Hands-on experience with AWS services: AWS Athena, AWS DynamoDB, AWS DocumentDB, AWS RDS, AWS Redshift.

Data Warehouse

  • experience with Snowflake, DataBricks.
  • Familiarity with visualization tools such as Grafana and ElasticSearch.

Python, Linux, Docker

Qualifications

YOU WILL SUCCEED IF YOU:

  • Angular, Python
  • Linux env (putty, shell/bash) / VirtualEnv (dockering) / GitLab + source control / Jenkins
  • Deploying REST-based web services / APIs
  • Web servers such as Nginx, Apache, etc
  • ElasticSearch, Kibana, noSQL MongoDB, ArangoDB, Anaconda, datascience libs, MariaDB, PostgreSQL,
  • Backend - JavaScript, JSON, NodeJS, Flask, Python, Ruby, Anaconda
  • Devops
  • AWS, Lambda, S3
  • Prefect – data management
  • NLP/ML – BERT, DBScan, Numpy, Jupyter Notebook, Hugging Face, GNN, NSP, NER, Facebook Prophet.

Additional Information

WHY SHOULD YOU CHOOSE US?

We believe in balance between work and personal life. An attractive and extensive work-life balance portfolio guarantees lasting motivation for employees and thus a better quality of life, promotes physical and mental well-being and contributes to a positive work environment. All this with the aim of providing more freedom in reconciling work, career growth, private life and individual lifestyle. Therefore we offer to our employees over 25 different benefits to improve their personal and professional life in these areas:

  • Financial benefits
  • Benefits with focus on learning and development
  • Benefits with focus on health and sport
  • Benefits with focus on family and work – life balance
  • Other benefits

For more information about our benefits click to Benefits

Salary

Final salary is negotiable.

We are offering base salary depending on seniority level and previous experience of candidate. In addition to base salary we provide variable part and other financial benefits. Base salary will not be lower than 3100 € /brutto.

Additional information

* Please be informed that our remote working possibility is only available within Slovakia due to European taxation regulation.

Privacy PolicyImprint