Big Data Engineer (IT-DA-DS-2023-76-LD)
- Contract
Company Description
Job Description
Introduction
Are you an experienced DevOps Engineer willing to take an active role in the support of the IT data store services used by the entire CERN community? Then join our team and take part in one of the most incredible scientific experiments in the world!
You will join one team of the CERN IT Database and Analytics (DA) group responsible for providing data store services to the CERN users. You will be working with several large scale open-source tools (OpenSearch, Hadoop, HDFS, HBase) as well as enterprise storage solutions (NetApp).
More information here:
- NXCALS paper: http://accelconf.web.cern.ch/icalepcs2019/papers/wepha163.pdf
- ATLAS Event Index paper: https://rdcu.be/c7o6I
Functions
As a Big Data Engineer, you will be responsible for operating Hadoop clusters and planning the evolution of the service. Your main activities will consist of:
- Operate multiple large-scale Hadoop clusters: including HDFS, YARN, and HBase.
- Monitor and manage the clusters’ performance, capacity, availability, and security.
- Plan and execute software and hardware upgrades to Hadoop clusters.
- Troubleshoot issues related to Hadoop clusters, consultancy to end users.
- Research and evaluate new Big Data technologies and tools.
- Provide technical mentorship and training to peers and share domain and technical expertise.
Qualifications
Master's degree or equivalent relevant experience in the field of Software or Computing engineering or a related field.
Experience:
The successful candidate should have:
- Proven experience operating and optimizing large-scale production big data environments.
- Experience in DevOps operations, Linux/Unix systems administration, configuration management, and monitoring.
- Experience with user relations, user support, and user requirements definition.
- Experience in agile project management environments and the scrum methodology in particular.
- Expertise in Big Data technologies and the Hadoop framework in particular.
Technical competencies:
- Knowledge of system configuration tools: familiarity with automation tools for infrastructure delivery and management.
- Knowledge of programming techniques and languages: uNIX shell script, or Python programming is required.
- Knowledge of operating systems: such as Linux is essential and knowledge of enterprise storage management (SAN or NAS) would be an asset.
- Capturing and analysis of requirements for ICT systems: ability to collect the needs of users and to manage the different phases of a project.
Behavioural competencies:
- Solving problems: identifying, defining and assessing problems, taking action to address them.
- Achieving results: having a structured and organised approach towards work; being able to set priorities and plan tasks with results in mind; delivering high quality work on time and fulfilling expectations.
- Working in teams: building and maintaining constructive and effective work relationships.
- Communicating effectively: delivering presentations in a structured and clear way; adjusting style and content to the audience; responding calmly and confidently to questions; ensuring that information, procedures and decisions are appropriately documented.
- Learning and sharing knowledge: keeping up-to-date with developments in own field of expertise and readily absorbing new information; sharing knowledge and expertise freely and willingly with others; coaching others to ensure knowledge transfer.
Language skills:
Spoken and written English is a must. French might be acquired later (once at CERN)
Additional Information
Eligibility and closing date:
Diversity has been an integral part of CERN's mission since its foundation and is an established value of the Organization. Employing a diverse workforce is central to our success. We welcome applications from all Member States and Associate Member States.
This vacancy will be filled as soon as possible, and applications should normally reach us no later than July 3rd 2023 at midnight (12:00 AM CEST).
Employment Conditions
Contract type: Limited duration contract (5 years). Subject to certain conditions, holders of limited-duration contracts may apply for an indefinite position.
These functions require:
- Work during nights, Sundays and official holidays, when required by the needs of the Organization.
- Stand-by duty, when required by the needs of the Organization.
Job grade: 6-7
Job reference: IT-DA-DS-2023-76-LD
Benchmark Job Title: Computing Engineer