Data Engineer (Data Streaming) - TE'S
- Full-time
Company Description
Natixis in Portugal is fully integrated in the global organization of Natixis, a French multinational financial services firm specialized in Asset & Wealth Management, Corporate & Investment Banking, Insurance and Payments. A subsidiary of Groupe BPCE, Natixis counts nearly 16.000 employees across 38 countries.
Based in Porto, Natixis Centre of Expertise mission is to transform traditional banking by developing innovative solutions for the bank’s business, operations and work culture worldwide, as a key driver of the company’s culture of agility and innovation. Teams of IT and Banking Support Activities work in an integrated, inclusive and transversal way, supporting all the business lines and country platforms.
Natixis in Portugal is the best combination of a “start-up mindset” with a large, solid structure. Its unique culture gives true meaning to a “beyond banking” personality: to be a real entrepreneur, self-challenging, ever striving to excel and go that extra mile.
Job Description
As a Data Engineer, you will work alongside our Data Scientists, Data Engineers, Business Analysts, Software Engineers, and others in the Application teams, from the specification to the implementation phase to improve our applications and business lines decisions. In addition, promote Data Centric mindset & Data Driven company.
Context / team / project
- Integrate into our Architecture & Innovation Data Team, working together with Paris team members, as an unique team
- Bring a differentiating expertise to our clients and stakeholders with integrity and responsibility. (Sustainable impact)
- Be agile, accountable, and resilient, according to the circumstances (Entrepreneurial mindset)
- Purposely striving to succeed together, Porto and Paris, as one team with openness and confidence to improve knowledge, practice, framework, ecosystem (Collective intelligence)
- Contribute on local initiative and project from assessment, use case identification, development, implementation, and industrialization
- Contribute to data community
Years of Exp:
- >5 years, >2 years in Data Streaming
Main Tasks & Responsibilities:
- Work closely with business users, business analysts, data scientists, data engineers and developers to deliver streaming solutions.
- Prototype, build, deploy and operate data.
- Active participation in all phases of the development cycle.
- Ensure optimum performance, high availability and stability of the solutions developed.
Qualifications
Qualifications:
- BS/MS Degree in Computer Engineering, Computer Science, or a similar area
- Experience with working on real-time data, streaming applications and creating Data Streaming Pipelines (Mandatory)
- Experience with data engineering and using programming languages, including Java, Scala, or Python (Mandatory)
- Experience with distributed data and computing tools, including Kafka, Nifi, Spark, Hadoop, Hive, or Flink (Mandatory)
- Experience with UNIX and Linux, including basic commands and Shell scripting
- Kafka project experience, event driven and microservices architecture
- Experience in Implementing kstream applications on java - group, aggregation, filter, etc
- Experience in writing programs using Kafka APIs and Kafka Streams API
- Experience with the following technologies: Kafka, Schema Registry, Kafka Stream, Maven.
- Experience with serialized format like JSON and Avro
- Experience in all development process (requirements, development, tests, integration and deployment)
Nice to Have:
- Knowledge in the following technologies:
- Stream processing with Confluent (ksqlDB, RBAC, and other Confluent specifics)
- Data pipelines with Kafka Connect
- Monitoring tools: JMX, Prometheus, Grafana, AppDynamics, Zabbix, AKHQ, ELK
- DevOps principles, build and deployments using CD/CI pipelines: Jenkins, XL Release, XL Deploy
- Virtualization: OpenShift / Kubernetes
- Good understanding and experience with cloud technologies.
Other Requirements:
- Good level of English - minimum B2 (mandatory)
- French is a big plus
- Knowledge in agile methodologies and tools (Scrum/Kanban) (nice to have)
- Problem solving, analytical and communication skills required, verbal and written
- A real passion for learning, doing things better and helping others, and an ability to turn ideas into realities
- Availability to travel abroad for short periods of time, as required
Additional Information
At Natixis, we are committed to fostering a working environment where each and every one of our people is treated with dignity and respect and where every voice is heard. Our differences make us collectively stronger and are a source of fulfilment, innovation and performance.
In the framework of its Diversity, Equity & Inclusion policy, Natixis in Portugal has implemented a Blind CV Screening process, with the purpose of reducing hiring bias. A blind CV excludes any personal details which refer to the applicant’s gender, age or ethnicity. When applying for our positions, please submit a blind CV, that is, with no picture, name, gender, age, nationality, ethnicity and address. Your personal statement, work experience, courses and certifications, education, skills and contact information is what matters to us.
#MuchMoreThanJustAJob
Early morning. Campo 24 de Agosto. In 4 minutes, you are clocking in at the office. After grabbing a cup of coffee and fresh fruit, pick up your laptop and choose your spot for the day. It's going to be a busy one: French class before lunch and, just after, quick medical appointment at Natixis doctor's office.
Lunch break. Outside in the big terrace (look at your crops at the Urban Garden; ready to harvest!) or, if you feel like stretching your legs, walk downtown to grab lunch.
Back inside. Quick sprint review (working together anywhere means virtual happy birthday to that colleague in Paris that just turned 35). The afternoon went flying (tasks, reports, calls, some jokes with your teammates). End it on a high note: just one PlayStation game or the final match for that ping-pong tournament.
Tomorrow, you complete that certified technical training and the day after, you will work from home, taking advantage to finally do that online course on Udemy. Once you are done with your tasks for the day, you can visit the office for a board games session or show up at the rehearsal of one of Natixis bands. If that is too steady for you, meet your colleagues to surf some waves or join them in a football match.