CDICourbevoie, France
Senior Real-Time Data Engineer - Finance
Hybride
As part of the development of data products for a demanding international environment, an organisation is looking for a Senior Real-Time Data Engineer.
The consultant will join a team responsible for designing, developing and operating cloud-based data products, from event ingestion through to data delivery via APIs and streaming interfaces. The solutions must meet high standards of reliability, security, performance, observability and maintainability.
The consultant will be responsible for designing, developing and operating real-time and batch data pipelines.
Key responsibilities will include:
Designing and developing real-time data products using Apache Flink, Apache Kafka and event-driven architectures.
Building robust and scalable ingestion, transformation and data delivery pipelines.
Developing REST APIs, OpenAPI specifications and microservices to expose data to consumers.
Implementing AWS cloud services suited to streaming, processing and deployment requirements.
Defining data models, schemas, data quality controls and validation rules.
Industrialising software delivery through automated CI/CD pipelines.
Implementing comprehensive observability covering logs, metrics, traces, dashboards and alerting.
Supporting production operations, incident management, root-cause analysis and continuous improvement.
Applying security best practices relating to authentication, authorisation, secrets management and access control.
Producing clear architecture documentation, technical specifications, operational procedures and runbooks.
Contributing to code reviews, engineering standards and knowledge transfer within the team.
The objective is to deliver production-ready real-time data products that meet functional, performance, reliability, security and maintainability requirements.
Required skills
Solid senior-level experience in Data Engineering.
Strong expertise in Apache Flink and Apache Kafka.
Proven experience delivering and operating real-time data products in production.
Good knowledge of event-driven architectures and distributed systems.
Experience developing REST APIs, OpenAPI specifications and microservices.
Strong knowledge of AWS services, particularly MSK, Kinesis, Lambda, API Gateway, ECS/EKS, S3 and IAM.
Experience with data quality, schema management and automated testing.
Knowledge of CI/CD tools such as GitLab CI, GitHub Actions or equivalent.
Experience with observability tools and practices, including CloudWatch, Prometheus, Grafana and OpenTelemetry.
Experience in production support, incident management and performance optimisation.
Good understanding of cloud and application security principles.
Ability to produce clear and comprehensive technical documentation.
Ability to contribute to architecture design, code reviews and technical standards.
Strong communication skills and the ability to mentor less experienced engineers.
Experience in financial markets or another regulated industry would be an advantage.
Informations de la mission :
The consultant will join a team responsible for designing, developing and operating cloud-based data products, from event ingestion through to data delivery via APIs and streaming interfaces. The solutions must meet high standards of reliability, security, performance, observability and maintainability.
The consultant will be responsible for designing, developing and operating real-time and batch data pipelines.
Key responsibilities will include:
Designing and developing real-time data products using Apache Flink, Apache Kafka and event-driven architectures.
Building robust and scalable ingestion, transformation and data delivery pipelines.
Developing REST APIs, OpenAPI specifications and microservices to expose data to consumers.
Implementing AWS cloud services suited to streaming, processing and deployment requirements.
Defining data models, schemas, data quality controls and validation rules.
Industrialising software delivery through automated CI/CD pipelines.
Implementing comprehensive observability covering logs, metrics, traces, dashboards and alerting.
Supporting production operations, incident management, root-cause analysis and continuous improvement.
Applying security best practices relating to authentication, authorisation, secrets management and access control.
Producing clear architecture documentation, technical specifications, operational procedures and runbooks.
Contributing to code reviews, engineering standards and knowledge transfer within the team.
The objective is to deliver production-ready real-time data products that meet functional, performance, reliability, security and maintainability requirements.
Required skills
Solid senior-level experience in Data Engineering.
Strong expertise in Apache Flink and Apache Kafka.
Proven experience delivering and operating real-time data products in production.
Good knowledge of event-driven architectures and distributed systems.
Experience developing REST APIs, OpenAPI specifications and microservices.
Strong knowledge of AWS services, particularly MSK, Kinesis, Lambda, API Gateway, ECS/EKS, S3 and IAM.
Experience with data quality, schema management and automated testing.
Knowledge of CI/CD tools such as GitLab CI, GitHub Actions or equivalent.
Experience with observability tools and practices, including CloudWatch, Prometheus, Grafana and OpenTelemetry.
Experience in production support, incident management and performance optimisation.
Good understanding of cloud and application security principles.
Ability to produce clear and comprehensive technical documentation.
Ability to contribute to architecture design, code reviews and technical standards.
Strong communication skills and the ability to mentor less experienced engineers.
Experience in financial markets or another regulated industry would be an advantage.
Informations de la mission :
- Début de mission : 15/11/2026
- Durée : 6 mois
- Date de publication : 05/11/2026
- Date limite de candidature : 09/11/2026
Compétences recherchées
Apache Flink (Indispensable)Apache Kafka (Indispensable)REST API (Indispensable)OpenAPI (Indispensable)microservices (Indispensable)AWS (Indispensable)MSK (Indispensable)Kinesis (Indispensable)Lambda (Indispensable)API Gateway (Indispensable)ECS (Indispensable)EKS (Indispensable)S3 (Indispensable)IAM (Indispensable)GitLab CI (Indispensable)GitHub Actions (Indispensable)CI/CD (Indispensable)CloudWatch (Indispensable)Prometheus (Indispensable)Grafana (Indispensable)OpenTelemetry (Indispensable)event-driven architectures (Indispensable)schemas (Indispensable)data quality (Indispensable)MSK/Kinesis/Lambda/API Gateway/ECS/EKS/S3 (Indispensable)GitLab CI/CD (Indispensable)
Intéressé(e) ?
Rejoignez l'équipe et participez à nos projets ambitieux.
