CDIPorto, Portugal
Tech Lead Data Engineering
Hybride
ℹ️ Hybrid, 3x/week on-site
-------------------------------------
The role is for a senior Tech Lead in real-time data engineering, with 10+ years of experience.
The profile must have strong hands-on experience with Apache Flink, Apache Kafka, AWS, APIs, microservices and event-driven architecture. The role covers the full lifecycle of real-time data products, from ingestion and processing to API delivery and production support.
The Tech Lead will also guide architecture decisions, technical reviews, engineering standards, mentoring, data quality, security, testing, observability and CI/CD.
Design and build streaming data products using Apache Flink, Apache Kafka and event-driven architecture.
Develop ingestion, processing, transformation and delivery pipelines for real-time and batch workloads.
Build REST, OpenAPI and streaming interfaces, as well as microservices for data consumers.
Use AWS services such as MSK, Kinesis, Managed Service for Apache Flink, Lambda, API Gateway, ECS, EKS, S3 and IAM.
Define data quality controls, schema management, validation processes and automated tests.
Implement CI/CD pipelines with GitLab CI, GitHub Actions or equivalent tools.
Set up monitoring, logging, metrics and tracing with tools such as CloudWatch, Prometheus, Grafana and OpenTelemetry.
Support production services, incident resolution, performance improvements and root-cause analysis.
Apply security practices covering authentication, authorisation, encryption, secrets management and access control.
Lead technical designs, code reviews, architecture discussions, documentation and knowledge sharing.
Experience Required
10+ years of experience in software engineering, data engineering or a related technical field.
Proven experience delivering real-time data products in production.
Strong hands-on experience with Apache Flink and Apache Kafka.
Experience with streaming pipelines, event-driven systems, APIs, microservices and distributed systems.
Production experience with AWS data and application services.
Experience with data quality, schema governance, automated testing and CI/CD.
Knowledge of observability, cloud security and production support.
Experience leading technical discussions, reviewing code and mentoring engineers.
Bilingual English proficiency for work with international technical and business teams.
Contact
costa.neto@littlebigconnection.com
+351 21 020 9908 (Tel. & WhatsApp)
Informations de la mission :
-------------------------------------
The role is for a senior Tech Lead in real-time data engineering, with 10+ years of experience.
The profile must have strong hands-on experience with Apache Flink, Apache Kafka, AWS, APIs, microservices and event-driven architecture. The role covers the full lifecycle of real-time data products, from ingestion and processing to API delivery and production support.
The Tech Lead will also guide architecture decisions, technical reviews, engineering standards, mentoring, data quality, security, testing, observability and CI/CD.
Design and build streaming data products using Apache Flink, Apache Kafka and event-driven architecture.
Develop ingestion, processing, transformation and delivery pipelines for real-time and batch workloads.
Build REST, OpenAPI and streaming interfaces, as well as microservices for data consumers.
Use AWS services such as MSK, Kinesis, Managed Service for Apache Flink, Lambda, API Gateway, ECS, EKS, S3 and IAM.
Define data quality controls, schema management, validation processes and automated tests.
Implement CI/CD pipelines with GitLab CI, GitHub Actions or equivalent tools.
Set up monitoring, logging, metrics and tracing with tools such as CloudWatch, Prometheus, Grafana and OpenTelemetry.
Support production services, incident resolution, performance improvements and root-cause analysis.
Apply security practices covering authentication, authorisation, encryption, secrets management and access control.
Lead technical designs, code reviews, architecture discussions, documentation and knowledge sharing.
Experience Required
10+ years of experience in software engineering, data engineering or a related technical field.
Proven experience delivering real-time data products in production.
Strong hands-on experience with Apache Flink and Apache Kafka.
Experience with streaming pipelines, event-driven systems, APIs, microservices and distributed systems.
Production experience with AWS data and application services.
Experience with data quality, schema governance, automated testing and CI/CD.
Knowledge of observability, cloud security and production support.
Experience leading technical discussions, reviewing code and mentoring engineers.
Bilingual English proficiency for work with international technical and business teams.
Contact
costa.neto@littlebigconnection.com
+351 21 020 9908 (Tel. & WhatsApp)
Informations de la mission :
- Début de mission : 16/11/2026
- Durée : 6 mois
- Date de publication : 07/11/2026
- Date limite de candidature : 20/11/2026
Compétences recherchées
Apache Flink (Indispensable)Apache Kafka (Indispensable)AWS (Indispensable)MSK (Indispensable)Kinesis (Indispensable)Managed Service for Apache Flink (Indispensable)Lambda (Indispensable)API Gateway (Indispensable)ECS (Indispensable)EKS (Indispensable)S3 (Indispensable)IAM (Indispensable)REST (Indispensable)OpenAPI (Indispensable)microservices (Indispensable)event-driven architecture (Indispensable)GitLab CI (Indispensable)GitHub Actions (Indispensable)CI/CD (Indispensable)CloudWatch (Indispensable)Prometheus (Indispensable)Grafana (Indispensable)OpenTelemetry (Indispensable)APIs (Indispensable)Microservices (Indispensable)Event-driven architecture (Indispensable)Observability (Indispensable)Security (Indispensable)Data quality (Indispensable)REST/OpenAPI (Indispensable)English (Apprécié)
Intéressé(e) ?
Rejoignez l'équipe et participez à nos projets ambitieux.
