O SEU PRÓXIMO CAPÍTULO
Senior Data Engineer
Sobre a vaga
• Design and build pipelines moving data from terminal operating systems such as Navis N4 into the Azure-based platform
• Build the transformation layer that turns raw operational data into curated, documented datasets
• Develop ELT pipelines from on-premises terminal databases into the Azure platform
• Implement near-real-time three-minute microbatch refreshes for operational reporting and daily batches for analytics
• Use watermark-based incremental queries over Kafka/Azure Event Hubs to PostgreSQL staging
• Build and evolve multi-tenant Azure PostgreSQL architecture with database-per-tenant isolation
• Work with the STG → ODS → DataMart layer structure and internal declarative transformation framework, dewi
• Develop and extend internal Go connector tooling
• Implement data quality monitoring, including gap detection, freshness alerting, and reconciliation
• Shape the standardized terminal data model across different TOS versions and configurations
• Work directly with terminal operations staff without intermediate layers
• Help scale engineering foundations for Terminal.exe, All Your BI's SaaS platform for container terminal operators
• 5+ years of data engineering experience, including end-to-end ownership of production data platforms
• Strong SQL and Python
• Go experience is a significant plus
• Solid experience with SQL Server as a source system and PostgreSQL as a target store
• Experience building and operating ELT pipelines against operational source systems
• Experience with watermark/incremental or CDC/replica-based extraction
• Experience with event-driven or streaming architectures
• Azure cloud data platform experience
• Familiarity with AKS is a plus
• Familiarity with Azure DevOps CI/CD is a plus
• Familiarity with GitOps and Argo CD is a plus
• Strong focus on data correctness and instrumentation
• Experience with OpenTelemetry
• Knowledge of container terminal or port logistics industry is a plus
• Direct experience with Navis N4 or another TOS is a plus
• Multi-tenant SaaS data architecture experience is a plus
• Familiarity with declarative, YAML-driven transformation frameworks is a plus
• Eligible to work in Europe
• €5,000 per year for personal professional growth
• 25 vacation days plus the option to buy up to 10 more
• Local public holidays
• Sabbatical of up to 4 months
• Two trips abroad per year with the whole team
• Occasional drinks and team outings
• €500 home-office budget
• Laptop
• Fully remote within Europe
• Statutory benefits including pension, health, social security, leave, sick pay, and notice according to the hire's country via local contract or EOR