Senior Data Engineer – Remote from Portugal, Selected EU Countries

• Act as the technical reference for the Client’s Databricks data platform
• Design, build, and optimise batch and streaming data pipelines on Databricks using PySpark, Spark SQL, Delta Lake, and Delta Live Tables
• Evolve the Lakehouse architecture (bronze, silver, and gold layers) to ingest and transform operational, behavioural, and HSE data from multiple clients and sources
• Implement and maintain CI/CD pipelines for data workloads using Databricks Asset Bundles, Git, Azure DevOps, or GitHub Actions
• Automate data testing, quality checks, and promotion across development, staging, and production environments
• Implement and manage Unity Catalog, including catalogs, permissions, lineage, auditing, and data access policies
• Define and enforce data governance standards, security controls, data masking, and per-client data isolation to ensure compliance with LGPD and GDPR
• Monitor pipeline performance, define SLAs, set up alerts, and lead incident reviews
• Provision infrastructure as code using Terraform and standardise pipeline templates and best practices
• Review code, mentor mid-level and junior engineers, and collaborate with product, data science, and consulting teams
• Document architecture decisions, technical standards, and data engineering best practices

• At least 6+ years of experience in similar roles
• 3+ years working with Databricks in production environments
• Strong hands-on experience with Databricks in production, including PySpark, Spark SQL, Delta Lake, and Delta Live Tables / Lakeflow
• Solid experience designing and optimising batch and streaming pipelines and evolving Lakehouse architectures (bronze, silver, gold layers)
• Proven experience implementing CI/CD for data workloads using Git, Azure DevOps or GitHub Actions, and Databricks Asset Bundles
• Practical DataOps experience, including automated testing, pipeline versioning, observability, and monitoring
• Hands-on experience with data governance, ideally using Unity Catalog (access control, lineage, and auditing)
• Experience with Infrastructure as Code using Terraform
• Strong proficiency in Python, PySpark, and advanced SQL
• Cloud experience, preferably on Azure (ADLS, Data Factory, Key Vault, Entra ID)
• Experience with agentic coding
• Fluent English; minimum B2+ level (professional working proficiency)
• Databricks Data Engineer Professional certification or Azure certifications (DP-203 / DP-700) appreciated
• Experience with multi-tenant SaaS platforms and per-client data isolation appreciated
• Knowledge of MLOps practices (MLflow, Feature Store, Model Serving) and building data pipelines for generative AI / RAG appreciated
• Experience with Microsoft Purview appreciated
• Experience with data quality tools (Great Expectations, Lakehouse Monitoring, dbt) appreciated
• Experience with streaming technologies (Kafka, Event Hubs, or Structured Streaming) appreciated
• Domain knowledge in HSE, industrial operations, or risk management data appreciated
• Ability to understand requirements and technical solutions
• Strong communication skills
• Critical thinking and a focus on continuous improvement
• Strong delivery mindset and commitment to deadlines and goals
• Must currently and lawfully reside with a work permit in Portugal, Bulgaria, Croatia, Estonia, Hungary, Latvia, Lithuania, Slovakia, or Romania
• No visa sponsorship or relocation support available

• Fully remote position with occasional, pre-planned visits to Client or FCamara sites in Portugal or Central Europe; regular office visits are not anticipated
• No visa sponsorship or relocation support
• Long-term project
• Contract model options: employment contract, independent contractor, or B2B