Senior Data Engineer – Databricks, PySpark, SQL

• Design, develop and maintain scalable data ingestion and transformation pipelines on a Databricks-based Lakehouse platform
• Implement Bronze, Silver and Gold data layers
• Integrate data from enterprise systems, APIs and external sources
• Develop processing workflows using PySpark and SQL
• Implement reusable engineering frameworks
• Optimise pipelines for scalability and cost efficiency
• Translate established architecture standards into practical engineering solutions
• Support data governance, lineage, cataloguing and access management initiatives
• Enable BI and Analytics teams to consume trusted, business-ready data
• Participate in Agile ceremonies
• Contribute to delivery through Git-based version control and CI/CD practices
• Collaborate with Data Architects, Analytics teams and business stakeholders

• At least 4 years of professional Data Engineering experience
• At least 2 years of hands-on Databricks development experience
• Strong practical skills in Databricks and PySpark for building and maintaining data processing pipelines
• Strong SQL development and optimisation skills
• Experience with Azure Data Platform services
• Proven experience designing and implementing ETL/ELT pipelines, including data ingestion and transformation
• Understanding of Lakehouse architecture and Medallion Architecture, including Bronze, Silver and Gold data layers
• Experience integrating data from multiple enterprise systems, APIs and external sources
• Knowledge of data quality, pipeline reliability, performance optimisation and data security principles
• Experience using Git and CI/CD practices in data engineering workflows
• Ability to collaborate effectively with Data Architects, BI and Analytics teams, and business stakeholders
• Professional working proficiency in English
• Availability to work remotely from Portugal or Spain
• Preferred: Experience with Delta Live Tables (DLT)
• Preferred: Familiarity with Unity Catalog and Databricks data governance capabilities
• Preferred: Experience with Microsoft Fabric
• Preferred: Previous involvement in Data Hub or Enterprise Data Platform programmes
• Preferred: Experience developing reusable data engineering frameworks and components
• Preferred: Knowledge of data lineage, cataloguing and enterprise data governance practices
• Preferred: Experience optimising cloud data workloads for performance and cost efficiency

• 15th month salary
• Health insurance covering your family
• Birthday off
• Mobility program for digital nomads
• Real work-life balance