Senior Data Engineer – Azure Databricks

• Design, build, and maintain production-grade data pipelines using Azure Databricks and Python
• Develop scalable data transformations using PySpark or Spark SQL
• Ingest and process data from APIs, relational databases, cloud storage, and SFTP sources
• Integrate data from ticketing, CRM, marketing, retail, and other enterprise platforms into a centralized Data Hub
• Develop and maintain data warehouse structures, dimensional models, and data marts
• Write, optimize, and maintain SQL transformations
• Implement data quality validations and consistency checks
• Build and maintain outbound data feeds for third-party systems
• Investigate data discrepancies and troubleshoot pipeline issues
• Document data pipelines, transformation logic, dependencies, and technical processes
• Collaborate with team members and stakeholders to clarify requirements, identify risks, and deliver reliable data solutions
• Communicate progress, blockers, and potential delays proactively, proposing next steps

• 5+ years of professional experience in Data Engineering
• Strong hands-on experience with Azure Databricks
• Advanced Python skills for data processing, transformation, and pipeline development
• Solid experience with Apache Spark, including PySpark and/or Spark SQL
• Advanced SQL proficiency, including complex transformations, data validation, and query performance optimization
• Strong knowledge of data warehousing and dimensional modeling, including facts, dimensions, and data marts
• Experience integrating data from REST APIs, relational databases, cloud storage, and SFTP
• Hands-on experience with Microsoft Azure data services
• Experience implementing data quality checks and validating consistency between source systems and target data models
• Ability to troubleshoot pipeline failures and investigate data discrepancies
• Ability to work autonomously, take ownership, and follow engineering practices and documentation standards
• Strong English communication skills
• Ability to collaborate effectively with a US-based team
• Experience migrating SQL-based data workloads to Azure Databricks is nice to have

• Employees can work remotely
• Opportunity to learn fast and take ownership
• Collaboration with strong teams
• Investment in modern ways of working
• Participation in AI-native transformation at scale