Senior Data Engineer – Azure Databricks

• Develop, maintain, and optimize data pipelines using Azure Databricks, PySpark, Azure Data Factory, Python, and Azure Data Lake
• Build and support ETL/ELT processes for enterprise data integration and analytical needs
• Perform data ingestion, transformation, validation, and reconciliation from multiple systems
• Conduct data analysis and profiling, identifying quality issues and ensuring the consistency and reliability of information
• Develop, write, and optimize complex SQL queries to achieve high-performance data processing
• Perform performance tuning and troubleshooting for large-scale workloads
• Resolve Level 2 production incidents involving Azure Data Factory pipelines, Databricks jobs, and data processing workflows
• Monitor and support production pipelines, ensuring availability, scalability, and operational efficiency
• Support deployment and release processes across development, staging, and production environments
• Manage priorities and demands across multiple projects, working autonomously and with a strong focus on meeting deadlines

• More than 8 years of experience in Data Engineering
• Proven experience in Data Engineering and ETL process development
• Strong hands-on experience with Azure Databricks and Azure Data Factory (ADF)
• Advanced proficiency in ETL/ELT development and data transformation
• Advanced SQL skills, including the development, optimization, and tuning of complex queries
• Experience with Python and PySpark
• Experience with Azure Data Lake and enterprise data integration
• Experience with data analysis, validation, profiling, and quality assurance
• Experience supporting, monitoring, and troubleshooting production pipelines
• Ability to work independently, stay organized, and manage priorities
• Strong verbal and written communication skills
• Advanced English proficiency is required
• Preferred: experience with CI/CD pipelines and DevOps practices
• Preferred: knowledge of Git, Azure DevOps, or similar version control and deployment tools
• Preferred: familiarity with monitoring, logging, and observability tools in cloud environments

• CLT employment contract
• Fully remote work