Mid-Level Data Engineer

• Build and maintain ingestion and transformation pipelines for data from APIs, relational databases, files, and data lakes
• Develop solutions in Python, SQL, and PySpark using organized, reusable, and testable code
• Model data in Delta Lake, applying incremental loads, MERGE operations, and maintenance best practices
• Implement Medallion architectures (Bronze, Silver, and Gold) and data quality rules
• Orchestrate jobs and pipelines, configuring dependencies, parameters, retries, and alerts
• Monitor executions, investigate failures, and diagnose data quality and performance issues
• Optimize queries, processing, cluster utilization, and costs, measuring the results of improvements
• Apply governance and security practices, including access control and sensitive data protection
• Collaborate on code reviews, testing, version control, and deployments across environments

• Hands-on experience with Python, advanced SQL, and PySpark
• Experience building and operating data pipelines in Databricks
• Knowledge of Delta Lake, including transactions, schema evolution, incremental loads, and update operations
• Experience with batch processing; knowledge of streaming is a plus
• Knowledge of Medallion architecture and formats such as CSV, JSON, and Parquet
• Experience with job orchestration, monitoring, and failure handling
• Familiarity with Git, code reviews, and testing
• Ability to investigate issues, explain technical decisions, and work independently
• Experience with Auto Loader, Structured Streaming, and declarative pipelines
• Knowledge of Unity Catalog, data lineage, auditing, and permissions
• Experience with AWS, Azure, or Google Cloud
• Experience with CI/CD, infrastructure as code, and Databricks Asset Bundles or equivalent tools
• Databricks Certified Data Engineer Associate certification

• Meal allowance or food voucher
• Discounts on courses, universities, and language institutions
• Stefanini Academy — a platform offering free, up-to-date online courses with certificates
• Mentoring
• Benefits club offering discounts on medical consultations and examinations
• Health insurance
• Dental insurance
• Benefits and discounts at leading establishments
• Travel club
• Pet care benefits