Data Engineer – Databricks

• Design, build, and manage scalable data solutions and pipelines using Databricks
• Work closely with cross-functional teams to ensure data is reliable, accessible, and efficient for analytics and business intelligence
• Apply Medallion Architecture using Bronze, Silver, and Gold lakehouse layers
• Build data quality frameworks with automated testing and monitoring
• Implement Delta Lake features including time travel, vacuum operations, and Z-ordering
• Develop and maintain complex ETL/ELT pipelines processing large-scale datasets daily
• Design and implement CI/CD workflows for data pipelines using Databricks Asset Bundles or equivalent tools
• Create real-time and batch data processing solutions with Structured Streaming and Delta Live Tables
• Optimize Spark jobs for cost efficiency and performance using cluster auto-scaling and resource management
• Develop custom integrations with Databricks APIs and external systems
• Design scalable data architectures using Unity Catalog, Delta Lake, and Apache Spark
• Establish data mesh architectures with governance and lineage tracking
• Contribute to a customer-facing banking app for a leading financial group in Japan

• 6+ years of experience in data engineering
• Strong track record of designing and deploying production-grade data pipelines and ETL/ELT workflows
• Proficiency in Python, PySpark, and SQL
• Extensive hands-on experience with AWS Glue, Lambda, Redshift, and S3
• Strong background in data governance and management tools, including Unity Catalog and AWS Sagemaker Unified Studio
• Proven experience in data migration initiatives and modernizing legacy systems
• Communicative English language skills
• Databricks Certified Professional Data Engineer or equivalent certification is a plus
• Experience with containerization and orchestration tools such as Docker and Kubernetes is an advantage

• Enriching and collaborative environment
• Growth opportunities
• Opportunity to contribute to an international banking app project
• Remote work