Senior Data Engineer, Databricks

• Build, migrate, and enhance Data Engineering solutions in Databricks environments
• Develop and maintain scalable, reliable, and high-performance data pipelines
• Implement data ingestion, transformation, and delivery processes using Spark and PySpark
• Work with Data Lake and Data Lakehouse architectures, implementing the Medallion model (Bronze, Silver, and Gold)
• Interpret business rules and translate them into data processes and solutions
• Participate in data platform migration and modernization projects
• Ensure pipeline quality, performance, monitoring, and reliability

• Proficiency in PySpark, Apache Spark, and SQL
• Experience with Delta Lake, Delta Tables, Unity Catalog, and Lakeflow Declarative Pipelines
• Knowledge of Lakeflow Connect for data ingestion
• Experience with Jobs, Workflows, pipeline orchestration, and monitoring
• Experience with Lakehouse architecture and the Medallion model (Bronze, Silver, and Gold)
• Experience migrating platforms or developing projects in Databricks
• Knowledge of Git, CI/CD, and development and deployment best practices
• Knowledge of Airflow, Kafka, dbt, AWS Glue, and BigQuery
• Experience with SQL/NoSQL databases such as PostgreSQL, MongoDB, or Cassandra
• Preferred: experience with accounting and financial projects
• Preferred: Databricks Certified Data Engineer Associate certification

• Remote work
• This position is also open to candidates with disabilities