O SEU PRÓXIMO CAPÍTULO
Data Engineer – GCP, Databricks
Sobre a vaga
• Develop and maintain scalable, efficient data pipelines (ETL/ELT)
• Handle data ingestion, transformation, and delivery in GCP environments
• Build solutions using Databricks (Spark/PySpark)
• Design and evolve data architectures (Data Lake, Data Warehouse, Lakehouse)
• Integrate different data sources (APIs, databases, streaming)
• Ensure data quality, governance, and reliability
• Monitor performance and optimize cloud costs
• Collaborate with BI, Analytics, and Data Science teams
• At least 4 years of experience as a Data Engineer
• Hands-on experience with Google Cloud Platform (BigQuery, Cloud Storage, Dataflow, or similar services)
• Experience with Databricks and distributed processing using Spark
• Proficiency in Python and SQL
• Experience with data modeling (relational and dimensional)
• Experience orchestrating pipelines (Airflow or similar tools)
• Knowledge of code version control (Git)
• Experience with Delta Lake
• Knowledge of Infrastructure as Code (Terraform)
• Experience with Docker
• Knowledge of data streaming (Kafka, Pub/Sub)
• GCP or Databricks certifications
• Experience with Lakehouse architecture
• Knowledge of BI tools (Power BI, Looker, Tableau)
• Familiarity with data governance and Brazil’s General Data Protection Law (LGPD)
• Intermediate or advanced English
• Ongoing professional development
• 100% remote work
• Inclusion of people with disabilities (this position is also open to candidates with disabilities)