O SEU PRÓXIMO CAPÍTULO
Senior Data Engineer
Sobre a vaga
• Implement monitoring systems and routines for data, applications, queries, and other components
• Enhance data models and architecture, and build data pipelines to meet new engineering and business requirements
• Implement data migration, processing, and storage routines (ETL)
• Develop integrations between different data sources (RDS, external APIs, etc.) to centralize data in a data lake
• Implement and conduct load tests
• Monitor data pipelines in production
• Experience with Python
• Experience with GCP
• Experience with continuous integration and cloud deployment
• Experience with data lakes, data warehouses, and data marts
• Knowledge of SQL and NoSQL databases
• Knowledge of cloud platform services and resources
• Knowledge of event-driven architecture
• Experience with streaming projects is a plus
• Experience with Airflow is a plus
• Experience with distributed data processing (Spark or similar technologies) is a plus