← Todas as vagas

AWS Data Engineer

Sobre a vaga

• Design, develop, and maintain automated ETL pipelines using Python and Apache Airflow
• Orchestrate pipelines to run sequentially or in parallel
• Track pipeline runs and reprocess error records
• Troubleshoot data pipeline errors and proactively fix issues
• Export and import CSV, JSON, and XML data primarily from S3 or other cloud storage
• Optimize complex SQL queries for performance in data warehouse technologies, preferably Snowflake
• Generate code using Python configurations and Jinja templates
• Implement CI/CD processes from scratch using GitHub
• Collaborate with international teams across global delivery centers
• Contribute to AI-driven automation and cloud solutions for financial, healthcare, and manufacturing clients

• 10+ years of total experience with a 100% hands-on approach to the required technical stack
• Advanced proficiency in Python concepts, including code structures, modules, packages, classes, subclasses, inheritance, multi-threading, and functional programming
• Experience developing reusable Python packages
• Advanced SQL skills, including complex joins, CTEs, and subqueries
• Proficiency in Python unit, integration, and system testing
• Proficiency implementing DBT tests for data validation and quality checks
• In-depth understanding of AWS S3, ECS, and IAM
• Knowledge of AWS security best practices, IAM roles, encryption standards, secure coding guidelines, and DBT profile access configurations
• Experience using AI IDE tools such as Cursor or GitHub Copilot
• Ability to write automated ETL processes and schedule jobs such as Airflow DAGs
• Experience troubleshooting and fixing data pipeline errors
• Experience exporting/importing CSV, JSON, and XML data from S3 or other cloud storage
• Experience optimizing SQL queries for Snowflake
• Experience generating code using Python and Jinja templates
• Experience with GitHub and implementing CI/CD processes from scratch
• Advanced oral English for collaboration with global teams
• Advanced Spanish
• High-performance mindset, resilience, emotional intelligence, and focus on agile delivery
• Desired: AWS Lambda experience
• Desired: Apache Airflow on AWS, including AWS service and DBT model integrations
• Desired: API integrations with Salesforce, SFTP, SharePoint, OneDrive, and similar systems
• Desired: Complex DBT models and custom DBT macros using Jinja and Python
• Desired: AWS CloudWatch and Datadog familiarity
• Desired: Cloud-native foundations or AI coding assistant familiarity

• Flexible work arrangement supporting lifestyle
• Remote work option
• Continuous learning opportunities
• Exposure to high-impact projects and complex engineering challenges
• Growth and professional development opportunities
• Collaboration with international teams and global delivery centers