O SEU PRÓXIMO CAPÍTULO
Data Engineer
Sobre a vaga
• Design, build, and maintain scalable data pipelines and ingestion frameworks supporting batch processing, streaming, and change data capture patterns
• Develop and optimize data processing workflows using Apache Spark and PySpark
• Implement and manage data lake architectures on AWS using Amazon S3 and Apache Iceberg
• Work with AWS Glue for ETL orchestration, Athena for serverless querying, and Lambda for event-driven data processing
• Manage data access controls and security configurations using AWS IAM
• Collaborate with data analysts, data scientists, and platform engineers to understand data requirements and deliver production-ready solutions
• Monitor pipeline health and troubleshoot data quality issues
• Implement improvements to ensure data reliability and freshness
• Document data flows, architecture decisions, and engineering standards
• Advanced hands-on experience with AWS services, including AWS Glue, Amazon S3, Amazon Athena, and AWS IAM
• Experience with Apache Spark / PySpark for data processing
• Knowledge of data lake architectures, ideally with Apache Iceberg
• Experience with data ingestion patterns, including batch processing, streaming, and CDC patterns
• Experience with SQL for data querying, validation, and exploratory analysis
• Solid understanding of data modeling and large-scale data processing
• Ability to work collaboratively in cross-functional teams and communicate technical concepts clearly to non-technical stakeholders
• Experience with infrastructure-as-code or pipeline orchestration tools such as Airflow, Step Functions, or dbt is a plus
• Familiarity with AI-assisted development workflows and engineering productivity tools
• English: Advanced, required for effective communication with global teams
• 2+ years of experience in Data Engineering or related roles, with hands-on work building and maintaining cloud-based data pipelines and lake architectures on AWS
• Certifications in AWS, Databricks, and Snowflake
• Access to AI learning paths
• Study plans, courses, and additional certifications tailored to your role
• Access to Udemy Business
• English lessons
• Travel opportunities to attend industry conferences and meet clients
• Career development plans and mentorship programs
• Special day rewards for birthdays, work anniversaries, and other personal milestones
• Company-provided equipment
• Flexible working options
• Other benefits may vary according to your location in LATAM