Data Engineer, Mid-Level

• Lead the end-to-end migration of tables and pipelines from the Cloudera Hadoop environment to AWS, from initial assessment through production stabilization
• Map jobs, pipelines, and HQL queries in Cloudera
• Map Shell Script orchestration routines
• Convert HQL queries to Amazon Athena, AWS Glue, or Amazon EMR, selecting the appropriate service based on cost, performance, and access patterns
• Redesign Shell Script orchestration routines using Step Functions, Lambda, EventBridge, and MWAA/Airflow
• Design the target data lake in Amazon S3 across the raw, trusted, and refined zones
• Design solutions in Amazon Redshift where applicable

• Experience with Cloudera Hadoop, HQL, Shell Script, Amazon Athena, AWS Glue, Amazon EMR, AWS Step Functions, AWS Lambda, Amazon EventBridge, Amazon MWAA/Airflow, Amazon S3, and Amazon Redshift
• Experience migrating data and pipelines between different environments is a plus
• Knowledge of other Big Data and Cloud technologies is a plus

• Meal voucher or food allowance
• Discounts on courses, universities, and language institutions
• Stefanini Academy — a platform offering free, up-to-date online courses with certificates
• Mentoring
• Benefits program offering discounts on consultations and medical tests
• Health insurance
• Dental insurance
• Benefits and discounts at leading establishments
• Travel club
• Pet benefits program