O SEU PRÓXIMO CAPÍTULO
Big Data Developer – Relocation to Spain
Sobre a vaga
• Design, develop and maintain data lake pipelines using Apache Spark, Scala and SQL
• Build and maintain scalable data processing solutions for large volumes of data
• Orchestrate batch workflows and dependencies using Control-M and Airflow
• Implement data ingestion, transformation, validation and publication processes for Market Risk use cases
• Analyse and optimise Spark workload performance, reliability and scalability
• Analyse technical and functional requirements, identify gaps and propose solutions
• Contribute to delivery planning and collaborate with different teams
• Support production incidents and perform root-cause analysis
• Contribute to continuous improvement of operational processes
• Collaborate with Agile squads, functional teams and production support teams
• Apply software engineering and data development best practices
• 2+ years of professional experience in Big Data, Data Lakes or cloud-based data platforms
• Strong hands-on experience with Apache Spark, Scala and SQL for large-scale data processing
• Good understanding of Data Lake architecture, data quality controls, data lineage and production-grade data pipelines
• Strong analytical and problem-solving skills
• Excellent communication and teamwork skills
• Adaptability and a proactive approach to solving technical challenges
• English: C1 level or equivalent professional fluency
• Experience with Control-M and Airflow valued
• Experience with Databricks, Azure and AWS valued
• Experience with YARN and cloud-based compute environments valued
• Experience with CI/CD and software engineering practices, including GitHub, Jenkins and SonarQube valued
• Experience with banking production environments, operational monitoring and incident management tools such as ServiceNow valued
• Knowledge of Market Risk processes, including P&L, valuations, risk metrics and regulatory reporting data flows valued
• Full-time, permanent employment contract
• 100% remote working with the flexibility to work from wherever you are
• Professional growth and career development opportunities
• Access to continuous learning
• Multicultural and international work environment
• Private medical insurance
• Life insurance
• Lunch and transport cards through the flexible remuneration programme
• Online language classes
• Smart Office Pack to support remote working