Big Data Developer (Relocation to Spain)

About the role

Talan, an international consulting group focused on innovation and business transformation through technology, is looking for a Big Data Developer to join an Agile environment and work on the design, development and evolution of data lake solutions for Market Risk use cases. You will build large-scale data processing pipelines and help ingest, transform, validate and publish critical data. The position is full-time, permanent and 100% remote.

Key responsibilities

• Design, develop and maintain data lake pipelines using Apache Spark, Scala and SQL.
• Build and maintain scalable data processing solutions for large volumes of data.
• Orchestrate batch workflows and dependencies with tools such as Control-M and Airflow.
• Implement data ingestion, transformation, validation and publication processes for Market Risk use cases.
• Analyse and optimise the performance, reliability and scalability of Spark-based workloads.
• Analyse technical and functional requirements, identify gaps and propose solutions.
• Contribute to delivery planning and work with Agile squads, functional teams and production support teams.
• Support production incidents, perform root-cause analysis and help improve operational processes.

Required profile

• 2+ years of professional experience in Big Data, Data Lakes or cloud-based data platforms.
• Strong hands-on experience with Apache Spark, Scala and SQL for large-scale data processing.
• Good understanding of data lake architecture, data quality controls, data lineage and production-grade pipelines.
• Strong analytical and problem-solving skills, and excellent communication and teamwork skills.
• C1-level English or equivalent professional fluency; Spanish is a plus.
• Nice to have: workflow orchestration tools (Control-M, Airflow), Databricks, Azure and AWS, YARN, CI/CD tools (GitHub, Jenkins, SonarQube), banking production environments and knowledge of Market Risk processes.

What we offer

• Permanent full-time remote employment.
• Professional growth and continuous learning opportunities.
• A multicultural, international environment.
• Benefits including private medical insurance, life insurance, lunch and transport cards, online language classes and a Smart Office Pack.