Data Engineer – Azure & AI Solutions

About the role

We are looking for a skilled Data Engineer to design, implement, and maintain robust data pipelines on the Azure platform. You will work on both batch and real‑time workflows, supporting analytics, AI, and large language model initiatives.

Key responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines using Azure Data Factory and Azure Databricks.
• Ingest and transform structured and unstructured data from APIs, databases, files and external systems.
• Develop and maintain data models and curated datasets for analytics, AI, LLM, RAG and agentic applications.
• Implement data quality, validation, monitoring, error‑handling and governance processes.
• Optimize pipelines for performance, scalability, reliability and cost.
• Build batch and, where required, real‑time/streaming processing workflows.
• Work with Azure data lake/storage solutions and Azure SQL Database.
• Develop AI services and APIs using Python 3.12+ and FastAPI.

Required profile

• University degree in Computer Science, Engineering or a related field.
• Proven experience as a Data Engineer with a focus on Azure technologies.
• Strong programming skills in Python, SQL and Spark.
• Knowledge of LangGraph, Retrieval‑Augmented Generation (RAG) and retrieval systems.
• Familiarity with airline/IRREG domain, EU261 and fare‑rule knowledge is a plus.
• Excellent English communication skills.

Required skills

• Azure Data Factory
• Azure Databricks
• Azure SQL Database
• Azure data lake/storage technologies
• Python 3.12+
• FastAPI
• SQL
• Spark
• Data modeling and data warehousing
• ETL/ELT processes
• LangGraph
• RAG / retrieval systems
• Data lineage, metadata and governance practices