Data Engineer – AI & Data Platforms

About the role

We are looking for a Data Engineer with strong expertise in modern data engineering and AI‑powered solutions. The role will focus on designing, building, and optimizing scalable data pipelines while creating intelligent AI agents that improve data accessibility and business productivity.

Key responsibilities

• Design and develop scalable ETL/ELT pipelines, data models, and processing solutions using Python, SQL, Spark, and PySpark.
• Build and deploy AI agents and copilots on platforms such as Copilot Studio, Claude, and Databricks Genie.
• Implement Retrieval‑Augmented Generation (RAG) architectures using vector databases, embeddings, and enterprise search technologies.
• Integrate AI solutions with Databricks, Snowflake, SharePoint, Microsoft Teams, and REST APIs.
• Develop and support solutions leveraging Azure OpenAI, Azure AI Foundry, and other enterprise AI services.
• Create workflow automation and agent orchestration to streamline data engineering processes.
• Collaborate with data, analytics, and business teams to deliver secure, scalable AI‑driven capabilities.

Required profile

• Strong hands‑on experience with Python, SQL, Spark, and PySpark.
• Experience building and integrating AI agents, copilots, and generative AI solutions.
• Knowledge of Retrieval‑Augmented Generation, vector databases, embeddings, and enterprise search frameworks.
• Familiarity with Azure AI services, Databricks, Snowflake, and Microsoft collaboration platforms.

Required skills

• Python
• SQL
• Apache Spark
• PySpark
• Azure AI services
• Databricks
• Snowflake
• SharePoint
• Microsoft Teams
• REST APIs
• Azure OpenAI
• Azure AI Foundry
• Copilot Studio
• Claude
• Databricks Genie
• Vector databases
• Embeddings
• Enterprise search frameworks