Data Engineer (Azure Databricks + Python) - Remote Work

About the role

We are looking for a skilled Data Engineer to design and build scalable data pipelines using Azure Databricks and Python. You will integrate AI and large‑language‑model APIs into data workflows, enabling automated classification and insight generation for our global clients.

Key responsibilities

• Design, develop, and optimise end‑to‑end data pipelines and Lakehouse architectures on Azure Databricks.
• Integrate LLM APIs and machine‑learning models into processing streams for automated classification.
• Write high‑quality Python code and SQL procedures for data transformation and ingestion.
• Collaborate with AI and product teams to deliver data‑driven solutions that create business value.
• Monitor pipeline performance, troubleshoot issues, and ensure reliability and scalability.
• Apply data‑governance and security best practices to maintain platform integrity and compliance.

Required profile

• Minimum 4 years of experience in Data Engineering, Machine Learning Engineering, or Software Engineering.
• Proven ability to build and optimise data pipelines with Azure Databricks and Python.
• Experience integrating AI/ML solutions and LLM APIs into automated workflows.
• Strong background in data manipulation, automation, and classification tasks.
• Advanced proficiency in English.

Required skills

• Azure Databricks
• Python
• SQL
• LLM APIs
• Machine Learning / AI integration
• Cloud‑native data architecture

What we offer

• 100% remote work from anywhere.
• Competitive compensation in USD or local currency.
• Provided hardware and software for home office.
• Flexible schedule and paid parental leave, vacations, and holidays.
• Multicultural environment with mentorship, skill development, and growth opportunities.