Python Technical Lead

We are seeking a highly skilled Python Technical Lead to join our dynamic team, driving the design and development of distributed backend solutions while leading a team of 5+ data engineers to deliver API backends for deploying and querying various models on Azure Databricks.

Responsibilities

• Lead design, development and deployment of backend platform capabilities in a restricted Azure Greenfield environment that will host the models
• Design an API to allow querying of the models by users
• Leverage Azure Databricks to host and deploy models
• Establish process and guidelines for model deployment, including how to wrap the model in an MLflow wrapper and what the API should look like
• Implement best practices for CI/CD using GitLab, ensure code quality, testing, and deployment automation
• Lead, mentor, and manage a team of 5+ engineers, foster a collaborative and high-performance environment

Requirements

• 8+ years of experience in data engineering, with at least 2+ years in a leadership role
• Expertise in Python and key data engineering libraries, including Python Core, Multithreading, Async, REST API, Exceptions, and Pydantic
• Strong experience with Azure cloud services, including Azure Databricks, Azure App Service, and IAM/RBAC
• Proficiency in CI/CD workflows, version control (GitLab), and DevOps practices
• Familiarity with containerization and orchestration, including Docker and Kubernetes
• Strong problem-solving skills and ability to work in a fast-paced, agile environment
• Excellent communication, leadership, and stakeholder management skills