Python Technical Lead

We are looking for a highly skilled Python Technical Lead to join our dynamic team, guiding the design and development of distributed backend solutions while leading a team of 5+ data engineers to deliver API backends for deploying and querying various models on Azure Databricks.

Responsibilities

• Lead design, development, and deployment of backend platform capabilities in a restricted Azure Greenfield environment that will host the models
• Design an API that enables users to query the models
• Leverage Azure Databricks for hosting and deploying models
• Establish processes and guidelines for model deployment, including how to wrap the model in an MLflow wrapper and define the API structure
• Implement best practices for CI/CD using GitLab, ensuring code quality, testing, and deployment automation
• Lead, mentor, and manage a team of 5+ engineers, fostering a collaborative and high-performance environment

Requirements

• 8+ years of experience in data engineering, including at least 2+ years in a leadership role
• Expertise in Python and essential data engineering libraries, including Python Core, Multithreading, Async, REST API, Exceptions, and Pydantic
• Background in Azure cloud services, including Azure Databricks, Azure App Service, and IAM/RBAC
• Proficiency in CI/CD workflows, version control (GitLab), and DevOps practices
• Familiarity with containerization and orchestration tools, including Docker and Kubernetes
• Skills in problem-solving and capability to thrive in a fast-paced, agile environment
• Excellent communication, leadership, and stakeholder management abilities
• English proficiency at an Upper-Intermediate level (B2) or higher