Python Technical Lead
We are looking for a highly skilled Python Technical Lead to join our dynamic team, guiding the design and development of distributed backend solutions while leading a team of 5+ data engineers to deliver API backends for deploying and querying various models on Azure Databricks.
Responsibilities
- Lead design, development, and deployment of backend platform capabilities in a restricted Azure Greenfield environment that will host the models
- Design an API that enables users to query the models
- Leverage Azure Databricks for hosting and deploying models
- Establish processes and guidelines for model deployment, including how to wrap the model in an MLflow wrapper and define the API structure
- Implement best practices for CI/CD using GitLab, ensuring code quality, testing, and deployment automation
- Lead, mentor, and manage a team of 5+ engineers, fostering a collaborative and high-performance environment
Requirements
- 8+ years of experience in data engineering, including at least 2+ years in a leadership role
- Expertise in Python and essential data engineering libraries, including Python Core, Multithreading, Async, REST API, Exceptions, and Pydantic
- Background in Azure cloud services, including Azure Databricks, Azure App Service, and IAM/RBAC
- Proficiency in CI/CD workflows, version control (GitLab), and DevOps practices
- Familiarity with containerization and orchestration tools, including Docker and Kubernetes
- Skills in problem-solving and capability to thrive in a fast-paced, agile environment
- Excellent communication, leadership, and stakeholder management abilities
- English proficiency at an Upper-Intermediate level (B2) or higher
