Senior Python Data Engineer with AI
We are seeking a highly skilled Senior Python Developer to join our dynamic team and play a pivotal role in building scalable, robust APIs and innovative backend solutions for generative AI applications.
This position will involve close collaboration with cross-functional teams to deliver high-performance, well-architected solutions aimed at solving complex problems.
Responsibilities
- Develop and deploy scalable RESTful APIs to serve web apps and integrations with other software
- Ensure API performance, scalability, and maintainability with focus on clear, concise code and robust logging/monitoring
- Support and optimize database integrations, ensuring efficient data modeling and query performance
- Collaborate with data engineers on pipelines and orchestration frameworks to deliver clean, organized data to APIs
- Conduct thorough unit and integration testing in collaboration with testing teams
- Review code from peers to ensure high-quality solutions and provide constructive feedback
- Create and maintain technical documentation for solutions and Software Development Lifecycle (SDLC) processes
- Apply modern software design best practices including version control, containerization, and scalable service design
- Work collaboratively with product teams throughout all phases of the development lifecycle
Requirements
- 5+ years of professional experience in Python-focused backend development
- Extensive experience with at least one Python backend framework, such as FastAPI
- Proficiency in asynchronous programming and advanced Python development
- Expertise in relational database systems, including PostgreSQL and data modeling
- Knowledge of RESTful API design principles and modern software development practices
- Familiarity with scalable architecture patterns, containerization tools, and cloud-based operations
- Extensive background in version control systems and CI/CD pipelines
- Experience working with data engineering frameworks, such as Spark or PySpark, and orchestration tools like Airflow is a plus
Nice to have
- Knowledge of Amazon Redshift and Databricks for data engineering workflows
- Background in ETL/ELT solutions for data transformation and loading
- Skills in leveraging Apache Airflow for orchestration frameworks
- Familiarity with PySpark and GitHub Actions for workflow automation and development pipelines
