Lead Data Software Engineer
We are seeking a Lead Data Software Engineer to build and scale big-data applications and cloud-native pipelines while advancing AI-assisted engineering practices. You will guide cross-functional delivery across data and application layers and help shape reliable, scalable architectures—apply now.
Responsibilities
- Design scalable architectures for distributed data and application systems
- Lead technical delivery across data engineering and full-stack components
- Develop high-performance big-data applications using Scala, Databricks, Spark SQL, Spark Streaming, and Python
- Build and optimize Azure-based data pipelines including ingestion, transformation, and orchestration with Azure Data Factory
- Implement APIs and microservices that integrate marketing technology systems with client-facing platforms
- Build and maintain full-stack applications using modern frontend frameworks and backend services
- Apply design patterns to improve reliability, maintainability, and scalability
- Drive AI-assisted engineering practices including Vibe Coding and related accelerators
- Collaborate with product, marketing, and data stakeholders to align scope, priorities, and outcomes
Requirements
- 5+ years of experience in data software engineering with Python and Scala
- 5+ years of experience with Databricks and Spark technologies including Spark SQL and Spark Streaming
- Proven leadership experience leading engineering teams in a fast-paced, cross-functional environment
- Hands-on project delivery experience translating business needs into technical solutions across data and application layers
- Strong system design skills including event-driven architectures and distributed design patterns
- Full-stack development skills with a modern frontend framework and backend services
- API design skills for RESTful and GraphQL interfaces
- Cloud engineering experience with Azure services including Azure Data Factory
- CI/CD pipeline experience supporting full-stack deployments
- Strong communication skills to align stakeholders and explain technical tradeoffs
- Upper-Intermediate English proficiency (B2)
- Availability to overlap with PST until 10 am PST
Nice to have
- Apache Spark
- Azure Data Factory
- Java
