Senior Data Software Engineer
We are seeking a Senior Data Software Engineer to design and build scalable data pipelines and platforms that power analytics, reporting, and AI-driven initiatives. In this role, you will work closely with Product, Engineering, and Business teams to deliver robust, high-quality data solutions using modern cloud and big data technologies.
Responsibilities
- Design and develop scalable batch and streaming data pipelines
- Build and optimize Databricks, Spark, and Kafka-based solutions
- Implement data quality, governance, and observability standards
- Develop data models and reporting foundations for analytics and AI initiatives
- Partner with Product, Engineering, and Business teams to deliver data-driven solutions
- Support enterprise reporting, dashboards, and self-service analytics platforms
- Leverage AI tools such as Claude Code, GitHub Copilot, and similar platforms for development, testing, and productivity improvements
- Apply MCP, prompt engineering, and multiple LLMs in AI-assisted development workflows
Requirements
- 3+ years of experience in data engineering or a related field
- Proficiency in SQL, Python, PySpark, Scala, and Java
- Expertise in Apache Spark, Spark SQL, Kafka, and Delta Lake
- Skills in Azure Databricks, Unity Catalog, and Databricks Asset Bundles (DAB)
- Familiarity with Azure Data Factory (ADF), ADLS Gen2, Azure Key Vault, Azure Cosmos DB, and Azure Monitor
- Knowledge of Data Modeling, Data Quality, Data Governance, and PII Handling
- Background in Medallion Architecture (Bronze/Silver/Gold), CDC, and SCD Type 1 & Type 2
- Competency in Azure DevOps, Git, CI/CD, and Gradle
- Proficiency in English at a B2+ level
Nice to have
- Familiarity with Tableau, ThoughtSpot, Cognos, and Data Visualization Best Practices
- Knowledge of Semantic Layer Concepts, AI/BI Dashboards, and Databricks Genie
- Understanding of scalable data platforms, analytics, and reporting solutions
