Senior Data Software Engineer
We are seeking a Senior Data Software Engineer to join our Data & Analytics team, focusing on utilizing cloud-native technologies in our Microsoft Azure environment.
You will be pivotal in processing large volumes of financial data, innovating to enhance scalability, reduce processing latency, and increase processing transparency. The ideal candidate will be involved in every stage of the development lifecycle, from engineering robust solutions to collaborating with business partners and supporting operations.
Responsibilities
- Develop and maintain high-stability, performant solutions within the Microsoft Azure environment
- Utilize Databricks, Azure DevOps, Delta Lake tables, and spark structured streaming in project implementations
- Collaborate with business partners and IT experts to understand requirements and shape solutions
- Participate in code reviews to ensure software quality
- Ensure accurate and up-to-date documentation of processes and solutions
- Support operations team in addressing complex problems
- Improve and maintain data processing pipelines used in financial data analysis
- Break down complex requirements into achievable tasks
- Ensure solutions are effectively tested and aligned with business needs
Requirements
- At least 3 years of experience in Data Software Engineering
- Proven core Python software engineering skills, ideally in a finance data context
- Proficiency in Apache Spark and familiarity with Delta Lake tables
- Strong background in relational data models and SQL
- Experience using automated testing to ensure software quality
- Strong analytical skills with the ability to manage complexity
- Self-driven and proactive in addressing issues and opportunities
- Fluent in English with effective collaboration skills in both in-person and remote settings
- Competency in working within a Cloud-native environment, specifically with Microsoft Azure technologies
- Ability to work onsite approximately 3 days per week
Nice to have
- Experience in Lakehouse architecture
- Understanding of low latency processing mechanisms
- Prior exposure to financial data processing systems
