Lead Data Software Engineer (Databricks)
What makes a number trustworthy enough to drive decisions across an enterprise? The Senior Data Software Engineer (Databricks) role in Malaga sits at the intersection of data engineering and analytics, where robust pipelines support seamless integration and actionable insights for multiple business units. Working closely with a team of data engineers and software developers, you shape the flow of information that powers business strategy. The challenge is to build infrastructure that adapts as business needs evolve. The person in this role decides how data becomes a reliable asset for the company.
Responsibilities
- Architect and implement scalable data pipelines to support diverse data ingestion and transformation needs
- Collaborate with software engineering teams to ensure smooth integration of data workflows into broader systems
- Engage regularly with project managers to align pipeline development with project timelines and objectives
- Develop, test, and maintain Python-based data workflows within the Databricks platform
- Monitor pipeline performance and troubleshoot data processing issues to maintain data quality and reliability
- Share data insights and pipeline status updates with business stakeholders to inform decision-making
- Participate in planning sessions to design future-proof data infrastructure and integration strategies
Requirements
- Proficient in designing and optimizing scalable data workflows using Databricks and Python
- Skilled in resolving complex data integration challenges across heterogeneous data sources
- Experienced in collaborating with cross-functional teams including software engineers and project managers
- Capable of translating business requirements into technical data solutions and pipeline architectures
- Adept at analysing data to extract meaningful insights and communicating findings to stakeholders
