About the Position
You will work closely with architects, engineers, product teams, and clients to translate business requirements into technical solutions, estimate and plan delivery, resolve technical challenges, and ensure high-quality engineering standards across the team.
Responsibilities
- Lead the day-to-day work of the Data Engineering team, including technical direction, planning, prioritization, and delivery.
- Translate client requirements into clear technical scope, implementation activities, estimates, and delivery plans.
- Contribute to solution design by proposing approaches, reviewing architectural decisions, and constructively challenging them when appropriate.
- Work closely with the Data Architect to ensure proposed solutions are practical, scalable, and aligned with implementation needs.
- Coordinate team priorities, task ownership, dependencies, and progress.
- Review technical solutions, code changes, database changes, and implementation approaches.
- Support engineers with technical decisions and blockers.
- Take ownership of problems and drive them through investigation, resolution, and validation.
- Identify risks and dependencies early and coordinate with the relevant teams to resolve them.
- Collaborate with Backend, AI, QA, DevOps, Product, and Architecture teams.
- Communicate progress, risks, estimates, and technical decisions clearly to stakeholders.
Requirements
- Strong experience in data engineering, technical leadership, and delivery coordination.
- Hands-on experience with at least one major cloud platform, such as AWS (preferably), Azure, or GCP.
- Experience with cloud services for batch processing, object storage, relational databases, messaging, containers, and serverless computing.
- Experience with Apache Spark.
- Strong knowledge of SQL, relational databases, and data modelling.
- Experience with Git-based development, code reviews, and CI/CD tools such as GitHub Actions, Azure DevOps or equivalent platforms.
- Experience with web scraping and web parsing.
- Understanding of Master Data Management.
- Ability to understand client requirements and translate them into technical scope, estimates, and delivery plans.
- Ability to evaluate technical and architectural proposals, suggest alternatives, and provide constructive feedback.
- Strong ownership and a proactive approach to identifying and resolving blockers.
- Clear communication, collaboration, and interpersonal skills.
Nice to Have
- Candidates with equivalent experience from other cloud platforms and engineering tools
Technologies
AWS Batch, Amazon RDS, Amazon S3, Amazon SNS, Amazon SQS, Amazon ECR, AWS Lambda, Apache Spark, PostgreSQL, GitHub, GitHub Actions, web parsing and scraping, and Master Data Management.