AWS Data Engineering Team Lead
We are seeking an experienced AWS Data Engineering Team Lead to drive the design, development, and optimization of highly secure data pipelines and cloud-based architectures. In this leadership role, you will guide a skilled team of engineers, contributing to innovative projects such as building new scanned image data pipelines and migrating healthcare data into centralized, scalable solutions.
Be part of a dynamic team where innovation and collaboration fuel success as we build secure and scalable AWS solutions!
Responsibilities
- Lead, mentor, and manage a team of data engineers to deliver high-quality, scalable solutions
- Design and implement optimized workflows using AWS Glue and Amazon Athena
- Build and enhance distributed data processing systems leveraging Apache Spark
- Analyze business requirements to improve and develop efficient BI processes
- Drive data migration and centralization efforts for large-scale and secure data solutions
- Integrate new scanned image data pipelines into existing systems with a focus on efficiency
- Troubleshoot, monitor, and optimize AWS-based systems to ensure high performance and reliability
- Conduct regular code reviews and enforce best practices in data engineering and cloud computing
- Collaborate with internal teams and leadership to align project deliverables with organizational goals
- Stay updated on emerging cloud and data engineering technologies to implement best practices
Requirements
- 5+ years of professional experience in data engineering or a related field
- At least 1 year of relevant leadership experience in managing technical teams to build and maintain large-scale solutions
- Proficiency in AWS Glue, Amazon Athena, and general Amazon Web Services ecosystem
- Expertise in Apache Spark, data pipeline optimization, and distributed processing systems
- Knowledge of BI process analysis and ability to design scalable solutions
- Familiarity with end-to-end data management practices, including governance and security
- Capability to troubleshoot complex cloud-based architectures and ensure system reliability
- Flexibility to work in EST time zone and collaborate within a LATAM-based engineering team
- Excellent command of written and spoken English (B2+ level)
Nice to have
- Knowledge of Amazon Elastic Kubernetes Service (EKS) for containerized application orchestration
- Understanding of Amazon Kinesis for real-time data streaming processes
- Familiarity with Apache Hive for data warehouse purposes and integration with big data ecosystems
- Knowledge of BI Toolset operational workflows for streamlined business intelligence reporting
- Understanding of Java and/or Node.js with flexibility to utilize them for development tasks
- Skills in SQL with a proven track record of crafting and optimizing queries for performance
