BigData Architect (Hadoop+ AWS)
AI Harness, Hadoop to AWS Migration and Temporal
Essential functions
Looking for 10+ years of experience candidates
Job Summary:
Looking for an experienced Big Data Architect with expertise in AI Harness, Hadoop to AWS migration, and Temporal workflow orchestration. The candidate will be responsible for designing scalable cloud-based data solutions, leading data modernization initiatives, and optimizing enterprise big data platforms.
Key Skills:
- Big Data technologies: Hadoop, Spark, Hive, Kafka
- Hadoop to AWS Migration
- AWS services: EMR, S3, Glue, Redshift, Lambda
- AI Harness implementation
- Temporal workflow orchestration
- Strong experience in data architecture and ETL pipelines
- Proficiency in Python, Java, or Scala
Qualifications
Desired data engineering skills:
- Experience with AWS (S3, EMR, running Spark jobs on K8s or EKS, Glue, Athena)
- Extensive experience with Apache Spark
- Hands-on experience in Python
- Experience with Apache Airflow
- Experience with Apache Iceberg
- Hands-on experience with Hadoop stack (YARN, HDFS, Hive) will be a plus
We offer
- Opportunity to work on bleeding-edge projects
- Work with a highly motivated and dedicated team
- Competitive salary
- Flexible schedule
- Benefits package - medical insurance, sports
- Corporate social events
- Professional development opportunities
- Well-equipped office
About us
Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. Fusing technical vision with business acumen, we solve the most pressing technical challenges and enable positive business outcomes for enterprise companies undergoing business transformation. A key differentiator for Grid Dynamics is our 8 years of experience and leadership in enterprise AI, supported by profound expertise and ongoing investment in data, analytics, cloud & DevOps, application modernization and customer experience. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the Americas, Europe, and India.
