We are looking for a Senior Data Engineer to join us! No Advanced English Needed.
Essential functions
* Ingestion & Standardization (Raw/Bronze): Design and implement batch/near-real-time ingestion pipelines from Oracle and other sources into Azure Fabric, managing optimization (columnar format, temporal partitioning, PII handling).
* Quality & Reliability (Trusted/Silver): Define and automate rigorous data quality rules (completeness, uniqueness, consistency, timeliness), data fitness thresholds, alerts, and quarantine flows.
* Modeling & Products (Gold): Model Dimensional Data Warehouses, design domain-specific data marts, and publish reusable data products complete with schemas, data contracts, and SLAs.
* Orchestration & DataOps: Build and maintain complex Airflow DAGs with retries and backfills, while enforcing CI/CD practices (linting, code reviews, feature flags) and end-to-end observability (lineage, freshness logging).
* Governance & Compliance: Tag datasets, document data lineage, expose technical/semantic metadata, and enforce domain-based access control policies (RBAC/ABAC).
Qualifications
* 3–6 years of proven experience in Data Engineering (or 2+ years with an intense focus on Lakehouse/Delta Lake environments).
* Strong technical proficiency in Azure Fabric (Lakehouse, pipelines/notebooks, SQL endpoints) or an equivalent Azure data ecosystem with high ramp-up capability.
* Robust experience using Oracle as a data source, including incremental extraction techniques (SCN, CDC), bulk load management, and query tuning.
* Advanced Python skills for data ingestion, transformations, and testing (highly valuing PySpark or Fabric/Spark).
* Practical mastery of modern ETL/ELT patterns (staging layers, merge/upsert operations, idempotency).
* Solid experience with Apache Airflow (or similar orchestrators), including modular DAG design, sensors, XComs, pools, and SLAs.
* Deep knowledge of Dimensional Modeling (Star/Snowflake schemas), data product design, and automated data quality frameworks (metrics, thresholds, alerting, metadata catalogs).
* Strong Git, CI/CD pipelines, automated testing, and Infrastructure as Code concepts (Terraform/Bicep are a plus).
Would be a plus
Advanced Databricks/Snowflake/Spark, Medallion/Data Mesh architecture, specialized DQ tools (Soda, Monte Carlo, Deequ), observability (OpenLineage, Datadog), and domain experience in Insurance/Finance.
We offer
About us
Mobile Computing is joining Grid Dynamics (NASDAQ: GDYN), a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. Fusing technical vision with business acumen, we solve the most pressing technical challenges and enable positive business outcomes for enterprise companies undergoing business transformation. A key differentiator for Grid Dynamics is our 8 years of experience and leadership in enterprise AI, supported by profound expertise and ongoing investment in data, analytics, cloud & DevOps, application modernization and customer experience. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the Americas, Europe, and India.