We are seeking a highly skilled Senior Data Quality Engineer to join our team.
In this role, you will be instrumental in ensuring the integrity and quality of our data across various platforms. You will work closely with product, engineering, and customer teams to design and implement robust data quality strategies, contribute to data governance processes, and maintain high standards of data quality across all business areas.
Responsibilities
- Work with product, engineering and customer teams to understand requirements to design and implement a data quality strategy
- Play the key role in the data governance processes, including data preparation, generation, data obfuscation, data integration, data slicing and data quality control
- Perform testing of data pipelines, ETLs, APIs, integration, and performance checks
- Prepare test data sets, perform data profiling and benchmarking
- Design and implement quality verification of data products strategy and ensure that all areas of the business perform according to the defined standards
- Prepare Data Quality environments and applications in compliance with the standards and contribute to the CI/CD process establishment
- Participate in designing and maintaining data platforms and design and building data quality automation framework, including potential troubleshooting issues
Requirements
- 3+ years of hands-on engineering experience and practice in Data Management, Data Quality verification/Data Governance, Data Integration
- Good understanding of data pipelines, Data Lakes, ETL testing
- Knowledge of CI/CD principles and best practices in the data processing
- Obligatory excellent SQL knowledge (aggregation, windows functions)
- Experience in Python (or other scripting languages)
- Experience with one of the major cloud providers, AWS, Azure or GCP
- Experience in building up a test automation framework
- Understanding of Big Data Principles
- Experience in Data analysis & requirements validation
- Experience in maintaining QA environments
- Concrete experience in Data project Test Planning, Test Case design, and Test Result Reporting
- Analytical approach to problem-solving; excellent interpersonal and communication skills
- Experience in direct customer communications
- English proficiency
Nice to have
- Experience with a few data processing technologies, e.g., Spark, Hadoop, Kafka, ElasticSearch, Python libraries (Pandas/NumPy/…)
- Good understanding of various ETL Tools (e.g., Databricks)
- Linux and Bash scripting basics
- Skills in infrastructure troubleshooting, support in performance tuning and optimization, bottleneck problem analysis
- Experience in Data project Test Strategy creation
