Senior Data Software Engineer
We are seeking a Senior Data Software Engineer. If you are looking to give your career a real boost with a global leader in digital transformation, EPAM is the perfect choice. If you’d like to learn more about this position and project, apply now.
Responsibilities
- Design, construct, install, test and maintain highly scalable and optimized data pipelines with state-of-the-art monitoring and logging practices
- Bring together large, complex, and sparse data sets to meet functional and non-functional business requirements and use a variety of languages, tools and frameworks to marry data
- Design and implement data tools for analytics and data scientist team members to help them build, optimize, and tune use cases
- Tackle challenging and varied problems related to gaining further maturity in Data Platform tools, processes, and engineering capabilities
- Focus on engineering excellence to deliver high-quality solutions that provide leverage for the company's objectives
Requirements
- 3+ years of hands-on experience with data processing-focused projects
- Proficiency in Java/Python/Scala and SQL
- Knowledge of Apache Spark
- Experience with one of the major cloud providers: AWS, Azure, or GCP
- Hands-on experience with selected data processing technologies, e.g., Hadoop, MongoDB, Cassandra, Kafka, Elasticsearch, Python libraries (Pandas/NumPy/etc.), and data processing tools of cloud providers (EMR, Glue, Data Factory, Big Table, etc.)
- Relevant experience with version control and code review
- Understanding of Agile methodologies
- Basic knowledge of Linux and Bash scripting
- Fluency in English, both written and spoken, at a minimum B2 level
Nice to have
- Good hands-on experience with Databricks and Delta Lake
- Ability to build Apache Airflow pipelines
- Experience with the Snowflake platform
