Senior Data Engineer (Palantir)

Are you passionate about leveraging cutting-edge technology to solve complex data challenges? Do you have a strong software engineering background and expertise in Palantir Foundry? EPAM is seeking an open-minded, innovative professional with excellent English skills to join our team in Portugal as a Senior Data Engineer. In this role, you’ll collaborate with talented colleagues on impactful projects, working with some of the world’s most advanced data platforms to drive real business value.

Responsibilities

• Ingest data from multiple sources and domains into the Palantir Foundry platform
• Develop and maintain a large-scale Big Data pipeline (PySpark) consisting of more than 350 datasets including orchestration and monitoring
• Perform entity resolution (fuzzy matching) of sites (healthcare centers) and investigators from diverse sources
• Apply data science techniques for segmentation and targeting of sites and investigators enabling users to select the best potential candidates across various features
• Create front-end applications to facilitate data consumption by end-users utilizing Workshop and coding in TypeScript

Requirements

• 4+ years of front-end software engineering experience
• Hands-on experience with Palantir Foundry including code workspace, pipeline builder and ontology for back-end pipeline development using Python, PySpark and Spark
• Experience with GenAI technologies
• Proficiency in JavaScript, Workshop and Slate

Nice to have

• Ontology