Senior Data Engineer – Palantir Foundry
Are you a software engineer with strong knowledge of Palantir Foundry and an open-minded approach? Join our team as a Senior Data Engineer and become a core contributor in a highly agile environment for Fortune 1000 clients. You will work alongside experts, following XP practices and best CI/CD standards, and help deliver impactful data solutions.
We are seeking a Senior Data Engineer with hands-on Palantir Foundry experience and a collaborative personality. You will be responsible for data ingestion from multiple domains, building and orchestrating large-scale Big Data pipelines and developing front-end applications to facilitate data consumption for end-users.
This position offers a hybrid work setup with flexibility to work from Malaga or Madrid, with occasional office visits required.
Responsibilities
- Ingest data from various sources into the Palantir Foundry platform
- Build, orchestrate and monitor large Big Data pipelines (PySpark) with more than 350 datasets
- Perform entity resolution (fuzzy matching) of sites and investigators from multiple sources
- Apply data science techniques for segmentation and targeting of sites and investigators to help users select the best options across different features
- Create front-end applications using Workshop and Typescript to facilitate data consumption by end-users
Requirements
- Bachelor's degree level or equivalent in Computer Science, Data Science or similar discipline
- 4+ years of front-end software engineering experience
- Hands-on experience with Palantir Foundry including code workspace, pipeline builder and ontology for back-end pipeline development with Python, PySpark and Spark
- GenAI experience
- Experience with JavaScript, Workshop and Slate
- Experienced with Scrum and Agile development approaches
- Good communication in English, with the ability to explain technical concepts in a clear way for non-technical audiences
- Familiarity with HTML, CSS, JavaScript, and Gradle
- Knowledge of Insurance Domain, Financial Industry or Finance function in other industries
- Solid communication skills in Spanish (at least C1)
