Big Data Software Engineer [Lead]
Come join a project at an industry-leading financial intelligence and analytics powerhouse!
Our customer is a renowned financial information and analytics company that provides essential intelligence to businesses, governments, and individuals worldwide. The client offers a wide range of services, including credit ratings, market intelligence, data analysis, and investment research. A company is best known for its credit ratings division which assesses the creditworthiness of companies and governments.
Join the project and be at the forefront of shaping the future of financial information and analytics!
Responsibilities
- Drive the development of the data platform
- Oversee a team of developers and QAs
- Take part in architecture decisions and implementation
- Design and develop solutions utilizing Integration Best Practices
- Manage complex data workflows
- Provide day-to-day support and technical expertise to other engineers
- Work across the full software development cycle
- Help improve end-to-end development process, from data collection tools to deployment in a production environment
- Handle direct communication with the customer
Requirements
- Data Architecture Modeling experience
- Strong Python development skills
- Expertise in SQL
- Strong understanding of Data Pipeline and Data Storage tooling (AWS S3, AWS Glue, Apache AirFlow, Apache Kafka, Apache Spark/PySpark, CloudFormation/Terraform, Delta Lake)
- Understanding of RESTFUL APIs and web technologies
- Familiarity with Micro-service architecture
- Experience with the full development lifecycle
- Experience with AWS cloud platform
- Solid understanding of containers and orchestration tools (Docker, CI/CD)
- English level of minimum B2 (Upper-Intermediate) for effective communication
