Senior Software Engineer
Elevate and engineer robust data platforms. Build pivotal components and optimize large-scale data pipelines in a dynamic, supportive environment. Your expertise will drive our core data capabilities forward.
Primary Skills
- Azure
- Python & Spark
- Databricks
Responsibilities
- Enhance and maintain the enterprise data platform
- Build and optimize platform components using Python
- Manage data platform operations and conduct daily troubleshooting
- Apply methodologies for large-volume data operations and performance tuning
- Design and construct new, scalable data pipelines
- Proactively ensure system reliability and efficiency
Requirements
- 3+ years of Data Engineering or ETL project experience
- Strong hands-on ETL and data pipeline development experience on Azure
- Proven Python and Spark coding skills with proficiency in PySpark and SQL
- Practical Databricks project experience or relevant certification
- Deep understanding of Databricks ecosystems like Unity Catalog
- Strong initiative and ability to manage multiple concurrent tasks effectively
Nice to have
- Experience in Data Framework Development via Python
- Large-volume pipeline optimization experience
