Our client, a leading player in the financial services sector, is seeking a highly skilled and experienced Data Engineer with expertise in Azure. This role offers an exciting opportunity to be part of a dynamic team that is investing heavily in data and analytics to drive commercial decision-making, risk management, and operations.
What you'll do:
As a Data Engineer specialising in Azure, your primary role will involve designing, building, and testing complex data ingestion and processing pipelines. You will collaborate closely with the Data Engineering Manager on technical architecture and design while understanding commercial data usage to identify system requirements. Your ability to analyse IT changes will be crucial in providing input on technical opportunities, constraints, and trade-offs. You will also be responsible for creating documentation that can be presented to both technical and non-technical audiences. Your commitment to conducting detailed testing for development activities will ensure that results are demonstrated according to the delivery methodology and coding standards. Furthermore, you will create complex data pipelines with quick turnaround times while maintaining high quality. Lastly, you will assist the team with production code deployment and data platform support.
- Design and deliver data solutions using an agile, iterative approach based on Scrum.
- Collaborate with the Data Engineering Manager on technical architecture and design.
- Understand commercial data usage to identify system requirements.
- Analyse and estimate IT changes, providing input on technical opportunities, constraints, and trade-offs.
- Create documentation and present to both technical and non-technical audiences.
- Conduct detailed testing for development activities and demonstrate results according to the delivery methodology and coding standards.
- Create and productionize complex data pipelines with quick turnaround and high quality.
- Assist the team with Production code deployment and data platform support.
What you bring:
As an experienced Data Engineer specialising in Azure, you bring extensive cloud experience in Azure along with advanced coding skills in Python and SQL. Your experience in Databricks or equivalent experience in Spark will be highly valuable. You possess an in-depth knowledge of Azure services and are proficient in dimensional modelling, including star and snowflake schema design. Your familiarity with Python packages such as Pandas, Numpy, and Seaborn, along with a strong understanding of Big Data, MapReduce, and Spark, will be crucial to your success in this role. Additionally, your familiarity with reporting tools such as Power BI or Tableau will be beneficial.
- Extensive cloud experience in Azure.
- Advanced coding experience in Python and SQL.
- Experience in Databricks or equivalent experience in Spark.
- In-depth knowledge of Azure services.
- Proficient in dimensional modelling (e.g., star and snowflake schema design).
- Knowledge of Python packages such as Pandas, Numpy, and Seaborn.
- Strong understanding of Big Data, MapReduce, Spark.
- Familiarity with reporting tools such as Power BI or Tableau.
What sets this company apart:
Our client is a leading player in the financial services sector that values lifelong learning and engineering excellence. They are committed to investing heavily in data and analytics to drive commercial decision-making, risk management, and operations. The successful candidate will have the chance to work on designing, building, and testing complex data ingestion and processing pipelines using Azure services and Databricks.
What's next:
If you're ready for an exciting challenge in a fast-paced environment, apply now!
Apply today by clicking on the link provided!
Do note that we will only be in touch if your application is shortlisted.
Robert Walters (Singapore) Pte Ltd
ROC No.: 199706961E | EA Licence No.: 03C5451
EA Registration No.: R1439850 Sachet Sethi
