Senior Data Engineer – Johannesburg

We’re looking for a curious, intelligent, and proactive cloud focused Senior Data Engineer to help us tackle complex data analytics projects end-to-end in Microsoft Azure.

Company Overview

The NMG Group is a global advisory and intermediary firm focused exclusively in financial services. Established in 1992, NMG has enjoyed steady expansion internationally. We have clients across the world with our most established businesses in Australia, South Africa, Asia, the UK and Canada and a growing presence in the US and Europe. Our main offices are in Sydney, Singapore, Kuala Lumpur, Johannesburg, Cape Town, London, Toronto and New York.

At NMG Consulting we are a nimble firm of 160 people focusing exclusively on the Insurance, Reinsurance, Wealth Management and Asset Management Industries. Our advisory model uniquely integrates Consulting, Insights and Analytics. Located globally, we are a diverse team of talented and experienced individuals, partnering with industry leaders to provide deep and powerful insights and knowledge.

We are constantly evolving and the range of work that we do rapidly challenges and expands our peoples’ knowledge. Our flat, team-based structures encourage participation from all experience levels – everyone is encouraged to contribute, regardless of their role. We advocate hearing different points of view, collaboration and constructive debate.

Summary Statement

In this role you will work with various teams based in multiple locations globally to deliver solutions on the Azure Cloud using core Azure cloud tools and languages. In addition, you will participate in improving recent implementations. You’re committed to delivering high quality interactions and you’re excited about making a big impact on a small team.

Role

Senior Data Engineer

Location:

Johannesburg

Key Responsibilities

  • Data Architecture: Participate in deep architectural discussions to build confidence and ensure customer success when building new solutions and migrating existing data applications on the Azure platform. Reverse engineer existing database data models, manage and maintain existing and new logical and physical data models.

  • Data Engineering (Development): Collaborate with functional group leaders and engineering team(s) to gather and analyse business and technical data requirement needs and understand how data is collected, analysed & utilised to design, and implement the management, monitoring, security, and privacy of data using the full stack of Azure data services. Design and build Microsoft Azure functions to optimize data extractions and ensure data validation, cleansing and merging forms a critical part of data processing solutions. Ensure that data services securely and seamlessly integrate with other data platform technologies or application services such as Azure Cognitive Services, Azure Search, or even bots.

  • Testing: Perform unit, integration, or system testing (automated or otherwise) on all developed code and / or system components through stringent routines and procedures to ensure accuracy and solution integrity and that solutions run smoothly with optimum operational efficiency, ensuring all solutions will meet SLAs & performance criteria. Provide feedback on solutions’ usability, features, and design based on results of testing.

  • Production Support and Maintenance: Provide exceptional support by applying critical thinking skills to troubleshoot, determine the cause of failure, and quickly restore failed components or processes when they occur; Diagnose and remediate resource contention issues and failures in application logs. Participate in an on-call rotation with the team, when necessary, specifically related to customer-facing digital cloud solutions.

  • Training and Mentorship: Provide technical training and mentoring to other teams and team members and organize and execute training sessions for the user base of in-house developments for new workflows, procedure recommendations, the availability of data in operational data stores as well as the data warehouse and how to consume the data effectively in business intelligence and analytics tools withing the organization.

Competencies, Qualifications & Experience

  • Experience in multiple or all Azure components, including: API Management, Event Hubs, Data Factory, Functions, Resource Manager Templates, Storage Accounts, Notifications Hub, Key Vault, DevOps, Data Lake Stores, Data Lake Analytics, Synapse Analytics, Databricks, HD Insight, SSAS, SQL Database or similar cloud infrastructure (5+ years’ experience and deep expertise in data engineering as applied to Azure preferred), including Visual Studio as applied to SSAS development. Applicable Azure certifications including for example Implementing an Azure Data Solution, Designing an Azure Data Solution, Designing and Implementing Microsoft DevOps Solutions.

  • In-depth knowledge of standard concepts, practices and procedures related to database modelling (logical and physical) and management, concepts of data lakes, data warehousing and data marts as well as legacy migrations to cloud services. Being able to conceptualize the full project life cycle.

  • Infrastructure automation for continuous integration and continuous deployment of technical solutions leveraging Azure Services and Features. Hands-on experience in scripting languages such as Python, R, etc. Modern version control Git, SVN, TFS, etc.

  • Advanced Business Intelligence experience, understanding of BI areas and reporting using SQL, SSAS, Tabular Models and Power BI, including proactive identification of issues and coordination of resolutions. QA testing.

  • Familiarity with the Technology stack available in the industry for data management, data ingestion, capture, processing, and curation as well as metadata management: data governance, data quality, master data management, lineage, data cataloguing, etc.

Related Job Openings