Data Engineer Market related

Our Client, JD Group Limited, is looking for a Data Engineer within their Data Analytics Department based in Marlboro, Johannesburg. You will be responsible for driving, designing, and building scalable ETL systems for a big data warehouse to implement robust & trustworthy data to support high performing ML algorithms, predictive models, and support real-time data visualisation requirements across the organisation to enable self-help analytics. *Duties and Responsibilities:* * Systematic solution design of the ETL and data pipeline in line with business user specifications * Ensure highest data quality assurance, data accuracy and data completeness through regular and in-depth review and testing of work * Create easily understandable technical documentation that are kept up to date * Conduct data design, database architecture, metadata and repository creation activities and tasks as required by business stakeholder. * Translates business needs into long-term architecture solutions. * Define, design, and build dimensional databases. * Design the ETL pipelines * Responsible for developing data warehousing blueprints, evaluating hardware and software platforms, and integrating systems. * Evaluates reusability of current data for additional analyses. * Conducts data cleaning to rid the system of old, unused, or duplicate data. * Review object and data models and the metadata repository to structure the data for better management and quicker access. * Determine processes to ensure execution of relevant data application requirements for various business needs * Utilise relevant templates that outlines the requirements for each step within the data modelling journey * Conduct testing and quality control of databases to ensure accurate and appropriate use of data. * Initiate and successfully motivate improved ways of operating * Develop and implement ETL pipelines aligned to the approved solution design * Enhance and maintain our existing ETL frameworks in line with agreed design patterns and internal governance standards to improve our EDW product offering and to remain scalable * Implement the ETL pipeline in a timely manner * Utilise most accurate data source to remodel into a set of data that is understandable to the end user. * Understand data structures to deliver data sets that are deliver to exact requirements of end user brief * Ensure data is precise and is benchmarked and validated against financial records * Utilise consistent data sources which result in one version of the truth * Deliver on standard data marts that can be utilised for reporting and analysis which is well documented and understood by business users. * Translate Meta data into explanatory reports and visuals for easy understanding to end user. * Ensure data governance and data quality assurance standards are upheld * Facilitate an understanding of data sources to ensure governance, procedures and standards are upheld. * Build data quality metrics and conduct data va