The role of a Data Engineers is to support the development of ETL Solutions. This includes developing and maintaining data interfacing to a central data warehouse for load into a PowerBi reporting environment and the interfacing of master data between information systems. The company has a mature reporting environment that is aligned with the Microsoft application stack and works using the Agile Scrum Development methodology.
- Integration activity (ETL) using Azure Data Factory and other technologies. Connecting multiple data sources to our Datawarehouse and integration into the reporting data model
- Developing master data interfaces between information systems using an array of interfacing methods
- Transformation of multiple data sources/systems into curated datasets for use in reporting and master data management
Job Responsibilities
- Help lead the development BI Solution Architecture and secure data sets using the Microsoft application stack. .
- Undertake ETL integrations and support tasks using ADF and similar technologies.
- Coach and mentor junior BI professionals
- Assessment of new systems and solutions to identify integration
- Integration of M/A inherited solutions into the Datawarehouse for provision of insights and alignment of the data model
- Supporting clients (within the Oil, Gas and Nuclear) business with their integration and reporting challenges as required.
- Liaise with software vendors in the provision on bi directional interfacing for master data and the extraction of data for reporting purposes.
- Resolve data integrity, quality and robustness challenges with legacy / system data to encourage quality and transformation reporting
- Develop and update process maps, ETL Topology diagrams and maintain good documentation on the configuration of ETL processes.
General Duties & Responsibilities
- Drive Excellence though effective and efficient use of systems.
- Understand and document business requirements over the short, medium and longer term.
- Consult through lesson learned sessions with End Users, Key users and Process Owners to ensure that functionality and configuration meets evolving business requirements
- To develop and maintain consistent solutions across our approved application suite.
- Maintain confidentiality with sensitive data/information
- Build and maintain workflows and process automation
- Support other Business Systems Analysts and leads in digital transformation projects.
Experience Required
- Experience as a business intelligence analyst/ developer or related role
- Experience with SQL Management Server, SSRS, SSIS and other related systems
- Experience with Microsoft Azure stack and related technology such as ADF, Logic Apps, Data Lake, Data Bricks, Power Query etc
- Experience in Low code MS related technologies, SharePoint, Nintex, Power Apps, Power Bi etc
- ETL Related experience using SSIS, ADF or similar products to undertake complex integrations.
- Experience in the role of a DBA or DBA related activities
- Relevant further qualification in business analytics related field
- Strong technical acumen and the ability to analyse complex situations and effectively solve problems and drive an excellence culture.
- Understanding of GDPR and good practice of complex data management
- Strong communication skills and able to effectively work with varying stakeholders
- Pragmatic approach, able to balance the ideal with the reality of what is needed today.
- Demonstrable ability to thrive in a complex, rapidly changing and demanding Globally integrated (but not centralised) business environment
- Experience / knowledge of the Agile Scrum development methodology
- Experience of Dynamics Navision, iTrent, SharePoint Online Office 365 is desired but not essential.
- Experience working in an Engineering / Construction / Maintenance industry would be beneficial but not essential.
Location
Date Posted