Microsoft Fabric Engineer

Kawader HR Consultancy أبو ظبي, الإمارات تم النشر 2026/10/19 07:18:27 تنتهي 2026-11-18 الرقم المرجعي: JB5496721 0 المرشحين الموظفين / 1 عدد الشواغر

وصف الوظيفة

Job Purpose / Summary

The Microsoft Fabric Engineer is an experienced individual contributor responsible for designing,

building, operating and continuously improving Ethara’s enterprise data platform on Microsoft Fabric.

The role converts data from business systems into governed, reliable and reusable data products that

support analytics, reporting, operational insight and customer-data use cases. Working across the

Digital & Data function, the engineer applies sound data-engineering practices to the full lifecycle, from

ingestion and orchestration through transformation, semantic consumption, security, deployment and

support.

Key Accountabilities

• Architecture and engineering: design scalable, maintainable Fabric solutions using OneLake,

lakehouses, warehouses, notebooks, Spark jobs, Dataflow Gen2, pipelines and semantic models,

selecting components according to workload needs rather than applying a single pattern to every

use case.

• Ingestion and orchestration: create resilient ingestion patterns for batch and, where justified, near

real-time data from enterprise sources such as Dynamics 365, ticketing, point-of-sale, Oracle

Fusion, SharePoint and other approved platforms.

• Medallion transformations: implement clear Bronze, Silver and Gold responsibilities, including

raw-data preservation, standardisation, conformance, business rules, dimensional structures and

consumption-ready datasets.

• Data quality and reconciliation: embed validation, completeness, uniqueness, referential-integrity

and reconciliation controls, with traceable exceptions and ownership

• Performance and capacity optimisation: tune SQL, Spark, storage layout, refresh patterns and

workload scheduling to deliver responsive, cost-aware services within available Fabric capacity.

• Security and governance: apply least-privilege access through RBAC, RLS and Entra ID groups;

support lineage, workspace governance, privacy obligations, auditability and controlled data

sharing.

• CI/CD and application lifecycle management: maintain source-controlled assets, branching and

review practices, automated validation, deployment pipelines and disciplined promotion across

Dev, Test and Prod workspaces.

• Monitoring and support: implement operational monitoring, alerts, runbooks and support

procedures; diagnose failures, restore service and prevent recurrence through root-cause actions.

• Stakeholder collaboration: translate business and analytical needs into proportionate technical

designs, partnering with data owners, analysts, architects, application teams and vendors.

• Documentation and knowledge transfer: keep architecture, mappings, data contracts, operating

procedures and support knowledge accurate, accessible and usable by the wider team

Detailed Duties and Expected Outcomes

Platform Architecture and Engineering

Develop solution designs that define workspace boundaries, storage and compute choices, data flows,

dependencies, security controls and operational ownership. Build reusable engineering patterns and

shared components that reduce duplication while allowing teams to meet different latency, scale and

governance needs. Expected outcomes are coherent platform designs, predictable delivery, reduced

technical debt and data products that can be supported by people other than their original author.

Ingestion and Orchestration

Engineer parameterised Fabric Data Factory pipelines, Dataflow Gen2 processes and notebook

orchestration with appropriate retry, dependency, idempotency and failure-handling behaviour. Use

APIs, files, databases and approved connectors safely, managing incremental loads, schema drift,

watermarking and backfills. Expected outcomes are reliable ingestion, transparent source-to-target

movement and controlled recovery without duplicate or missing records.

Medallion Data Transformation

Preserve source fidelity and audit information in Bronze; standardise formats, resolve keys, remove or

flag invalid records and conform shared entities in Silver; and publish business-ready dimensional,

aggregated or feature-oriented products in Gold. Use SQL and Python/PySpark with Delta and Parquet

patterns suited to the workload. Expected outcomes are traceable transformations, consistent

definitions and efficient downstream use by Power BI, analytics and approved applications.

Data Quality and Reconciliation

Define automated controls at critical points in each data flow, including schema checks, record counts,

totals, threshold tests, duplicate detection and referential validation. Reconcile material measures to

source systems and agree exception ownership with data stewards. Expected outcomes are visible

quality status, rapid isolation of defects, auditable corrections and increased trust in published

information.

Performance and Capacity Optimisation

Profile workloads and optimise partitioning, file sizes, query plans, data models, refresh design,

concurrency and scheduling. Review capacity utilisation and recommend changes based on evidence,

balancing user experience, resilience and cost. Expected outcomes are stable refresh windows,

responsive analytical workloads, fewer avoidable capacity peaks and demonstrable efficiency

improvements.

Security, Governance and Lifecycle Management

Implement access through approved Entra ID groups and workspace roles, and apply row-level

security where consumption requirements demand it. Maintain lineage, ownership and classification

information and participate in design reviews. Keep code and configuration in Git, use peer review and

automated checks, and promote changes through deployment pipelines across Dev, Test and Prod.

Expected outcomes are controlled access, reproducible releases, clear lineage and reduced deployment

risk.

Monitoring, Incident Response and Support

Create actionable monitoring for pipeline runs, data freshness, quality controls, capacity and critical

dependencies. Maintain runbooks and support handovers, participate in incident response and

complete root-cause analysis for significant failures. Expected outcomes are earlier detection, faster

restoration, lower repeat-incident rates and clear communication to affected stakeholders.

Stakeholder Collaboration and Customer Data

Work with business stakeholders to clarify data definitions, service expectations and acceptance

criteria. Coordinate with Dynamics 365, Customer Insights - Data and Customer 360 teams so that

shared customer entities and measures are reliable, governed and fit for activation and insight.

Collaborate equally with finance, operations, ticketing, commercial, digital and other functions as

priorities require. Expected outcomes are solutions aligned to business value and fewer definition or

integration gaps across platforms.

Documentation and Knowledge Transfer

Produce maintainable technical documentation covering architecture, mappings, transformation rules,

data contracts, support dependencies, security and recovery. Explain design decisions, mentor

colleagues through pairing and review, and hand over completed services with operational evidence.

Expected outcomes are sustainable ownership, faster onboarding and reduced concentration of

knowledge

المهارات

Education and Experience

• Bachelor’s degree in computer science, data engineering, information systems, software

engineering or a related discipline, or equivalent practical experience demonstrating the required

capability

• Typically five or more years of progressive experience in data engineering, data platforms or

analytics engineering, with flexibility for candidates who demonstrate equivalent depth through

complex delivery experience.

• Typically three or more years of hands-on Microsoft Fabric experience, or closely related Azure

data-services experience with clear evidence of applying that foundation to Fabric.

• Demonstrated experience delivering production-grade pipelines, transformations and analytical

data products across development, test and production environments.

• Experience diagnosing operational issues, improving performance and communicating technical

trade-offs to both technical and non-technical stakeholders

Required Technical Skills

• Strong practical knowledge of Microsoft Fabric, including OneLake, lakehouses, warehouses, Data

Factory pipelines, Dataflow Gen2, notebooks/Spark jobs, deployment pipelines and integration

with Power BI semantic models.

• Advanced SQL and effective Python/PySpark skills for data ingestion, transformation, validation,

automation and troubleshooting.

• Sound dimensional-modelling knowledge, including facts, dimensions, slowly changing

dimensions, conformed entities and semantic-model considerations.

• Hands-on use of Delta and Parquet formats, lakehouse design, partitioning and practical data

lifecycle patterns.

• Ability to integrate REST APIs, relational databases, files and enterprise applications using secure,

supportable patterns.

• Working knowledge of Git, pull requests, CI/CD, Azure DevOps or equivalent engineering

workflows, automated testing and environment promotion.

• Strong understanding of RBAC, RLS, Entra ID groups, secrets and credentials, least privilege,

lineage, auditability and data-governance responsibilities.

• Experience with monitoring, logging, alerting, incident diagnosis, reconciliation and data-quality

frameworks.

• Strong Azure, Fabric and Power BI ecosystem experience; familiarity with Dynamics 365 or

Customer Insights is useful but not required for every candidate.

Preferred Certifications

• Microsoft Certified: Fabric Data Engineer Associate, or a current successor certification aligned to

Microsoft Fabric data engineering.

• Relevant Microsoft Azure data-engineering, analytics or solution-architecture certification.

• Microsoft Power BI certification or equivalent demonstrated semantic-modelling and analytical

delivery expertise.

Certifications are valued as evidence of structured learning but do not replace relevant hands-on

experience.

تقدم الآن

تفاصيل الوظيفة

مكان الوظيفة أبو ظبي, الإمارات

الدور الوظيفي تكنولوجيا المعلومات

الحالة الوظيفية الاستعانة بمصادر خارجية

نوع التوظيف دوام كامل

عدد الوظائف الشاغرة 1

المرشح المفضل

المستوى المهني متوسط الخبرة

عدد سنوات الخبرة الحد الأدنى: 5

الشهادة بكالوريوس

Kawader HR Consultancy

وظائف ذات صلة

مشاهدة الكل

إرفاق