Data Engineering

As I come to the end of a contract I tend to start the process of looking around to see who specifically is hiring and what the current trends are in data projects, industries that seem to be recruiting. When I first started working with data and databases, the role was more clearly defined as a Data Analyst or as a (SQL) Database Developer as mostly organisations stored their data in SQL Server DBs or Oracle DBs or similar. This has obviously changed over the years as other storage formats have become more viable. ...

2 August 2026

Microsoft Fabric

For a few years now I have been working in Azure using the various data resource types such as Data Factory, Data Lake, Azure Databricks and Synapse. It seems like more and more organisations are now looking to implement Microsoft Fabric, which takes all these separate resources and pulls them under the one banner making it easier to develop and maintain. The interface follows the existing Power BI setup with workspaces. Fabric Notebooks are familiar for anyone who has used Azure Databricks, Pipelines are almost exactly the same as Data Factory and of course having Power BI in the same place makes it easier to hook up to data stored in the Fabric Lakehouse or Fabric SQL DB. ...

14 July 2026