Insufficient data from Andrew Fryer

The place where I page to when my brain is full up of stuff about the Microsoft platform

Better Data with Metadata

Metadata (data about data) is becoming increasingly popular not just to meet ever more stringent auditing requirements for business intelligence projects, but also to enable accelerated development and maintenance. 

The challenge is to deliver rich metadata as part of a  BI project with minimal overhead and to keep it up to date.  So I was pleased to find this white paper on how to use SQL Server Integration Services (SSIS), to make this as painless as possible.

The idea is to have a dedicated metadata repository which drives programmatically driven SSIS packages like this:

Click here for larger image

I think this paper will have an even bigger impact than the project Real resources that came out with SQL Server 2005 and as definitely worth half an hour of your time to understand the principles and approach.


Note (20/04/2009): this post has been superceded by a later one, as there is a new metadata toolkit available at