Metadata Management

Most of the organizations (small/mid sized/large) have data store which cater to the whole enterprise, the so called data warehouse or data marts. More often than not it has been observed that the applications which feed from the warehouse or feed to the warehouse need some sort of Metadata management tool which acts as inventory of the data fields which are in involved in the data transfer.

Following are some of the reasons why there is a need of Metadata tool

- To determine the impact of a change in field definition. A classic case here is Y2K problem where before the year 2000 only 2 digits were allocated to the year and post Y2K it was required a change it to 4 digits. In this scenario the only option would have been to manually go thru each and every source code file to check which all files use 2 digit year if the organization did not use some kind of Metadata Management tool to identify the potential impact to all the up/down stream applications.

- Identify Golden Elements amongst suite of applications. Each enterprise has some “golden” elements which are widely used amongst different applications in an enterprise. Having a Metadata Management tool will enable us to identify it efficiently.

- Promotes reuse of data. Rather than creating 20 different fields for account number the enterprise can leverage and enforce a single field for account number. Needless to say reuse of data elements is always an efficient and effective way of enforcing data consistency in the enterprise.

- Enable developers/data analyst/maintenance staff to understand the data semantics. Metadata management tools by default forces all those who work closely with the application to keep metadata information current.

I am currently in process of determining best practices, industry standard and tools available in market for Metadata Management. I will be updating my blog on a regular basis on this topic. If you have any suggestions or comments please feel free to post here, I will highly appreciate it.

Leave a Reply