Master data management theory and Practice

This article introduces the overview of master data , Including the definition of master data 、 features 、 type 、 Relationship with other data , The significance of master data management , Implementation pain points of master data management , Content of master data management , Management and implementation methods of master data and project implementation examples , It provides a certain reference for friends who are interested in master data and data management .

One 、 Master Data Management Overview

1.1. Definition of master data

In the field of data management , There are different interpretations and explanations for the concept and definition of master data . Refer to standards and specifications for definitions , This paper adopts the International Data Management Association DAMA stay 《DAMA Data management knowledge system guide 》 The definition of master data is explained in the book .
Master data is data about business entities , These entities provide a connected environment for business transactions . Business rules usually specify the master data format and allowable value range , The master data of a general organization includes the parties 、 product 、 Financial structure and location .
Master data is about the authority of key business entities 、 The most accurate data , It can be used to establish the associated environment of transaction data . The master data value is considered to be “ gold ” data , Master data relative to transaction data , The properties are relatively stable , Higher accuracy is required , Unique identification .

1.2. Characteristics of master data

Compared with other data , Master data has the following characteristics ：
1） Beyond the Department , Master data is the largest convention data of all departments and all business processes ;
2） Beyond the process , The master data does not change with the specific process , But as a constant factor of the whole process .
3） Beyond the theme , Information about business entities that do not rely on specific business topics but serve all business topics ;
4） Beyond the system , Master data management exists as a separate system , Serve but higher than other business systems ;
5） Beyond technology , Master data must apply a technical condition that is compatible with all kinds of heterogeneous systems , Microservice oriented architecture provides an effective tool for the implementation of master data .

1.3. Type of master data

Master data mainly includes configuration master data and core master data .
1） Configuration master data ： Configuration master data , Also known as reference data , It is the reference information to describe the business or core master data attribute classification , Will be shared throughout the organization . Generally according to international standards 、 National standard 、 Industry standards or enterprise standards and relevant specifications , Configure the basic data for one-time use in the system , For example, the state 、 nation 、 Gender and other normative expressions . The configuration master data is relatively stable , Not easy to change .
2） Core master data ： Core master data refers to the master data used to describe the core business entities of an enterprise , It is the core business object of the enterprise 、 The executive body of the transaction business , Such as products 、 supplies 、 equipment 、 Organization 、 staff 、 supplier 、 Customer 、 Accounting subjects, etc .

1.4. The relationship between master data and other data
stay 《DAMA Data management knowledge system guide 》 In a Book , Summarize the knowledge system in the field of data management into ten major aspects , They are data architecture management 、 Data development 、 Data operation management 、 Data security management 、 Reference data and master data management 、 Data warehouse and business intelligence management 、 Document and content management 、 Metadata management 、 Data quality management and data governance . Master data management and reference data management are the core business contents , In the data management system , And improve data quality , It plays a huge role in the process of building enterprise data assets .

Master data and master data management are often mixed with other existing concepts , Thus affecting people's understanding of the essence of master data and master data management . In this paper, master data and metadata 、 Master data and transaction data 、 The three concepts of master data and reference data are different and related .

1） Master data and metadata
Master data and metadata are two completely different concepts . Metadata refers to the foundation of company data asset management , It's about “ Data of data ”, For example, data types 、 Data definition 、 Data relations, etc , It is equivalent to the header information in the data table , Is a relatively objective concept . The master data is selected from the metadata , The key to the operation of the company's business 、 General data , Is a relatively subjective concept . It's not just header information , It includes instance data . For example, the company's product list 、 Customer list 、 Branch address information, etc .
2） Master data and transaction data
Transaction data is also derived from metadata , Data reflecting the company's real-time business records , It is also instance data . The master data is relatively stable , Static data or data that remains static for a period of time , The transaction data is the data that changes in real time , It often describes the trading behavior at a certain point in time . For example, customer orders 、 Inventory tracking 、 Sales record 、 After sales events .
One master data may be associated with multiple transaction data , And a transaction data may have an impact on the master data . for instance , Airlines ,“ The customer's flying mileage this year ” It is a master data , and “ Each flight record of the customer ”, Is the transaction data , When transaction data “ Each flight record of the customer ” Accumulated to one year , Master data “ The customer's flying mileage this year ” Will produce updates .
3） Master data and reference data
Reference data is data used to classify or catalogue other data . Business rules usually stipulate that the reference data value is one of several allowable values . The data set of allowable values is a value range . Some organizations define the value range of reference data according to their internal business , The value range of other reference data can be defined by external resources such as government or industry standards . The value domain of multiple groups of reference data can point to the same concept domain . Each value is unique in its range set . In popular terms , Reference data can also be called data dictionary 、 Code set, etc .
In order to integrate data more efficiently 、 Data sharing and data analysis applications , Start to try to integrate and manage reference data at the enterprise or department level , Use the reference data set recording system to try to record IT The database in the system provides unified reference data . Reference data is the interpretation of data, aiming at the data interpretation of some data ranges and values , Make it easy for people to read relevant data .
In the field of government data application , The generalized reference data is embodied in the reference data set recording system 、 Government information resource directory system 、 Code set system 、 Data library and other systems , Generalized master data is embodied in the process of data fusion and warehouse building , General government data projects will include population 、 legal person 、 House 、 Electronic license 、 Social credit 、 Master data such as spatial geography , Also called basic library .
In practice , Reference data management and standard implementation are generally implemented together with master data management projects .

Two 、 The significance of master data management

Master data is the source of data , It is the core of data asset management , It is the cornerstone of information system interconnection , It is an important foundation for informatization and digitization . By building accurate 、 only 、 The authoritative data source establishes the enterprise master data standard management system , It is the key factor to improve the data quality and data asset value of enterprises and institutions . Good master data management is important for the construction of enterprise data asset system , Through data-driven development , Build the core competitiveness of future development and competition , Of great significance .

1. Eliminate data redundancy , Improve data quality ： Master data to open up all business chains , Unified data language , Unified data standards , Implement data sharing , Maximize and eliminate data redundancy , Improve data quality .
2. Improve data processing efficiency ： Through master data management, data dynamic automatic sorting can be realized 、 Copy , Reduce the time and workload of manual data collation .
3. Data driven , Improve the strategic synergy of the company ： The data is used as the internal operation analysis of the company 、 Decision support “ Traffic voice ”, After the unification of multiple departments , Help get through the Department 、 Systemic barriers , Realize information integration and sharing , Improve the overall strategic synergy of the company .
4. perfect IT System architecture and enterprise data architecture , Help with data application and management ： Through master data construction , It will lay a foundation for enterprises in data application and management . from IT From the perspective of construction , Master data management can be enhanced IT Structural flexibility , Build a data asset management foundation and corresponding specifications covering the whole enterprise , And more flexibly adapt to the changes of enterprise business needs . Besides , The improvement of master data quality can also lay a good foundation for later data integration and data integration .

3、 ... and 、 Implementation pain points of master data management

Master data management is of great significance , But there are still many difficulties in practice and implementation , Outstanding performance in the following aspects ：
1） Cognitive disunity , Don't pay attention to the master plan of master data , Lack of top-level design , Cannot be at the decision-making level of the unit 、 The management and business levels should unify their thinking ;
2） Each functional department does its own thing , It is difficult to reach agreement on standards and rules , As a result, it is difficult to unify the master data code standards ;
3） General standard master data （ international standard 、 Master data generated by national and Industrial Standards ） Decentralized management , Lack of convenient and reliable data access , Data acquisition is difficult ;
4） Master data that already exists in the company and is under decentralized management , Due to the lack of unified standards and data correlation , A lot of data cleaning depends on human judgment , Data cleaning is difficult and risky ;
5） The data standardization degree of enterprise historical system and historical data is not high , Data cleaning is difficult , The cost of transformation is high , It causes great difficulties for master data system integration ; The master data management process needs to modify the existing relevant production business processes and systems , It is necessary to fully mobilize the close cooperation of business departments from the perspective of management , It requires higher business operation efficiency and information decision-making cycle of the organization .
6） Master data management mode requires form data exchange between businesses , Therefore, the information architecture will change in the short term , Even more complicated .

Four 、 Content of master data management

The main contents of master data management include “ Two systems 、 A tool ”, Master data management standard system 、 Master data management assurance system and master data management tools . among , Master data management standard system is the top priority of master data management , The master data management guarantee system is the escort of master data management , Master data management tools ensure the effective implementation of master data management .
4.1. Master data management standard system

The master data standard management system includes business standards （ Encoding rules 、 Classification rules 、 Describe rules, etc )、 Master data model standard . The master data standard management system is in the process of construction and sorting , Generally, a set of code system table or master data asset directory will be derived .
1） Master data business standard is a unified interpretation and requirement of the meaning of master data business , Including master data sources 、 Management level of master data 、 Basic data items under unified management 、 Description and meaning explanation of the generation process of data items in relevant business environment 、 Constraints between data 、 Business rules to be followed in the process of data generation . Master data business rules contain the coding specifications of each data item of master data 、 Classification rules 、 Describe rules, etc .
2） Master data model standards include ： Master data logical model and master data physical model . The master data logic model is mainly represented by entity relationship diagrams ,ER chart , Physical model of master data , It also becomes the physical storage structure table of master data .
3） Master data code system table ： In some areas , Also known as master data asset directory . It describes the type of master data code used in the informatization construction of enterprises and institutions 、 Names of various master data codes 、 Code properties （ classification 、 Detailed 、 Rules etc. ）、 Mining （ ginseng ） Summary of label and code construction , It is the basis for enterprise master data code query and Application , At the same time, it is also the overall and guiding document of the master data code . The master data code system table mainly combines the operation and management characteristics of enterprises , Serve the construction of enterprise informatization , It mainly includes two parts , The first is the framework and classification of enterprise information code system table , The second is the standard details and construction of information codes under all classifications .
Such as the government information resource directory system in the field of government data application .
4.2. Master data management assurance system

Master data management assurance system includes master data management organization 、 The system 、 technological process 、 Five parts of application and management evaluation .
1） Master data management organization
The master data management organization mainly includes the management organization structure of all kinds of master data in the enterprise 、 Operation mode 、 Role and responsibility Planning , Establish a clear master data management organization and organization system through organization system planning , Implement the responsibilities of departments at all levels and sustainable master data management organization and personnel .
The master data management organizational structure includes the decision-making level 、 Management and executive .
2） Master data management system
The master data management system stipulates the contents of master data management 、 Program 、 Articles and methods , It is the code of conduct and code of conduct for master data managers , It mainly includes various management methods 、 standard 、 Detailed rules for the 、 Manuals, etc . It mainly includes 《 Master data management method 》、《 Master data standard specification 》、《 Master data proposal Guide 》、《 Master data maintenance rules 》、《 Master data management tool operation manual 》 etc. .
3） Master data management process
Provide data maintenance and management processes , Establish a management process that conforms to the actual application of the enterprise , Ensure the effective implementation of Master Data Standards , Realize the continuous and long-term governance of master data . Master data management process can exist in the form of management system , It can also be directly embedded in the master data management tool .
Master data management process includes master data business management process （ Application of master data 、 check 、 to examine 、 Release 、 change 、 frozen 、 Archive, etc. for full life cycle management ）、 Master data standard management process （ Analysis of Master Data Standards 、 To develop 、 to examine 、 Release 、 Application and feedback process ）、 Master data quality management process （ Creation of master data 、 change 、 frozen 、 file ） etc. .
4） Master data application
Master data application mainly includes three parts ： Clarify management requirements 、 Implement effective management 、 Strengthen security services .
5） Master data management evaluation
Master data management evaluation is used to evaluate and assess the performance of the responsibilities of the person in charge of master data and the implementation of data management standards and data policies , By establishing qualitative or quantitative master data management evaluation indicators , Strengthen the responsibility of enterprises for master data management 、 The ability to control the implementation of standards and policies .
The evaluation index of master data management is from management standard 、 Data accountability and data policy , It is jointly determined by the data owner and the data responsible person , Define a series of measurement indicators and rules , On the one hand, implement and check the application of master data , On the other hand, investigate and evaluate master data management 、 Master data standard 、 Implementation of master data quality .

4.3. Master data management tool

Master data management tool is master data standard text publishing 、 An important platform for master data lifecycle management . The maintenance process and management measures of master data standards are systematically realized and controlled through the management platform , To ensure the uniqueness of the standard and the timeliness of publicity and implementation .

Master data management tools mainly include data modeling 、 Data integration 、 Data management 、 Basic management of data services 、 Standard management and other functional modules .

1） Master data modeling ： Mainly based on the master data standard system , Through visual modeling tools , Define master data objects 、 Encoding rules 、 Basic elements such as attribute values and control processes , Build master data standard model .
2） Master data consolidation ： Mainly use data cleaning tools and extended functions , Collect the master data generated by each system 、 Verify according to the master data standard and the rules defined by the master data model 、 cleaning 、 Release , Realize the full lifecycle management of master data , And integrate into a unified 、 Trusted master data .
3） Master data management ： According to the requirements of standard master data management procedures , Through strict management process , Realize master data creation 、 The examination and approval 、 Release 、 modify 、 The whole life cycle management of freezing and invalidation and the management and maintenance of data dictionary , Ensure data consistency 、 accuracy 、 Real time and authority .
4） Master data storage and services ： Benchmark data released by master data platform , Centrally stored in the master data base , Provide online query and subscription functions , And provide data sharing services through process driven and message driven standard interfaces .
5） Standard document management ： Use external public document management system or built-in management function , Realize the storage and management of standard documents and related materials 、 Version management and standard directory management , Configure intelligent search engine , Realize intelligence 、 quick 、 Accurate and efficient query and retrieval function .
6） Basic management ： It mainly realizes the setting of basic data in the system , Flexible configuration 、 Safe and reliable permission management and log management , Include users 、 User group 、 role 、 resources 、 Process configuration, etc , And statistical analysis of various master data , Provide strong support for the application evaluation of main data .

5、 ... and 、 Management and implementation methods of master data

The key points of master data implementation mainly include master data planning 、 Develop master data standards 、 Establish master data code base 、 Build master data management tools 、 Build the operation and maintenance system and promote the implementation of the standard , Master data planning is the program 、 Setting master data standards is the foundation 、 Establishing master data master data code base is a process 、 Building master data management tools is a technical means 、 Building an operation and maintenance system is the premise , The promotion and implementation of standards is a continuous guarantee .

1） Master Data Planning ： Apply methodology and combine with the actual situation of the enterprise , Develop master data integration implementation roadmap .
Master data planning emphasizes the close combination of requirements analysis and system modeling , Requirement analysis is the basis of system modeling , And business research is the premise of demand analysis .
In the process of master data planning consultation, we need to refer to standards , The main reference standards are international standards 、 National standard 、 Industry standard 、 Enterprise standards , Ensure that the master data planning consultation of the enterprise can meet the relevant national regulations , It also has the characteristics of the enterprise industry .
Output master data planning results through preliminary work such as current situation investigation and demand analysis , This achievement mainly includes master data standardization architecture 、 Master data integration architecture 、 Master data security architecture （ Data desensitization 、 Data access ） And operation management structure （ organization 、 The system 、 technological process 、 Management specification 、 Quality management measures, etc ） The content such as , In addition, the key activity in the master data planning stage is the evaluation of results 、 Publicity and implementation of the system , Through publicity and implementation, managers and employees at all levels of the enterprise can grasp the corresponding standards in time 、 standard , Ensure the sorting and operation of the whole system .
2） Develop master data standards ： Determine the data range , Work with business departments to develop master data standards , The standard includes the determination of classification specifications 、 Coding structure 、 Data model 、 Attribute description, etc .
Formulating master data standards is the basic work of establishing master data code base , The premise of ensuring the development, operation and maintenance of master data management tools to realize data sharing between systems , It is also a key stage for the smooth development of master data management organization and process . The formulation of master data standards generally follows simplicity 、 Uniqueness 、 Scalability and other related principles , It should be convenient for the needs of current application systems , We should also consider the needs of future information system development , Besides , The development of master data standards should also be built in stages according to the urgency of business needs .
Process reference for master data development ：
1） On the basis of understanding the overall planning of enterprise informatization , Carry out research on the current situation of Master Data Standards , Sort out relevant business processes ;
2） Select the organizational structure 、 Business scope and other similar excellent enterprises are used as benchmarks for comparative analysis , Summarize the master data management requirements in the core management field and business field , Determine the data scope and organizational scope .
3） According to the characteristics of various master data and the actual situation of the enterprise , Discuss with relevant business departments to develop master data standards that meet the needs of enterprise applications , The standard mainly includes classification specifications 、 Coding structure 、 Master data model 、 Description template 、 Attribute value, etc .
The classification of business standards is the basis , Scientific and reasonable classification is the guarantee for the success of formulating standards , Description standard is the main basis for data information proofreading in the standardization system , The description of the information is connected by the attribute fields of each information , A standardized description template can be established for data classification , Effectively avoid the phenomenon of multiple objects .
3） Establish master data code base ： Check the data according to the master data standard 、 Data De duplication 、 Data encoding 、 Data loading, etc , Establish a master data code base that conforms to data standards and specifications .
The formulation method of establishing master data code base can refer to the following steps , First of all , Determine the code structure ; second , research 、 Collect various code standards ; Third , analysis 、 Optimize various code standards and put forward suggestions for planning ; Fourth , Prepare rules for comments ; The fifth ; Seek the opinions of departments to improve and confirm the rules ; Last , Submit the draft of rules for approval .
4） Build master data management tools ： Build master data management tools , Provide technical support for the management of main data , Realize master data query 、 apply 、 modify 、 to examine 、 Release 、 frozen 、 Lifecycle management such as archiving .
5） Build the operation and maintenance system ： Establish the operation and maintenance organization of master data management and standard management 、 Management process 、 Assessment mechanism, etc , Ensure that master data standards and specifications are effectively implemented .
6） Promote the implementation of Standards ： Unified implementation of master data standards and specifications , Expand the application scope of master data standard , Realize interconnection and sharing between information systems .

6、 ... and 、 Project example of master data management

Master data management involves the core business process of an enterprise 、 Trading data and data assets , Related to all aspects of enterprise production and operation . Therefore, the implementation and construction of master data management is destined to be a long-term process , Combined with the implementation experience in the industry , The implementation strategy of master data management project is generally ： Set standards as a whole 、 Build the system step by step 、 First base 、 Post deepening .
The key points of master data implementation mentioned above mainly include master data planning 、 Develop master data standards 、 Establish master data code base 、 Build master data management tools 、 Build the operation and maintenance system and promote the implementation of the standard , Combined with the actual specific project process , It is necessary to combine the knowledge and experience of master data management and project process management . The following is the project process phase division and implementation plan arrangement of a master data implementation project . The project is mainly divided into three stages .
The first stage ： The main work includes standardization 、 Basic module construction of master data platform 、 Data initialization, cleaning and import ;
The second stage ： The main work includes improving the construction of master data platform 、 Some systems are connected 、 Data monitoring and statistical analysis ;
The third stage ： The main work includes expanding the scope of master data 、 Access more systems 、 Construction of information display layer ;
The following is an example of master data project implementation plan ：
1） Party B's project team ：

2） Party A's project team ：

The following figure is the functional architecture of master data management of Sinotrans .

The following figure shows the master data standard system of Sinotrans .

7、 ... and 、 Reference documents

《DAMA Data management knowledge system guide 》-DAMA association
《 Master data management practices white paper 1.0》- China Academy of communications
《 UFIDA master data management solution 》
《Oracle Master data management solutions 》