Kingbasees heterogeneous database migration guide (3. Kingbasees migration capability support system)

3. KingbaseES Transplant capability support system

This chapter contains the following ：

• Overview of migration tools

• KingbaseES Overview of application capabilities

• KingbaseES Cutting capacity of support system

3.1.  Overview of migration tools

KingbaseES Support offline and online migration of application systems .

Offline migration refers to , The application system is offline , When the source database service provides services , adopt KingbaseES The migration tool of moves the object definition and data of the source database to the destination database .

Online migration refers to , The application system is online , When the source database server continues to provide services , adopt KingbaseES The migration tool of completes the relocation of objects and data .

3.1.1.  Data migration tools

Jincang database provides KDTS-PLUS and KFS 2 Tools to complete the task of migrating data . KDTS-PLUS yes KingbaseES Tools provided to , It can be used for offline migration , It can complete the migration of all object definitions and data in the database . KFS Is a separate synchronization tool , It can be applied to data synchronization , It is mainly used for the initial relocation of table structure and table data , And the real-time synchronization of data after the initial relocation . KDTS-PLUS and KFS Deploy together , It can complete the online migration of a large system .

Migration capability	KDTS-PLUS	KFS
Whether it supports the migration of object definitions such as migration stored procedures	Support the migration of all object definitions	Support the migration of table structure and primary key definitions
Synchronization time , Or keep syncing	One synchronization	Keep syncing
Whether initial state synchronization is required	Unwanted	need
Cross platform	Support	Support
Migrate partial tables	Support	Support
Migrate some data of a table	Support	Support
Breakpoint continuation	I won't support it	Support

KDTS-PLUS The core task of is to migrate data from heterogeneous databases to KingbaseES. It fully supports various features needed in the process of data migration , Including custom data type mapping , Migrate data in parallel , Statistics after migration failure , Support secondary migration , Support data comparison between source and destination databases after migration . This product is a tool that must be used in the migration task .

NPC gold warehouse provides synchronous products of heterogeneous databases KFS. The first step of data synchronization is to complete the initial data synchronization , Then we will use log analysis technology to incrementally synchronize data . This product can be used for data synchronization between heterogeneous databases , Data set , Including the synchronization of some data between heterogeneous databases , The synchronization strategy is flexible , Support breakpoint renewal .

3.1.2.  Debugging tools

KingbaseES The following tools are provided , Used for debugging during migration ：

• Command line SQL Interactive tools ksql

• The graphical interface SQL Interactive tools Kstudio

Comparative study	ksql	Kstudio
perform SQL	Support	Support
Edit data directly	Need to write SQL sentence	Support , Edit directly through the graphical interface
Execute stored procedures	Support	Support
see SQL Implementation plan	Support	Support
debugging plsql	Support	Support

ksql It's command line SQL Interactive tools , Light and fast .

Kstudio Tools are graphical interfaces SQL Interactive tools , Easy to use , It also includes plsql Debugging function of , And some monitoring and performance analysis tools .

3.1.3.  Data synchronization tool after system cutover

KingbaseES Provides 2 A data synchronization tool ：

• KingbaseES Built in physical synchronization function

• Heterogeneous database synchronization KFS product

Comparative study	KingbaseES Physical synchronization function	KFS
Heterogeneous data sources	I won't support it	Support
Span CPU	Support	Support
Breakpoint continuation	Support	Support
Synchronize some objects	I won't support it	Support
Synchronize all operations	Support	I won't support it

KingbaseES Built in physical synchronization , Mainly aimed at 2 individual KingbaseES Synchronization between products . The unit of synchronization is 2 individual data, Synchronization of some objects is not supported . Physical synchronization can synchronize all user operations , You can perform breakpoint continuation , Support playback .

KFS The product is to solve the synchronization between heterogeneous data sources , Or synchronize the synchronization of some objects between data sources , Synchronization granularity is more flexible .

If the application system is cut , Users need dual track operation , You can choose physical synchronization or KFS product .

3.1.4.  System backup tool after system cutover

KingbaseES Provides 2 A backup tool ：

• Logical backup sys_dump

• The physical backup sys_rman

Comparative study	sys_dump	sys_rman
Heterogeneous data sources	I won't support it	I won't support it
Incremental Support	I won't support it	Support
Support recovery to the specified time point according to the log	I won't support it	Support
Back up individual tables	Support	I won't support it
You can not back up the specified table	Support	I won't support it

Logical backup sys_dump, Support the definition and data of backup objects in a certain execution state . Incremental backup is not supported , Flexible selection of backup objects , You can support a single table , Backup of a single function, etc . Logical backup cannot be combined with redo Log together .

The physical backup sys_rman Back up the data of the entire instance , It does not support backing up a single database or a single table , But it supports incremental backup .

3.2. KingbaseES Overview of application capabilities

Usually , The workload of heterogeneous database migration is heavy , These workloads mainly come from two aspects ：

1. Application development and migration requirements ： In data object type 、SQL Language 、PL/SQL Language 、 Client application programming interface, development framework and many other aspects of the two databases 、 A lot of syntax or functional alignment processing . meanwhile , Third party products or components used by the source application system , The target database also needs support .

2. Application system operation requirements ： Whether the high availability solution supports , Whether the performance meets the requirements .

This chapter , Yes KingbaseES The ability in these two aspects is summarized , It is convenient for users to evaluate . If users need to evaluate KingbaseES Yes Oracle The ability to support , Please see the 《Oracle 12c and KingbaseES V8 Technical difference table 》 as well as 《Oracle to KingbaseES Migration best practices 》 .

3.2.1.  Supported schema objects

KingbaseES Support database 、 Table space 、 Pattern 、 Users and roles . At the same time, the following objects in the mode are supported .

surface 3.2.14  Supported schema objects

Serial number	Objects in mode
1	Tables and divisions
2	View （ contain force view）
3	Updatable view
4	trigger
5	The rules
6	constraint
7	Indexes
8	Database connection dblink
9	function
10	stored procedure
11	The operator
12	package
13	Sequence
14	A synonym for
15	External data sources
16	data type
17	Tags and strategies
18	The rules rule
19	Domain domain
20	Expansion pack,
21	Global temporary table
22	DUAL surface
23	Oracle Compatible views
24	ROWNUM, LEVEL Equipseudo column
25	Anonymous block
26	expression , Including conditional expressions, etc

surface 3.2.15  Built in data types

Serial number	KingbaseES data type
Numerical type
1	smallint
2	integer
3	bigint
4	decimal
5	numeric
6	number
7	real
8	float
9	double precision
10	double
11	smallserial
12	serial
13	bigserial
Character
1	character(n[char | byte]), char(n[char | byte])
2	character varying(n[char | byte]), varchar(n[char | byte]), varchar2(n[char | byte])
3	nvarchar(n[char | byte])
4	text
Large object type
1	clob, nclob
2	blob
Date time type
1	timestamp [ (p) ] [ without time zone ]
2	timestamp [ (p) ] with time zone
3	date
4	time [ (p) ] [ without time zone ]
5	time [ (p) ] with time zone
6	interval year
7	interval month
8	interval day
9	interval hour
10	interval minute
11	interval second
12	interval year to month
13	interval day to second
Boolean type
1	boolean
Binary
1	bit(n)
2	bit varying(n)
XML type
1	xml
Array type
1	array
enum
1	enum
JSON type
1	json
2	jsonb
UUID type
1	uuid
GIS type
1	point
2	line
3	box
4	path
5	circle
6	polygon
7	geometry

KingbaseES Supported functions , See 《KingbaseES SQL Reference manual 》, View see 《KingbaseES Database reference manual 》.

3.2.2. SQL

stay KingbasES Supported by SQL in , except 2.2.1 Of the object mentioned in CREATE/ALTER/DROP outside , There are other SQL Access interface ：

Data manipulation

• INSERT | UPDATE | DELETE

• TRUNCATE

• MERGE INTO

• INSERT FIRST/ALL

• COPY

• CLUSTER

Data query

• SELECT

• Hierarchical query CONNECT BY

• LATERAL Clause

• Outer join operator (‘+’)

• WITH [ RECURSIVE ] Clause

• PREPARE, EXECUTE

• VALUES Clause

• EXPLAIN

Data collation

• ANALYZE

• VACUUM

• REINDEX

Transaction control statement

• BEGIN,START TRANSACTION

• COMMIT

• ROLLBACK

• SAVEPOINT | RELEASE SAVEPOINT | ROLLBACK TO SAVEPONIT

• SET TRANSACTION { READ ONLY | READ WRITE }

• PREPARE TRANSACTION

Permission statement

• GRANT

• REVOKE

3.2.3. PL/SQL

KingbaseES Support the following PL/SQL Common syntax ：

• Assignment statement

• IF-THEN-ELSE sentence

• CASE sentence

• Multiple loop statements , Such as LOOP sentence 、WHILE-LOOP Statement and FOR LOOP sentence

• %TYPE Properties and %ROWTYPE attribute

• REF CURSOR The cursor

• Predefined exceptions and custom exceptions

• %NOTFOUND、%FOUND、%ISOPEN and %ROWCOUNT Cursor properties

• RETURNING INTO sentence

• dynamic SQL

• BULK COLLECT

• Message input RAISE

• PL/SQL Support collection types （ Associative array 、 Nested table 、 Variable array ）

KingbaseES Support the following PL/SQL Common objects ：

• trigger （ Contains row level triggers , Column level triggers and event triggers ）

• function

• Nested function

• stored procedure

• Anonymous block

• Package

• OBJECT TYPE

3.2.4.  Client programming

KingbaseES Support the following programming interfaces and development framework .

surface 3.2.16  Programming interface and development framework

Serial number	programing language / frame	KingbaseES
Programming interface (API)
1	JAVA	JDBC
2	.Net	.Net Data Provider
3	C/C++	Pro*c
4		OCI
5		ODBC
6		OCCI
7	Php	pdo
8	Perl	DBI
9	Python	Support
10	QT	QODBC
11		Qkingbase
12	Nodejs	Support
13	golang	Support
Development framework
1	hibernate	Support
2	hibernate-spatial	Support
3	activiti	Support
4	mybatis	Support
5	Mybatis-plus	Support
6	flyway	Support
7	Liquibase	Support
8	Dbunit	Support
Connection pool
1	C3P0	Support
2	DBCP	Support
3	Druid	Support

3.2.5.  Third party products and components

KingbaseES At present, it has exceeded 1200 Home hardware and software products complete adaptation , cover CPU、 Storage 、 operating system 、 middleware 、 Backup software 、 office OA、 report form 、 Secure mail 、 Flow label 、 Information security 、 Geographic information and other mainstream products have been covered .

3.2.6.  High availability

KingbaseES Support perfect high availability solutions , A series of products and solutions provided to customers can solve common problems caused by unpredictable downtime and planned downtime , And can be deployed at the lowest cost .

Support a variety of physical backup and logical backup , Support multiple clusters , Support physical synchronization , Support logical synchronization . Please refer to 《KingbaseES High availability guide 》.

3.2.7.  performance

With the explosive growth of enterprise business data , The problem of database performance has become more and more prominent . Usually , Database performance optimization is a system engineering . In different scenes , The focus on performance will also be different ,KingbaseES Adopt more targeted optimization technology to ensure that users' various applications can get high-performance support .

KingbaseES In data loading , Transactional application scenarios , Analytical application scenarios have targeted performance optimization , Please refer to 《KingbaseES Database Performance Tuning Guide 》 .

3.2.8.  Relevant technical resources

This guide focuses on statement compatibility features 、 Migration tools 、 Describe the key technologies and implementation methods of migration in terms of migration scenarios and application migration . In the description of each technology and implementation , This guide provides only a limited introduction , Comprehensive details are not provided . therefore , If you need to know the implementation details of some technologies, please also refer to the relevant technical materials , These materials such as ：

• KingbaseES Database administrator's Guide ： Introduce in detail and comprehensively how to manage efficiently KingbaseES Database system . among , Such management as user management 、 Storage management 、 Pattern object management .

• KingbaseES Development of guidelines ： Provides JDBC、ODBC、DCI and ESQL And other application programming interfaces .

• KingbaseES High availability guide ： The support of the system in high availability is described in detail .

• KingbaseES Database tuning guide ： The optimization capability provided by the system is described in detail .

3.3. KingbaseES Cutting capacity of support system

This chapter mainly describes the support of products for application operation , Whether the requirements in the process of system cutover online are met .

3.3.1.  Application business cutover time is short

The application business cannot be shut down , Or the time for cutting is very short , You need to use the synchronization tool to continuously synchronize data .

• Evaluate the minimum time required for system cutover , Coordinate users to reserve the shortest time ;

• Make a fallback plan for system cutover failure , Once the cutover fails , Quickly return to the original system ;

• Using migration tools KDTS-PLUS Complete historical data migration ;

• Use KFS Continuous synchronization of heterogeneous databases .

When the data difference between the source database and the destination database is less than the reserved time , You can cut the system .

3.3.2.  Double track operation is required after cutover

If the application migration time is short , There is not enough testing time and commissioning time , Users can use the double track operation after cutover , The application system runs on a database , The data in the database is synchronized to another database in real time ; Once the application goes wrong , You can quickly switch to another database .

KFS Support KingbaseES Synchronize with the implementation of heterogeneous databases .