Oracle advanced (I) realize DMP by expdp impdp command

One 、 Preface

About

dmp

We still use more documents ,

dmp

The document serves as

oracle

File formats used for importing and exporting tables .

Two 、 The preparation of the instruments

• FileZilla

• SecureCRT

among ,

FileZilla

It is mainly used to view the generated

dmp

Files and log files ;

SecureCRT

Mainly used for execution shell Script .

3、 ... and 、Expdp File export

dmp

There are generally three kinds of file export ： Export all data under the entire database instance 、 Export all tables of the specified user 、 Export specified table .

Related parameters and export examples ：

• DIRECTORY
  Specify the directory where the dump and log files are located .

DIRECTORY=directory_object


Directory_object

Used to specify the directory object name . We need to pay attention to , Directory objects are created using

CREATE DIRECTORY

The object created by the statement , instead of

OS

Catalog .

Expdp scott/tiger DIRECTORY= DMP DUMPFILE=a.dump
create or replace directory dmp as 'd:/dmp'
expdp zftang/zftang(@zftang) directory=dmp dumpfile=test.dmp content=metadata_only


• CONTENT
  This option is used to specify what to export . The default value is
  ALL
  .

CONTENT={ALL | DATA_ONLY | METADATA_ONLY}


When setting

CONTENT

by

ALL

when , The object definition and all its data are exported . by

DATA_ONLY

when , Export only object data , by

METADATA_ONLY

when , Export only object definitions .

expdp zftang/[email protected] directory=dmp dumpfile=test.dmp content=metadata_only

expdp zftang/[email protected] directory=dmp dumpfile=test.dmp content=data_only


• DUMPFILE
  Used to specify the name of the dump file , The default name is
  expdat.dmp
  .

DUMPFILE=[directory_object:]file_name [,….]


Directory_object

Used to specify the directory object name ,

file_name

Used to specify the dump file name . We need to pay attention to , If you don't specify

directory_object

, The export tool will automatically use

DIRECTORY

Option .

expdp zftang/[email protected] directory=dmp dumpfile=test1.dmp


Data pump tool export steps ：1、 establish

DIRECTORY

create directory dir_dp as 'D:/oracle/dir_dp'; 


2、 to grant authorization

Grant read,write on directory dir_dp to zftang;


-- View directory and permissions

SELECT privilege, directory_name, DIRECTORY_PATH FROM user_tab_privs t, all_directories d WHERE t.table_name(+) = d.directory_name ORDER BY 2, 1;


3、 Perform export

expdp zftang/[email protected] schemas=zftang directory=dir_dp dumpfile =expdp_test1.dmp logfile=expdp_test1.log;


Connect to : 

Oracle Database 10g Enterprise Edition Release 10.2.0.1

With the Partitioning, OLAP and Data Mining options start-up  "ZFTANG"."SYS_EXPORT_SCHEMA_01": zftang/********@fgisdb schory=dir_dp dumpfile =expdp_test1.dmp logfile=expdp_test1.log; */

Four 、 remarks

1、

directory=dir_dp

It has to be in the front , If you put it last , Will prompt :

• ORA-39002
  :  Invalid operation

• ORA-39070
  :  Unable to open log file .

• ORA-39087
  :  Directory name  
  DATA_PUMP_DIR
  ;  Invalid 2、 In the export process ,
  DATA DUMP
    Created and used a program called
  SYS_EXPORT_TABLE_01
  The object of , This object is
  DATA DUMP
  Used in the export process
  JOB
  name , If you do not specify the exported
  JOB
  Name, then a default
  JOB
  name , If... Is specified during export
  JOB
  A name is a given name .

expdp zftang/[email protected] schemas=zftang directory=dir_dp dumpfile =expdp_test1.dmp logfile=expdp_test1.log,job_name=my_job1;


3、 There should be no semicolon after the export statement , Otherwise, in the above export statement

job

Table, ‘my_job1;’, instead of my_job1. Resulting in

expdp zftang/zftang attach=zftang.my_job1

When you execute this command, you are always prompted that you can't find job surface .

5、 ... and 、 Various modes of data pump export

5.1  Export in table mode ：

expdp zftang/[email protected] tables=zftang.b$i_exch_info,zftang.b$i_manhole_info dumpfile 
=expdp_test2.dmp logfile=expdp_test2.log directory=dir_dp 
job_name=my_job


5.2  Export by query condition

expdp zftang/[email protected] tables=zftang.b$i_exch_info dumpfile =expdp_test3.dmp logfile=expdp_test3.log directory=dir_dp job_name=my_job query='&quot;where rownum<11&quot;'


5.3  Export by table space

Expdp zftang/[email protected] dumpfile=expdp_tablespace.dmp tablespaces=GCOMM.DBF logfile=expdp_tablespace.log directory=dir_dp job_name=my_job


5.4  Export scheme

Expdp zftang/zftang DIRECTORY=dir_dp DUMPFILE=schema.dmp SCHEMAS=zftang,gwm


5.5  Export the entire database

expdp zftang/[email protected] dumpfile =full.dmp full=y logfile=full.log directory=dir_dp job_name=my_job


6、 ... and 、Impdp File import

6.1  Import by table

p_street_area.dmp The table in the file , This document is based on gwm User presses schemas=gwm Derived ：

impdp gwm/[email protected] dumpfile =p_street_area.dmp 
logfile=imp_p_street_area.log directory=dir_dp tables=p_street_area 
job_name=my_job


6.2  Import by user （ You can import user information directly into , That is, if the user information does not exist, it can also be imported directly ）

impdp gwm/[email protected] schemas=gwm dumpfile =expdp_test.dmp logfile=expdp_test.log directory=dir_dp job_name=my_job


6.3  Not through expdp To generate dmp File and direct import method

-- Import tables from the source database to the target database p_street_area
impdp gwm/gwm directory=dir_dp NETWORK_LINK=igisdb tables=p_street_area logfile=p_street_area.log job_name=my_job
igisdb Is the link name between the destination database and the source data ,dir_dp Is the directory on the destination database


6.4  Change the table space

use

remap_tablespace

Parameters

-- export gwm All the data under the user
expdp system/orcl directory=data_pump_dir dumpfile=gwm.dmp SCHEMAS=gwm


notes ： If it is to use

sys

User data exported by users , Including user creation 、 The authorized part , Export with its own user does not contain these contents -- Here is what will be gwm All the data under the user is imported into the table space gcomm（ Originally for gmapdata In table space ） Next

impdp system/orcl directory=data_pump_dir dumpfile=gwm.dmp remap_tablespace=gmapdata:gcom


7、 ... and 、EXP、IMP And EXPDP、IMPDP The difference between

• EXP
  and
  IMP
  Is a client utility , They can be used on the client side , It can also be used on the server .

• EXPDP
  and
  IMPDP
  It is the tool program of the server , They can only be in
  ORACLE
  Server use , Can't use... On the client side .

• IMP
  Only applicable to
  EXP
  Exported files , Do not apply to
  EXPDP
  export file ;
  IMPDP
  Only applicable to
  EXPDP
  Exported files , Not applicable to
  EXP
  export file .

• expdp
  or
  impdp
  On command , Don't indicate the user name for the moment / password @ Instance name  as  identity , And then type... According to the prompt , Such as ：

expdp schemas=scott dumpfile=expdp.dmp DIRECTORY=dpdata1;


8、 ... and 、 Export and import may encounter obstacles

Two problems encountered in the import process ：

8.1 Chinese character set conversion

• KUP-11007
  : 
  conversion error loading table "TEST"."T_PSR" ORA-12899:
    Column REASON_CODE  It's worth too much  ( actual value : 21,  Maximum : 20)

• KUP-11009
  : 
  data for row: REASON_CODE : 0X'BABDBFD5C6F7C8DDC1BFCFDED6C6'

Here comes the problem of character set conversion , In Chinese GBK The character set accounts for 2 position , But in UTF-8 The character set accounts for 3 position , So in GBK Save less than 20 In the case of characters , Import to UTF-8 Library , The field length definition may be exceeded due to the need for additional character space , Yes

ORA-12899

Error of .

8.2  Primary foreign key Association

• ORA-31693
  : 
  Table data object "TEST"."T_ITE" failed to load/unload and is being skipped due to error:

• ORA-29913
  : 
  error in executing ODCIEXTTABLEFETCH callout

• ORA-02291
  : 
  integrity constraint (TEST.FK_ITE_REF_PSR) violated parent key not found

Because there are primary and foreign key associations between some tables ,expdp When exporting, select data_only Export data only ,impdp When importing, foreign key records will be inserted because primary key records are not inserted , appear

ORA-02291

Error of , In this case, you can choose to disable the primary foreign key association first , Restore the association after importing . Sequence of operation ：

• Before importing , The implementation is as follows SQL Find the foreign key association that needs to be forbidden

select 'ALTER TABLE '||TABLE_NAME||' DISABLE CONSTRAINT '||constraint_name||';'from user_constraints WHERE 
CONSTRAINT_TYPE='R';


• perform (a) Result SQL.

• After import , The implementation is as follows SQL Find the foreign key association that needs to be restored

select 'ALTER TABLE '||TABLE_NAME||' ENABLE NOVALIDATE CONSTRAINT '||constraint_name||';' from user_constraints WHERE 
CONSTRAINT_TYPE='R';


NOVALIDATE

Parameters do not validate stored data , However, the records to be inserted in the future will follow the relationship between the primary and foreign keys .

Nine 、 summary

• Use 10g The above version provides expdp/impdp Data pump import and export tool , More than ever exp/imp Tools , Whether in terms of the optional parameters , Or speed and compression ratio , There have been no small improvements , Provide us with more convenient and fast data import and export methods .

• Import and export may encounter the most problems , Character set conversion is one of them , It is necessary to clarify the dependence of imported and exported data on character sets , To ensure the correct import and export of data .

• For data associated with primary and foreign keys , If you choose data_only Export data only , Then you can disable constraints before importing , In this way, the import process will not be affected by the primary foreign key Association , Constraints can be restored after import , Ensure that the constraints are correct .

Ten 、 Delete foreign key constraint

 ALTER TABLE test_sub DROP CONSTRAINT main_id_cons;


1、ORACLE The foreign key constraint names in the database are all in the table

user_constraints

You can find . among

constraint_type='R'

Represents a foreign key constraint .2、 The command to enable foreign key constraints is ：

alter table table_name enable constraint constraint_name

3、 The command to disable foreign key constraints is ：

alter table table_name disable constraint constraint_name

4、 And then use SQL Find out the constraint name of all foreign keys in the database ：

select 'alter table '||table_name||' enable constraint '||constraint_name||';' from user_constraints where constraint_type='R'