How Tencent cloud es achieves cross cluster data copy & lt through reindex; Lower & gt;

One 、 Preface |

In the previous chapter on Reindex The function is being explained , We have realized the copy of the cluster between the public cloud and the private cloud , Please refer to the following for relevant links ：https://cloud.tencent.com/developer/article/1764879 So this section , Let's talk about the public cloud of Tencent cloud ElasticSeach Some applications of , The test environment is as follows ：

ES Trans regional Reindex Practice topology

Two 、 Basic conditions

 Target cluster ： es-cqujhmdp    Guangzhou three districts 
 Source cluster ：   es-q8xzb62x    Guangzhou three districts 、 Four districts of Guangzhou 
 Source cluster ：   es-8cezflol    Guangzhou three districts 
 Source cluster ：   es-qvk8sx82    Four districts of Guangzhou 

3、 ... and 、Reindex To configure

Reindex The function requires open remote ES White list of cluster access addresses , Users can now use the Tencent cloud console - -> To select a ES colony --> Change the configuration file in advanced configuration , Be careful ： Changing this configuration requires a reboot ES colony .

Be careful 1： reindex.remote.whitelist Indicates the access to the cluster VIP Information , such as ,A The cluster needs to pass Reindex Copy B Data on the cluster , Then we are B In the cluster configuration file , To configure A Clustered VIP Information , And restart the cluster .

Be careful 2： If the source cluster 、 When there are multiple zones in the target cluster , Here, for example. , I copy the cluster data of a single availability zone from a cluster of multiple availability zones , perform reindex When , There was such a mistake “10.2.20.29:9200 not whitelisted in reindex.remote.whitelist”

terms of settlement ： You need to add... In the local cluster, that is, the source cluster reindex The white list , Put the error prompt VIP Information is added locally , Then restart the cluster , In this way, you can execute reindex command .

Be careful 3： Same as VPC Between different subnets reindex, For example, one is in the third district of Guangzhou 、 One is in the Fourth District of Guangzhou , The above error will also be reported , If something goes wrong , You should also add the target cluster in the local cluster VIP Information .

Be careful 4： 2 Between clusters of multiple zones reindex The above error will also be reported , The treatment method is the same as above .

Four 、 summary

It seems Reindex There are still many things to pay attention to when operating multiple availability zones across domains , Here is a unified summary , If other problems are found later , Will be updated in time

 Target cluster ： es-XXX    Guangzhou three districts              Single zone 


 Source cluster ：   es-XXX    Guangzhou three districts 、 Four districts of Guangzhou     Area available on ： Configure in the target cluster remote Remote access cluster list , In the local source cluster, the target side should also be configured VIP
 Source cluster ：   es-XXX    Guangzhou three districts              Single zone ： Configure directly in the target cluster remote After accessing the cluster list remotely , The operation on the source cluster succeeded 
 Source cluster ：   es-XXX    Four districts of Guangzhou              Single zone ： Configure in the target cluster remote Remote access cluster list , In the local source cluster, the target side should also be configured VIP
 Source cluster ：   es-XXX    Guangzhou three districts 、 Four districts of Guangzhou     Area available on ： Configure in the target cluster remote Remote access cluster list , In the local source cluster, the target side should also be configured VIP      

So this section is the last one Reindex The actual supplement of document operation .

Tencent cloud ES How to use Reindex Realize cross cluster data copy < On > Reference here ： https://cloud.tencent.com/developer/article/1764879