当前位置：网站首页>[in depth understanding of tcapulusdb technology] getting started with MySQL driver

[in depth understanding of tcapulusdb technology] getting started with MySQL driver

2022-06-22 20:02:00 【InfoQ】

【 In depth understanding of TcaplusDB technology 】 introduction MySQL Driver

TcaplusDB Version in 3.57.1 Later compatible MySQL 5.7 agreement , Support MySQL The basic functions and grammar of .MySQL Eco client driven 、 All tools are suitable for TcaplusDB.

compatible MySQL Agreement is TcaplusDB New features , Currently supported SQL Limited function , Including the following 7 A point ：

Single table is supported SELECT、INSERT、DELETE、UPDATE sentence ;

SELECT、DELETE、UPDTATE Operation of the WHERE Clause must explicitly specify one or more primary keys , See the later 《SQL Grammar use reference 》;

When the global index is configured , Support basic aggregation functions , See the later 《 Global index query 》;

Temporary does not support prepared statement;

Temporary does not support DDL, namely CREATE / DROP TABLE etc. ;

I won't support it ORDER BY、GROUP BY;

Cross table is not supported JOIN.

1. The version of the client or driver is compatible

TcaplusDB compatible MySQL 5.7 agreement , Use support MySQL 5.7 agreement （ Include 5.7） Either the client or the driver can connect .

In practical use , There may be compatibility differences between different versions , We recommend using MySQL 5.0 above 5.7（ Include 5.7） The following clients or drivers . After our test , The following versions of the client or driver can be used normally ：

MySQL client Tools ,5.5.24

Python Of
MySQLdb
, The actual bottom layer uses mysql c api Of 5.5.24 edition

JDBC,
mysql-connector-java-5.1.49

.NET mysql driver 8.0.25

2. Table definition and table creation

2.1 The table definition

TcaplusDB At present, it is not supported to pass SQL Dynamic table creation in the way of , For a smooth sample experience , have access to XML file （ As shown in the following example ） Define the table , adopt Tcaplus OMS Create tables on the platform .

Table definition example ：

<?xml version=&quot;1.0&quot; encoding=&quot;GBK&quot; standalone=&quot;yes&quot; ?>
<metalib name=&quot;demo_table&quot; tagsetversion=&quot;1&quot; version=&quot;1&quot;>
 <struct name=&quot;user&quot; version=&quot;1&quot; primarykey=&quot;user_id,server_id&quot; splittablekey=&quot;user_id&quot;>
 <entry name=&quot;user_id&quot; type=&quot;string&quot; size=&quot;450&quot; desc=&quot; user ID&quot;/>
 <entry name=&quot;server_id&quot; type=&quot;int64&quot; desc=&quot; The server ID&quot; />
 <entry name=&quot;nick_name&quot; type=&quot;string&quot; size=&quot;50&quot; desc=&quot; nickname &quot;/>
 <entry name=&quot;desc&quot; type=&quot;string&quot; size=&quot;1024&quot; desc=&quot; Description information &quot;/>
 <entry name=&quot;state&quot; type=&quot;Tinyuint&quot; defaultvalue=&quot;0&quot; desc=&quot; User state  0 : AVALIABLE, 1 DELETED&quot;/>
 <index name=&quot;index1&quot; column=&quot;user_id&quot;/>
 <index name=&quot;index2&quot; column=&quot;user_id,server_id&quot;/>
 </struct>
</metalib>

Elements metalib yes xml The root element of the file .

contain primarykey Of struct Element is a table , It doesn't contain primarykey Of struct The element is an ordinary structure .

Every time the table structure is modified , The version attribute value needs to be added accordingly 1, The initial version is always 1.

primarykey Property specifies the primary key field ; about generic surface , You can specify at most 8 Primary key fields , about list surface , You can specify 7 individual .

splittablekey Property is equivalent to a partition key （shard key）,TcaplusDB Tables are split and stored to multiple storage nodes .splittablekey Must be one of the primary key fields , A good splittablekey It should be highly decentralized , This means a wide range of values , String type is recommended .

desc Property contains the description of the current element .

entry Element defines a field , Supported value types include int32,string,char,int64,double,short etc. .

index Element defines an index , The index must contain splittablekey. Because you can use the primary key to query the table , Therefore, the index should not be the same as the primary key attribute .

2.2 Table building process

Preparatory work ： Pre deployed

Tcaplus Local edition

, Pay attention to the need to use

3.57.1

edition .

# step0, Use the above xml Table definition of format , Save as .xml Suffix text , Such as table-define.xml.
# step1, Get into OMS  page , Open... In the menu bar ： The business management ＝〉 Watch management .
# step2, page Tab Column , Choose ： Table to add 
# step3, Select the business and cluster and check the game area ,  colony ：test_set(1),  Business ：tdr_app(2),  Game Zone ID: 3,  Click again ： Batch add table 
# step4, In the page that comes out , Browse to the bottom of the page , Click on ： Add... From local file , Select the sample table definition file downloaded from the above resources in the pop-up page :table-define.xml
# step5, Click on ： Submit , Create a sample table : demo_table
# step6, Check whether the table is created ok, Get into ： The business management => Watch management , Select the corresponding business (tdr_app) And the game area (3),  See if demo_table Table information

The operation sample ：

step1:

step2:

step3:

step4&5:

step6:

3. Quick experience

3.1 Connection instructions

And standards MySQL Use the same , The user name is required to connect to the database 、 password 、 Database name 、IP And the port number above .

MySQL Of
database
The concept of corresponding TcaplusDB In a
Business
One of the
District
, Use
'appid.zoneid'
As the database name , For example, the area where the example table is located is
2.3
.

MySQL The address of the client or driver connection is Tcaplus Proxy Node IP + port , Can be found in OMS Of
Operational platform => State of the cluster
Page view IP And port number .

MySQL Before the first connection , You need to create a corresponding MySQL Users and give corresponding permissions , See the following graphic guidelines for the creation process .

see Proxy Node MySQL Connection address , Any of

'appid.zoneid'

Of proxy Fine ：

establish MySQL user ：

step0, Open the maintenance center of the corresponding business .

step1, Create user , Fill in the user name and password .

step2, Contact the operation and maintenance department for approval , If the current operator has permission, he can approve it himself .

step3, Give the user read and write permission , Here is given in the app All of them zone Read and write permission of .

explain ：TcaplusDB Currently only supported
mysql_native_password
Plug in authentication , It's also MySQL 5.7 Default connection authentication .

3.2 Experience examples （ Use mysql client）

Connect with MySQL equally , Execute the following command , Use MySQL Of client Tools can be used to connect TcaplusDB Of proxy

mysql -u user_name -p user_passwd --port=15755 --host=xxx.xxx.xxx.xxx 2.3

3.3 Experience examples （ Use .NET mysql driver）

compatible MySQL 5.7 Agreed MySQL Driver The database can be accessed normally . Use here .NET 5.0 and MySQL Connector/NET 8.0.25 Demonstrate the process of initializing the connection .

public class Database
{
 static MySqlConnection conn; // MySql Connect 
 const String server = &quot;xxx.xxx.xxx.xxx&quot;; //  Server address , The client to connect to  proxy  Node  IP
 const String port = &quot;15755&quot;; //  Port number , The client to connect to  proxy  Node  Port
 const String uid = &quot;user_name&quot;; //  user name 
 const String pw = &quot;user_passwd&quot;; //  password 
 const String db = &quot;2.3&quot;; //  Library name , from TcaplusDB Business in ID And zoning ID Splicing into 

 public static Boolean Init()
 {
 try
 {
 if (conn == null)
 {
 conn = new MySqlConnection(&quot;server=&quot; + server + &quot;;port=&quot; + port + &quot;;user id=&quot; + uid + &quot;;password=&quot; + pw + &quot;;database=&quot; + db);
 conn.Open();
 Console.WriteLine(&quot;database connected.&quot;);
 }
 return true;
 }
 catch (Exception e)
 {
 Console.WriteLine(&quot;Exception caught: {0}&quot;, e);
 return false;
 }
 }
}

4. Data type support

TcaplusDB and MySQL Data type correspondence

5. SQL Grammar use reference

Suppose the data sheet demo share 5 A field ：key1, key2, key3, value1, value2, among ,key1, key2 by partkey,key1, key2, key3 form fullkey.

5.1 The insert

Insert the of a single record SQL The sentence form is as follows ：

INSERT INTO demo (key1,key2,key3,value1,value2) values (x1,x2,x3,x4,x5);

Insert multiple records SQL The sentence form is as follows ：

INSERT INTO demo (key1,key2,key3,value1,value2) values (x1,x2,x3,x4,x5); INSERT INTO demo (key1,key2,key3,value1,value2) values (x6,x7,x8,x9,x10);

5.2 where Clause syntax restrictions

When the global index is not configured ,where Clause consists of two parts ：1、 Required part ：partkey or fullkey;2、 Optional part ： Filter conditions .

partkey or fullkey： Only equivalent queries can be performed , And the composition partkey or fullkey You can only use... Between the fields of AND Connect ;

Filter conditions ： Support NOT、=、>、<、!=、>=、<= Operator , And multiple filter conditions can be used AND or OR Connect , Support key Field or value Field .

1、 Use fullkey When deleting, modifying and querying where The clause form is as follows ：

WHERE key1=x1 AND key2=x2 AND key3=x3;

2、 Use fullkey+ When deleting, modifying, and querying filter conditions where The clause form is as follows , If the filter conditions include OR Operator , The filter conditions must be bracketed ：

WHERE key1=x1 AND key2=x2 AND key3=x3 AND ( Filter conditions );

3、 Use partkey When deleting, modifying and querying where The clause form is as follows ：

WHERE key1=x1 AND key2=x2;

4、 Use partkey+ When deleting, modifying, and querying filter conditions where The clause form is as follows , If the filter conditions include OR Operator , The filter conditions must be bracketed ：

WHERE key1=x1 AND key2=x2 AND ( Filter conditions );

When where The required part in the clause is partkey when ,where Clause may result in multiple records .

5.3 Delete operation

1、 adopt fullkey When deleting a single record ,SQL The statement has the following two forms ：

DELETE FROM demo WHERE key1=x1 AND key2=x2 AND key3=x3;
DELETE FROM demo WHERE key1=x1 AND key2=x2 AND key3=x3 AND ( Filter conditions );

2、 adopt fullkey When deleting records in batch ,SQL The sentence form is as follows ：

DELETE FROM demo WHERE (key1=x1 AND key2=x2 AND key3=x3) OR (key1=x4 AND key2=x5 AND key3=x6);

Delete / Batch delete operation is not supported partkey, The batch deletion operation does not support the filter criteria .

5.4 update operation

1、 adopt fullkey When updating a single record ,SQL The statement has the following two forms ：

UPDATE demo SET value1=x1, value2=x2 WHERE key1=x1 AND key2=x2 AND key3=x3;
UPDATE demo SET value1=x1, value2=x2 WHERE key1=x1 AND key2=x2 AND key3=x3 AND ( Filter conditions );

2、 adopt fullkey When updating records in batch ,SQL The sentence form is as follows ：

UPDATE demo SET value1=x1, value2=x2 WHERE (key1=x3 AND key2=x4 AND key3=x5) OR (key1=x6 AND key2=x7 AND key3=x8);

to update / Batch update operation does not support partkey, The batch update operation does not support the filter criteria .

5.5 Query operation

1、 adopt fullkey When querying a single record ,SQL Statements have the following four forms ：

SELECT * FROM demo WHERE key1=x1 AND key2=x2 AND key3=x3;
SELECT * FROM demo WHERE key1=x1 AND key2=x2 AND key3=x3 AND ( Filter conditions );
SELECT key1,value1 FROM demo WHERE key1=x1 AND key2=x2 AND key3=x3;
SELECT key1,value1 FROM demo WHERE key1=x1 AND key2=x2 AND key3=x3 AND ( Filter conditions );

2、 adopt partkey When querying multiple records ,SQL Statements have the following four forms ：

SELECT * FROM demo WHERE key1=x1 AND key2=x2;
SELECT * FROM demo WHERE key1=x1 AND key2=x2 AND ( Filter conditions );
SELECT key1,value1 FROM demo WHERE key1=x1 AND key2=x2;
SELECT key1,value1 FROM demo WHERE key1=x1 AND key2=x2 AND ( Filter conditions );

3、 adopt fullkey When querying records in batch ,SQL The form of the statement is as follows ：

SELECT * FROM demo WHERE (key1=x1 AND key2=x2 AND key3=x3) OR (key1=x4 AND key2=x5 AND key3=x6);

The batch query operation does not support the filter criteria .

4、 adopt partkey When querying records in batch ,SQL The form of the statement is as follows ：

SELECT * FROM demo WHERE (key1=x1 AND key2=x2) OR (key1=x3 AND key2=x4);

The batch query operation does not support the filter criteria .

6. Global index query

TcaplusDB Provide sql Index query with query statement , among ,sql The field in the query criteria must be a field with a global index . in addition , If it is an aggregate query , The aggregate field must also be a field with a global index . In the current version , Each index query request returns up to 3000 Bar record .

Since the data is synchronized to the global index module, it takes up to 1 Seconds , therefore , After performing an insert or update operation , At most 1 The latest data can be queried in about seconds .

6.1 Supported by sql Query statement

Conditions of the query

Support =, >, >=, <, <=, !=, between, in, not in, like, not like, and, or , such as :

SELECT * FROM `mail` WHERE user_id>=&quot;10004&quot; AND server_id=100;
SELECT * FROM `mail` WHERE user_id BETWEEN 10000 AND 10003 AND server_id=100;
SELECT * FROM `mail` WHERE user_id=&quot;10000&quot; AND server_id=100 AND mail_id LIKE &quot;210507%&quot;;
SELECT * FROM `mail` WHERE user_id>=&quot;10004&quot; OR server_id<=200;

Be careful ：between When inquiring ,between a and b, The corresponding query range is [a, b];like Query supports fuzzy matching , among "%" wildcard , matching 0 One or more characters ; “_” wildcard , matching 1 Characters ;

Paging query

Support limit offset Paging query , such as ：

SELECT * FROM mail WHERE user_id>&quot;10000&quot; LIMIT 100 OFFSET 2;

Be careful ： At present limit Must be with offset Use it with , I won't support it limit 1 perhaps limit 0, 1

Aggregate query

Currently supported aggregate queries include ：sum, count, max, min, avg, such as ：

SELECT server_id, COUNT(DISTINCT user_id), COUNT(*), SUM(state) FROM \`mail\` WHERE user_id>=&quot;10000&quot; AND server_id=100;

Be careful ： Aggregate queries do not support limit offset, namely limit offset Don't take effect ; At present, only count Support distinct, namely

select count(distinct(a)) from table where a > 1000;

Nothing else supports distinct.

TcaplusDB It's a distributed product of Tencent NoSQL database , The code for storage and scheduling is completely self-developed . With cache + Landing fusion architecture 、PB Levels of storage 、 Millisecond delay 、 Lossless horizontal expansion and complex data structure . At the same time, it has rich ecological environment 、 Easy migration 、 Extremely low operation and maintenance costs and five nine high availability features . Customer coverage game 、 Internet 、 government affairs 、 Finance 、 Manufacturing and the Internet of things .

原网站

版权声明
本文为[InfoQ]所创，转载请带上原文链接，感谢
https://yzsam.com/2022/173/202206221832199888.html