Clickhouse notes 02 -- installation test clickvisual

Introduce

clickvisual Is a lightweight open source log query 、 analysis 、 Visual platform of alarm , We are committed to providing visual solutions for one-stop application reliability . It can be deployed and used independently , It can also be integrated into third-party systems as a plug-in . At present, it is the only one in the market that supports ClickHouse Class Kibana Business log query platform .
In this paper Ubuntu Deploy on the system clickvisual, And with Kibana Made a simple comparison .
clickvisual

precondition

Deploy a set of mysql, Here's straight docker Pull up mysql5

docker run -d -p3306:3306 --name=mysql5 -e MYSQL_ROOT_PASSWORD=111111 mysql:5
 Get into mysql  establish  db： clickvisual

Deploy a set of redis, Here's straight docker Pull up redis5 Deploy a set of redis, Here's straight docker Pull up redis5

docker run --name=redis5.0  -d -p 6379:6379 redis:5.0

Deploy a set of clickhouse, Deployment documentation reference clickhouse note 01– Rapid deployment clickhouse , After deployment, import the test data as follows

 stay  ck  Import data from , uk_price_paid2
 Download data (27265985 strip ,csv 4.5GB size )： 
wget http://prod.publicdata.landregistry.gov.uk.s3-website-eu-west-1.amazonaws.com/pp-complete.csv

 Build table , Import data ：  Be careful  clckvisual  Time field required , Therefore, it is necessary to  date  Field set to  DateTime
$ clickhouse-client 
localhost :) use default;
localhost :) 
CREATE TABLE uk_price_paid2
(
    price UInt32,
    date DateTime,
    postcode1 LowCardinality(String),
    postcode2 LowCardinality(String),
    type Enum8('terraced' = 1, 'semi-detached' = 2, 'detached' = 3, 'flat' = 4, 'other' = 0),
    is_new UInt8,
    duration Enum8('freehold' = 1, 'leasehold' = 2, 'unknown' = 0),
    addr1 String,
    addr2 String,
    street LowCardinality(String),
    locality LowCardinality(String),
    town LowCardinality(String),
    district LowCardinality(String),
    county LowCardinality(String),
    category UInt8
) ENGINE = MergeTree ORDER BY (postcode1, postcode2, addr1, addr2);

$ clickhouse-local --input-format CSV --structure ' uuid String, price UInt32, time DateTime, postcode String, a String, b String, c String, addr1 String, addr2 String, street String, locality String, town String, district String, county String, d String, e String ' --query " WITH splitByChar(' ', postcode) AS p SELECT price, toDateTime(time) AS date, p[1] AS postcode1, p[2] AS postcode2, transform(a, ['T', 'S', 'D', 'F', 'O'], ['terraced', 'semi-detached', 'detached', 'flat', 'other']) AS type, b = 'Y' AS is_new,clickvisual transform(c, ['F', 'L', 'U'], ['freehold', 'leasehold', 'unknown']) AS duration, addr1, addr2, street, locality, town, district, county, d = 'B' AS category FROM table" --date_time_input_format best_effort < pp-complete.csv | clickhouse-client --query "INSERT INTO uk_price_paid2 FORMAT TSV"

The deployment of test

Download software configuration

#  Get the latest version 
latest=$(curl -sL https://api.github.com/repos/clickvisual/clickvisual/releases/latest | grep ".tag_name" | sed -E 's/.*"([^"]+)".*/\1/')

# Linux amd64 System 
wget "https://github.com/clickvisual/clickvisual/releases/download/${latest}/clickvisual-${latest}-linux-amd64.tar.gz" -O clickvisual-${latest}.tar.gz

Start the service

#  Decompress the package 
mkdir -p ./clickvisual-${latest} && tar -zxvf clickvisual-${latest}.tar.gz -C ./clickvisual-${latest}

#  Modify the configuration file  config/default.toml, take  MySQL、Redis  Wait for the configuration to change to your own configuration .
#  After modifying the configuration file , Use the following instructions to run  clickvisual
cd ./clickvisual-${latest} && ./clickvisual -config config/default.toml

#  visit  http://localhost:19001
# login username: clickvisual
# login password: clickvisual

The normal output after startup is as follows ：

http://localhost:19001 Account number / password clickvisual/clickvisual

Clicking the Install button below will trigger multiple table initialization operations

Login screen ：

main interface ：

New instance ：
stay DSN Fill in the instance information in ： tcp://127.0.0.1:9000?username=default

New logstore ：

Check the log ：
It can be similar in the search column kibana To search for logs , You can use some simple fuzzy matching search .

Advantages and disadvantages

clickvisual Can be used to view Clickhouse Log data in , But compared with the mainstream logging system Kibana It's still a long way off , There is still much room for hints in the future . For reference here kibana Briefly talk about some of its advantages and disadvantages , As follows ：
advantage ：

1. You can query at the front end clickhouse journal
2. You can configure some simple filters

Insufficient ：

1. The front-end query filtering function is relatively weak ,UI It's also very simple.
   Kibana Query is more flexible ,clickVisual Query limitations are relatively large
   
   
2. Cannot provide aggregate function , You cannot configure the relevant data statistics panel through aggregation
3. The front end cannot provide data export function
4. Open source time is short , Incomplete function , Errors are often reported when using
   No error is reported when connecting , But the data cannot be queried ：
   
   
   An abnormal error is reported when searching ：
   

explain

Software environment ：
Ubuntu 21.04 Desktop
mysql 5
redis 5.0
clickvisual v0.3.2-rc2
Reference documents ：
ClickVisual Official documents -- Binary installation