当前位置：网站首页>Esrally domestic installation and use pit avoidance Guide - the latest in the whole network
Esrally domestic installation and use pit avoidance Guide - the latest in the whole network
2022-07-06 07:41:00 【Spirit of water】
Follow the steps on the official website , One pit at a time , Wasted my whole day ！ Most of it is because of the domestic network , Download and pull speed is too slow , Cause installation to fail . So I wrote this article , To record my successful installation cases , I hope it can help you esrallu People who do benchmarking ！
There are also articles on the Internet, but they are all out of date ！ What about the official website , It is not suitable for the use of Chinese network . I even seriously doubt , Steps on the official website , Did they try it again . Because there are bound to be problems with which commands . such as ：
sudo yum install gitI don't believe this order , Can help us download the new version git！
Pay attention to the present esrally The latest version is 2.5.0！
Official website address （ The latest edition in English ）：Quickstart — Rally 2.5.0 documentation
Chinese document （0.9 Version of ）： install — Rally 0.9.0 file
Prepare the environment - Introduction to the environment needed
When I'm looking at the documents , Actually, I really want to know why I install these things , And whether it's OK not to install , What version do I need to install . I wasted a lot of time watching the official website toss about this , So I specially wrote a blog to take everyone to avoid the pit ！
operating system centos7, I was in centos7 Installed below , Other versions , Operating system not applicable , I didn't verify whether the other versions were successful .esrally It can only run on linux Next ！
The installation process requires a network environment . Even if there is a network , There are still many problems when loading some things , So when I install something , You can also use the installation package to install , To reduce the occurrence of problems .
Another word ,esrally The document is written for foreigners , Because we don't have some network environment , So operate according to the document , A lot of questions .
Want to run esrally Necessary tools
- python3.8 Above version , I think the example on the official website is python3.8.10 Version of . To reduce problems , I also use python3.8.10. Say why you want to use it , because esrally Yes, it is python Written , Installation also uses pip3. These are all necessary ！
- git, edition 1.9 And above . use git Because es All the data used are on the Internet , The test cases used are also placed in git On , So we need to pull it when we use it . This is also necessary , No, no, No ！
- JDK. I use this because ,esrally Support automatic build es colony , Is to help you build a cluster .es Low version （7 Before the release ） No inline JDK, So these versions need JDK, And configure the environment . If you build your own cluster , Test the existing cluster , Then there is no need for JDK 了 . If you need it to help you build a cluster , You need to JDK The environment is well configured .
- esrally,es The protagonist of benchmarking .
How to be in linux centos Lower installation python Environmental Science
I am using this article esrally When I wrote , When I followed the official website, I encountered a lot of holes , Mainly a waste of time , It's not necessary . My plan is simpler ！ Please read my article ：
centos Compile and install various versions of python_ Water spirit blog -CSDN Blog
How to upgrade git, Or install git
centos7 Installed by default git, Unfortunately, its version is 1.8 Of . That is, lower than the requirements of the official website 1.9 edition . So we need to upgrade . Searching for documents on the Internet for a long time , It 's not true . So I suggest you read this article （ Very simple , Three orders ）：
Linux centos Next three commands to install and upgrade git_ Water spirit blog -CSDN Blog
How to install JDK
Download and install jdk13
https://www.oracle.com/java/technologies/javase-jdk13-downloads.htmlCopy
download , Upload to server .
then rpm install
rpm -ivh jdk-13.0.2_linux-x64_bin.rpmConfigure environment variables , stay /etc/profile Add the following at the end of the document
export JAVA_HOME=/usr/java/jdk-13.0.2
export PATH=$JAVA_HOME/bin:$PATH
export CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jarAnd execute the following commands to make the environment variables take effect
source /etc/profileinstall esrally
The operation given by the official website is to use a command to install , It's easy to drive ：
pip3 install esrallyBut my execution was unsuccessful . Maybe I'm right python For reasons that are not very familiar . I used other methods to install （ Offline installation esrally Is the most reliable , Solve the pulling problem ！ I was trying the above command , There are a lot of problems . I don't want to solve it ！ So install it offline ）：
- Install all dependent packages mentioned in the above documents
- download The latest released offline package , And copy it to the target machine .
- Unzip the installation package
tar -xzf esrally-dist-*.tar.gz. - Execute installation script
sudo ./esrally-dist-*/install.sh.
When implementing Article 4 , I still have a problem （ I posted some problems I encountered , I hope I can help you ）：
perform ./install.sh The first question is ：
ERROR: Could not find a version that satisfies the requirement py-cpuinfo==7.0.0 (from esrally) (from versions: 7.0.0)
ERROR: No matching distribution found for py-cpuinfo==7.0.0
Solve the order ：
pip3 install py-cpuinfo -i https://pypi.tuna.tsinghua.edu.cn/simple/ --trusted-host pypi.tuna.tsinghua.edu.cn perform ./install.sh The second question is （python pip Related issues ）：
problem
WARNING: You are using pip version 21.1.1; however, version 22.1.2 is available.
You should consider upgrading via the '/usr/local/python38/bin/python3.8 -m pip install --upgrade pip' command.
Solve the order ：
python3 -m pip install --upgrade pip -i https://pypi.tuna.tsinghua.edu.cn/simple/ --trusted-host pypi.tuna.tsinghua.edu.cnThird question ：
solve the problem ：
pip3 install --upgrade setuptools -i https://pypi.tuna.tsinghua.edu.cn/simple/ --trusted-host pypi.tuna.tsinghua.edu.cnAfter the above three problems are solved ,esrally It has been successfully installed ！
Try running it , Because I've already installed es colony . So it can be used ！
The order is as follows ：
esrally race --track=percolator --target-hosts=10.10.10.10:9200,10.10.10.10:9201,10.10.10.10:9202 --pipeline=benchmark-only If you don't have a built cluster , Try using this command to run （ This will help you create a es colony , Wait patiently , It takes a long time ）：
esrally --distribution-version=6.0.0
The running results of my case are as follows ：
[[email protected] esrally-track]# esrally race --track=percolator --target-hosts=10.10.10.10:9200,10.10.10.10:9201,10.10.10.10:9202 --pipeline=benchmark-only
____ ____
/ __ \____ _/ / /_ __
/ /_/ / __ `/ / / / / /
/ _, _/ /_/ / / / /_/ /
/_/ |_|\__,_/_/_/\__, /
/____/
[INFO] Race id is [7f280f60-6b48-41db-9ab3-f6977170c417]
[WARNING] Could not update tracks. Continuing with your locally available state.
[WARNING] Could not update tracks. Continuing with your locally available state.
[INFO] Downloading track data (121.1 kB total size) [100.0%]
[INFO] Decompressing track data from [/root/.rally/benchmarks/data/percolator/queries-2.json.bz2] to [/root/.rally/benchmarks/data/percolator/queries-2.json] (resulting size: [0.1... [OK]
[INFO] Preparing file offset table for [/root/.rally/benchmarks/data/percolator/queries-2.json] ... [OK]
[INFO] Racing on track [percolator], challenge [append-no-conflicts] and car ['external'] with version [6.8.0].
[WARNING] merges_total_time is 8107257 ms indicating that the cluster is not in a defined clean state. Recorded index time metrics may be misleading.
[WARNING] merges_total_throttled_time is 1274256 ms indicating that the cluster is not in a defined clean state. Recorded index time metrics may be misleading.
[WARNING] indexing_total_time is 79966971 ms indicating that the cluster is not in a defined clean state. Recorded index time metrics may be misleading.
[WARNING] refresh_total_time is 3806308 ms indicating that the cluster is not in a defined clean state. Recorded index time metrics may be misleading.
[WARNING] flush_total_time is 522750 ms indicating that the cluster is not in a defined clean state. Recorded index time metrics may be misleading.
Running delete-index [100% done]
Running create-index [100% done]
Running check-cluster-health [100% done]
Running index [100% done]
Running refresh-after-index [100% done]
Running force-merge [100% done]
Running refresh-after-force-merge [100% done]
Running wait-until-merges-finish [100% done]
Running percolator_with_content_president_bush [100% done]
Running percolator_with_content_saddam_hussein [100% done]
Running percolator_with_content_hurricane_katrina [100% done]
Running percolator_with_content_google [100% done]
Running percolator_no_score_with_content_google [100% done]
Running percolator_with_highlighting [100% done]
Running percolator_with_content_ignore_me [100% done]
Running percolator_no_score_with_content_ignore_me [100% done]
------------------------------------------------------
_______ __ _____
/ ____(_)___ ____ _/ / / ___/_________ ________
/ /_ / / __ \/ __ `/ / \__ \/ ___/ __ \/ ___/ _ \
/ __/ / / / / / /_/ / / ___/ / /__/ /_/ / / / __/
/_/ /_/_/ /_/\__,_/_/ /____/\___/\____/_/ \___/
------------------------------------------------------
| Metric | Task | Value | Unit |
|---------------------------------------------------------------:|-------------------------------------------:|--------------:|-------:|
| Cumulative indexing time of primary shards | | 1334.87 | min |
| Min cumulative indexing time across primary shards | | 0.39835 | min |
| Median cumulative indexing time across primary shards | | 15.4366 | min |
| Max cumulative indexing time across primary shards | | 26.0545 | min |
| Cumulative indexing throttle time of primary shards | | 0 | min |
| Min cumulative indexing throttle time across primary shards | | 0 | min |
| Median cumulative indexing throttle time across primary shards | | 0 | min |
| Max cumulative indexing throttle time across primary shards | | 0 | min |
| Cumulative merge time of primary shards | | 135.302 | min |
| Cumulative merge count of primary shards | | 805 | |
| Min cumulative merge time across primary shards | | 0.03545 | min |
| Median cumulative merge time across primary shards | | 1.25905 | min |
| Max cumulative merge time across primary shards | | 8.2117 | min |
| Cumulative merge throttle time of primary shards | | 21.2376 | min |
| Min cumulative merge throttle time across primary shards | | 0 | min |
| Median cumulative merge throttle time across primary shards | | 0 | min |
| Max cumulative merge throttle time across primary shards | | 3.46082 | min |
| Cumulative refresh time of primary shards | | 63.4783 | min |
| Cumulative refresh count of primary shards | | 4067 | |
| Min cumulative refresh time across primary shards | | 0.00725 | min |
| Median cumulative refresh time across primary shards | | 0.758333 | min |
| Max cumulative refresh time across primary shards | | 1.46298 | min |
| Cumulative flush time of primary shards | | 8.7125 | min |
| Cumulative flush count of primary shards | | 233 | |
| Min cumulative flush time across primary shards | | 0 | min |
| Median cumulative flush time across primary shards | | 0.0939167 | min |
| Max cumulative flush time across primary shards | | 0.46015 | min |
| Total Young Gen GC time | | 11.337 | s |
| Total Young Gen GC count | | 777 | |
| Total Old Gen GC time | | 0 | s |
| Total Old Gen GC count | | 0 | |
| Store size | | 84.4625 | GB |
| Translog size | | 2.95658 | GB |
| Heap used for segments | | 172.674 | MB |
| Heap used for doc values | | 0.014431 | MB |
| Heap used for terms | | 141.275 | MB |
| Heap used for norms | | 0.038147 | MB |
| Heap used for points | | 7.70514 | MB |
| Heap used for stored fields | | 23.6414 | MB |
| Segment count | | 85 | |
| Total Ingest Pipeline count | | 0 | |
| Total Ingest Pipeline time | | 0 | s |
| Total Ingest Pipeline failed | | 0 | |
| error rate | index | 0 | % |
| Min Throughput | percolator_with_content_president_bush | 47.9 | ops/s |
| Mean Throughput | percolator_with_content_president_bush | 48.16 | ops/s |
| Median Throughput | percolator_with_content_president_bush | 48.16 | ops/s |
| Max Throughput | percolator_with_content_president_bush | 48.43 | ops/s |
| 50th percentile latency | percolator_with_content_president_bush | 10.2912 | ms |
| 90th percentile latency | percolator_with_content_president_bush | 13.3935 | ms |
| 99th percentile latency | percolator_with_content_president_bush | 16.1495 | ms |
| 100th percentile latency | percolator_with_content_president_bush | 16.4619 | ms |
| 50th percentile service time | percolator_with_content_president_bush | 9.44676 | ms |
| 90th percentile service time | percolator_with_content_president_bush | 12.2333 | ms |
| 99th percentile service time | percolator_with_content_president_bush | 15.5729 | ms |
| 100th percentile service time | percolator_with_content_president_bush | 15.6444 | ms |
| error rate | percolator_with_content_president_bush | 0 | % |
| Min Throughput | percolator_with_content_saddam_hussein | 50.07 | ops/s |
| Mean Throughput | percolator_with_content_saddam_hussein | 50.07 | ops/s |
| Median Throughput | percolator_with_content_saddam_hussein | 50.07 | ops/s |
| Max Throughput | percolator_with_content_saddam_hussein | 50.08 | ops/s |
| 50th percentile latency | percolator_with_content_saddam_hussein | 3.68269 | ms |
| 90th percentile latency | percolator_with_content_saddam_hussein | 4.41383 | ms |
| 99th percentile latency | percolator_with_content_saddam_hussein | 8.45466 | ms |
| 100th percentile latency | percolator_with_content_saddam_hussein | 9.41373 | ms |
| 50th percentile service time | percolator_with_content_saddam_hussein | 2.81123 | ms |
| 90th percentile service time | percolator_with_content_saddam_hussein | 3.50136 | ms |
| 99th percentile service time | percolator_with_content_saddam_hussein | 7.73842 | ms |
| 100th percentile service time | percolator_with_content_saddam_hussein | 8.28083 | ms |
| error rate | percolator_with_content_saddam_hussein | 0 | % |
| Min Throughput | percolator_with_content_hurricane_katrina | 50.13 | ops/s |
| Mean Throughput | percolator_with_content_hurricane_katrina | 50.15 | ops/s |
| Median Throughput | percolator_with_content_hurricane_katrina | 50.15 | ops/s |
| Max Throughput | percolator_with_content_hurricane_katrina | 50.17 | ops/s |
| 50th percentile latency | percolator_with_content_hurricane_katrina | 8.31714 | ms |
| 90th percentile latency | percolator_with_content_hurricane_katrina | 9.77985 | ms |
| 99th percentile latency | percolator_with_content_hurricane_katrina | 11.9031 | ms |
| 100th percentile latency | percolator_with_content_hurricane_katrina | 16.0777 | ms |
| 50th percentile service time | percolator_with_content_hurricane_katrina | 6.9336 | ms |
| 90th percentile service time | percolator_with_content_hurricane_katrina | 8.12209 | ms |
| 99th percentile service time | percolator_with_content_hurricane_katrina | 11.4533 | ms |
| 100th percentile service time | percolator_with_content_hurricane_katrina | 14.9582 | ms |
| error rate | percolator_with_content_hurricane_katrina | 0 | % |
| Min Throughput | percolator_with_content_google | 26.57 | ops/s |
| Mean Throughput | percolator_with_content_google | 26.77 | ops/s |
| Median Throughput | percolator_with_content_google | 26.76 | ops/s |
| Max Throughput | percolator_with_content_google | 26.97 | ops/s |
| 50th percentile latency | percolator_with_content_google | 83.5241 | ms |
| 90th percentile latency | percolator_with_content_google | 104.656 | ms |
| 99th percentile latency | percolator_with_content_google | 115.239 | ms |
| 100th percentile latency | percolator_with_content_google | 119.399 | ms |
| 50th percentile service time | percolator_with_content_google | 34.601 | ms |
| 90th percentile service time | percolator_with_content_google | 44.8482 | ms |
| 99th percentile service time | percolator_with_content_google | 52.8977 | ms |
| 100th percentile service time | percolator_with_content_google | 53.925 | ms |
| error rate | percolator_with_content_google | 0 | % |
| Min Throughput | percolator_no_score_with_content_google | 99.79 | ops/s |
| Mean Throughput | percolator_no_score_with_content_google | 99.79 | ops/s |
| Median Throughput | percolator_no_score_with_content_google | 99.79 | ops/s |
| Max Throughput | percolator_no_score_with_content_google | 99.79 | ops/s |
| 50th percentile latency | percolator_no_score_with_content_google | 3.85806 | ms |
| 90th percentile latency | percolator_no_score_with_content_google | 4.32838 | ms |
| 99th percentile latency | percolator_no_score_with_content_google | 4.84981 | ms |
| 100th percentile latency | percolator_no_score_with_content_google | 5.66612 | ms |
| 50th percentile service time | percolator_no_score_with_content_google | 2.98046 | ms |
| 90th percentile service time | percolator_no_score_with_content_google | 3.37479 | ms |
| 99th percentile service time | percolator_no_score_with_content_google | 4.04749 | ms |
| 100th percentile service time | percolator_no_score_with_content_google | 5.13068 | ms |
| error rate | percolator_no_score_with_content_google | 0 | % |
| Min Throughput | percolator_with_highlighting | 48.79 | ops/s |
| Mean Throughput | percolator_with_highlighting | 48.94 | ops/s |
| Median Throughput | percolator_with_highlighting | 48.94 | ops/s |
| Max Throughput | percolator_with_highlighting | 49.09 | ops/s |
| 50th percentile latency | percolator_with_highlighting | 5.55708 | ms |
| 90th percentile latency | percolator_with_highlighting | 6.13534 | ms |
| 99th percentile latency | percolator_with_highlighting | 10.0739 | ms |
| 100th percentile latency | percolator_with_highlighting | 21.7479 | ms |
| 50th percentile service time | percolator_with_highlighting | 4.72898 | ms |
| 90th percentile service time | percolator_with_highlighting | 5.13776 | ms |
| 99th percentile service time | percolator_with_highlighting | 9.4044 | ms |
| 100th percentile service time | percolator_with_highlighting | 21.1273 | ms |
| error rate | percolator_with_highlighting | 0 | % |
| Min Throughput | percolator_with_content_ignore_me | 0.08 | ops/s |
| Mean Throughput | percolator_with_content_ignore_me | 0.08 | ops/s |
| Median Throughput | percolator_with_content_ignore_me | 0.08 | ops/s |
| Max Throughput | percolator_with_content_ignore_me | 0.08 | ops/s |
| 50th percentile latency | percolator_with_content_ignore_me | 10721.8 | ms |
| 90th percentile latency | percolator_with_content_ignore_me | 11339.3 | ms |
| 99th percentile latency | percolator_with_content_ignore_me | 11920.1 | ms |
| 100th percentile latency | percolator_with_content_ignore_me | 12114.7 | ms |
| 50th percentile service time | percolator_with_content_ignore_me | 10719.2 | ms |
| 90th percentile service time | percolator_with_content_ignore_me | 11337.3 | ms |
| 99th percentile service time | percolator_with_content_ignore_me | 11916.3 | ms |
| 100th percentile service time | percolator_with_content_ignore_me | 12112 | ms |
| error rate | percolator_with_content_ignore_me | 0 | % |
| Min Throughput | percolator_no_score_with_content_ignore_me | 15.03 | ops/s |
| Mean Throughput | percolator_no_score_with_content_ignore_me | 15.05 | ops/s |
| Median Throughput | percolator_no_score_with_content_ignore_me | 15.05 | ops/s |
| Max Throughput | percolator_no_score_with_content_ignore_me | 15.06 | ops/s |
| 50th percentile latency | percolator_no_score_with_content_ignore_me | 31.3156 | ms |
| 90th percentile latency | percolator_no_score_with_content_ignore_me | 50.9371 | ms |
| 99th percentile latency | percolator_no_score_with_content_ignore_me | 58.0967 | ms |
| 100th percentile latency | percolator_no_score_with_content_ignore_me | 58.1975 | ms |
| 50th percentile service time | percolator_no_score_with_content_ignore_me | 30.048 | ms |
| 90th percentile service time | percolator_no_score_with_content_ignore_me | 49.9852 | ms |
| 99th percentile service time | percolator_no_score_with_content_ignore_me | 57.0299 | ms |
| 100th percentile service time | percolator_no_score_with_content_ignore_me | 57.3463 | ms |
| error rate | percolator_no_score_with_content_ignore_me | 0 | % |
[WARNING] No throughput metrics available for [index]. Likely cause: The benchmark ended already during warmup.
----------------------------------
[INFO] SUCCESS (took 1691 seconds)
----------------------------------
边栏推荐
- 解决方案：智慧工地智能巡检方案视频监控系统
- Ble of Jerry [chapter]
- Mise en œuvre du langage leecode - C - 15. Somme des trois chiffres - - - - - idées à améliorer
- onie支持pice硬盘
- Opencv learning notes 9 -- background modeling + optical flow estimation
- TS 体操 ＆(交叉运算) 和 接口的继承的区别
- How Navicat imports MySQL scripts
- xpath中的position()函数使用
- Word delete the contents in brackets
- TypeScript 函数定义
猜你喜欢
Typescript interface and the use of generics
TS 类型体操 之 extends,Equal,Alike 使用场景和实现对比
861. Score after flipping the matrix
Qualitative risk analysis of Oracle project management system
NiO programming introduction
Ali's redis interview question is too difficult, isn't it? I was pressed on the ground and rubbed
数字经济时代，如何保障安全？
Description of octomap averagenodecolor function
How to delete all the words before or after a symbol in word
leecode-C語言實現-15. 三數之和------思路待改進版
随机推荐
【mysql学习笔记30】锁（非教程）
Iterator Foundation
珠海金山面试复盘
Excel的相关操作
The ECU of 21 Audi q5l 45tfsi brushes is upgraded to master special adjustment, and the horsepower is safely and stably increased to 305 horsepower
Get the path of edge browser
软件测试界的三无简历，企业拿什么来招聘你，石沉大海的简历
leecode-C語言實現-15. 三數之和------思路待改進版
How to delete all the words before or after a symbol in word
Jerry's general penetration test - do data transmission with app Communication [article]
TS 体操 ＆(交叉运算) 和 接口的继承的区别
Typescript interface and the use of generics
Simulation of holographic interferogram and phase reconstruction of Fourier transform based on MATLAB
Relevant introduction of clip image
实现精细化生产， MES、APS、ERP必不可少
The ECU of 21 Audi q5l 45tfsi brushes is upgraded to master special adjustment, and the horsepower is safely and stably increased to 305 horsepower
OpenJudge NOI 2.1 1661:Bomb Game
How to estimate the number of threads
Risk planning and identification of Oracle project management system
洛谷P4127 [AHOI2009]同类分布 题解