当前位置:网站首页>ES日志报错赏析-Limit of total fields
ES日志报错赏析-Limit of total fields
2022-07-07 11:47:00 【ES小助理】
报错现象
[o.e.a.a.i.m.p.TransportPutMappingAction] [------nodeid-------] failed to put mappings on indices [[[--------IndexName---------]]], type [doc]
java.lang.IllegalArgumentException: Limit of total fields [1000] in index [--------IndexName---------] has been exceeded
at org.elasticsearch.index.mapper.MapperService.checkTotalFieldsLimit(MapperService.java:656) ~[elasticsearch-6.8.2.jar:6.8.2]
at org.elasticsearch.index.mapper.MapperService.internalMerge(MapperService.java:537) ~[elasticsearch-6.8.2.jar:6.8.2]
at org.elasticsearch.index.mapper.MapperService.internalMerge(MapperService.java:415) ~[elasticsearch-6.8.2.jar:6.8.2]
报错解析
此问题为写入时报错,ES中默认限制单个索引1000个字段,因为索引中定义太多的字段会导致 mapping 的激增,从而引起内存的错误和难以恢复的情况。
此问题常见于日志拆分后,自动更新更新mapping,由于日志拆分逻辑异常,导致很多异常字段被误认为是新字段,导致索引maaping字段激增大于1000.导致更新报错。
解决方案
1-调整索引setting,临时增大字段数限制,下述方式中my_index为报错的index名。
PUT my_index/_settings
{
"index.mapping.total_fields.limit": 2000
}
此处设置为2000 最大索引
2-检查业务侧导致字段数激增的原因,减少单个索引字段数量。
边栏推荐
- Server to server (S2S) event (adjust)
- 最佳实践 | 用腾讯云AI意愿核身为电话合规保驾护航
- Use of polarscatter function in MATLAB
- 单片机学习笔记之点亮led 灯
- 一文读懂数仓中的pg_stat
- TPG x AIDU | AI leading talent recruitment plan in progress!
- 10 pictures open the door of CPU cache consistency
- Indoor ROS robot navigation commissioning record (experience in selecting expansion radius)
- Summary of import, export, backup and recovery of mongodb
- 记一次 .NET 某新能源系统 线程疯涨 分析
猜你喜欢
高端了8年,雅迪如今怎么样?
Help tenants
Enregistrement de la navigation et de la mise en service du robot ROS intérieur (expérience de sélection du rayon de dilatation)
Realize the IP address home display function and number home query
Thread pool reject policy best practices
室內ROS機器人導航調試記錄(膨脹半徑的選取經驗)
LIS longest ascending subsequence problem (dynamic programming, greed + dichotomy)
Final review notes of single chip microcomputer principle
118. 杨辉三角
社会责任·价值共创,中关村网络安全与信息化产业联盟对话网信企业家海泰方圆董事长姜海舟先生
随机推荐
Clion mingw64 Chinese garbled code
clion mingw64中文乱码
简单好用的代码规范
2022-7-6 使用SIGURG来接受外带数据,不知道为什么打印不出来
Detr introduction
Mongodb slice summary
What parameters need to be reconfigured to replace the new radar of ROS robot
Supply chain supply and demand estimation - [time series]
[fortress machine] what is the difference between cloud fortress machine and ordinary fortress machine?
JS function returns multiple values
Scripy tutorial classic practice [New Concept English]
如何让join跑得更快?
xshell连接服务器把密钥登陆改为密码登陆
为租客提供帮助
Ikvm of toolbox Net project new progress
数据库系统概论-第一章绪论【概念模型、层次模型和三级模式(外模式、模式、内模式)】
Help tenants
2022-7-6 初学redis(一)在 Linux 下下载安装并运行 redis
2022-7-6 sigurg is used to receive external data. I don't know why it can't be printed out
How far can it go to adopt a cow by selling the concept to the market?