当前位置:网站首页>Use KUSTO query statement (KQL) to query LOG on Azure Data Explorer Database
Use KUSTO query statement (KQL) to query LOG on Azure Data Explorer Database
2022-08-05 10:24:00 【zyypjc】
目录
(一)前言
Recently, the company will usually store one inAzurein a managed instanceAudit_logThe entire table is migrated toAzure Data Explorer Database来存储.So in this article, I will first summarizeAzure Data Explorer Database的基本概念,Then I will try to illustrate it with a simple example.
(二)Azure Data Explorer介绍及应用
Companies are generating and storing vast amounts of data every day. This data can be unstructured(例如音频,视频),半结构化的(例如XML,JSON)或结构化的(例如数字,日期,字符串). Data professionals are always looking for efficient techniques to process large volumes of disparate data. Although we can certainly use a traditional data warehouse,Hadoop,Sparkand other analytical tools to do this,But before exploring and analyzing the data,This will involveTB级和PBlevel dataETL的常规方法.所以,A platform is desperately needed,The platform will enable users to rapidly leverage and analyze various raw data,And ingest data quickly and get the best performance. Let's solve this situation with an interesting data analysis service.
1. 什么是Azure Data Explorer?
AzureData Browser akaADX,is used for logging,Fast telemetry and streaming data,Highly scalable and fully managed data analytics service. Browse services through this data,You can aggregate,Store and analyze various data. You can query the number in secondsTB的数据,It allows fast ad hoc queries on all kinds of data.
在Azure Data ExplorerThe tools above were formerly known as “代号为Kusto”,使用类似SQLThe query language of ieKusto查询语言(KQL)来分析来自IoT设备,应用程序,Fast-moving data for websites, etc.KQLNot limited to using functions and hundreds of operators such as aggregation,过滤等,It also includes built-in machine learning capabilities,例如聚类,回归等.
ADX使用SSDStore as cache andAzure BlobPersistent storage in storage,Works on the principle of isolation between compute and storage. It is fully managed“平台即服务(PaaS)”,Make users focus only on their data and queries. 为了说明ADX的主要优势之一,The next advantage is highlighted here,即时间序列分析:它
非常方便,And provides a lot of functions to analyze,Identify trends and anomalies.
2. 实战案例
(1)案例背景
Query the user of a key system of the companyAudit_log,and import logs(CSV)
(2)进入Azure Data Explorer主页面
(3)点击Query
点击后,See it on the rightKQLThe entered query area,You can edit the query in it
同时,In the middle area, you can view the objects you want to query just like selecting the database and the tables under the database
(4)输入查询的KQL
如下KQLThe purpose is to pull outAuditLogs表的前10000行
AuditLogs
| take 10000
(5)导出功能
Right-click in the query results area,See the list of export functions
边栏推荐
- 气象数据数据处理实例——matlab字符串切割匹配与R语言日期匹配(数据拼接)
- JS逆向入门学习之回收商网,手机号码简易加密解析
- Still looking for a network backup resources?Hurry up to collect the following network backup resource search artifact it is worth collecting!
- [Translation] Chaos Net + SkyWalking: Better observability for chaos engineering
- 数分面试(一)----与业务相关
- 2022 Huashu Cup Mathematical Modeling Question A Optimization Design Ideas for Ring Oscillators Code Sharing
- 基于MindSpore高效完成图像分割,实现Dice!
- 第七章,activiti个人任务分配,动态指定和监听器指定任务委派人「建议收藏」
- High-quality DeFi application building guide to help developers enjoy DeFi Summer
- SD NAND Flash简介!
猜你喜欢
5. Deploy the web project to the cloud server
What are the standards for electrical engineering
three.js调试工具dat.gui使用
【MindSpore Easy-Diantong Robot-01】You may have seen many knowledge quiz robots, but this one is a bit different
阿里全新推出:微服务突击手册,把所有操作都写出来了PDF
深入理解 Istio 流量管理的超时时间设置
用KUSTO查询语句(KQL)在Azure Data Explorer Database上查询LOG实战
华为轻量级神经网络架构GhostNet再升级,GPU上大显身手的G-GhostNet(IJCV22)
告白数字化转型时代:麦聪软件以最简单的方式让企业把数据用起来
RT-Thread记录(一、RT-Thread 版本、RT-Thread Studio开发环境 及 配合CubeMX开发快速上手)
随机推荐
牛刀小试基本语法,Go lang1.18入门精炼教程,由白丁入鸿儒,go lang基本语法和变量的使用EP02
A small test of basic grammar, Go lang1.18 introductory refining tutorial, from Bai Ding to Hongru, basic grammar of go lang and the use of variables EP02
How to choose coins and determine the corresponding strategy research
Why are RELTABLESPACE values 0 for many tables displayed in sys_class?
第四章:redis 数组结构的set和一些通用命令「建议收藏」
公众号如何运维?公众号运维专业团队
第四章:activiti流程中,变量的传递和获取流程变量 ,设置和获取多个流程变量,设置和获取局部流程变量「建议收藏」
浅析WSGI协议
Microcontroller: temperature control DS18B20
012_SSS_ Improving Diffusion Model Efficiency Through Patching
[Strong Net Cup 2022] WP-UM
第六章:activiti流程分流判断之排它网关和并行网关
First Decentralized Heist?Loss of nearly 200 million US dollars: analysis of the attack on the cross-chain bridge Nomad
PCB布局必知必会:教你正确地布设运算放大器的电路板
This notebook of concurrent programming knowledge points strongly recommended by Ali will be a breakthrough for you to get an offer from a big factory
FPGA: Basic Getting Started Button Controlling LED Lights
The century-old Nordic luxury home appliance brand ASKO smart wine cabinet in the three-temperature area presents the Chinese Valentine’s Day, and tastes the love of the delicacy
2022 Huashu Cup Mathematical Modeling Question A Optimization Design Ideas for Ring Oscillators Code Sharing
Getting started with Polkadot parachain development, this article is enough
FPGA:基础入门LED灯闪烁