当前位置:网站首页>The BP neural network
The BP neural network
2022-07-31 03:32:00 【Road Lu727】
1, role
BP neural network is a multi-layer feedforward network trained by error back-propagation algorithm. It is one of the most widely used neural network models.The learning rule of the bp neural network is to use the steepest descent method to continuously adjust the weights and thresholds of the network through backpropagation to minimize the sum of squared errors of the network.
2, input and output description
Input: The independent variable X is one or more categorical or quantitative variables, and the dependent variable Y is a quantitative variable.
Output: The result value of the model output and the model regression effect.
3, case example
There is a batch of Iris flowers. It is known that this batch of Iris flowers can be divided into 3 varieties, which need to be classified.According to the data of sepal length, sepal width, petal length, petal width.Train a neural network to use as a classifier with existing data.
4, modeling steps
BP neural network is a multi-layer feed-forward neural network, its main feature is: the signal is forward-propagated, and the error is back-propagated.Specifically, for the following neural network model with only one hidden layer:
The process of BP neural network is mainly divided into two stages. The first stage is the forward propagation of the signal, from the input layer through the hidden layer,Finally, it reaches the output layer; the second stage is the back-propagation of the error, from the output layer to the hidden layer, and finally to the input layer, adjusting the weights and biases from the hidden layer to the output layer, and the weights from the input layer to the hidden layer in turnand bias.
Take a three-layer BP neural network as an example
The output of the hidden layer is set to Fj, the output of the output layer to m is set to Ok, the excitation function of the system is set to G, and the learning rate is set to β, then the three layers have the following mathematicsRelationship:
If the expected output of the system is set as Tk, the error E of the system can be represented by the variance of the actual output value and the expected target value. The specific relationship is expressed as follows:
And let , using the gradient descent principle, the update formulas of the system weights and biases are as follows:
边栏推荐
- Atomic operation CAS
- 下载jar包的好地方
- MultipartFile file upload
- 刚出道“一战成名”,安全、舒适一个不落
- 5. How does the SAP ABAP OData service support the $filter operation
- Why SocialFi achievement Web3 decentralized social in the future
- IIR filter and FIR filter
- beforeDestroy与destroyed的使用
- [C language] Three-pointed chess (classic solution + list diagram)
- With 7 years of experience, how can functional test engineers improve their abilities step by step?
猜你喜欢
TCP详解(一)
Detailed explanation of TCP (3)
IDEA常用快捷键与插件
[Swift]自定义点击APP图标弹出的快捷方式
5. How does the SAP ABAP OData service support the $filter operation
Recursive query single table - single table tree structure - (self-use)
MultipartFile文件上传
endian mode
【Exception】The field file exceeds its maximum permitted size of 1048576 bytes.
LocalDate加减操作及比较大小
随机推荐
[C language] General method for finding the sum of the greatest common factor and the least common multiple of two integers m and n, the classical solution
LeetCode simple problem to find the subsequence of length K with the largest sum
LeetCode简单题之找到和最大的长度为 K 的子序列
Difference between unallocated blocks and unused blocks in database files
els 方块向右移动边界判断、向下加速
原子操作 CAS
PMP WeChat group daily exercises
安全20220722
A brief introduction to the CheckboxListTile component of the basic components of Flutter
【HCIP】ISIS
$parent/$children 与 ref
False positives and false negatives in testing are equally worthy of repeated corrections
SQALE 是什么
数据库实现分布式锁
[Compilation principle] Lexical analysis program design principle and implementation
Day32 LeetCode
数据库文件中的未分配的块和未使用的块的区别
SIP协议标准和实现机制
分布式锁以及实现方式三种
Zotero如何删除自动生成的标签