当前位置:网站首页>Theory 1: Deep Learning - Detailed Explanation of the LetNet Model
Theory 1: Deep Learning - Detailed Explanation of the LetNet Model
2022-08-04 14:03:00 【xp_fangfei】
Event address: CSDN 21-day Learning Challenge
Introduction
LeNet is the first real convolutional neural network proposed by Y. Lecun et al. in 1998. Now LeNet now mainly refers to LeNet5, which is mainly characterized by convolutional layers and lowerThe sampling layers are combined as the basic structure of the network, which includes 3 convolutional layers and 2 downsampling layers and 2 fully connected layers.The original purpose of designing LeNet is to recognize handwritten characters and printed characters, and the effect is very good.
Network Structure
Structure Explanation:
- The C1 layer is a convolutional layer with 6 channels, which is obtained by convolution of the input image through 6 5x5 convolution checks.
- The S1 layer is a downsampling layer with 6 channels. It is obtained by the average pooling of the feature map of the C1 layer through a 2x2 window with a step size of 2, and is transformed by the sigmoid activation function.
- C3 is a convolutional layer with 16 channels, which is obtained by convolving S2 with 16 5x5 convolution kernels.
- S4 is a downsampling layer with 16 channels, which is obtained by the average pooling of the feature map of the C3 layer through a 2x2 window with a step size of 2, and using the sigmoid activation function to transform.
- C5 is a convolutional layer containing 120 feature maps, which is obtained by convolving S2 with 120 5x5 convolution kernels.
- F6 is a fully connected layer with 84 neurons, using a hyperbolic tangent activation function.
- output is the output layer with 10 neurons.
Network Process:
- k_size: represents the size of the convolution kernel
- k_num: represents the number of convolutions
- s: represents the step size
Calculation formula introduction:
- Convolution calculation formula:
(n + 2p - k_size) / s + 1
Where: n is the input image size
p is the padding size;is 0;
- The special part of the above process is the process from AvgPool4 to Conv5. The input feature map size is the same as the convolution kernel size, and one-dimensional data is obtained.
Summary:
As the earliest convolutional neural network, LetNet is characterized by a small number of layers, few parameters, and fast training; although the model is relatively small, it has what a real neural network should have (although the sparrow is small and complete), in handwritingWord recognition has better results.
边栏推荐
猜你喜欢
ICML 2022 | 图神经网络的局部增强
eyb:JWT介绍
将 Sentinel 熔断限流规则持久化到 Nacos 配置中心
MySQL性能指标TPS\QPS\IOPS如何压测?
Convolutional Neural Network Basics
秋招攻略秘籍,吃透25个技术栈Offer拿到手软
【LeetCode】38、外观数列
《中国综合算力指数》《中国算力白皮书》《中国存力白皮书》《中国运力白皮书》在首届算力大会上重磅发出
CReFF缓解长尾数据联邦学习(IJCAI 2022)
nVisual secondary development - Chapter 2 nVisual API operation guide Swagger use
随机推荐
文字编码 - Markdown 简明教程
PAT甲级:1040 Longest Symmetric String
Fuse bit of AVR study notes
odoo13 note point
ICML 2022 | 图神经网络的局部增强
《C 陷阱与缺陷 》阅读概要
Week 7 Latent Variable Models and Expectation Maximization
【LeetCode】1403. 非递增顺序的最小子序列
华为手机切换屏幕效果_华为p40页面切换效果怎么换
【WeChat Mini Program】Social Internship Production Project for Information Management and Information System Major--Trash Fingerprint
电子行业MES管理系统有哪些特殊功能
关于redis的几件小事(五)redis保证高并发以及高可用
记录都有哪些_js常用方法总结
节省50%成本!京东云重磅发布新一代混合CDN产品
字符串类的设计与实现_C语言字符串编程题
Why don't young people like to buy Mengniu and Yili?
Lecture 4 SVN
Map常见的遍历方式-keySet 和 entrySet
Install mysql on k8s
AutoCAD DWG,DXF文件导出高清图片、PDF