当前位置：网站首页>Matrix calculation of Neural Network Introduction (pytoch)

Matrix calculation of Neural Network Introduction (pytoch)

2022-07-03 10:33:00 【-Plain heart to warm】

Matrix computing

Scalar derivative

[ Failed to transfer the external chain picture , The origin station may have anti-theft chain mechanism , It is suggested to save the pictures and upload them directly (img-VIdZ2NPH-1656249957772)(attachment:image.png)]

Sub derivative

[ Failed to transfer the external chain picture , The origin station may have anti-theft chain mechanism , It is suggested to save the pictures and upload them directly (img-em8ytYae-1656249957774)(attachment:image-2.png)]

gradient

  • Expand the derivative to the vector
    [ Failed to transfer the external chain picture , The origin station may have anti-theft chain mechanism , It is suggested to save the pictures and upload them directly (img-x6w4BRjt-1656249957775)(attachment:image-3.png)]

y It's scalar ,x It's a column vector

∂ y ∂ x \partial y \over \partial x ∂x∂y​

[ Failed to transfer the external chain picture , The origin station may have anti-theft chain mechanism , It is suggested to save the pictures and upload them directly (img-hCSkNmna-1656249957776)(attachment:image-5.png)]

The gradient must point in the direction where your value changes the most

Examples

Insert picture description here
Insert picture description here
Insert picture description here

Input expands to matrix

Insert picture description here

原网站

版权声明
本文为[-Plain heart to warm]所创，转载请带上原文链接，感谢
https://yzsam.com/2022/184/202207030927196732.html

边栏推荐

猜你喜欢

随机推荐