machine-learning - 为什么我们必须对人工神经网络的输入进行标准化?

标签 machine-learning neural-network normalization

为什么我们必须标准化神经网络的输入?

我知道有时,例如当输入值是非数字时,必须执行某种转换,但是当我们有数字输入时?为什么数字必须在一定的区间内?

如果数据没有标准化会发生什么?

最佳答案

解释得很好here .

If the input variables are combined linearly, as in an MLP [multilayer perceptron], then it is rarely strictly necessary to standardize the inputs, at least in theory. The reason is that any rescaling of an input vector can be effectively undone by changing the corresponding weights and biases, leaving you with the exact same outputs as you had before. However, there are a variety of practical reasons why standardizing the inputs can make training faster and reduce the chances of getting stuck in local optima. Also, weight decay and Bayesian estimation can be done more conveniently with standardized inputs.

关于machine-learning - 为什么我们必须对人工神经网络的输入进行标准化?,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/4674623/

相关文章:

python - tensorflow -运行时错误 : Cannot get value inside Tensorflow graph function

artificial-intelligence - 我们如何初始化 Hopfield 神经网络?

mysql - 如何在MySQL中为一个联系人存储多封电子邮件,个人邮件等

math - 如何为高斯过程(GP)选择合适的内核?

machine-learning - 用 sklearn 对目标进行 PCA?

python - 超高成本Tensorflow

neural-network - 如何使用 tensorflow 构建多输入图?

mysql - INSERTing 到 mysql 表中以获取用户关系

database-design - OLAP 和 OLTP 中的规范化

python - 如何使用机器学习解决时间序列问题