深度学习与神经网络

第1 章 绪论····················································································.1
1.1 人工智能·············································································.2
1.1.1 人工智能技术的发展历程···············································.3
1.1.2 人工智能技术的流派·····················································.9
1.2 深度学习与神经网络概述······················································.11
1.2.1 深度学习与神经网络技术的发展历程······························.11
1.2.2 深度学习与神经网络的前沿技术····································.16
1.3 深度学习系统架构·······························································.17
1.4 深度学习框架·····································································.19
1.5 深度学习的应用··································································.20
1.5.1 计算机视觉·······························································.20
1.5.2 语音语义··································································.21
1.5.3 自然语言处理····························································.22
1.6 人工智能潜在的安全风险······················································.22
1.6.1 数据层面的风险·························································.23
1.6.2 算法模型层面的风险···················································.23
1.6.3 智能计算框架层面的风险·············································.23
1.6.4 基础软硬件层面的风险················································.24
1.6.5 应用服务层面的风险···················································.24
本章小结··················································································.24
第2 章 预备知识············································································.25
2.1 相关数学基础·····································································.25
2.1.1 线性代数··································································.25
2.1.2 概率论·····································································.27
2.1.3 优化理论··································································.32
2.2 机器学习基础·····································································.34
2.2.1 机器学习算法的基本流程·············································.35
2.2.2 机器学习常用评价指标················································.36
2.2.3 典型机器学习算法······················································.41
2.3 实验环境基础·····································································.49
2.3.1 GPU 驱动的安装配置··················································.49
2.3.2 依赖环境的安装配置···················································.52
2.3.3 深度学习框架的安装配置·············································.54
2.3.4 集成开发环境的安装配置·············································.56
本章小结··················································································.57
第3 章 前馈神经网络······································································.58
3.1 感知器··············································································.58
3.1.1 单层感知器·······························································.58
3.1.2 多层感知器·······························································.61
3.1.3 前馈神经网络的基本结构·············································.62
3.2 激活函数···········································································.63
3.2.1 Sigmoid 函数·····························································.63
3.2.2 ReLU 函数································································.65
3.2.3 Tanh 函数·································································.67
3.2.4 Softmax 函数·····························································.68
3.3 误差反向传播·····································································.69
3.3.1 梯度下降法·······························································.69
3.3.2 链式法则··································································.70
3.3.3 反向传播··································································.72
本章小结··················································································.75
第4 章 深度模型的优化···································································.76
4.1 神经网络的优化问题····························································.76
4.1.1 局部*优和振荡陷阱···················································.76
4.1.2 梯度爆炸和梯度消失·····································