- 博客(7)
- 收藏
- 关注
原创 C5eg1 Linear Regression
Gold To build a system that can take a vector x⃗∈Rn\vec{x}\in\mathbb{R}^nx∈Rn as input and predict the value of a scalar y∈Ry\in\mathbb{R}y∈R as its output. Definition Output:y^=w⃗Tx⃗\hat{y}=\vec{w...
2018-10-20 19:11:15 126
原创 C4eg1-Linear Least Squares
Suppose f(x)=12∥Ax−b∥22f(x)=\frac{1}{2}\|Ax-b\|_2^2f(x)=21∥Ax−b∥22 gradient-based optimization obtain the gradient: ∇xf(x)=AT(Ax−b)=ATAx−ATb\nabla_xf(x)=A^T(Ax-b)=A^TAx-A^Tb∇xf(x)=AT(Ax−b)=ATAx−A...
2018-10-20 19:08:20 99
原创 C4-Numerical Computation
Overflow and Underflow underflow occurs when numbers near zero are rounded to zero Overflow occurs when numbers with large magnitude are approximated as ∞\infty∞ or −∞-\infty−∞ Softmax function...
2018-10-20 19:08:01 189
原创 C3-Probability and Information Theory
Possible sources of uncertainty Inherent stochasticity in the system being modeled. Incomplete observability. Incomplete modeling. Concepts Note: In this note, x\text{x}x is random varaible and xxx ...
2018-10-20 19:06:56 170
原创 C2-Linear Algebra
concepts linear algebra is a form of continuous rather than discrete mathematics detailed information --> Matrix Cookbook (Petersen and Pedersen, 2006) Scalars:–>(ponit) A scalar is just a sin...
2018-10-20 19:04:08 145
原创 C1-Introduction
Some Concepts The hierarcy of concepts allows the computer to learn complicated concepts by building them out of simpler ones. --> deep learning A computer can reason about statements in these fo...
2018-10-20 18:12:58 273
原创 C2eg1-Principal Components Analysis
Suppose mmm points {x(1),⋯ ,x(m)}∈Rn\{\mathbf{x}^{(1)},\cdots,\mathbf{x}^{(m)}\} \in \mathbb{R}^n{x(1),⋯,x(m)}∈Rn each point x(i)∈Rn\mathbf{x}^{(i)}\in \mathbb{R}^nx(i)∈Rn corresponding...
2018-10-20 18:12:17 73
空空如也
空空如也
TA创建的收藏夹 TA关注的收藏夹
TA关注的人