redkaoliang-CSDN博客

原创 Support Vector Machine

Ali Ghodsi - Waterloo Stat441 Statistical Learning Classification 2015 Lecture 11 & lecture 12 SVMMath Prerequisite：Lagrange MultiplierPrime Problem and Dual Problem (K.K.T)Quadratic Progr...

2020-03-08 11:48:49 164

原创 Distance from a point to a hyperplane

I have an n-dimensional hyperplane: w′x+b=0 and a point x0. The shortest distance from this point to a hyperplane is d=|w⋅x0+b|||w||. I have no problem to prove this for 2 and 3 dimension space using ...

2020-03-04 21:18:18 318

原创 Gradient Boosting

Video 1: StatQuest with Josh Starmer Gradient Boost Part 1 - Part 4Video 2: Bloomberg Machine Learning 23. Gradient BoostingVideo 3: Hsuan-Tien LinGradient Boosted Decision Tree :: Gradient Boost...

2019-07-20 13:32:26 123

原创 Regularization

Watch in sequence:Video 1: Machine Learning by Andrew Ng Lecture 7 Regularization Video 2: Caltech CS156 Machine Learning by Yaser Abu-Mostafa Lecture 12 RegularizationVideo 3: Virginia ECE5984...

2019-07-14 08:55:53 157

原创 Adaboost Algorithm （Derivation）

Chooseto update the weights:Video: 李宏毅 Machine Learning 2017 ---Lecture 22: EnsembleChooseto ensemble the target function:Video: ConellCS4780 Machine Learning Fall 2013 ---09/26: Ensemble...

2019-07-06 17:04:30 204

原创 Definition of Differentiability --- Multivariable Calculus (Where does it come from?)

Videos in sequence:Swarthmore College-Diana Davis video 1:tangent planes video 2:Differentiability of multivariable functions-------------------------------------------------------------...

2019-07-06 13:39:07 172

原创 Chain Rule Proof --- Multivariable Calculus

Calculus 8th Edition --- James Steward (Page 938)James Steward --- Page 930Calculus 11th Edition ---- Ron Larson (Page 905)Both of the textbooks don't have the explanation of why we ...

2019-07-06 09:57:36 332

原创 Back Propagation Derivation

Book:Neural Networks and Deep Learning -- byMichael NielsenVideo:Back Propagation Derivation for Feed Forward Artificial Neural Networks

2019-07-06 08:18:03 120