This is an introductory-level course in supervised learning, with a focus on regression and classification methods. The syllabus includes: linear and polynomial regression, logistic regression and linear discriminant analysis; cross-validation and the bootstrap, model selection and regularization methods (ridge and lasso); nonlinear models, splines and generalized additive models; tree-based methods, random forests and boosting; support-vector machines; neural networks and deep learning; survival models; multiple testing. Some unsupervised learning methods are discussed: principal components and clustering (k-means and hierarchical).
This is not a math-heavy class, so we try and describe the methods without heavy reliance on formulas and complex mathematics. We focus on what we consider to be the important elements of modern data science. Computing is done in Python. There are lectures devoted to Python, giving tutorials from the ground up, and progressing with more detailed sessions that implement the techniques in each chapter.
The lectures cover all the material in An Introduction to Statistical Learning, with Applications in Python by James, Witten, Hastie, Tibshirani and Taylor (Springer, 2023). The pdf for this book is available for free on the book website.
What You'll Learn:
Overview of statistical learning
Linear regression
Classification
Resampling methods
Linear model selection and regularization
Moving beyond linearity
Tree-based methods
Support vector machines
Deep learning
Survival modeling
Unsupervised learning
Multiple testing
Aulas do Curso
(108 vídeos)
0 de 108 aulas concluídas
0%
Progresso salvo somente neste navegador.
0
Statistical Learning: 1.1 Opening Remarks
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
1
Statistical Learning: 8 Years Later (Second Edition of the Course)
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
2
Statistical Learning I Introducing Jonathan - Third Edition of the Course I 2023
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
3
Statistical Learning: 1.2 Examples and Framework
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
4
Statistical Learning: 2.1 Introduction to Regression Models
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
5
Statistical Learning: 2.2 Dimensionality and Structured Models
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
6
Statistical Learning: 2.3 Model Selection and Bias Variance Tradeoff
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
7
Statistical Learning: 2.4 Classification
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
8
Statistical Learning: 2.Py Setting Up Python I 2023
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
9
Statistical Learning: 2.Py Data Types, Arrays, and Basics I 2023
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
10
Statistical Learning: 2.Py.3 Graphics I 2023
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
11
Statistical Learning: 2.Py Indexing and Dataframes I 2023
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
12
Statistical Learning: 3.1 Simple linear regression
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
13
Statistical Learning: 3.2 Hypothesis Testing and Confidence Intervals
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
14
Statistical Learning: 3.3 Multiple Linear Regression
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
15
Statistical Learning: 3.4 Some important questions
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
16
Statistical Learning: 3.5 Extensions of the Linear Model
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
17
Statistical Learning: 3.Py Linear Regression and statsmodels Package I 2023
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
18
Statistical Learning: 3.Py Multiple Linear Regression Package I 2023
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
19
Statistical Learning: 3.Py Interactions, Qualitative Predictors and Other Details I 2023
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
20
Statistical Learning: 4.1 Introduction to Classification Problems
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
21
Statistical Learning: 4.2 Logistic Regression
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
22
Statistical Learning: 4.3 Multivariate Logistic Regression
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
23
Statistical Learning: 4.4 Logistic Regression Case Control Sampling and Multiclass
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
24
Statistical Learning: 4.5 Discriminant Analysis
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
25
Statistical Learning: 4.6 Gaussian Discriminant Analysis (One Variable)
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
26
Statistical Learning: 4.7 Gaussian Discriminant Analysis (Many Variables)
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
27
Statistical Learning: 4.8 Generalized Linear Models
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
28
Statistical Learning: 4.9 Quadratic Discriminant Analysis and Naive Bayes
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
29
Statistical Learning: 4.Py Logistic Regression I 2023
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
30
Statistical Learning: 4.Py Linear Discriminant Analysis (LDA) I 2023
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
31
Statistical Learning: 4.Py K-Nearest Neighbors (KNN) I 2023
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
32
Statistical Learning: 5.1 Cross Validation
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
33
Statistical Learning: 5.2 K-fold Cross Validation
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
34
Statistical Learning: 5.3 Cross Validation the wrong and right way
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
35
Statistical Learning: 5.4 The Bootstrap
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
36
Statistical Learning: 5.5 More on the Bootstrap
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
37
Statistical Learning: 5.Py Cross-Validation I 2023
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
38
Statistical Learning: 5.Py Bootstrap I 2023
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
39
Statistical Learning: 6.1 Introduction and Best Subset Selection
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
40
Statistical Learning: 6.2 Stepwise Selection
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
41
Statistical Learning: 6.3 Backward stepwise selection
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
42
Statistical Learning: 6.4 Estimating test error
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
43
Statistical Learning: 6.5 Validation and cross validation
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
44
Statistical Learning: 6.6 Shrinkage methods and ridge regression
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
45
Statistical Learning: 6.7 The Lasso
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
46
Statistical Learning: 6.8 Tuning parameter selection
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
47
Statistical Learning: 6.9 Dimension Reduction Methods
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
48
Statistical Learning: 6.10 Principal Components Regression and Partial Least Squares
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
49
Statistical Learning: 6.Py Stepwise Regression I 2023
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
50
Statistical Learning: 6.Py Ridge Regression and the Lasso I 2023
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
51
Statistical Learning: 7.1 Polynomials and Step Functions
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
52
Statistical Learning: 7.2 Piecewise Polynomials and Splines
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
53
Statistical Learning: 7.3 Smoothing Splines
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
54
Statistical Learning: 7.4 Generalized Additive Models and Local Regression
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
55
Statistical Learning: 7.Py Polynomial Regressions and Step Functions I 2023
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
56
Statistical Learning: 7.Py Splines I 2023
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
57
Statistical Learning: 7.Py Generalized Additive Models (GAMs) I 2023
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
58
Statistical Learning: 8.1 Tree based methods
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
59
Statistical Learning: 8.2 More details on Trees
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
60
Statistical Learning: 8.3 Classification Trees
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
61
Statistical Learning: 8.4 Bagging
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
62
Statistical Learning: 8.5 Boosting
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
63
Statistical Learning: 8.6 Bayesian Additive Regression Trees
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
64
Statistical Learning: 8.Py Tree-Based Methods I 2023
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
65
Statistical Learning: 9.1 Optimal Separating Hyperplane
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
66
Statistical Learning: 9.2.Support Vector Classifier
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
67
Statistical Learning: 9.3 Feature Expansion and the SVM
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
68
Statistical Learning: 9.4 Example and Comparison with Logistic Regression
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
69
Statistical Learning: 9.Py Support Vector Machines I 2023
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
70
Statistical Learning: 9.Py ROC Curves I 2023
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
71
Statistical Learning: 10.1 Introduction to Neural Networks
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
72
Statistical Learning: 10.2 Convolutional Neural Networks
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
73
Statistical Learning: 10.3 Document Classification
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
74
Statistical Learning: 10.4 Recurrent Neural Networks
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
75
Statistical Learning: 10.5 Time Series Forecasting
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
76
Statistical Learning: 10.6 Fitting Neural Networks
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
77
Statistical Learning: 10.7 Interpolation and Double Descent
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
78
Statistical Learning: 10.Py Single Layer Model: Hitters Data I 2023
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
79
Statistical Learning: 10.Py Multilayer Model: MNIST Digit Data I 2023
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
80
Statistical Learning: 10.Py Convolutional Neural Network: CIFAR Image Data I 2023
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
81
Statistical Learning: 10.Py Document Classification and Recurrent Neural Networks I 2023
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
82
Statistical Learning: 11.1 Introduction to Survival Data and Censoring
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
83
Statistical Learning: 11.2 Proportional Hazards Model
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
84
Statistical Learning: 11.3 Estimation of Cox Model with Examples
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
85
Statistical Learning: 11.4 Model Evaluation and Further Topics
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
86
Statistical Learning: 11.Py Cox Model: Brain Cancer Data I 2023
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
87
Statistical Learning: 11.Py Cox Model: Publication Data I 2023
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
88
Statistical Learning: 12.1 Principal Components
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
89
Statistical Learning: 12.2 Higher order principal components
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
90
Statistical Learning: 12.3 k means Clustering
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
91
Statistical Learning: 12.4 Hierarchical Clustering
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
92
Statistical Learning: 12.5 Matrix Completion
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
93
Statistical Learning: 12.6 Breast Cancer Example
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
94
Statistical Learning: 12.Py Principal Components I 2023
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
95
Statistical Learning: 12.Py Clustering I 2023
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
96
Statistical Learning: 12.Py Application: NCI60 Data I 2023
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
97
Statistical Learning: 13.1 Introduction to Hypothesis Testing
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
98
Statistical Learning: 13.1 Introduction to Hypothesis Testing II
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
99
Statistical Learning: 13.2 Introduction to Multiple Testing and Family Wise Error Rate
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
100
Statistical Learning: 13.3 Bonferroni Method for Controlling FWER
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
101
Statistical Learning: 13.4 Holm's Method for Controlling FWER
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
102
Statistical Learning: 13.5 False Discovery Rate and Benjamini Hochberg Method
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
103
Statistical Learning: 13.6 Resampling Approaches
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
104
Statistical Learning: 13.6 Resampling Approaches II
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
105
Statistical Learning: 13.Py Multiple Testing I 2023
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
106
Statistical Learning: 13.Py False Discovery Rate I 2023
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…
107
Statistical Learning: 13.Py Multiple Testing and Resampling I 2023
Statistical Learning, featuring Deep Learning, Survival Analysis and Multiple Testing
Trevor Hastie, Professor of Stati…