|
|
@@ -1,74 +1,81 @@ |
|
|
|
# Lhy_Machine_Learning |
|
|
|
李宏毅2021春季机器学习课程课件及作业 |
|
|
|
|
|
|
|
#------------------------------------------------------------------# |
|
|
|
|
|
|
|
2021/03/16 更新HW1、HW2助教范例; |
|
|
|
|
|
|
|
2021/03/26 更新HW3、HW4课件、代码、范例;release页发布HW1-HW4数据; |
|
|
|
|
|
|
|
2021/04/01 更新选修内容To Learn More,基本是李老师今年不打算讲而以前讲过的知识点(旧视频); |
|
|
|
|
|
|
|
2021/04/09 更新GAN及HW05; |
|
|
|
|
|
|
|
2021/04/16 更新Self-Supervised Learning及HW06 |
|
|
|
|
|
|
|
2021/04/30/ 更新Explainable AI&Adversarial Attack 及 HW07&HW08 |
|
|
|
|
|
|
|
2021/05/06/ 更新Domain Adaptation 及 HW09&HW10 |
|
|
|
|
|
|
|
2021/05/21/ 更新RL 及 HW11 |
|
|
|
|
|
|
|
2021/05/28/ 更新Quantum ML |
|
|
|
|
|
|
|
2021/06/04/ 更新Life-Long&Compression 及 HW12 |
|
|
|
|
|
|
|
2021/06/11/ 更新Meta Learning 及 HW13&HW14 |
|
|
|
|
|
|
|
2021/06/18/ 更新HW15,随着李老师课程结语视频上传,2021机器学习基本结束啦。 |
|
|
|
|
|
|
|
#------------------------------------------------------------------# |
|
|
|
|
|
|
|
B站视频地址:https://www.bilibili.com/video/BV1Wv411h7kN#reply4197445138 |
|
|
|
|
|
|
|
课程主页:https://speech.ee.ntu.edu.tw/~hylee/ml/2021-spring.html |
|
|
|
|
|
|
|
不定期分享读研干货,提供参与大厂讲座学知识和兼职的机会,点赞关注一起进步:https://space.bilibili.com/46880349 |
|
|
|
|
|
|
|
人工智能技术探讨群:78174903(目前满了)、571218304 |
|
|
|
=========================== |
|
|
|
|
|
|
|
[](https://space.bilibili.com/46880349) |
|
|
|
|
|
|
|
**** |
|
|
|
|
|
|
|
``` |
|
|
|
群内有许多来自不同领域的人才,未来大咖云集的地方哈哈哈; |
|
|
|
不定期分享AI干货,提供参与大厂讲座学知识和兼职的机会,点赞关注一起进步; |
|
|
|
ppt/pdf支持直链下载,也支持[百度云盘 提取码:ry4a]((https://pan.baidu.com/s/1ZFWzLpMT301GacRPWIndEg))全部下载。 |
|
|
|
``` |
|
|
|
|
|
|
|
|B站主页|[啥都会一点的研究生](https://space.bilibili.com/46880349)| |
|
|
|
|---|---| |
|
|
|
|人工智能技术探讨群1|[78174903](https://jq.qq.com/?_wv=1027&k=lY5KVICA)| |
|
|
|
|人工智能技术探讨群2|[571218304](https://jq.qq.com/?_wv=1027&k=ZCDCT3xV)| |
|
|
|
|人工智能技术探讨群3|[584723646](https://jq.qq.com/?_wv=1027&k=bakez5Yz)| |
|
|
|
|
|
|
|
**** |
|
|
|
|
|
|
|
**** |
|
|
|
|
|
|
|
|名称|项目| |
|
|
|
|---|---| |
|
|
|
|课程主页|[李宏毅2021春季机器学习](https://speech.ee.ntu.edu.tw/~hylee/ml/2021-spring.html)| |
|
|
|
|B站视频合集|[(强推)李宏毅2021春机器学习课程](https://www.bilibili.com/video/BV1Wv411h7kN)| |
|
|
|
|百度云资料/作业/范例汇总|[提取码:ry4a](https://pan.baidu.com/s/1ZFWzLpMT301GacRPWIndEg)| |
|
|
|
|
|
|
|
**** |
|
|
|
|
|
|
|
|
|
|
|
**** |
|
|
|
|
|
|
|
|章节|名称|视频|资料|作业| |
|
|
|
|---|---|---|---|---|---| |
|
|
|
|Introduction|Course Introduction|[视频链接](https://www.bilibili.com/video/BV1Wv411h7kN)|[ppt](https://speech.ee.ntu.edu.tw/~hylee/ml/ml2021-course-data/introduction%202021%20(v6)%20Chinese.pptx) [pdf](https://speech.ee.ntu.edu.tw/~hylee/ml/ml2021-course-data/introduction-2021-v6-Chinese.pdf)|-| |
|
|
|
|Introduction|Introduction of ML/DL|[视频链接](https://www.bilibili.com/video/BV1Wv411h7kN?p=2)|[ppt](https://speech.ee.ntu.edu.tw/~hylee/ml/ml2021-course-data/regression%20(v16).pptx) [pdf](https://speech.ee.ntu.edu.tw/~hylee/ml/ml2021-course-data/regression%20(v16).pdf)|HW1: Regression| |
|
|
|
|Deep Learning|Guideline of ML: overfit|[视频链接](https://www.bilibili.com/video/BV1Wv411h7kN?p=10)|[ppt](https://speech.ee.ntu.edu.tw/~hylee/ml/ml2021-course-data/overfit-v6.pptx) [pdf](https://speech.ee.ntu.edu.tw/~hylee/ml/ml2021-course-data/overfit-v6.pdf)|-| |
|
|
|
|Deep Learning|Critical Point: small gradient|[视频链接](https://www.bilibili.com/video/BV1Wv411h7kN?p=11)|[ppt](https://speech.ee.ntu.edu.tw/~hylee/ml/ml2021-course-data/small-gradient-v7.pptx) [pdf](https://speech.ee.ntu.edu.tw/~hylee/ml/ml2021-course-data/small-gradient-v7.pdf)|-| |
|
|
|
|Deep Learning|Adaptive Learning Rate: optimizer|[视频链接](https://www.bilibili.com/video/BV1Wv411h7kN?p=13)|[ppt](https://speech.ee.ntu.edu.tw/~hylee/ml/ml2021-course-data/optimizer_v4.pptx) [pdf](https://speech.ee.ntu.edu.tw/~hylee/ml/ml2021-course-data/optimizer_v4.pdf)|-| |
|
|
|
|Deep Learning|Adaptive Learning Rate: optimizer|[视频链接](https://www.bilibili.com/video/BV1Wv411h7kN?p=14)|[ppt](https://speech.ee.ntu.edu.tw/~hylee/ml/ml2021-course-data/classification_v2.pptx) [pdf](https://speech.ee.ntu.edu.tw/~hylee/ml/ml2021-course-data/classification_v2.pdf)|HW2: Classification| |
|
|
|
|CNN & Self-Attention|ML Pretest|-|[pdf](https://speech.ee.ntu.edu.tw/~hylee/ml/ml2021-course-data/pretest.pdf)|-| |
|
|
|
|CNN & Self-Attention|CNN|[视频链接](https://www.bilibili.com/video/BV1Wv411h7kN?p=22)|[ppt](https://speech.ee.ntu.edu.tw/~hylee/ml/ml2021-course-data/cnn_v4.pptx) [pdf](https://speech.ee.ntu.edu.tw/~hylee/ml/ml2021-course-data/cnn_v4.pdf)|HW3: CNN| |
|
|
|
|CNN & Self-Attention|Self-Attention|[视频链接](https://www.bilibili.com/video/BV1Wv411h7kN?p=23)|[ppt](https://speech.ee.ntu.edu.tw/~hylee/ml/ml2021-course-data/self_v7.pptx) [pdf](https://speech.ee.ntu.edu.tw/~hylee/ml/ml2021-course-data/self_v7.pdf)|HW4: Self-Attention| |
|
|
|
|Theory of ML|PAC Learning|-|[pdf](https://speech.ee.ntu.edu.tw/~hylee/ml/ml2021-course-data/W14_PAC-introduction.pdf)|-| |
|
|
|
|Transformer|Normalization|[视频链接](https://www.bilibili.com/video/BV1Wv411h7kN?p=34)|[ppt](https://speech.ee.ntu.edu.tw/~hylee/ml/ml2021-course-data/normalization_v4.pptx) [pdf](https://speech.ee.ntu.edu.tw/~hylee/ml/ml2021-course-data/normalization_v4.pdf)|-| |
|
|
|
|Transformer|Seq2Seq|[视频链接](https://www.bilibili.com/video/BV1Wv411h7kN?p=35)|[ppt](https://speech.ee.ntu.edu.tw/~hylee/ml/ml2021-course-data/seq2seq_v9.pptx) [pdf](https://speech.ee.ntu.edu.tw/~hylee/ml/ml2021-course-data/seq2seq_v9.pdf)|HW5: Transformer| |
|
|
|
|Generative Model|GAN|[视频链接](https://www.bilibili.com/video/BV1Wv411h7kN?p=40)|[ppt](https://speech.ee.ntu.edu.tw/~hylee/ml/ml2021-course-data/gan_v10.pptx) [pdf](https://speech.ee.ntu.edu.tw/~hylee/ml/ml2021-course-data/gan_v10.pdf)|HW6: GAN| |
|
|
|
|Self-Supervised Learning|BERT|[视频链接](https://www.bilibili.com/video/BV1Wv411h7kN?p=50)|[ppt](https://speech.ee.ntu.edu.tw/~hylee/ml/ml2021-course-data/bert_v8.pptx) [pdf](https://speech.ee.ntu.edu.tw/~hylee/ml/ml2021-course-data/bert_v8.pdf)|HW7: BERT| |
|
|
|
|Self-Supervised Learning|Auto-Encoder|[视频链接](https://www.bilibili.com/video/BV1Wv411h7kN?p=53)|[ppt](https://speech.ee.ntu.edu.tw/~hylee/ml/ml2021-course-data/auto_v8.pptx) [pdf](https://speech.ee.ntu.edu.tw/~hylee/ml/ml2021-course-data/auto_v8.pdf)|HW8: Anomaly Detection| |
|
|
|
|Explainable AI / Adversarial Attack|Adversarial Attack|[视频链接](https://www.bilibili.com/video/BV1Wv411h7kN?p=63)|[ppt](https://speech.ee.ntu.edu.tw/~hylee/ml/ml2021-course-data/attack_v3.pptx) [pdf](https://speech.ee.ntu.edu.tw/~hylee/ml/ml2021-course-data/attack_v3.pdf)|HW10: Adversarial Attack| |
|
|
|
|Explainable AI / Adversarial Attack|Explainable AI|[视频链接](https://www.bilibili.com/video/BV1Wv411h7kN?p=65)|[ppt](https://speech.ee.ntu.edu.tw/~hylee/ml/ml2021-course-data/xai_v4.pptx) [pdf](https://speech.ee.ntu.edu.tw/~hylee/ml/ml2021-course-data/xai_v4.pdf)|HW9: Explainable AI| |
|
|
|
|Domain Adaptation|-|[视频链接](https://www.bilibili.com/video/BV1Wv411h7kN?p=71)|[ppt](https://speech.ee.ntu.edu.tw/~hylee/ml/ml2021-course-data/da_v6.pptx) [pdf](https://speech.ee.ntu.edu.tw/~hylee/ml/ml2021-course-data/da_v6.pdf)|HW11: Adaptation| |
|
|
|
|RL|DRL|[视频链接](https://www.bilibili.com/video/BV1Wv411h7kN?p=73)|[ppt](https://speech.ee.ntu.edu.tw/~hylee/ml/ml2021-course-data/drl_v5.pptx) [pdf](https://speech.ee.ntu.edu.tw/~hylee/ml/ml2021-course-data/drl_v5.pdf)|HW11: Adaptation| |
|
|
|
|Quantum ML|-|-|[pdf](https://speech.ee.ntu.edu.tw/~hylee/ml/ml2021-course-data/GuestLecture_QML.pdf)|-| |
|
|
|
|Life-Long/Compression|Life-long Learning|[视频链接](https://www.bilibili.com/video/BV1Wv411h7kN?p=84)|[ppt](https://speech.ee.ntu.edu.tw/~hylee/ml/ml2021-course-data/life_v2.pptx) [pdf](https://speech.ee.ntu.edu.tw/~hylee/ml/ml2021-course-data/life_v2.pdf)|HW13: Compression| |
|
|
|
|Life-Long/Compression|Network Compression|[视频链接](https://www.bilibili.com/video/BV1Wv411h7kN?p=86)|[ppt](https://speech.ee.ntu.edu.tw/~hylee/ml/ml2021-course-data/tiny_v7.pptx) [pdf](https://speech.ee.ntu.edu.tw/~hylee/ml/ml2021-course-data/tiny_v7.pdf)|HW14: Life-long Learning| |
|
|
|
|Meta Learning|-|[视频链接](https://www.bilibili.com/video/BV1Wv411h7kN?p=91)|[ppt](https://speech.ee.ntu.edu.tw/~hylee/ml/ml2021-course-data/meta_v3.pptx) [pdf](https://speech.ee.ntu.edu.tw/~hylee/ml/ml2021-course-data/meta_v3.pdf)|HW15: Meta Learning| |
|
|
|
|
|
|
|
**** |
|
|
|
|
|
|
|
## 更新日志 |
|
|
|
|
|
|
|
|日期|项目| |
|
|
|
|---|--- |
|
|
|
|2021/03/16|更新HW1、HW2,同步更新助教范例| |
|
|
|
|2021/03/26|更新HW3、HW4课件、代码、范例;release页发布HW1-HW4数据| |
|
|
|
|2021/04/01|更新选修内容To Learn More,基本是李老师今年不打算讲而以前讲过的知识点(旧视频)| |
|
|
|
|2021/04/09|更新GAN 及 HW05| |
|
|
|
|2021/04/16|更新Self-Supervised Learning 及 HW06| |
|
|
|
|2021/04/30|更新Explainable AI&Adversarial Attack 及 HW07&HW08| |
|
|
|
|2021/05/06|更新Domain Adaptation 及 HW09&HW10| |
|
|
|
|2021/05/21|更新RL 及 HW11| |
|
|
|
|2021/05/28|更新Quantum ML| |
|
|
|
|2021/06/04|更新Life-Long&Compression 及 HW12| |
|
|
|
|2021/06/11|更新Meta Learning 及 HW13&HW14| |
|
|
|
|2021/06/18|更新HW15,随着李老师课程结语视频上传,2021机器学习基本结束啦| |
|
|
|
|2021/06/18|更新Github排版,删除repo中的ppt/pdf直接提供下载链接,总资料放入百度云盘| |
|
|
|
|
|
|
|
 |
|
|
|
|
|
|
|
 |
|
|
|
|
|
|
|
 |
|
|
|
|
|
|
|
已同步更新助教范例! |
|
|
|
|
|
|
|
第一节 Introduction 作业 HW1: Regression 提交地址:https://www.kaggle.com/c/ml2021spring-hw1 |
|
|
|
|
|
|
|
第二节 Deep Learning 作业 HW2: Classification 提交地址:https://www.kaggle.com/c/ml2021spring-hw2 |
|
|
|
|
|
|
|
第三节 Self-Attention 作业 HW3: CNN HW4: Self-Attention 提交地址:https://www.kaggle.com/c/ml2021spring-hw3 https://www.kaggle.com/c/ml2021spring-hw4 |
|
|
|
|
|
|
|
第四节 Theory of ML |
|
|
|
|
|
|
|
第五节 Transformer 作业 HW5: Transformer |
|
|
|
|
|
|
|
第六节 Generative Model 作业 HW6: GAN |
|
|
|
|
|
|
|
第七节 Self-Supervised Learning 作业 HW7: BERT HW8: Autoencoder |
|
|
|
|
|
|
|
第八节 Explainable AI / Adversarial Attack 作业 HW9: Explainable AI HW10: Adversarial Attack |
|
|
|
|
|
|
|
第九节 Domain Adaptation/ RL 作业 HW11: Adaptation |
|
|
|
|
|
|
|
第十节 RL 作业 HW12: RL |
|
|
|
|
|
|
|
第十一节 Privacy v.s. ML |
|
|
|
|
|
|
|
第十二节 Quantum ML |
|
|
|
|
|
|
|
第十三节 Life-Long/Compression 作业 HW13: Life-Long HW14: Compression |
|
|
|
|
|
|
|
第十四节 Meta Learning 作业 HW15: Meta Learning |