- 1. Lecture 1.1 - What is ML 什么是机器学习
- 2. Lecture 1.2 - What is DL 什麼是深度學習
- 3. Lecture 1.3 - How to Apply 如何應用深度學習
- 4. Lecture 2.1 - How to Train a Model 如何訓練模型
- 5. Lecture 2.2 - What is Model 什麼是模型
- 6. Lecture 2.3 - What does the Good Function Mean 什麼叫做好的Function呢
- 7. Lecture 2.4 - How can we Pick the Best Function 如何找出最好的Function
- 8. Lecture 2.5 - Backpropagation 效率地計算大量參數
- 10. Lecture 3.1 - Word Representations
- 11. Lecture 3.2 - Language Modeling 語言模型
- 12. Lecture 3.3 - Recurrent Neural Network 詳細解析
- 13. Lecture 3.4 - RNN Applications RNN各式應用
- 14. TA Recitation - Practical Tips
- 15. Lecture 4.1 - Attention Mechanism 注意力機制
- 16. Lecture 4.2 - Attention Applications 注意力的各式應用
- 17. Assignment 1 Tutorial
- 18. Lecture 5.1 - Word Representation Review 詞向量各式表示法
- 19. Lecture 5.2 - Word2Vec 詞向量
- 21. Lecture 5.4 - Negative Sampling
- 22. Lecture 5.5 - Word2Vec Variants 各種訓練的變化方式
- 23. Lecture 5.5 - Word2Vec Variants 各種訓練的變化方式
- 24. Lecture 5.6 - GloVe 詞向量
- 25. Lecture 5.7 - Word vector Evaluation 如何评估词向量的好坏
- 26. Lecture 5.8 - Contextualized Word Embeddings 前後文相關之詞向量
- 27. Lecture 5.9 - ELMo 芝麻街家族之起源
- 28. Lecture 6.1 - Basic Attention 基本注意力模型複習
- 29. Lecture 6.2 - Self Attention 新注意力機制
- 30. Lecture 6.3 - Multi-Head Attention
- 31. Lecture 6.4- Transformer
- 32. Lecture 6.5- BERT 進擊的芝麻街巨人
- 33. TA Recitation- More on Embeddings
- 34. Lecture 7.1 - Transformer-XL 處理超長輸入的變形金剛
- 35. Lecture 7.2 - XLNet 兼顧AR及AE好處的模型
- 36. Lecture 7.3 - RoBERTa SpanBERT XLM 簡單有用的改進方法
- 37. Lecture 7.4- ALBERT 如何讓BERT縮小卻依然好用呢
- 38. TA Recitation - More on Transformers
- 39. Lecture 8.1- Deep Reinforcement Learning Introduction
- 40. Lecture 8.2- Markov Decision Process
- 41. Lecture 8.3- Reinforcement Learning
- 42. Lecture 8.4- Value-Based RL Approach
- 43. Lecture 8.5- Advanced DQN
- 44. Lecture 9.1- Policy Gradient
- 45. Lecture 9.2- Actor Critic
- 46. Lecture 10.1- Natural Language Generation
- 47. Lecture 10.2- Decoding Algorithm
- 48. Lecture 10.3- NLG Evaluation
- 49. Lecture 10.4- RL for NLG (20-05-12)
- 50. TA Recitation- RL for Dialogues (20-05-12)
- 51. GAN (Quick Review)
- 52. GAN Lecture 4 (2018)- Basic Theory
- 53. GAN Lecture 6 (2018)- WGAN EBGAN
- 54. Lecture 11.1- Unsupervised Learning Introduction
- 55. Lecture 11.2- Autoencoder & Variational Autoencoder
- 56. Lecture 11.3- Distant Supervision & Multi-Task Learning
- 57. Lecture 12.1- Conversational AI Introduction 對話AI簡介
- 58. Lecture 12.2- Task-Oriented Dialogues 任務型對話
- 59. Lecture 12.3- Chit-Chat Social Bots 聊天型對話
- 60. Lecture 13.1- Robustness 對話系統的強健性 (20-06-16)
- 61. Lecture 13.2- Scalability 對話系統的擴展性
- 62. Final Project- Rules & Grading
- 63. Career Sharing 求学经验分享
本课程主要讲解如何利用深度学习算法来解决各种实际应用场景问题,学生学习如何使用这些深度学习算法,以及为什么要使用这些算法。本课程希望学生在课堂上学习理论,并通过做作业和最后的项目来学习实施方法。 注意:如果已修过类似的课程,例如,李宏毅老师的课程,则无需修此课程。
课程涵盖了深度学习和表示学习中的最新技术,重点包括监督/自监督学习、嵌入方法、度量学习、卷积网络和循环网络,并应用于计算机视觉、自然语言理解和语音识别。
This course is enable students to learn how and why to apply deep learning to tackle various practical problems, where the students are expected to learn the theory during the class and learn the implementation by doing assignments and final projects.
Lecture 02019/02/19Course Logistics [slides]
Registration: [Google Form]
Lecture 12019/02/26Introduction [slides] (video)
Guest Lecture (R103)[PyTorch Tutorial]
Lecture 22019/03/05Neural Network Basics [slides] (video)
Suggested Readings:
[Linear Algebra]
[Linear Algebra Slides]
[Linear Algebra Quick Review]
A12019/03/05A1: Dialogue Response Selection[A1 pages]
Lecture 32019/03/12Backpropagation [slides] (video)
Word Representation [slides] (video)
Suggested Readings:
[Learning Representations]
[Vector Space Models of Semantics]
[RNNLM: Recurrent Neural Nnetwork Language Model]
[Extensions of RNNLM]
[Optimzation]
Lecture 42019/03/19Recurrent Neural Network [slides] (video)
Basic Attention [slides] (video)
Suggested Readings:
[RNN for Language Understanding]
[RNN for Joint Language Understanding]
[Sequence-to-Sequence Learning]
[Neural Conversational Model]
[Neural Machine Translation with Attention]
[Summarization with Attention]
[Normalization]
A22019/03/19A2: Contextual Embeddings[A2 pages]
Lecture 52019/03/26Word Embeddings [slides] (video)
Contextual Embeddings - ELMo [slides] (video)
Suggested Readings:
[Estimation of Word Representations in Vector Space]
[GloVe: Global Vectors for Word Representation]
[Sequence Tagging with BiLM]
[Learned in Translation: Contextualized Word Vectors]
[ELMo: Embeddings from Language Models]
[More Embeddings]
2019/04/02Spring BreakA1 Due
Lecture 62019/04/09Transformer [slides] (video)
Contextual Embeddings - BERT [slides] (video)
Gating Mechanism [slides] (video)
Suggested readings:
[Contextual Word Representations Introduction]
[Attention is all you need]
[BERT: Pre-training of Bidirectional Transformers]
[GPT: Improving Understanding by Unsupervised Learning]
[Long Short-Term Memory]
[Gated Recurrent Unit]
[More Transformer]
Lecture 72019/04/16Reinforcement Learning Intro [slides] (video)
Basic Q-Learning [slides] (video)
Suggested Readings:
[Reinforcement Learning Intro]
[Stephane Ross' thesis]
[Playing Atari with Deep Reinforcement Learning]
[Deep Reinforcement Learning with Double Q-learning]
[Dueling Network Architectures for Deep Reinforcement Learning]
A32019/04/16A3: RL for Game Playing[A3 pages]
Lecture 82019/04/23Policy Gradient [slides] (video)
Actor-Critic (video)
More about RL [slides] (video)Suggested Readings:
[Asynchronous Methods for Deep Reinforcement Learning]
[Deterministic Policy Gradient Algorithms]
[Continuous Control with Deep Reinforcement Learning]
A2 Due
Lecture 92019/04/30Generative Adversarial Networks [slides] (video)
(Lectured by Prof. Hung-Yi Lee)
Lecture 102019/05/07Convolutional Neural Networks [slides]
A42019/05/07A4: Drawing[A4 pages]
2019/05/14BreakA3 Due
Lecture 112019/05/21Unsupervised Learning [slides]
NLP Examples [slides]
Project Plan [slides]
Special2019/05/28 Company WorkshopRegistration: [Google Form]
2019/06/04BreakA4 Due
Lecture 122019/06/11Project Progress Presentation
Course and Career Discussion
Special2019/06/18Company WorkshopRegistration: [Google Form]
Lecture 132019/06/25Final Presentation