NCHU Course Outline
Course Name (中) 自然語言處理之深度學習專論(6133)
(Eng.) Special Topics on Deep Learning for Natural Language Processing
Offering Dept Department of Management Information Systems
Course Type Elective Credits 3 Teacher Ying, Jia-Ching
Department Department of Management Information Systems / Graduate Language Chinese Semester 2026-SPRING
Course Description 隨著深度學習在自然語言處理上的快速進展,相當多的巨型語言模型(Large Language Model)被提出,如 BERT、XLNet、GPT-4 等。本課程將專注於介紹時下最新穎的巨型語言模型以及深度學習在自然語言處理上的相關應用,並應用這些巨型語言模型於目前自然語言處理的研究議題。
Prerequisites
Relevance of Course Objectives and Core Learning Outcomes(%) Teaching and Assessment Methods for Course Objectives
Course Objectives Competency Indicators Ratio(%) Teaching Methods Assessment Methods
讓學生了解時下最新穎的巨型語言模型以,並應用這些巨型語言模型於目前自然語言處理的研究議題。
1.Professional Knowledge and Practical Application
2.Independent Analysis
3.Innovative Research
50
40
10
topic Discussion / Production
Discussion
Lecturing
Oral Presentation
Internship
Course Content and Homework/Schedule/Tests Schedule
Week Course Content
Week 1 課程簡介
Week 2 Recurrent Neural Networks (RNN) (採非同步遠距教學) (作業1)
Week 3 RNN-based Sequence-to-sequence Model (1) (採非同步遠距教學)
Week 4 RNN-based Sequence-to-sequence Model (2) (採非同步遠距教學)
Week 5 RNN-based Sequence-to-sequence Model (3) (採非同步遠距教學) (作業2)
Week 6 Paper Presentation (1)
Week 7 Paper Presentation (2)
Week 8 BERTology (1) (採非同步遠距教學)
Week 9 BERTology (2) (採非同步遠距教學)(作業3)
Week 10 BERTology (3) (採非同步遠距教學)(作業4)
Week 11 GPTology(1)
Week 12 GPTology(2)(作業5)
Week 13 LLaMA(1)
Week 14 LLaMA(2)(作業6)
Week 15 專題演講
Week 16 Term Project Demo
1. Term Project的形式為參與教育部舉辦之AI Cup競賽
2. 競賽網站會提供該題目的一些相關知識的教學影片
3. 競賽網站:https://www.aicup.tw/
self-directed
learning
   03.Preparing presentations or reports related to industry and academia.

Evaluation
作業: 30%
Paper presentation: 30%
Term Project: 40%
Textbook & other References

Teaching Aids & Teacher's Website
ilearning
Office Hours
Mon. 14:00 ~ 16:00
Sustainable Development Goals, SDGs(Link URL)
include experience courses:N
Please respect the intellectual property rights and use the materials legally.Please respect gender equality.
Update Date, year/month/day:2026/02/25 22:17:03 Printed Date, year/month/day:2026 / 5 / 31
The second-hand book website:http://www.myub.com.tw/