| 當期課號 |
2346 |
Course Number |
2346 |
| 授課教師 |
陳伯岳 |
Instructor |
CHEN,PO YUEH |
| 中文課名 |
資訊理論 |
Course Name |
Information theory |
| 開課單位 |
資訊工程系(四日)四A |
Department |
|
| 修習別 |
必修 |
Required/Elective |
Required |
| 學分數 |
3 |
Credits |
3 |
| 課程目標 |
本課程主要講述資訊理論的基本原理，利用各種專業術語之定義，逐步導出許多有用的理論方程式。學生在完成本課程後，將可學習到以下之基本技能：1. 資訊理論之專業術語完整定義、2. 各項重要定理之推導、3. 資訊理論的物理意義與實際應用。 |
Objectives |
Introduction to Random Variables, Random Processes, Distribution, Entropy, Relative Entropy, Conditional Entropy, Mutual Information, Channel capacity, and Gaussian Channels. |
| 教材 |
Classes, Homeworks, Quizes, Exams |
Teaching Materials |
Classes, Homeworks, Quizes, Exams |
| 成績評量方式 |
Quiz:30%
Midterm:30%
Final:40% |
Grading |
Quiz:30%
Midterm:30%
Final:40% |
| 教師網頁 |
|
| 教學內容 |
Entropy,conditional entropy, relative entropy, mutual information, Huffman coding, channel capacity, Gaussian channels, parallel Gaussian channels |
Syllabus |
Entropy,conditional entropy, relative entropy, mutual information, AEP, entropy rate, Huffman coding, channel capacity, Gaussian channels, parallel Gaussian channels |