課程目標 |
本課程主要講述資訊理論的基本原理,利用各種專業術語之定義,逐步導出許多有用的理論方程式。學生在完成本課程後,將可學習到以下之基本技能:1. 資訊理論之專業術語完整定義、2. 各項重要定理之推導、3. 資訊理論的物理意義與實際應用。 |
Objectives |
Introduction to Random Variables, Random Processes, Distribution, Entropy, Relative Entropy, Conditional Entropy, Mutual Information, Channel capacity, and Gaussian Channels. |
教學內容 |
Entropy,conditional entropy, relative entropy, mutual information, Huffman coding, channel capacity, Gaussian channels, parallel Gaussian channels |
Syllabus |
Entropy,conditional entropy, relative entropy, mutual information, AEP, entropy rate, Huffman coding, channel capacity, Gaussian channels, parallel Gaussian channels |