Fundamentals of Information Theory (Series of Textbooks for Information and Computing Science Undergraduates) Textbook for Undergraduates in the 21st Century

Author: Shi Feng Mo Zhongxi
Publisher:
Publish Date: 2002-07-16
Features: This book starts with basic concepts and methods, using primarily elementary mathematical tools to systematically and comprehensively introduce the fundamental theories, basic methods, and recent developments in information theory, including some new and relatively mature principles. The book is divided into 10 chapters. Chapter 1 introduces the basic concepts, main content, and brief history of Shannon's information theory. Chapter 2 discusses the source of information and the measurement of information. Chapter 3 covers mutual information. Chapter 4 primarily introduces some basic concepts of source coding and Huffman optimal coding. Chapter 5 mainly introduces the discrete channel coding theorem. Chapter 6 covers linear codes. Chapter 7 discusses the theory of rate-distortion. Chapter 8 introduces the maximum entropy principle and the minimum discrimination information principle. In Chapter 9, the non-statistical meaning of information theory (combinatorial information and algorithmic information) is introduced, along with the representative universal coding method—Lempel-Ziv coding. Chapter 10 covers the basic knowledge of cryptography. Most chapters include exercises.