Fundamentals of Information Theory

Author: Shi Feng
Publisher:
Publish Date: 2002-07-01
Features: This book starts with basic concepts and methods, using primarily elementary mathematical tools to systematically and comprehensively introduce the fundamental theories, basic methods, and recent developments in information theory, including some new and relatively mature principles. The book is divided into 10 chapters. Chapter 1 introduces the basic concepts, main content, and brief history of Shannon's information theory. Chapter 2 discusses the source of information and the measurement of information. Chapter 3 introduces mutual information. Chapter 4 primarily covers some basic concepts of source coding and Huffman optimal coding. Chapter 5 primarily introduces the discrete channel coding theorem. Chapter 6 introduces linear codes. Chapter 7 introduces the theory of rate-distortion. Chapter 8 introduces the maximum entropy principle and the minimum discrimination information principle. In Chapter 9, the information theory under non-statistical conditions (combinatorial information and algorithmic information) is introduced, along with the representative universal coding method—Lempel-Ziv coding. Chapter 10 introduces the basic knowledge of cryptography. Most chapters are accompanied by exercises.