An Introduction to Statistical Signal Processing

The origins of this book lie in our earlier book Random Processes: A Mathematical Approach for Engineers, Prentice Hall, 1986. This book began as a second edition to the earlier book and the basic goal remains unchanged — to introduce the fundamental ideas and mechanics of random processes to engineers in a way that accurately reflects the underlying mathematics, but does not require an extensive mathematical background and does not belabor detailed general proofs when simple cases suffice to get the basic ideas across. | An Introduction to Statistical Signal Processing f −1(F ) f F Pr(f ∈ F )=P ({ω : ω ∈ F })=P (f −1(F )) ✲ May 5, 2000 ii An Introduction to Statistical Signal Processing Robert M. Gray and Lee D. Davisson Information Systems Laboratory Department of Electrical Engineering Stanford University and Department of Electrical Engineering and Computer Science University of Maryland iv c 1999 by the authors. v to our Families vi Contents Preface xi Glossary xv 1 Introduction 1 2 Probability 11 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . 11 Spinning Pointers and Flipping Coins . . . . . . . . . . . . 15 Probability Spaces . . . . . . . . . . . . . . . . . . . . . . . 23 Sample Spaces . . . . . . . . . . . . . . . . . . . . . 28 Event Spaces . . . . . . . . . . . . . . . . . . . . . . 31 Probability Measures . . . . . . . . . . . . . . . . . . 42 Discrete Probability Spaces . . . . . . . . . . . . . . . . . . 45 Continuous Probability Spaces . . . . . . . . . . . . . . . . 56 Independence . . . . . . . . . . . . . . . . . . . . . . . . . . 70 Elementary Conditional Probability . . . . . . . . . . . . . 71 Problems . . . . . . . . . . . . . . . . . . . . . . . . . . . . 75 3 Random Objects 85 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . 85 Random Variables . . . . . . . . . . . . . . . . . . . 85 Random Vectors . . . . . . . . . . . . . . . . . . . . 89 Random Processes . . . . . . . . . . . . . . . . . . . 93 Random Variables . . . . . . . . . . . . . . . . . . . . . . . 95 Distributions of Random Variables . . . . . . . . . . . . . . 104 Distributions . . . . . . . . . . . . . . . . . . . . . . 104 Mixture Distributions . . . . . . . . . . . . . . . . . 108 Derived Distributions . . . . . . . . . . . . . . . . . 111 Random Vectors and Random Processes . . . . . . . . . . . 115 Distributions of Random Vectors . . . . . . . . .