Preface xiii
Common Symbols xvii
I Introduction to Dynamics 1
1 Introduction 3
2 Programming 25
3 Analysis in Metric Space 39
4 Introduction to Dynamics 59
5 Further Topics for finite MCs 99
6 Infinite State Space 115
II Advances Techniques 153
7 Integration 155
8 Density Markov Chains 185
9 Measure-Theoretic Probability 209
10 Stochastic Dynamic Programming 227
11 Stochastic Dynamics 247
12 More Stochastic Dynamic Programming 295
III Appendixes 315
A Real Analysis 317
B Chapter Appendixes 339
Bibliography 357
Index 369