Textbook in PDF format
This book is a gentle introduction to Markov Chains for programmers. It describes the basics of the formalism and demonstrate numerical methods using the C Programming Language (presented as 'coding challenges' for programming enthusiasts). The code is then validated using MatLAB and CTMC/DTMC models in the PRISM Statistical Model Checker tool. The book also describes and comments on several basic models with applications in dependability