We extend Markov Chains in discrete times to Reward and Decision Processes and talk about the fundamentals of optimal control.