In Markovian Demand Inventory Models, the authors are concerned with inventory models where these world events are modeled by Markov processes. Their research on Markovian demand inventory models was carried out over a period of ten years beginning in the early nineties. They demonstrate that the optimality of (s, S)-type policies, or base-stock policies (i.e., s = S) when there are no fixed ordering costs with the provision that the policy parameters s and S depend on the current state of the Markov process representing the environment. Models allowing backorders when the entire demand cannot be filled from the available inventory as well as those when the current demand is lost are considered. As for cost criteria, we treat both the minimization of the expected total discounted cost and the long-run average cost. The average-cost criterion is mathematically more difficult than the discounted cost criteria. Finally, we generalize the usual assumptions on holding and shortage costs and on demands that are made in the literature.