Planning involves reasoning about the future by considering actions and hypothesizing possible outcomes for each. This process branches out like a tree, growing exponentially in the horizon length. But does it have to be this way? In this project we develop graph based probabilistic planners that utilize the same outcomes over and over in a graph structure, as opposed to a tree, with finite-time performance guarantees.