Stopping Markov processes and first path on graphs

Giacomo Aletti, Ely Merzbach

Research output: Contribution to journalArticlepeer-review

3 Scopus citations

Abstract

Given a strongly stationary Markov chain (discrete or continuous) and a finite set of stopping rules, we show a noncombinatorial method to compute the law of stopping. Several examples are presented. The problem of embedding a graph into a larger but minimal graph under some constraints is studied. Given a connected graph, we show a noncombinatorial manner to compute the law of a first given path among a set of stopping paths. We prove the existence of a minimal Markov chain without oversized information.

Original languageEnglish
Pages (from-to)49-75
Number of pages27
JournalJournal of the European Mathematical Society
Volume8
Issue number1
DOIs
StatePublished - 2006

Keywords

  • Directed graph
  • Markov chains
  • Stopping rules

Fingerprint

Dive into the research topics of 'Stopping Markov processes and first path on graphs'. Together they form a unique fingerprint.

Cite this