Thursday, 1 August 2019

probability theory - Application of Strong Markov Property





Theorem SMP (Strong Markov Property)



Let X be a time homogenous Markov process with T=R+ or
Z+ and let τ be a stopping time taking countably many
values. Then P[θτXAFτ]a.s on {τ<}=PXτ(XA)




Assume from now on T=Z+ and that X is canonical. Define the first hitting time of state y as τ=inf{n0:Xn=y}. Now define recursively τk+1y=τky+τyθτky,k0

starting from τ0y=0.




Why does the SMP imply the following equality?Px{τky<,τyθτky}=Px{τky<}Py{τy<}


Answer



The missing step has nothing in particular to do with Markov processes - it uses the decomposition P(AB)=P(BA)P(A). Thus Px{τky<,τyθτky}=Px{τyθτkyτky<}Px{τky<}=Px{τky<}Py{τy<}

where the strong Markov property is used in the final transition.


No comments:

Post a Comment

real analysis - How to find limhrightarrow0fracsin(ha)h

How to find limh0sin(ha)h without lhopital rule? I know when I use lhopital I easy get $$ \lim_{h\rightarrow 0}...