Markov Process

Latest research

1. Reliability Assessment of a non Markovian \( k \)-out-of-\((\mathfrak {a}+\mathfrak {b}+\mathfrak {c})\):\( G \) System with Preventive Maintenance and Unreliable Repairer using Markov Regenerative Stochastic Petri Nets

   • Samira Taleb
   • Kheir eddine Boudehane

   in Methodology and Computing in Applied Probability

   Article 01 May 2026

   

2. CovMADT: efficient offline multi-agent reinforcement learning via convex Markov games

   • Sikong Wen
   • Rui Wang
   • Zixuan Wang

   in Applied Intelligence

   Article 30 April 2026

   

3. On One-Dimensional Cluster-cluster Model

   • Noam Berger
   • Eviatar B. Procaccia
   • Daniel Sharon

   in Journal of Statistical Physics

   Article 28 April 2026

   

4. Task scheduling using Markov decision process over supervisory control theory

   • Daniel Sarsur
   • Lucas Alves
   • Patrícia Pena

   in Discrete Event Dynamic Systems

   Article Open access 28 April 2026

   

5. Sharp concentration for sums of matrices with Markovian dependence through universality

   • Alexander Van Werde
   • Jaron Sanders

   in Probability Theory and Related Fields

   Article Open access 27 April 2026

   

6. Markov-Modulated Brownian Motion

   • Guy Latouche

   in Springer Series in Operations Research and Financial Engineering

   Book 2026

   

7. Explicit Solution to an Optimal Two-player Switching Game in Infinite Horizon

   • El Asri Brahim
   • Magnoudéwa Paka

   in Journal of Optimization Theory and Applications

   Article 25 April 2026

   

8. Optimal Analysis on a Two-Way Communication Retrial Queueing System with Priority Customers

   • Yu Quan
   • Ruiling Tian
   • Leiping Xi

   in Methodology and Computing in Applied Probability

   Article 24 April 2026

   

9. Game Equilibrium and Simulation in M/M/1 Retrial Queues with Standby Mechanism

   • Siyu Liu
   • Xiuli Xu
   • Keyu Liu

   in Methodology and Computing in Applied Probability

   Article 20 April 2026

   

10. Strategic reneging in service systems with working breakdowns

    • Odysseas Kanavetas
    • Dimitrios Logothetis
    • Athanasia Manou

    in Queueing Systems

    Article Open access 20 April 2026

    

11. An optimal bi-level inspection and maintenance policy for a multi-component system: An enhanced successively approximated point-based value-iteration algorithm

    • Yian Wei
    • Sangqi Zhao
    • Yao Cheng

    in ENGINEERING Management

    Article Open access 20 April 2026

12. samsara: a continuous-time Markov chain Monte Carlo sampler for trans-dimensional Bayesian analysis

    • Gabriele Astorino
    • Lorenzo Valbusa Dall’Armi
    • Walter Del Pozzo

    in The European Physical Journal C

    Article Open access 20 April 2026

    

13. Simluation of Concomitants of Records from Sequences of Independent and Non-Identically Distributed Vectors

    • A. V. Stepanov

    in Vestnik St. Petersburg University, Mathematics

    Article 19 April 2026

14. Uniform convergence of weighted ergodic averages for uniquely ergodic \(C^*\)-dynamical systems

    • Farrukh Mukhamedov

    in Positivity

    Article 18 April 2026

15. Information-theoretic coordinate subset and partition selection of multivariate Markov chains via submodular optimization

    • Zheyuan Lai
    • Michael C. H. Choi

    in Journal of Combinatorial Optimization

    Article Open access 18 April 2026

    

16. Semi-Markov Stopping Games with Risk-Sensitive Discounted Cost Criterion

    • Bivakar Bose
    • Chandan Pal
    • Subhamay Saha

    in Dynamic Games and Applications

    Article 17 April 2026

17. Semi-convergence of dual matrices in dual Markov chains

    • Ning Zhang
    • Haifeng Ma

    in Journal of Applied Mathematics and Computing

    Article 16 April 2026

    

18. A model of a DoS attack on programmable logic controllers based on the topological transformation of stochastic network

    • Alexandr Boger
    • Alexander Sokolov
    • Alexey Ruchay

    in Computational Mathematics and Modeling

    Article 13 April 2026

    

19. A hidden quantum Markov model framework for entanglement and topological order in the AKLT chain

    • Abdessatar Souissi
    • Amenallah Andolsi

    in The European Physical Journal Plus

    Article 12 April 2026

    

20. Modeling long memory with zero-inflated geometric INAR(1) process and its \(\mathbb {Z}\)-valued version

    • Yixuan Niu
    • Fukang Zhu
    • Yanqiu Yang

    in Statistical Papers

    Article 11 April 2026

    

Related journals

• 

  Journal

  Queueing Systems

  Queueing Systems: Theory and Applications (QUESTA) is a well-established journal focusing on queueing theory. The models considered concern resource...

  Publishing model

  Hybrid

  Journal Impact Factor

  0.7 (2024)

  Downloads

  108,144 (2025)

  Submission to first decision(median)

  17 days

• 

  Journal

  Methodology and Computing in Applied Probability

  Methodology and Computing in Applied Probabilitywill publish high quality research and review articles in the areas of applied probability that...

  Publishing model

  Hybrid

  Journal Impact Factor

  1.0 (2024)

  Downloads

  94,203 (2025)

  Submission to first decision(median)

  12 days

• 

  Journal

  Journal of Theoretical Probability

  Journal of Theoretical Probabilitypublishes high-quality, original papers in all areas of probability theory, including probability on semigroups,...

  Publishing model

  Hybrid

  Journal Impact Factor

  0.6 (2024)

  Downloads

  148,025 (2025)

  Submission to first decision(median)

  7 days