Preprints

O. Mrani-Zentar, R. Simpson and S. Yüksel, Non-Sequential Decentralized Stochastic Control Revisited: Causality and Static Reducibility (arXiv)

Y. Zhou, Y. Song and S. Yüksel, Robustness to Model Approximation, Empirical Model Learning, and Sample Complexity in Wasserstein Regular MDPs Mathematics of Operations Research, to appear 2026 (arXiv).

A.D. Kara and S. Yüksel. Approximations and Learning for Continuous State and Action MDPs under Average Cost Criteria (arXiv) Journal of Machine Learning Research, 2026.

N. Saldi and S. Yüksel, Kernel Mean Embedding Topology: Weak and Strong Forms for Stochastic Kernels and Implications for Model Learning Annals of Applied Probability, vol. 36 (2), 1653-1689, April 2026 (pdf) (arXiv)

S. Sanjari, N. Saldi and S. Yüksel, Optimality of Symmetric Independent Policies under Decentralized Mean-Field Information Sharing for Stochastic Teams and Equivalence with McKean-Vlasov Control of a Representative Agent, Mathematics of Operations Research, to appear 2026 (arXiv).

S. Pradhan and S. Yüksel, Discrete-Time Approximations of Controlled Diffusions with Infinite Horizon Discounted and Average Cost (arXiv) (provisionally accepted to EEE Transactions on Automatic Control,)

S. Pradhan, Z. Selk and S. Yüksel. Robustness of Optimal Controlled Diffusions with Near-Brownian Noise via Rough Paths Theory, Mathematics of Control, Signals, and Systems, 2026 (pdf).

N. Saldi, S. Sanjari and S. Yüksel. Quantum Markov Decision Processes: Dynamic and Semi-Definite Programs for Optimal Solutions. Applied Mathematics and Optimization, 2026 (pdf). 

E. Hubbard, L. Cregg and S. Yüksel. Reinforcement Learning for Jointly Optimal Coding and Control Policies for a Controlled Markovian System over a Communication Channel IEEE Transactions on Automatic Control, 2026. 

L. Cregg, F. Alajaji and S. Yüksel, Sliding Window Codes: Near-Optimality and Q-Learning for Zero-Delay Coding IEEE Transactions on Information Theory, 2026.

N. Garcia, C. Kawan and S. Yüksel, Ergodic Stabilization of Controlled Stochastic Nonlinear Systems under Information Constraints: Geometric Analysis with Stable and Unstable Coordinate Splitting, Communications in Optimization Theory (COT), Special Issue in memory of Professor Sanjoy Mitter, Editors: Vivek Borkar, Michel Delfour and Alexander Zaslavski, vol. 2026 (2026), No. 36, pp. 1-30 (April 2026) (pdf).

S. Pradhan and S. Yüksel, Controlled Diffusions under Full, Partial and Decentralized Information: Existence of Optimal Policies and Discrete-Time Approximations SIAM Journal on Control and Optimization 2025 (pdf) (arXiv)

Y. E. Demirci and S. Yüksel, Unique Ergodicity of Non-Linear Filters via Reachability and Uniform Weak Continuity Electronic Communications in Probability, 2025 (pdf) (arXiv)

S. Yüksel, Another Look at Partially Observed Optimal Stochastic Control: Existence, Ergodicity, and Approximations without Belief-Reduction, Applied Mathematics and Optimization, 2025 (pdf) (arXiv).

A.D. Kara, E. Bayraktar,  S. Yüksel, Near Optimal Approximations and Finite Memory Policies for POMPDs with Continuous Spaces (arXiv) Special Issue in Honor of Peter Caines's 80th Birthday, Editors: Minyi Huang and Ji-Feng Zhang, 2025 (pdf).

B. Yongacoglu, G. Arslan and S. Yüksel, Unsynchronized Decentralized Q-Learning: Two Timescale Analysis by Persistence SIAM Journal on Control and Optimization vol. 63, pp. 2224-2250, 2025 (pdf) (arXiv) 

N. Saldi, S. Sanjari and S. Yüksel, Quantum Markov Decision Processes: General Theory, Approximations, and Classes of Policies SIAM Journal on Control and Optimization vol. 63, pp. 1156-1183, 2025 (pdf) (arXiv)

2024

S. Yüksel, On Borkar and Young Relaxed Control Topologies and Continuous Dependence of Invariant Measures on Control Policy, SIAM Journal on Control and Optimization vol 62, pp. 2367--2386, 2024 (pdf).

B. Yongacoglu, G. Arslan and S. Yüksel. Mean-Field Games With Finitely Many Players: Independent Learning and Subjectivity, Journal of Machine Learning Research, (419):1−69, 2024 (pdf) (CDC'22).

S. Pradhan and S. Yüksel, Robustness of Stochastic Optimal Control to Approximate Diffusion Models under Several Criteria, Mathematics of Operations Research, pp.2049-2077, Nov. 2024 (arXiv).

A.D. Kara and S. Yüksel, Q-Learning for Stochastic Control under General Information Structures and Non-Markovian Environments Transactions on Machine Learning Research (TMLR) (pdf, Featured Certification), 2024.

Y.E. Demirci, A.D. Kara and S. Yüksel, Average Cost Optimality of Partially Observed MDPS: Contraction of Non-linear Filters, Optimal Solutions and Approximations SIAM Journal on Control and Optimization, vol. 62, pp. 2859-2883, 2024.

L. Cregg, T. Linder and S. Yüksel. Reinforcement Learning for Near-Optimal Design of Zero-Delay Codes for Markov Sources IEEE Transactions on Information Theory, vol. 70, no. 11, pp. 8399-8413, Nov. 2024. 

S. Sanjari, N. Saldi and S. Yüksel, Nash Equilibria for Exchangeable Team against Team Games, their Mean Field Limit, and Role of Common Randomness SIAM Journal on Control and Optimization, vol. 62, pp. 1437-1464, 2024 (arXiv).

S. Pradhan and S. Yüksel, Continuity of Cost in Borkar Control Topology and Implications on Discrete Space and Time Approximations for Controlled Diffusions under Several Criteria Electronic Journal of Probability, vol. 29, pp. 1-32, 2024.

S. Pradhan and S. Yüksel. Near Optimality of Lipschitz and Smooth Policies in Controlled Diffusions Systems and Control Letters, 2024 (arXiv)

Z. Selk and S. Yüksel. Robust Decentralized Control of Coupled Systems via Risk Sensitive Control of Decoupled or Simple Models with Measure Change, Systems and Control Letters, 105915, 2024.

C. McDonald and S. Yüksel, Stochastic Observability and Filter Stability under Several Criteria, IEEE Transactions on  Automatic Control, vol. 69, no. 5, pp. 2931-2946, May 2024.

G. Arslan and S. Yüksel, Subjective Equilibria under Beliefs of Exogenous Uncertainty: Linear Quadratic Case, Applied and Computational Mathematics, vol. 23, Special Issue: Control, Teams, and Games, pp. 346-365, 2024.

A.D. Kara, N. Saldi and S. Yüksel, Q-Learning for MDPs with General Spaces: Convergence and Near Optimality via Quantization under Weak Continuity Journal of Machine Learning Research, 2023 (arXiv)

B. Yongacoglu, G. Arslan and S. Yüksel. Satisficing Paths and Independent Multi-Agent Reinforcement Learning in Stochastic Games, SIAM Journal on Mathematics of Data Science, vol. 5, pp. 745-773, 2023. (arXiv)

S. Sanjari, N. Saldi and S. Yüksel,  Optimality of Independently Randomized Symmetric Policies for Exchangeable Stochastic Teams with Infinitely Many Decision Makers Mathematics of Operations Research, 48(3), 1254-1285, 2023 (arXiv).

I. Hogeboom-Burr and S. Yüksel, Sequential Stochastic Control (Single or Multi-Agent) Problems Nearly Admit Change of Measures with Independent Measurements, Applied Mathematics and Optimization, vol. 87, 51, 2023 (link)(arXiv)

A. D. Kara and S. Yüksel, Convergence of Finite Memory Q-Learning for POMDPs and Near Optimality of Learned Policies under Filter Stability, Mathematics of Operations Research, vol. 48, pp. 2066-2093, Nov. 2023 (link) (CDC'21).

S. Sanjari, T. Başar and S. Yüksel, Isomorphism Properties of Optimality and Equilibrium Solutions under Equivalent Information Structure Transformations: Stochastic Dynamic Games and Teams, SIAM Journal on Control and Optimization, vol. 61, pp. 3102-3130, 2023.

G. Arslan and S. Yüksel, Subjective Equilibria under Beliefs of Exogenous Uncertainty for Dynamic Games SIAM Journal on Control and Optimization, 2023 (arXiv)

I. Hogeboom-Burr and S. Yüksel, Continuity Properties of Value Functions in Information Structures for Zero-Sum and General Games and Stochastic Teams SIAM Journal on Control and Optimization, 2023 (link) (arXiv).

J. Keeler, T. Linder and S. S. Yüksel. An Asymptotically Optimal Two-Part Fixed-Rate Coding Scheme for Networked Control with Unbounded Noise IEEE Transactions on Information Theory, 2023 (link)(also ISIT'22) (arXiv)

C. Kawan and S. Yüksel, Metric and Topological Entropy Bounds for Optimal Coding of Stochastic Dynamical Systems, IEEE Transactions on Automatic Control, v. 65, pp. 2466-2479, June 2020.

C. McDonald, F. Alajaji and S. Yüksel, Two-Way Gaussian Networks with a Jammer and Decentralized Control, IEEE Transactions on Control of Network Systems, pp. 446-457, March 2020.

N. A. Dalkiran and S. Yüksel,  Stochastic Control Approach to Reputation Games, IEEE Transactions on Automatic Control, vol. 65, pp. 4710-4725, Nov. 2020.

S. Saritas, S. Yüksel and S. Gezici, Dynamic Signaling Games with Quadratic Criteria under Nash and Stackelberg Equilibria, Automatica, May 2020.

N. Saldi, S. Yüksel and T. Linder, Finite Model Approximations for Partially Observed Markov Decision Processes with Discounted Cost, IEEE Transactions on  Automatic Control, v. 65, Jan. 2020.

2019

A. D. Kara, N. Saldi and S. Yüksel, Weak Feller Property of Non-linear Filters Systems and Control Letters, Dec. 2019 (arXiv) (pdf link)

A. D. Kara and S. Yüksel, Robustness to Incorrect Priors in Partially Observed Stochastic Control, SIAM Journal on Control and Optimization, v. 57, pp. 1929–1964, 2019.

S. Yüksel, A Note on the Separation of Optimal Quantization and Control Policies in Networked Control, SIAM Journal on Control and Optimization, v. 57, pp. 773-782, 2019.

2018

G. Arslan and S. Yüksel, Decentralized Q-Learning for Stochastic Teams and Games, IEEE Transactions on Automatic Control, vol. 62, pp. 1545 - 1558, April 2017.

S. Saritas, S. Yüksel and S. Gezici, Quadratic Multi-Dimensional Signaling Games and Affine Equilibria, IEEE Transactions on  Automatic Control, vol. 62, pp. 605-619, Feb. 2017.

2016

N. Saldi, S. Yüksel and T. Linder, Near Optimality of Quantized Policies in Stochastic Control Under Weak Continuity Conditions, J. of Math. Analysis and Applications, v. 435, pp. 321-337, March 2016.

S. Yüksel, Stationary and Ergodic Properties of Stochastic Non-Linear Systems Controlled over Communication Channels, SIAM Journal on Control and Optimization, pp. 2844-2871, 2016.

R. Zurkowski, S. Yüksel and T. Linder, On Rates of Convergence for Markov Chains under Random Time State Dependent Drift Criteria, IEEE Transactions on Automatic Control, v. 61, pp. 145-155, Jan. 2016.

N. Saldi, T. Linder and S. Yüksel, Asymptotic Optimality and Rates of Convergence of Quantized Stationary Policies in Stochastic Control, IEEE Transactions on Automatic Control, vol. 60, pp. 553 -558, Feb. 2015.

G. Arslan, F. Demirkol and S. Yüksel, On Games with Coupled Constraints IEEE Transactions on Automatic Control, vol. 60, pp. 358-372, Feb. 2015.  

N. Saldi, T. Linder and S. Yüksel, Randomized Quantization and Source Coding  with Constrained Output Distribution, IEEE Transactions on Information Theory, vol. 61, pp. 91-106, Jan. 2015.

2014

D. Quevedo, V. Gupta, J.W. Ma, and S. Yüksel, Stochastic Stability of Event-triggered Anytime Control, IEEE Transactions on Automatic Control, vol. 59, pp. 3373-3379, December 2014.

A. Ozcelikkale, S. Yüksel, H. M. Ozaktas Unitary Precoding and Basis Dependency of MMSE Performance for Gaussian Erasure Channels, IEEE Transactions on Information Theory, v. 60, pp. 7186-7203, Nov. 2014.

T. Linder and S. Yüksel, On Optimal Zero-delay Coding of Vector Markov Sources IEEE Transactions on Information Theory, v. 60., pp. 2975-5991, Oct. 2014.

A. A. Zaidi, T. J. Oechtering, S. Yüksel, M. Skoglund, Stabilization of Linear Systems Over Gaussian Networks, IEEE Transactions on  Automatic Control, vol. 59, pp. 2369-2384, Sept. 2014.

S. Yüksel, Jointly Optimal LQG Quantization and Control Policies for Multi-Dimensional Systems, IEEE Transactions on Automatic Control, vol. 59, pp. 1612-1617, June 2014.

A. Johnston and S. Yüksel, Stochastic Stabilization of Partially Observed and Multi-Sensor Systems Driven by Unbounded Noise under Fixed-Rate Information Constraints, IEEE Transactions on  Automatic Control, vol. 59, pp. 792-798, March 2014; a longer version with complete proofs available on arXiv: (arXiv version)

2013

N. Sen, F. Alajaji, S. Yüksel, G. Como, On the Multiple Access Channel with Asymmetric Noisy State Information at the Encoders IEEE Transactions on Information Theory, vol. 59, pp. 7052-7070, November 2013.

W. Dai and S. Yüksel, Observability of a Linear System under Sparsity Constraints IEEE Transactions on  Automatic Control, pp. 2372-2376, vol 58, Sept. 2013.

A. A. Zaidi, S. Yüksel, T. J. Oechtering, M. Skoglund, On Optimal Policies for Control and Estimation Over a Gaussian Relay Channel, Automatica, September 2013.

S. Yüksel, On Optimal Causal Coding of Partially Observed Markov Sources in Single and Multi-Terminal Settings, IEEE Transactions on  Information Theory, vol. 59, pp. 424-437, January 2013.

S. Yüksel and S. P. Meyn, Random-Time, State-Dependent Stochastic Drift for Markov Chains and Application to Stochastic Stabilization Over Erasure Channels, IEEE Transactions on  Automatic Control, vol. 58, pp. 47 - 59, January 2013.

2012

S. Yüksel, Characterization of Information Channels for Asymptotic Mean Stationarity and Stochastic Stability of Non-stationary/Unstable Linear Systems, IEEE Transactions on  Information Theory, vol. 58, pp. 6332-6354, October 2012 (pdf).

S. Yüksel and T. Linder, Optimization and Convergence of Observation Channels in Stochastic Control,  SIAM Journal on Control and Optimization, vol. 50, no. 2, pp. 864-887, 2012.

2011

S. Yüksel, A Tutorial on Quantizer Design for Networked Control Systems: Stabilization and Optimization, Applied and Computational Mathematics, vol.10, no.3, pp.365-403, 2011.

N. Sen, F. Alajaji, S. Yüksel, Feedback Capacity of a Class of Symmetric Finite-State Markov Channels, IEEE Transactions on  Information Theory, vol. 56, pp. 4110 - 4122, July 2011.

S. Yüksel and T. Basar, Control over Noisy Forward and Reverse Channels, IEEE Transactions on  Automatic Control, pp. 1014-1029, vol 56, May 2011.

G. Como and S. Yüksel, On the Capacity of Memoryless Finite State Multiple Access Channels with Asymmetric State Information at the Encoders, IEEE Transactions on  Information Theory, pp. 1267 - 1273, March 2011.

2010 and earlier

S. Yüksel, Stochastic Stabilization of Noisy Linear Systems with Fixed-Rate Limited Feedback, IEEE Transactions on  Automatic Control, v. 55, pp. 2847-2853, Dec. 2010.

S. Yüksel, Stochastic Nestedness and the Belief Sharing Information Pattern, IEEE Transactions on  Automatic Control, vol. 54, pp. 2773-2786, Dec. 2009.

G. Como, S. Yüksel and S. Tatikonda The Error Exponent of Variable-Length Codes over Markov Channels with Feedback, IEEE Transactions on Information Theory, vol. 55, pp. 2139-2160, May 2009.

S. Yüksel and S. Tatikonda, A Counterexample in Distributed Optimal Sensing and Control, IEEE Transactions on Automatic Control, vol. 54, pp. 841-844, April 2009.

S. Yüksel and T. Basar Optimal Signaling Policies for Decentralized Multi-Controller Stabilizability over Communication Channels, IEEE Transactions on Automatic Control, vol. 52, pp. 1969-1974, October 2007.

S. Yüksel and T. Basar Communication Constraints for Decentralized Stabilizability with Time-Invariant Policies, IEEE Transactions on Automatic Control,,  vol. 52, pp. 1060-1066, June 2007.

S. Yüksel and T. Basar, Minimum Rate Coding for LTI Systems over Noiseless Channels, IEEE Transactions on Automatic Control, v. 51, pp. 1878-1887, Dec. 2006. 

O. C. Imer, S. Yüksel and T. Basar Optimal control of LTI systems over unreliable communication links, Automatica, vol. 42, pp. 1429-1440, Sept. 2006. 

S. Yüksel and T. Basar, Multi-Agent Reinforcement Learning under General Information Structures, Elsevier Encylopedia, 2025.

S. Yüksel, Control of Stochastic Systems, Elsevier Encylopedia, 2025.

A. D. Kara and S. Yüksel Robustness to Approximations and Model Learning in MDPs and POMDPs in Modern Trends in Controlled Stochastic Processes: Theory and Applications, Volume III. A. B. Piunovskiy and Y. Zhang, editors, Luniver Press, Frome, UK 2021 (pdf).

S. Yüksel, Information and Communication Complexity of Networked Control Systems, Encyclopedia of Systems and Control (2nd Edition), Eds:J. Baillieul, T. Samad, Springer, 2019

N. Saldi, S.Yüksel and T. Linder, Finite Approximations to Markov Decision Processes with Borel Spaces, in Modern Trends in Controlled Stochastic Processes: Theory and Applications, Volume II. A. B. Piunovskiy, editor, Luniver Press, Frome, UK 2015.

S. Yüksel, Information and Communication Complexity of Networked Control Systems, Encyclopedia of Systems and Control, Eds:J. Baillieul, T. Samad, Springer, 2015 (pdf).

S. Yüksel, Design of Information Channels for Optimization and Stabilization in Networked Control, Information and Control in Networks. Eds: G. Como, B. Bernhardsson, A. Rantzer, Springer, 2014 (pdf). 

A. A. Zaidi, T. J. Oechtering, S. Yüksel, M. Skoglund, Stabilization and Control over Gaussian Networks, Information and Control in Networks. Eds:G. Como, B. Bernhardsson, A. Rantzer, Springer, 2014 (pdf)

S.Yüksel, T. Basar Causal Coding of Markov Sources with Continuous Alphabets, in Analysis and Design of Nonlinear Control Systems: In Honor of Alberto Isidori, A. Astolfi, L. Marconi (Eds.), Springer 2008.