Periodic Updates for Constrained OCO with Application to Large-Scale Multi-Antenna Systems

Juncheng Wang, Min Dong, Ben Liang*, Gary Boudreau

*Corresponding author for this work

Research output: Contribution to journalJournal articlepeer-review

1 Citation (Scopus)


In many dynamic systems, decisions on system operation are updated over time, and the decision maker requires an online learning approach to optimize its strategy in response to the changing environment. When the loss and constraint functions are convex, this belongs to the general family of online convex optimization (OCO). In existing OCO works, the environment is assumed to vary in a time-slotted fashion, while the decisions are updated at each time slot. However, many wireless communication systems permit only periodic decision updates, i.e., each decision is fixed over multiple time slots, while the environment changes between the decision epochs. The standard OCO model is inadequate for these systems. Therefore, in this article, we consider periodic decision updates for OCO. We aim to minimize the accumulation of time-varying convex loss functions, subject to both short-term and long-term constraints. Feedback information about the loss functions within the current update period may be delayed and incomplete. We propose an efficient algorithm, termed Periodic Queueing and Gradient Aggregation (PQGA), which employs novel periodic queues together with possibly multi-step aggregated gradient descent to update the decisions over time. We derive upper bounds on the dynamic regret, static regret, and constraint violation of PQGA. As an example application, we study the performance of PQGA for network virtualization in a large-scale multi-antenna system shared by multiple wireless service providers. Simulation results show that PQGA converges fast and substantially outperforms the current best alternative.

Original languageEnglish
Pages (from-to)6705-6722
Number of pages18
JournalIEEE Transactions on Mobile Computing
Issue number11
Early online date3 Aug 2022
Publication statusPublished - 1 Nov 2023

Scopus Subject Areas

  • Software
  • Electrical and Electronic Engineering
  • Computer Networks and Communications

User-Defined Keywords

  • Long-term constraint
  • Massive MIMO
  • Online convex optimization
  • Periodic updates
  • Wireless network virtualization


Dive into the research topics of 'Periodic Updates for Constrained OCO with Application to Large-Scale Multi-Antenna Systems'. Together they form a unique fingerprint.

Cite this