Simultaneously achieving sublinear regret and constraint violations for online convex optimization with time-varying constraints

نویسندگان

چکیده

In this paper, we develop a novel virtual-queue-based online algorithm for convex optimization (OCO) problems with long-term and time-varying constraints conduct performance analysis respect to the dynamic regret constraint violations. We design new update rule of dual variables way incorporating functions into variables. To best our knowledge, is first parameter-free simultaneously achieve sublinear Our proposed also outperforms state-of-the-art results in many aspects, e.g., does not require Slater condition. Meanwhile, group practical widely-studied constrained OCO which variation consecutive smooth enough across time, achieves O ( 1 ) Furthermore, extend case when time horizon T unknown. Finally, numerical experiments are conducted validate theoretical guarantees algorithm, some applications framework will be outlined.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A Low Complexity Algorithm with $O(\sqrt{T})$ Regret and Finite Constraint Violations for Online Convex Optimization with Long Term Constraints

This paper considers online convex optimization over a complicated constraint set, which typically consists of multiple functional constraints and a set constraint. The conventional Zinkevich’s projection based online algorithm (Zinkevich 2013) can be difficult to implement due to the potentially high computation complexity of the projection operation. In this paper, we relax the functional con...

متن کامل

Trading regret for efficiency: online convex optimization with long term constraints

In this paper we propose efficient algorithms for solving constrained online convex optimization problems. Our motivation stems from the observation that most algorithms proposed for online convex optimization require a projection onto the convex set K from which the decisions are made. While the projection is straightforward for simple shapes (e.g., Euclidean ball), for arbitrary complex sets ...

متن کامل

Online Convex Optimization with Stochastic Constraints

This paper considers online convex optimization (OCO) with stochastic constraints, which generalizes Zinkevich’s OCO over a known simple fixed set by introducing multiple stochastic functional constraints that are i.i.d. generated at each round and are disclosed to the decision maker only after the decision is made. This formulation arises naturally when decisions are restricted by stochastic e...

متن کامل

Regret Bound by Variation for Online Convex Optimization

In (Hazan and Kale, 2008), the authors showed that the regret of the Follow the Regularized Leader (FTRL) algorithm for online linear optimization can be bounded by the total variation of the cost vectors. In this paper, we extend this result to general online convex optimization. We first analyze the limitations of the FTRL algorithm in (Hazan and Kale, 2008) when applied to online convex opti...

متن کامل

Online Convex Optimization for Cumulative Constraints

We propose an algorithm for online convex optimization which examines a clipped long-term constraint of the form T ∑ t=1 [g(xt)]+, encoding the cumulative constraint violation. Previous literature has focused on longterm constraints of the form T ∑ t=1 g(xt), for which strictly feasible solutions can cancel out the effects of violated constraints. In this paper, we generalize the results in [16...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Performance Evaluation

سال: 2021

ISSN: ['0166-5316', '1872-745X']

DOI: https://doi.org/10.1016/j.peva.2021.102240