We study the contextual bandit problem with linear payoff function. In the traditional contextual bandit problem, the algorithm iteratively chooses an action based on the observed context, and immediately receives a reward for the chosen action. Motivated by a practical need in many applications, we study the design of algorithms under the piled-reward setting, where the rewards are received as...

In recent years, there has been a rise in the construction of expansive underground structures and shield tunnels with exceptionally large diameters. These projects introduce unique challenges regarding their impact on surrounding soil structures, which differ from those typically encountered conventional tunnels. However, existing body research this specific domain remains insufficient. When s...