Communication efficiency is crucial for federated learning (FL). Conducting local training steps in clients to reduce the communication frequency between and server a common method address this issue. However, it leads client drift problem due non-i.i.d. data distributions different which severely deteriorates performance. In work, we propose new improve performance cross-silo FL via maintainin...