CodedPaddedFL and CodedSecAgg: Straggler Mitigation and Secure Aggregation in Federated Learning
نویسندگان
چکیده
We present two novel federated learning (FL) schemes that mitigate the effect of straggling devices by introducing redundancy on devices’ data across network. Compared to other in literature, which deal with stragglers or device dropouts ignoring their contribution, proposed do not suffer from client drift problem. The first scheme, CodedPaddedFL, mitigates while retaining privacy level conventional FL. It combines one-time padding for user gradient codes yield straggler resiliency. second CodedSecAgg, provides resiliency and robustness against model inversion attacks is based Shamir’s secret sharing. apply CodedPaddedFL CodedSecAgg a classification For scenario 120 devices, achieves speed-up factor 18 an accuracy 95% MNIST dataset compared Furthermore, it yields similar performance terms latency recently scheme Prakash et al. without shortcoming additional leakage private data. outperforms state-of-the-art secure aggregation LightSecAgg 6.6–18.7 95%.
منابع مشابه
Redundancy Techniques for Straggler Mitigation in Distributed Optimization and Learning
Performance of distributed optimization and learning systems is bottlenecked by “straggler” nodes and slow communication links, which significantly delay computation. We propose a distributed optimization framework where the dataset is “encoded” to have an over-complete representation with built-in redundancy, and the straggling nodes in the system are dynamically left out of the computation at...
متن کاملPractical Secure Aggregation for Federated Learning on User-Held Data
Secure Aggregation protocols allow a collection of mutually distrust parties, each holding a private value, to collaboratively compute the sum of those values without revealing the values themselves. We consider training a deep neural network in the Federated Learning model, using distributed stochastic gradient descent across user-held training data on mobile devices, wherein Secure Aggregatio...
متن کاملEffective Straggler Mitigation: Attack of the Clones
Small jobs, that are typically run for interactive data analyses in datacenters, continue to be plagued by disproportionately long-running tasks called stragglers. In the production clusters at Facebook and Microsoft Bing, even after applying state-of-the-art straggler mitigation techniques, these latency sensitive jobs have stragglers that are on average 8 times slower than the median task in ...
متن کاملmanipulation in dubbing and subtitling
پژوهش حاضر در چارچوب مکتب دستکاری قرار گرفت و با استفاده از تقسیم بندی دوکات (2007) از شیوه های دستکاری، به دنبال یافتن پاسخ برای پرسش های زیر بود: 1-رایج ترین شیوه دستکاری در دوبله فیلم ها کدام است؟ 2-رایج ترین شیوه دستکاری در زیرنویس فیلم ها کدام است؟ 3-دستکاری در دوبله فیلم ها رایج تر است یا در زیرنویس آن ها؟ این پژوهش از نوع تحقیقات توصیفی- مقایسه ای و پیکره ای می باشد. پیکره تحقیق شا...
willingness to communicate in the iranian context: language learning orientation and social support
why some learners are willing to communicate in english, concurrently others are not, has been an intensive investigation in l2 education. willingness to communicate (wtc) proposed as initiating to communicate while given a choice has recently played a crucial role in l2 learning. it was hypothesized that wtc would be associated with language learning orientations (llos) as well as social suppo...
ذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Communications
سال: 2023
ISSN: ['1558-0857', '0090-6778']
DOI: https://doi.org/10.1109/tcomm.2023.3244243