Few-Shot Learning With Class Imbalance
نویسندگان
چکیده
Few-Shot Learning (FSL) algorithms are commonly trained through Meta-Learning (ML), which exposes models to batches of tasks sampled from a meta-dataset mimic seen during evaluation. However, the standard training procedures overlook real-world dynamics where classes occur at different frequencies. While it is generally understood that class imbalance harms performance supervised methods, limited research examines impact on FSL evaluation task. Our analysis compares 10 state-of-the-art meta-learning and methods distributions rebalancing techniques. results reveal 1) some display natural disposition against while most other approaches produce drop by up 17% compared balanced task without appropriate mitigation; 2) many will not automatically learn balance exposure imbalanced tasks; 3) classical strategies, such as random oversampling, can still be very effective, leading performances should overlooked.
منابع مشابه
Few-shot Learning
Though deep neural networks have shown great success in the large data domain, they generally perform poorly on few-shot learning tasks, where a classifier has to quickly generalize after seeing very few examples from each class. The general belief is that gradient-based optimization in high capacity classifiers requires many iterative steps over many examples to perform well. Here, we propose ...
متن کاملFew-Shot Learning with Graph Neural Networks
We propose to study the problem of few-shot learning with the prism of inference on a partially observed graphical model, constructed from a collection of input images whose label can be either observed or not. By assimilating generic message-passing inference algorithms with their neural-network counterparts, we define a graph neural network architecture that generalizes several of the recentl...
متن کاملFew-Shot Learning with Meta Metric Learners
Existing few-shot learning approaches are based on either meta-learning or metriclearning, which would suffer if the tasks have varying numbers of classes and/or the tasks diverge significantly. We propose meta metric learning to deal with the limitations of the existing few-shot learning approaches. Our meta metric learning approach consists of two components, task-specific learners that explo...
متن کاملClass Imbalance Learning
This report presents the work completed since the thesis proposal and the revised plan for the future PhD study. Two main issues have been discussed so far: diversity analysis of ensemble models in class imbalance learning, exploration of negative correlation learning on imbalanced data. Experimental design and main conclusions are simply described. More details are included in the two papers i...
متن کاملOne-shot and few-shot learning of word embeddings
Standard deep learning systems require thousands or millions of examples to learn a concept, and cannot integrate new concepts easily. By contrast, humans have an incredible ability to do one-shot or few-shot learning. For instance, from just hearing a word used in a sentence, humans can infer a great deal about it, by leveraging what the syntax and semantics of the surrounding words tells us. ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE transactions on artificial intelligence
سال: 2023
ISSN: ['2691-4581']
DOI: https://doi.org/10.1109/tai.2023.3298303