Synonyms
Related Concepts
Definition
Few-shot learning refers to the machine learning problem of learning a model from very few examples (shots).
Background
Computer vision systems based on machine learning often require the collection of large datasets for their training. This is often a challenging obstacle for their deployment. Moreover, there is evidence that humans are actually able to learn concepts from very few examples [1, 2, 3]. Few-shot learning methods aim to reduce this observed gap between human learning and machine learning. This is achieved by performing a form of transfer learning using data from many previously observed tasks toward new tasks with little data.
Theory and Application
In the 2000s, early research in computer vision on few-shot learning tackled the problem by using hand-designed feature representations and focusing on the exploration of learning and inference algorithms operating on that data...
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Landau B, Smith LB, Jones SS (1988) The importance of shape in early lexical learning. Cogn Dev 3(3):299–321
Markman EM (1989) Categorization and naming in children – problems of induction. MIT Press, Cambridge
Xu F, Tenenbaum JB (2007) Word learning as bayesian inference. Psycholog Rev 114(2): 245–272
Miller EG, Matsakis NE, Viola PA (2000) Learning from one example through shared densities on transforms. In: IEEE conference on computer vision and pattern recognition. IEEE Computer Society, pp 464–471
Fink M (2005) Object classification from a single example utilizing class relevance metrics. In: Advances in neural information processing systems, vol 17, pp 449–456
Bart E, Ullman S (2005) Cross-generalization: learning novel classes from a single example by feature replacement. In: IEEE conference on computer vision and pattern recognition, pp 672–679. IEEE Computer Society
Fei-Fei L, Fergus R, Perona P (2006) One-shot learning of object categories. IEEE Trans Pattern Anal Mach Intell 28(4):594–611
Schmidhuber J (1987) Evolutionary principles in self-referential learning on learning now to learn: The meta-meta-meta…-hook. Diploma thesis, Technische Universitat Munchen, Germany
Triantafillou E, Zhu T, Dumoulin V, Lamblin P, Evci U, Xu K, Goroshin R, Gelada C, Swersky K, Manzagol P-A, Larochelle H (2020) Meta-dataset: a dataset of datasets for learning to learn from few examples. In: International conference on learning representations
Ravi S, Larochelle H (2017) Optimization as a model for few-shot learning. In: International conference on learning representations
Finn C, Abbeel P, Levine S (2017) Model-agnostic meta-learning for fast adaptation of deep networks. In: International conference of machine learning
Bertinetto L, Henriques JF, Valmadre J, Torr P, Vedaldi A (2016) Learning feed-forward one-shot learners. In: Advances in neural information processing systems, vol 29, pp 523–531
Snell J, Swersky K, Zemel R (2017) Prototypical networks for few-shot learning. In: Advances in neural information processing systems, pp 4077–4087
Bertinetto L, Henriques JF, Torr P, Vedaldi A (2019) Meta-learning with differentiable closed-form solvers. In: International conference on learning representations
Lee K, Maji S, Ravichandran A, Soatto S (2019) Meta-learning with differentiable convex optimization. In: IEEE conference on computer vision and pattern recognition
Vinyals O, Blundell C, Lillicrap T, Wierstra D, et al (2016) Matching networks for one shot learning. In: Advances in neural information processing systems, pp 3630–3638
Hochreiter S, Younger AS, Conwell PR (2001) Learning to learn using gradient descent. In: International conference on artificial neural networks, pp 87–94
Santoro A, Bartunov S, Botvinick M, Wierstra D, Lillicrap T (2016) Meta-learning with memory-augmented neural networks. In: International conference on machine learning, pp 1842–1850
Graves A, Wayne G, Danihelka I (2014) Neural turing machines. CoRR, abs/1410.5401
Mishra N, Rohaninejad M, Chen X, Abbeel P (2018) A simple neural attentive meta-learner. In: International conference on learning representations
Lake BM, Salakhutdinov R, Tenenbaum JB (2015) Human-level concept learning through probabilistic program induction. Science 350(6266):1332– 1338
Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, Huang Z, Karpathy A, Khosla A, Bernstein M et al (2015) Imagenet large scale visual recognition challenge. Int J Comput Vis 115(3):211–252
Hariharan B, Girshick RB (2017) Low-shot visual recognition by shrinking and hallucinating features. In: IEEE International conference on computer vision, pp 3037–3046
Gidaris S, Komodakis N (2018) Dynamic few-shot visual learning without forgetting. In: IEEE conference on computer vision and pattern recognition
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer International Publishing
About this entry
Cite this entry
Larochelle, H. (2021). Few-Shot Learning. In: Ikeuchi, K. (eds) Computer Vision. Springer, Cham. https://doi.org/10.1007/978-3-030-63416-2_861
Download citation
DOI: https://doi.org/10.1007/978-3-030-63416-2_861
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-63415-5
Online ISBN: 978-3-030-63416-2
eBook Packages: Computer ScienceReference Module Computer Science and Engineering