{"id":13171,"date":"2023-09-08T17:17:58","date_gmt":"2023-09-08T21:17:58","guid":{"rendered":"https:\/\/www.predictiveanalyticsworld.com\/machinelearningtimes\/?p=13171"},"modified":"2023-09-08T17:17:58","modified_gmt":"2023-09-08T21:17:58","slug":"can-llms-learn-from-a-single-example","status":"publish","type":"post","link":"https:\/\/www.predictiveanalyticsworld.com\/machinelearningtimes\/can-llms-learn-from-a-single-example\/13171\/","title":{"rendered":"Can LLMs Learn From a Single Example?"},"content":{"rendered":"Originally published in Fast.AI, Sept 4, 2023. We\u2019ve noticed an unusual training pattern in fine-tuning LLMs. At first we thought it\u2019s a bug, but now we think it shows LLMs can learn effectively from a single example. How neural networks learn We train neural network classifiers by showing them examples of inputs and outputs, and they learn to predict outputs based on inputs. For example, we show examples of pictures of dogs and cats, along with the breed of each, and they learn to guess the breed from the image. To be more precise, for a list of <a href=\"https:\/\/www.predictiveanalyticsworld.com\/machinelearningtimes\/can-llms-learn-from-a-single-example\/13171\/\" class=\"more-link\">(more&hellip;)<\/a>","protected":false},"excerpt":{"rendered":"<p>Originally published in Fast.AI, Sept 4, 2023. We\u2019ve noticed an unusual training pattern in fine-tuning LLMs. At first we thought it\u2019s a bug, but now we think it shows LLMs can learn effectively from a single example. How neural networks learn We train neural network classifiers by showing them examples of inputs and outputs, and [&hellip;]<\/p>\n","protected":false},"author":72,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":"","_links_to":"","_links_to_target":""},"categories":[11,48],"tags":[879,368,1268,243,1119],"class_list":["post-13171","post","type-post","status-publish","format-standard","hentry","category-industry-news","category-left-hand","tag-ai","tag-artificial-intelligence","tag-llm","tag-machine-learning","tag-neural-networks"],"_links":{"self":[{"href":"https:\/\/www.predictiveanalyticsworld.com\/machinelearningtimes\/wp-json\/wp\/v2\/posts\/13171","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.predictiveanalyticsworld.com\/machinelearningtimes\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.predictiveanalyticsworld.com\/machinelearningtimes\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.predictiveanalyticsworld.com\/machinelearningtimes\/wp-json\/wp\/v2\/users\/72"}],"replies":[{"embeddable":true,"href":"https:\/\/www.predictiveanalyticsworld.com\/machinelearningtimes\/wp-json\/wp\/v2\/comments?post=13171"}],"version-history":[{"count":1,"href":"https:\/\/www.predictiveanalyticsworld.com\/machinelearningtimes\/wp-json\/wp\/v2\/posts\/13171\/revisions"}],"predecessor-version":[{"id":13172,"href":"https:\/\/www.predictiveanalyticsworld.com\/machinelearningtimes\/wp-json\/wp\/v2\/posts\/13171\/revisions\/13172"}],"wp:attachment":[{"href":"https:\/\/www.predictiveanalyticsworld.com\/machinelearningtimes\/wp-json\/wp\/v2\/media?parent=13171"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.predictiveanalyticsworld.com\/machinelearningtimes\/wp-json\/wp\/v2\/categories?post=13171"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.predictiveanalyticsworld.com\/machinelearningtimes\/wp-json\/wp\/v2\/tags?post=13171"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}