Originally published in Fast.AI, Sept 4, 2023. We’ve noticed an unusual training pattern in fine-tuning LLMs. At first we thought it’s a bug, but now we think it shows LLMs can learn effectively from a single example. How neural networks learn We train neural network classifiers by showing them examples of inputs and outputs, and
Neural networks get a bad reputation for being black boxes. And while it certainly takes creativity to understand their decision making, they are really not as opaque as people would have you believe. In this tutorial, I’ll...
Originally published in Jonathan Ramkissoon Blog, July 29, 2020. I trained a multi-class classifier on images of cats, dogs and wild animals and passed an image of myself, it’s 98% confident I’m a dog. The problem isn’t...
