Originally published in together.ai, Sept 11, 2023. Large Language Models (LLMs) have changed the world. However, generating text with them can be slow and expensive. While methods like speculative decoding have been proposed to accelerate the generation speed, their intricate nature has left many in the open-source community hesitant to embrace them. That’s why we’re
Originally published in Fast.AI, Sept 4, 2023. We’ve noticed an unusual training pattern in fine-tuning LLMs. At first we thought it’s a bug, but now we think it shows LLMs can learn effectively from a single example....
Originally posted in The Verge, Aug 24, 2023. Meta said Code Llama will make it easier to finish code. Meta has released a tool called Code Llama, built on top of its Llama 2 large language model, to generate...
Originally posted on Replit.com, Sept 21, 2022. Large Language Models (LLMs) are known for their near-magical ability to learn from very few examples — as little as zero — to create language wonders. LLMs can chat, write...
