Descriptions:
In this video, I look at Needle by the company Cactus. This is a 26 million parameter function calling model with a very unique architecture that is outperforming a lot of models much bigger than itself.
Blog: https://cactuscompute.com/blog/needle
Demo: https://huggingface.co/spaces/shreyask/needle-playground
Github: https://github.com/cactus-compute/needle
Twitter: https://x.com/Sam_Witteveen
🕵️ Interested in building LLM Agents? Fill out the form below
Building LLM Agents Form: https://drp.li/dIMes
👨‍💻Github:
https://github.com/samwit/llm-tutorials
⏱️Time Stamps:
00:00 Intro
01:00 Cactus Needle
01:21 Blog
03:39 Baseline Transformer
04:00 Architecture
05:23 GitHub Repo
07:00 Demo
