Llama Panel 🦙🦙🦙
🦙🦙🦙 Llama Panel 🦙🦙🦙 A multi-model agentic AI application that provides internet backed, consensus based answers from a configurable panel of LLMs. Open Source Greatness in Numbers Open Source LLMs have come a long way and can now challenge closed source models! Excitingly several Instruction Tuned open source models are now out and proving quite capable. Moreover, thanks to great improvements in efficiency and quantization, capable models are now small enough to run many on one system. Building on the idea that groups outperform individuals on various cognitive tasks, I set out to create at simple application to see if these latest models perform better as a group! Python Leading Llama Leading Llamas 🐍🦙🔎🦙🦙🦙 For simplicity, I built the app in Python on top of Ollama. A large capable model, ideally instruction tuned, leads the investigation, querying the panel of models and internet until a reasonable consensus is reached! Sample Run! gregarious@hal9000 : ~/llama_panel $ ./...