Gregarious Engineering

🦙🦙🦙 Llama Data Science🦙🦙🦙    I created a simple Python command line tool that leverages Ollama Client and llm-sandbox to test how well the latest tool wielding open-weights models can do data science! Full code and usage at  GregariousEngineering/llama-datascience   In short, ChatGPT’s brand new OPEN-WEIGHTS model  gpt-oss   does data science better and faster than many people :) Runner up, Mistral Small 3.2 was also quite competent! gregarious@hal9000 : ~/code/llama-datascience $ ./llama_datascience.py --data-file traffic_volume_000256_2004_2024.csv "What is the best time to travel South through the intersection?" Expert: gpt-oss (temp: 0.5) --- Expert Reasoning Step 1/20 --- > Expert wants to use tool: 'python_datascience' > Reason for tool selection: Load and inspect data > Code: import pandas as pd import numpy as np # Load data try: df = pd.read_csv('/sandbox/data.csv') except Exception as e: print('Error loadin...

Hello, Gemma3n! Jetson + MatFormer + PLE Caching + Audio Input Bringing Google latest open-source model, Gemma3n, to NVIDIA Jetson Orin to enable on-device, live audio chat! Google Gemma 3n is nothing short of incredible! In addition to incredible multi-modal performance in a tiny, efficient package, they also managed to add multi-language audio input!!   Design Considerations:  Python + transformers + torch Audio input is so new, we'll have to leverage the latest tranformers package from HuggingFace to leverage it. jetson-containers To make things easy, I'll build a container with the latest transformers for the Jetson using  jetson-containers Piper for efficient on device text-to-speech   …video coming when I get a chance shrink it… Full build and details on GitHub:  GregariousEngineering/hello-gemma   Up Next! Wake word and query completion detection Internet access Remote LLMs 

A multi-model agentic app to provide internet backed, consensus based answers from a configurable panel of LLMs (ReAct , Self- and Cross-Consistency) Open Source Greatness in Numbers Open Source LLMs have come a long way and can now challenge closed source models! Excitingly several Instruction Tuned open source models are now out and proving quite capable. Moreover, thanks to great improvements in efficiency and quantization, capable models are now small enough to run many on one system. Building on the idea that groups outperform individuals on various cognitive tasks, I set out to create at simple application to see if these latest models perform better as a group! Python Leading Llama Leading Llamas 🐍🦙🔎🦙🦙🦙 For simplicity, I built the app in Python on top of Ollama. A large capable model, ideally instruction tuned, leads the investigation, querying the panel of models and internet until a reasonable consensus is reached! Sample Run! gregarious@hal9000 : ~/llama_panel $ ./lla...

Bad Decisions: In moves seen aimed at ensure I finally switch devices, in addition to recently adding ads to Prime, Amazon decided to start autoplaying ads as soon as the device turns on. Buried Settings: Fortunately, this can be disable under Settings > Preferences > Featured Content. While in Preferences, I stopped in Privacy Settings to turn Off the slew of tracking On by default. Repeated Pain Sadly these settings are per device, not account, so you’ll have to make them on every device.

Hackles Feedback Hypothesis “The  facial feedback hypothesis , rooted in the conjectures of  Charles Darwin  and  William James , is that one's facial expression directly affects their  emotional  experience. Specifically, physiological activation of the facial regions associated with certain emotions holds a direct effect on the elicitation of such emotional states, and the lack of or inhibition of facial activation will result in the suppression (or absence altogether) of corresponding emotional states.” https://en.m.wikipedia.org/wiki/Facial_feedback_hypothesis I ask, does smoothing or raising a dog’s hackles affect their emotional experience??

Change these “Off-Facebook” Facebook (and Instagram) Privacy Settings New Settings! OK, perhaps not new. It’s been many years since I checked any social media regularly and I should really just delete my accounts, but like many, I leave them collecting dust… But then, over the weekend I received a slew of recovery tokens for my Facebook account, which prompted me to head over to Settings to check activity and enable MFA. While there I noticed the new settings, buried deep as you’d expect. I am genuinely ecstatic about these settings. Their defaults leave nearly everyone open to widespread invasion of privacy, but they still have the settings available. I suspect we have the ever increasing barrage of new consumer privacy oriented laws from cities and states (e.g. California Consumer Privacy Act) to country unions (GDPR). Apply these in addition to standard privacy settings, as described well in Consumer Reports’ How to Use Facebook Privacy Settings . They also apply to connected Instag...