Tool
cactus
cactus-compute/cactus
What it is
A Python package for running small text, speech and vision models on the local machine, with function calling, structured extraction, transcription and fine-tuning included.
Who it might suit
App developers wanting tool-calling agents, transcription or image description running on local hardware without a hosted model service.
What to check first
Anonymous usage counts are sent from the Python package unless an environment variable turns them off, according to the README. The engine and model weights download on first use, and the run call executes your functions directly.
How it runs
Python library and command-line tool
Written