Anyone have experience running their own AI agents locally without having to be in the command line the whole time? What tools do you use?

I'd love to run and train something on my own machine or on a home server. Thoughts/suggestions?
Ollama + OpenWebUI is the move!
Codename Goose + models running in Ollama for AI Agents!
Training a model means defining your own parameters based on data you supply. As such that would require a massive dataset and also 100s of H100 Nvidia GPUs to churn that data into model parameters.

This is a simple video showing someone using the latest RTX 5090 to run an existing model and make some AI content at home.
Maybe he meant specializing a model, instead of doing a full training from scratch.
The only legitimate person capable of having any weight on this convo is @npub1h8n…6rpev
I use ollama and webUI in conjunction with one another to have a web based local AI that’s resembles ChatGPT
I haven’t found a good way to train a model, I referencing docs is fairly easy, but from my understanding you would need access to the same amount of compute power that was used to train the original model; in order to update its weights and train your own model
Log In
App Logo
Feeds
Relays
Notifications
Messages
Groups
Settings
0
0
0