Support loading models from ollama as a provider #8
Description
What would you like to be added:
Since llama.cpp use gguf format models, ollama models are the compatible ones.
Why is this needed:
{{ message }}
What would you like to be added:
Since llama.cpp use gguf format models, ollama models are the compatible ones.
Why is this needed: