Function Calling for Ollama
complete
S
Static
Ollama supports function calling using several models. Please add function calling support for Ollama.
example:
Daniel Nguyen
complete
I've added this in v1.17.0 https://boltai.canny.io/changelog/v1170-build-91
Sam
Daniel Nguyen love your work!
Daniel Nguyen
in progress
Daniel Nguyen
planned
This is planned but it's going to take a while. As you can see, Ollama doesn't follow OpenAI's "tool_use" api spec and require hacknig the prompt making it quite difficult to integrate system-wide.
Pramod J
Daniel Nguyen Has it gotten any easier now? I think they've made some progress at Ollama. https://www.ollama.com/blog/tool-support
Daniel Nguyen
Pramod J: Yes. I've finished the implementation. Will be included in the next release (today or tomorrow)
Sam
Daniel Nguyen yay!