Unique System Instructions for each model
S
Static
I use many different offline models for specific tasks. Unfortunately, every time I change to a different model I have to open the inspector and change the system instructions for that specific model which can get really time consuming. It would be really helpful if I can define the system instructions for each model in the settings so when I change the model in the chat, the system instructions change based on the model.
The AI command already does this and it would be great to have this feature for the regular chat.
Daniel Nguyen
Can you use the Assistant for this?
S
Static
Daniel Nguyen I could do that. I would have to add a bunch of extra assistants with the model names to differentiate it (eg. Llama3.2-8b) whereas it would be cleaner to have a model specific instruction. Perhaps, instead of calling it "System Instruction" in the inspector, maybe it would be better to call it "Model Instruction". Initially it would take the system instruction from settings, but if we change the instructions and set it as default, instead of the System instruction in settings changing, it would associate the new "model instruction" with that specific model for all new chats.
Also, currently there's an issue with Assistant where it does not change the model when the assistant is changed.
https://boltai.canny.io/bug-reports/p/ai-assistant-doesnt-change-model