Allow System instruction to be null
complete
Daniel Nguyen
complete
I've fixed this in v1.29. Can you confirm?
Full release note https://boltai.com/blog/amazon-bedrock-and-xai-support-cache-breakpoint-and-more
Daniel Nguyen
in progress
It's technically not required. But this does look like an UX issue where it's not easy to set it to null.
Is that what you're referring to?
Yxax
Daniel Nguyen This bugs
Daniel Nguyen
Yxax: Do you want to not include the "system" instruction when sending the message (null), or you just want the UI to show nothing?
Yxax
Daniel Nguyen Allowed not to include，thank you !
Daniel Nguyen
Yxax: Which model are you using? I'm adding better support for o1 if that's what you're looking for
Yxax
Daniel Nguyeno1 and o1 mini
Daniel Nguyen
Yxax: I see. Which AI service? It should work correctly for OpenAI already
Yxax
Daniel Nguyen Thank you for all you do. It’s openai api.
Daniel Nguyen
Yxax: Can you confirm it works for you now. Because when you use o1, I move custom prompt into the user prompt, not the "system" message since o1 doesn't support it.
Yxax
Daniel Nguyen maybe more tests , Does this setting also apply to the GPT-4o ？
Daniel Nguyen
Yxax: No. GPT-4o supports system instruction natively