OpenRouter "show" list messes up when openrouter adds new models
in progress
rvid
I have a subset of OpenRouter models selected in the Models tab in the preferences. I've noticed that every time OpenRouter adds new models, this list is messed up. I have to go back re-select the ones I care about. This is especially annoying since I have multiple OR connections and I have to redo this for each.
Daniel Nguyen
in progress
Thanks. I realized there are a couple of issues and been working on the fix. But I wanted to understand your request better. Please elaborate more on your issue.
- Currently the implementation is "blacklist", not whitelist. Meaning it stores a list of hidden models, not list of visible models. This design decision is based on the idea that when OR adds new model, new users can see it right away without having going to the connection to manually add it. This has been the source of many bug reports / support tickets.
- Each of the OR connection has its own "hidden models" setting. Because of this, and pairing with the #1 above, it results in your situation where it can be quite annoying I agree.
Now I think maybe we will need an option to not automatically add newly added models to the list.
rvid
Daniel Nguyen I don't know about the underlying implementation but the UI definitely makes it seem like I'm whitelisting models (by ticking the show checkbox). Personally, I would prefer if models aren't automatically added because I have to go uncheck these in each of the connections. Moreover, I think there is another bug where some subset of my selected models is de-selected and some random models are selected. There's no way for me to reproduce this until the next OR update.
My 2 cents - I'd love something as simple as a plaintext model list where I could just paste the models I want. This'd also let me use OR's online models (https://openrouter.ai/announcements/introducing-web-search-via-the-api). For example, I could have both
anthropic/claude-3.5-sonnet:beta:online
and anthropic/claude-3.5-sonnet:beta
and toggle these as needed. The OR website is pretty good for discovery, pricing info etc. I don't really care for that to be in Bolt.