Is your feature request related to a problem?
There are currently no flags to control the routing of Gemini model inferences through Google Vertex and Google AiStudio. This requires code changes for any ad-hoc routing adjustments, which is inefficient.
Describe the solution you'd like
Add an environment variable to allow easy routing to either Vertex or AiStudio.
Original issue
Describe the current behavior
Currently there are no flags that could route Gemini model inferences via Google vertex and Google AiStudio.
It has to be via code changes if the ad-hoc routing changes are necessary.
Describe the enhancement you'd like
Add an env variable to efficiently route to either vertex or aistudio
Is your feature request related to a problem?
There are currently no flags to control the routing of Gemini model inferences through Google Vertex and Google AiStudio. This requires code changes for any ad-hoc routing adjustments, which is inefficient.
Describe the solution you'd like
Add an environment variable to allow easy routing to either Vertex or AiStudio.
Original issue
Describe the current behavior
Currently there are no flags that could route Gemini model inferences via Google vertex and Google AiStudio.
It has to be via code changes if the ad-hoc routing changes are necessary.
Describe the enhancement you'd like
Add an env variable to efficiently route to either vertex or aistudio