This strategy is useful for managing multiple subscription based models (non pay-as-you-go). Current available strategy such as round-robin will deprive the benefit of token caching because it will switch the model every-time based on the setup weights.
This strategy is useful for managing multiple subscription based models (non pay-as-you-go). Current available strategy such as round-robin will deprive the benefit of token caching because it will switch the model every-time based on the setup weights.