← Back to changelog
Marc Klingen
July 20, 2023
Tokenization for exact token counts

For OpenAI and Anthropic models token counts are now automatically calculated. This is helpful for streaming endpoints that do not return usage data.
For OpenAI and Anthropic models token counts are now automatically calculated. This is helpful for streaming endpoints that do not return usage data.