July 20, 2023

Tokenization for exact token counts

Marc Klingen

For OpenAI and Anthropic models token counts are now automatically calculated. This is helpful for streaming endpoints that do not return usage data.