Telerik Blog Build a Token Visualizer in Dotnet

Using the dotnet stack of Blazor, MLNET and Telerik UI for Blazor, create a simple tool for visualizing how text is encoded by LLMs. The visualizer can be used to complement your AI development workflow by estimating token size in a given prompt, showing how LLMs see text data, and can be included in applications to estimate a user's chat input.