Tech News
← Home  ·  All topics

Token Generation

2 GoKawiil briefs on this topic

Developer builds 'jevchat', a character-by-character chatbot powered by an LLM named Jev

A hobby project called jevchat turns a model referred to as Jev into a chat interface by asking it, one symbol at a time, to predict the next character of its reply given the conversation so far. The tool samples from a probability distribution over a chosen alphabet (letters, truncated tokens, etc.) using configurable sampling strategies, displaying live generation stats and the top candidate symbols as it works. The creator built it with Claude's help by describing the sampling algorithms and having the AI implement them.

Show HN tool visualizes attention weights behind LLM token generation

A hobbyist project lets users hover over tokens generated by a transformer language model to see which earlier tokens most influenced each output, by combining attention weights and value vector magnitudes across all heads and layers into a single opacity value. The demo highlights cases like verbatim copying of addresses or dates, showing the source text lighting up strongly when reproduced.