Talkie: A 13B Language Model Trained on 1930s Text

hackernews·3w·jekude

jekude released Talkie, a 13 billion parameter language model trained exclusively on 1930s-era text, creating a chatbot that speaks and reasons like it's from the Depression era. It's a creative probe into how training data shapes model behavior—useful for indie builders experimenting with domain-specific language models or exploring historical datasets as training material.