GPT

OpenAI‘s unsupervised language models. Compared with BERT, it is unidirectional and generative.

GPT 1, GPT 2, GPT 3, ChatGPT, GPT 4, GPT o1

But what is a GPT? Visual intro to transformers | Chapter 5, Deep Learning by 3Blue1Brown

Minimal implementations: - nanoGPT by Andrej Karpathy - tweet - video: https://www.youtube.com/watch?v=kCc8FmEb1nY - GPT in 60 Lines of NumPy - Let’s reproduce GPT-2 (1.6B): one 8XH100 node, 24 hours, $672, in llm.c

Noam Chomsky and GPT-3 by Gary Marcus

Papers

• Radford2018improving - GPT1

Explanation

• But what is a GPT? Visual intro to transformers | Chapter 5, Deep Learning by 3Blue1Brown

Apps built on GPT models

Obsidian

• Smart Chat

Browser

• https://www.editgpt.app/

Editor

• https://www.cursor.so

Capacity

Science

• ChatGPT for (Finance) research: The Bananarama Conjecture

Digital humanities

• Using GPT-4 to measure the passage of time in fiction by Ted Underwood

# From Scratch - https://github.com/karpathy/minGPT -> https://github.com/karpathy/nanoGPT - https://github.com/jingyaogong/minimind -