article thumbnail

What Builders Talk About When They Talk About AI

Andreessen Horowitz

While a lot of the focus today is on the development of foundational large language models (LLMs) , the transformer architecture was invented only 6 years ago, and ChatGPT was released less than a year ago. The microchip was invented in 1958, but it took almost 50 years for us to get the iPhone. Noam Shazeer, Character.AI

article thumbnail

Improving AI

Andreessen Horowitz

Anj: What was it at that moment—when you and the team at OpenAI had started publishing your first experiments towards the end of that 5-year period—you just talked about around scaling laws that gave you so much confidence that this was going to hold when everybody else thought that was crazy talk? It’s just a matter of time.

AI Search 121