• We’ve worked with writers to publish 17 articles in our magazine
• We’ve released 26 editions of our Update newsletter
• We’ve released 51 episodes of The Gradient Podcast

Magazine

• Petar Veličković’s overview article on Neural Algorithmic reasoning.
• Kenneth Li’s article on OthelloGPT, exploring whether large language models merely memorize training data, or whether they build internal world models.
• Arjun Ramani and Zhengdong Wang’s collection of technical, social, and economic arguments that the path to transformative AI is not straightforward.

Newsletter

• Our Update #49 covering fundamental limitations of alignment in LLMs, and regulatory divergence.
• Our Update #52, discussing the ironies in pausing AI and fine-tuning LLMs without backpropagation.
• Our Update #44, covering challenges for personal robotics and cheap methods for poisoning web-scale datasets.

Podcast

• My conversation with Terry Winograd, a legendary pioneer in artificial intelligence, who built one of the first programs for natural language processing, among many other achievements. This conversation challenged how I think about some of AI’s more fundamental questions, and grounded a number of narratives and debates in AI’s history.
• My conversation with Ken Liu, a brilliant science fiction author who has deeply considered what it is to be a technologist, and the back and forth between the technologies we build and the stories we tell—his science fiction has changed how I think about technology, and this conversation seriously impacted how I think about technology and our collective future.
• My conversation with Sewon Min, a PhD student at the University of Washington whose thoughtful approach to language modeling pushed me to think more deeply about a number of phenomena.
• Bonus (yes, I’m cheating): a review of the year’s AI progress, with Nathan Benaich, whose State of AI Report continues to provide an important service to the community."