Supercomputing & AI: From Dartmouth Workshop to Deep Learning & LLMs
Encyclopedia/2. Technology & The Built World/1. Computing, AI & Information Technology/02. Supercomputing & Artificial Intelligence • Curated by Admin Timeline.sg
The evolution of machine intelligence from the Dartmouth Conference to modern deep learning and large language models, encompassing supercomputing milestones and AI breakthroughs.
Chronological Storyline (42 Milestones)
1950 CE
Turing Test Proposed
Alan Turing publishes 'Computing Machinery and Intelligence', proposing the Turing Test as a measure of machine intelligence. #AI #history
Turing Test Proposed By Juan Alberto Sánchez Margallo - File:Test_de_Turing.jpg, CC BY 2.5, https://commons.wikimedia.org/w/index.php?curid=57298943
Jun 1, 1956 CE
Dartmouth Conference
The Dartmouth Summer Research Project on Artificial Intelligence coins the term 'artificial intelligence', marking the birth of AI as a field. #AI #history
1957 CE
Perceptron Model
Frank Rosenblatt introduces the Perceptron, an early neural network capable of simple pattern recognition. #AI #neuralnetworks
1958 CE
LISP Programming Language
John McCarthy creates LISP, the first programming language designed for AI research, becoming a standard tool for decades. #AI #programming )
1964 CE
CDC 6600 Supercomputer
Seymour Cray's CDC 6600 is released as the first successful supercomputer, offering unprecedented processing speed. #supercomputing #history
CDC 6600 Supercomputer By FlyAkwa - Own work Data & Pictures : Science Museum Data & Pictures : Computer History Museum Data : CYBER 170 Systems Hardware Handbook Aug 75 Pictures : Histoire de l'Informatique, CC BY-SA 4.0, https://commons.wikimedia.org/w/index.php?curid=70665171
1966 CE
Shakey the Robot
SRI International develops Shakey, the first mobile robot capable of reasoning about its actions, integrating AI and robotics. #AI #robotics
Shakey the Robot By The wub - Own work, CC BY-SA 4.0, https://commons.wikimedia.org/w/index.php?curid=158377025
1969 CE
Minsky and Papert's Perceptrons
Marvin Minsky and Seymour Papert publish 'Perceptrons', highlighting limitations of single-layer networks, contributing to the first AI winter. #AI #history )
1970 CE
Backpropagation Derived
Seppo Linnainmaa describes reverse-mode automatic differentiation, later used for backpropagation in neural networks. #AI #neuralnetworks
1975 CE
Cray-1 Supercomputer
The Cray-1 is released as the fastest supercomputer, using vector processing to revolutionize scientific computing. #supercomputing #history
Cray-1 Supercomputer By Irid Escent - 20180227_132902, CC BY-SA 2.0, https://commons.wikimedia.org/w/index.php?curid=85791445
1979 CE
Stanford Cart Autonomous Navigation
Hans Moravec's Stanford Cart successfully navigates a room autonomously, demonstrating early computer vision and control. #AI #robotics
1980 CE
XCON Expert System
Digital Equipment Corporation deploys XCON, an expert system that configures computer systems, showing commercial viability of AI. #AI #expert systems
1982 CE
Fifth Generation Computer Project
Japan launches the Fifth Generation Computer Systems project, aiming to create AI-driven computers, spurring global competition. #AI #supercomputing #history
1986 CE
Backpropagation Rediscovered
Rumelhart, Hinton, and Williams popularize backpropagation in multi-layer perceptrons, reigniting neural network research. #AI #neuralnetworks
1987 CE
Connectionist AI Conference
The first Connectionist Models Summer School at Carnegie Mellon boosts interest in neural networks and parallel distributed processing. #AI #history
Connectionist AI Conference By en:User:Cburnett - Own work This W3C-unspecified vector image was created with Inkscape ., CC BY-SA 3.0, https://commons.wikimedia.org/w/index.php?curid=1496812
1993 CE
Intel ASCI Red Supercomputer
The ASCI Red supercomputer achieves one teraflop, marking the first teraflop-scale system for nuclear simulations. #supercomputing #history
Intel ASCI Red Supercomputer By Sandia National Laboratories - https://web.archive.org/web/19990202210213/http://www.sandia.gov/ASCI/images/RedPictures.htm, Public domain, https://commons.wikimedia.org/w/index.php?curid=28171282
1995 CE
Java Programming Language
Sun Microsystems releases Java, an object-oriented language that becomes crucial for internet and enterprise applications. #programming #history )
May 11, 1997 CE
Deep Blue Beats Kasparov
IBM's Deep Blue supercomputer defeats world chess champion Garry Kasparov, a milestone in AI and supercomputing. #AI #supercomputing )
Deep Blue Beats Kasparov By James the photographer - https://www.flickr.com/photos/22453761@N00/592436598/, CC BY 2.0, https://commons.wikimedia.org/w/index.php?curid=3511068
1998 CE
MNIST Dataset Released
Yann LeCun releases the MNIST database of handwritten digits, becoming a benchmark for image recognition and machine learning. #AI #machinelearning
MNIST Dataset Released By Suvanjanprasai - Own work, CC BY-SA 4.0, https://commons.wikimedia.org/w/index.php?curid=156115980
2002 CE
Earth Simulator Supercomputer
NEC's Earth Simulator in Japan becomes the fastest supercomputer, used for climate simulations, showcasing vector processing. #supercomputing #history
2004 CE
IBM Blue Gene Project
IBM launches Blue Gene, a massively parallel supercomputer architecture focused on protein folding and bioinformatics. #supercomputing #history
IBM Blue Gene Project By Argonne National Laboratory's Flickr page - originally posted to Flickr as Blue Gene / P From Argonne National Laboratory Uploaded using F2ComButton, CC BY-SA 2.0, https://commons.wikimedia.org/w/index.php?curid=6412306
2006 CE
Deep Belief Networks
Geoffrey Hinton introduces deep belief networks, restarting deep learning research and leading to breakthroughs in AI. #AI #deeplearning
Deep Belief Networks By Qwertyus - Own work, CC0, https://commons.wikimedia.org/w/index.php?curid=30324766
2008 CE
IBM Roadrunner Petaflop Supercomputer
IBM's Roadrunner becomes the first supercomputer to achieve a petaflop (10^15 operations per second), using hybrid CPU-GPU architecture. #supercomputing #history
IBM Roadrunner Petaflop Supercomputer By LeRoy N. Sanchez, Records Management/Media Services and Operations - http://www.lanl.gov/news/albums/computer/Roadrunner_1207.jpg, Attribution, https://commons.wikimedia.org/w/index.php?curid=4197014
2009 CE
ImageNet Dataset Released
Fei-Fei Li releases ImageNet, a large-scale visual database that accelerates computer vision research and deep learning. #AI #computervision
Oct 1, 2010 CE
Tianhe-1A Supercomputer
China's Tianhe-1A becomes the world's fastest supercomputer at 2.5 petaflops, marking China's rise in supercomputing. #supercomputing #history
Tianhe-1A Supercomputer By Nakrut - Own work, CC BY-SA 4.0, https://commons.wikimedia.org/w/index.php?curid=61056973
Feb 14, 2011 CE
IBM Watson Wins Jeopardy!
IBM's Watson AI defeats human champions on the quiz show Jeopardy!, demonstrating natural language processing and question answering. #AI #NLP
IBM Watson Wins Jeopardy! By Clockready - Own work, CC BY-SA 3.0, https://commons.wikimedia.org/w/index.php?curid=15891787
Sep 30, 2012 CE
AlexNet Wins ImageNet
Alex Krizhevsky, Ilya Sutskever, and Geoffrey Hinton's AlexNet uses GPUs to achieve a dramatic improvement in image classification, sparking the deep learning revolution. #AI #deeplearning
AlexNet Wins ImageNet By Zhang, Aston and Lipton, Zachary C. and Li, Mu and Smola, Alexander J. - https://github.com/d2l-ai/d2l-en, CC BY-SA 4.0, https://commons.wikimedia.org/w/index.php?curid=152265712
2013 CE
Word2Vec Released
Google's Tomas Mikolov introduces Word2Vec, a neural network model for learning word embeddings, revolutionizing natural language processing. #AI #NLP
Jun 1, 2014 CE
Generative Adversarial Networks
Ian Goodfellow proposes GANs, a framework where two neural networks compete, leading to breakthroughs in image generation. #AI #generative
Generative Adversarial Networks By Zhang, Aston and Lipton, Zachary C. and Li, Mu and Smola, Alexander J. - https://github.com/d2l-ai/d2l-en, CC BY-SA 4.0, https://commons.wikimedia.org/w/index.php?curid=152265649
Nov 9, 2015 CE
TensorFlow Open-Sourced
Google releases TensorFlow, an open-source machine learning library, accelerating AI research and development worldwide. #AI #deeplearning #opensource
TensorFlow Open-Sourced By Google LLC - https://www.tensorflow.org/extras/tensorflow_brand_guidelines.pdf, Public domain, https://commons.wikimedia.org/w/index.php?curid=113524128
Mar 15, 2016 CE
AlphaGo Beats Lee Sedol
Google DeepMind's AlphaGo defeats world champion Go player Lee Sedol, a landmark achievement in AI and reinforcement learning. #AI #deeplearning
Jun 20, 2016 CE
Sunway TaihuLight Supercomputer
China's Sunway TaihuLight, with over 93 petaflops, becomes the world's fastest supercomputer, using indigenous processors. #supercomputing #history
Sunway TaihuLight Supercomputer By 懒懒的天 - Own work, CC BY-SA 4.0, https://commons.wikimedia.org/w/index.php?curid=156046437
Jun 12, 2017 CE
Transformer Architecture
Vaswani et al. publish 'Attention is All You Need', introducing the Transformer model, the foundation of modern LLMs. #AI #deeplearning #NLP )
Transformer Architecture By dvgodoy - https://github.com/dvgodoy/dl-visuals/?tab=readme-ov-file, CC BY 4.0, https://commons.wikimedia.org/w/index.php?curid=151216016
Jun 1, 2018 CE
IBM Summit Supercomputer
IBM's Summit becomes the world's fastest supercomputer at 200 petaflops, designed for AI and scientific research. #supercomputing #history )
IBM Summit Supercomputer By Carlos Jones/ORNL - flickr, CC BY 2.0, https://commons.wikimedia.org/w/index.php?curid=73905694
Jun 1, 2018 CE
OpenAI GPT-1
OpenAI introduces the Generative Pre-trained Transformer (GPT-1), showing the power of unsupervised pre-training for language tasks. #AI #NLP
OpenAI GPT-1 By Original: Marxav, Vectorization: Mrmw - Own work based on: Full GPT architecture.png:, CC0, https://commons.wikimedia.org/w/index.php?curid=146645810
Jun 1, 2018 CE
BERT from Google
Google releases BERT, a bidirectional transformer model that achieves state-of-the-art results on numerous NLP tasks. #AI #NLP )
Feb 14, 2019 CE
OpenAI GPT-2 Released
OpenAI debuts GPT-2, a large language model with 1.5 billion parameters, initially withheld due to concerns about misuse. #AI #NLP
OpenAI GPT-2 Released By Unknown author, Public domain, https://commons.wikimedia.org/w/index.php?curid=95884801
Jun 11, 2020 CE
OpenAI GPT-3
OpenAI releases GPT-3 with 175 billion parameters, demonstrating few-shot learning and generating human-like text. #AI #NLP
Jun 11, 2020 CE
Fugaku Supercomputer
Japan's Fugaku becomes the world's fastest supercomputer, with over 442 petaflops, used for COVID-19 research and simulations. #supercomputing #history )
Fugaku Supercomputer By 文部科学省 - https://www.mext.go.jp/b_menu/activity/detail/2020/20200809.html, CC BY 4.0, https://commons.wikimedia.org/w/index.php?curid=145131821
Jan 5, 2021 CE
DALL-E by OpenAI
OpenAI announces DALL-E, a transformer model generating images from text descriptions, advancing multimodal AI. #AI #generative
DALL-E by OpenAI By DALL·E 2 - https://cdn.openai.com/dall-e-2/demos/text2im/teddy_bears/ai_research/underwater/4.jpg, Public domain, https://commons.wikimedia.org/w/index.php?curid=120317263
Nov 30, 2022 CE
ChatGPT Launched
OpenAI releases ChatGPT, a conversational AI based on GPT-3.5, rapidly gaining widespread adoption and sparking the LLM boom. #AI #chatbot
ChatGPT Launched By OpenAI - This file was derived from: OpenAI logo 2025.svg, Public domain, https://commons.wikimedia.org/w/index.php?curid=159145630
Feb 24, 2023 CE
LLaMA Open-Source LLM
Meta releases LLaMA, a collection of open-source large language models, democratizing access to LLMs. #AI #opensource
LLaMA Open-Source LLM By Software: Meta AI Screenshot: VulcanSphere - Self-taken; derivative work from https://www.meta.ai/, Public domain, https://commons.wikimedia.org/w/index.php?curid=156628621
Mar 14, 2023 CE
GPT-4 Released
OpenAI launches GPT-4, a multimodal large language model with improved reasoning and creativity, raising AI capabilities further. #AI #LLM