Information Theory & Coding Theory: Global Cross-Cultural Milestones
Encyclopedia/1. The Cosmos & The Natural World/1. Mathematics & Formal Systems • Curated by Admin Timeline.sg
This timeline traces the global cross-cultural evolution of information theory and coding theory, from ancient signal systems to modern digital communication, highlighting contributions from diverse civilizations.
Chronological Storyline (44 Milestones)
500 BCE
Greek Hydraulic Telegraph
Aeneas Tacticus describes a hydraulic semaphore system using water levels to transmit pre-arranged messages, an early form of discrete signaling. #communication #ancienttech
Greek Hydraulic Telegraph By Original relief: unknown; modern photograph of the relief contributed by Demetre Valaris via his website (no copyright applies) - http://www.qsl.net/sv1uy/index.html#hydraulic, Public domain, https://commons.wikimedia.org/w/index.php?curid=17378591
490 BCE
Persian Postal System (Chapar Khaneh)
The Achaemenid Empire establishes a relay postal system using mounted couriers, enabling rapid message transmission across vast distances, a precursor to efficient data relay. #communication #history
350 BCE
Indian Grammarian Panini
Panini's Ashtadhyayi formalizes Sanskrit grammar using metarules and recursion, anticipating concepts of formal languages and information encoding. #linguistics #mathematics
300 BCE
Chinese Smoke Signals
The Great Wall of China uses smoke signals from beacon towers to transmit military alerts, an early binary-like communication system (smoke/no smoke). #communication #ancientchina
Chinese Smoke Signals By Frederic Remington - Photograph of original painting, Public domain, https://commons.wikimedia.org/w/index.php?curid=48222257
60 CE
Hero of Alexandria's Automata
Hero describes programmable automata using strings and pegs, an early concept of stored instructions and sequential control. #engineering #history
Hero of Alexandria's Automata By Unknown author - Historia n° 767 - Novembre 2010 - page, Public domain, https://commons.wikimedia.org/w/index.php?curid=12080168
800 CE
Al-Kindi's Cryptanalysis
Al-Kindi writes 'A Manuscript on Deciphering Cryptographic Messages', introducing frequency analysis and early information-theoretic concepts of redundancy. #cryptography #islamicgoldenage
Al-Kindi's Cryptanalysis By Iraqi Post - Personal collection, Public domain, https://commons.wikimedia.org/w/index.php?curid=91832934
850 CE
Maya Codices and Writing
The Maya develop a complex logographic writing system with phonetic elements, encoding historical and astronomical information in codices. #writing #mayacivilization
Maya Codices and Writing By Unknown author - From http://www.famsi.org/mayawriting/codices/dresden.html, Public domain, https://commons.wikimedia.org/w/index.php?curid=365638
1040 CE
Al-Biruni's Chronology
Al-Biruni's work on calendars and eras involves systematic data collection and error correction, foreshadowing information theory. #science #islamicgoldenage
Al-Biruni's Chronology By The original uploader was Romanm at Slovenian Wikipedia. - Originally from sl.wikipedia; description page is/was here., Public domain, https://commons.wikimedia.org/w/index.php?curid=2590841
1440 CE
Gutenberg's Printing Press
Johannes Gutenberg's movable type printing press enables mass production of texts, dramatically increasing information storage and transmission efficiency. #technology #history
Gutenberg's Printing Press By vlasta2 - Flickr: PrintMus 038, CC BY 2.0, https://commons.wikimedia.org/w/index.php?curid=16412858
1640 CE
Blaise Pascal's Pascaline
Pascal invents a mechanical calculator that performs arithmetic using gears, an early step toward automated information processing. #computing #history
Blaise Pascal's Pascaline By Rama - Own work, CC BY-SA 3.0 fr, https://commons.wikimedia.org/w/index.php?curid=53246694
1679 CE
Leibniz's Binary System
Gottfried Wilhelm Leibniz describes binary arithmetic, linking it to the I Ching's hexagrams, laying groundwork for digital encoding. #mathematics #binary
Leibniz's Binary System By Christoph Bernhard Francke - Herzog Anton Ulrich-Museum, online, Public domain, https://commons.wikimedia.org/w/index.php?curid=53159699
1794 CE
Claude Chappe's Semaphore Line
Chappe demonstrates the first optical telegraph network in France, using coded positions of arms for rapid long-distance communication. #communication #technology
Claude Chappe's Semaphore Line By Lokilech at German Wikipedia - Own work, CC BY-SA 3.0, https://commons.wikimedia.org/w/index.php?curid=784410
1837 CE
Morse Code Telegraph
Samuel Morse and Alfred Vail develop the electric telegraph and Morse code, a variable-length binary code for efficient transmission. #communication #invention
Morse Code Telegraph By Hp.Baumeler - Own work, CC BY-SA 4.0, https://commons.wikimedia.org/w/index.php?curid=61723472
1843 CE
Ada Lovelace's Notes on Analytical Engine
Ada Lovelace writes the first algorithm intended for machine processing, envisioning symbolic manipulation and information processing. #computing #womeninstem
Ada Lovelace's Notes on Analytical Engine By Antoine Claudet - shared by Paul Graham on x.com https://x.com/paulg/status/1927655441913250041, Public domain, https://commons.wikimedia.org/w/index.php?curid=166285599
1854 CE
George Boole's Laws of Thought
Boole publishes 'An Investigation of the Laws of Thought', introducing Boolean algebra, the foundation of digital logic and information encoding. #mathematics #logic
George Boole's Laws of Thought By Unknown author - The Illustrated London News, 21 January 1865, Public domain, https://commons.wikimedia.org/w/index.php?curid=39762976
1874 CE
Émile Baudot's Code
Baudot invents a 5-bit character code for telegraphy, one of the first fixed-length binary codes for text transmission. #communication #coding
Émile Baudot's Code By M. Rothen - Journal telegraphique vol8 N 12 decembre 1884 reprod Eric Fischer History of Character code 1874-1968, Public domain, https://commons.wikimedia.org/w/index.php?curid=16239282
1924 CE
Nyquist's Telegraph Transmission Theory
Harry Nyquist publishes 'Certain Factors Affecting Telegraph Speed', establishing the Nyquist rate for signaling and laying groundwork for information theory. #communication #engineering
1928 CE
Hartley's Information Measure
Ralph Hartley proposes a logarithmic measure of information, introducing the concept of information as a quantifiable quantity. #informationtheory #mathematics
Hartley's Information Measure By This photograph of RVL Hartley was among his personal belongings and is now owned by his nephew (father of English Wikipedia user HenryHartley), RW Hartley who gives permission to place it on Wikipedia under the GFDL. - Old photograph of RVL Hartley uploaded to the English Wikipedia by his grand-nephew, CC BY-SA 3.0, https://commons.wikimedia.org/w/index.php?curid=4153877
1937 CE
Claude Shannon's Master's Thesis
Shannon shows that Boolean algebra can be used to simplify relay circuits, linking logic and information processing. #computing #logic
Claude Shannon's Master's Thesis By Unknown author - Tekniska Museet of Sweden, Item 43069 via Flickr, CC BY 2.0, https://commons.wikimedia.org/w/index.php?curid=190273293
1940 CE
Alan Turing's Bombe
Turing designs the Bombe to decrypt Enigma messages, applying statistical analysis and early information-theoretic concepts. #cryptography #wwii
Alan Turing's Bombe By Unknown author - Set of wartime photos of GC&CS at Bletchley Park, Public domain, https://commons.wikimedia.org/w/index.php?curid=72819587
Jul 1, 1948 CE
Shannon's 'A Mathematical Theory of Communication'
Claude Shannon publishes his seminal paper, founding information theory with concepts of entropy, channel capacity, and source coding. #informationtheory #mathematics
Shannon's 'A Mathematical Theory of Communication' By Claude E. Shannon and Warren Weaver - https://archive.org/details/in.ernet.dli.2015.503815/page/n5/mode/2up, Public domain, https://commons.wikimedia.org/w/index.php?curid=171159167
1949 CE
Shannon's Communication Theory of Secrecy Systems
Shannon applies information theory to cryptography, establishing theoretical foundations for secure communication. #cryptography #informationtheory
1950 CE
Richard Hamming's Error-Correcting Codes
Hamming invents the Hamming(7,4) code, introducing error detection and correction for reliable digital communication. #codingtheory #mathematics
Richard Hamming's Error-Correcting Codes By User:Cburnett - Own work, CC BY-SA 3.0, https://commons.wikimedia.org/w/index.php?curid=1511411
1951 CE
Marcel Golay's Binary Codes
Golay publishes the Golay codes, perfect error-correcting codes used in deep-space communications. #codingtheory #mathematics
1952 CE
Huffman Coding
David Huffman develops the optimal prefix code for lossless data compression, widely used in file formats. #datacompression #codingtheory
Huffman Coding By Meteficha - Own work, Public domain, https://commons.wikimedia.org/w/index.php?curid=2875155
1954 CE
Irving Reed and Gustave Solomon's Reed-Solomon Codes
Reed and Solomon introduce non-binary error-correcting codes, essential for CDs, QR codes, and satellite communication. #codingtheory #mathematics
1955 CE
Peter Elias's Convolutional Codes
Elias introduces convolutional codes, a class of error-correcting codes using sliding windows, later used in deep-space and mobile communications. #codingtheory #mathematics
1959 CE
Shannon's Rate-Distortion Theory
Shannon publishes rate-distortion theory, addressing lossy compression and the trade-off between rate and distortion. #informationtheory #datacompression
1960 CE
Bose–Chaudhuri–Hocquenghem (BCH) Codes
Bose, Ray-Chaudhuri, and Hocquenghem independently discover BCH codes, a class of cyclic error-correcting codes. #codingtheory #mathematics
1961 CE
Kolmogorov Complexity Introduced
Andrey Kolmogorov, Ray Solomonoff, and Gregory Chaitin independently develop algorithmic information theory, measuring complexity via shortest program length. #informationtheory #mathematics
Kolmogorov Complexity Introduced By Reguiieee at English Wikipedia - Own work Color adjusted from en:Image:Mandelpart2.png to provide a likeness to Image:Mandelpart2.jpg. Created with Fractal Forge 2.8.2; modified by Adobe Photoshop 7.0, Public domain, https://commons.wikimedia.org/w/index.php?curid=13441999
1965 CE
Lempel–Ziv Compression
Abraham Lempel and Jacob Ziv publish LZ77, a universal lossless compression algorithm, foundational for formats like ZIP and PNG. #datacompression #codingtheory
1968 CE
Viterbi Algorithm
Andrew Viterbi develops the Viterbi algorithm for decoding convolutional codes, widely used in digital communications and speech recognition. #codingtheory #algorithms
1970 CE
Berlekamp–Massey Algorithm
Elwyn Berlekamp and James Massey develop an algorithm for decoding BCH and Reed-Solomon codes, crucial for error correction in storage and communication. #codingtheory #algorithms
Berlekamp–Massey Algorithm By Aats1988 - Own work, Public domain, https://commons.wikimedia.org/w/index.php?curid=9030345
Dave Forney introduces concatenated codes, combining inner and outer codes to approach channel capacity, later inspiring turbo codes. #codingtheory #mathematics
1977 CE
RSA Cryptography
Rivest, Shamir, and Adleman introduce RSA public-key cryptography, relying on number theory and information-theoretic security. #cryptography #security )
1984 CE
Shannon's Death and Legacy
Claude Shannon dies, leaving a profound legacy in information theory, coding, and digital circuit design. #informationtheory #history
LDPC codes, originally invented by Gallager in 1960, are rediscovered and shown to approach channel capacity, used in Wi-Fi and DVB. #codingtheory #communication
2001 CE
Network Information Theory: Ahlswede–Körner–Wyner
Key contributions to network information theory, including the Ahlswede–Körner–Wyner problem, extend Shannon's work to multi-user networks. #informationtheory #networking
2003 CE
Polar Codes Introduced
Erdal Arıkan introduces polar codes, the first provably capacity-achieving codes with low complexity, adopted for 5G. #codingtheory #mathematics )
2006 CE
Compressed Sensing Theory
Donoho, Candès, Romberg, and Tao develop compressed sensing, allowing signal recovery from fewer samples than Nyquist rate, with information-theoretic implications. #signalprocessing #informationtheory
2010 CE
Quantum Information Theory Advances
Quantum information theory matures with concepts like quantum entropy and channel capacity, extending Shannon's ideas to quantum systems. #quantum #informationtheory
2016 CE
Deep Learning for Channel Coding
Researchers apply deep neural networks to learn encoding and decoding schemes, achieving competitive performance with traditional codes. #machinelearning #codingtheory
Deep Learning for Channel Coding By Sven Behnke - Own work, CC BY-SA 4.0, https://commons.wikimedia.org/w/index.php?curid=82466022
2020 CE
5G NR Standard Adopts LDPC and Polar Codes
The 5G New Radio standard uses LDPC codes for data and polar codes for control channels, showcasing modern coding theory in global telecommunications. #telecom #codingtheory