Colossus computer

From Wikipedia, the free encyclopedia
Jump to: navigation, search
A Colossus computer as it was during World War II

Colossus was the world's first programmable electronic digital computer.[1] British codebreakers[2] used Colossus to help to read German coded radio messages during World War II.

These messages were sent between the German High Command,[3] and Adolf Hitler's top army commanders. Reading these messages helped the Allies to win the war.

Codebreaker Max Newman worked at the Government Code and Cypher School (GC&CS) at Bletchley Park. His problem was how to get a machine that would help turn German coded radio teleprinter messages into ordinary language. A group of Post Office engineers led by Tommy Flowers worked out how to do this.[4] Their design, which was called "Colossus" used many vacuum tubes (valves). The first machine, Mark 1, worked in December 1943. It solved its first problem at Bletchley Park on 5 February 1944.[5] Colossus Mark 2 was even better. It first worked on 1 June 1944, just before the Normandy Landings on D-Day. Ten Colossus computers were in use at the end of the war.

British codebreakers called the teleprinter messages "Fish". The messages had been coded by an unknown German machine. They called the machine and its coded messages "Tunny".[6] Colossus imitated the machine and read the coded message from a punched tape. It tried various possibilities of how two of the wheels had been set up. When Colossus found likely settings for two wheels, the codebreaker designed further programs for Colossus until likely settings of other wheels were found. Colossus did not perform all of the decoding process. It just found likely settings of the machine. The output from Colossus was then worked on by people who had a very good knowledge of the German language.

Wartime view of Colossus number ten.

It was not until the end of the war that the British codebreakers found out that the code machine was the Lorenz SZ42.[7] After the war all the secret Colossus computers were taken to pieces, so that no one would find out about them. The designs were destroyed. For thirty years no one knew who made the first computers. Between the early 1990s and 2007, a working copy of a Colossus computer was built. This can be seen at The National Museum of Computing at Bletchley Park in Engalnd.

Purpose and origins[change | change source]

Regular radio transmissions of "Tunny" messages started in June 1941. The British codebreakers saw that it used a five-unit code like a teleprinter system.[8] Their research also showed that the coding was being done by a rotor cipher machine with 12 wheels (rotors). For each new message sent, the wheels had first to be turned to different positions from before. This position was called the start position for the message. It was chosen by the operator who was sending the message. He told the operator who was receiving the message what the start positions were with 12 letters that were not coded. The total number of possible start positions of the 12 wheels was very large indeed.

The coding machine added together[9] the plaintext (the un-coded version of the message) and a stream of characters (letters, numbers, punctuation) called the keystream (a stream of seemingly random characters) that it generated to make the ciphertext (the coded version of the message). The ciphertext, which made no sense, was transmitted by radio. At the receiving end an identical machine removed the keystream to produce the plaintext of the message.

If the German operators always worked correctly, no two messages would have the same start position of the wheels. However, mistakes were made. They helped the British codebreakers. On 30 August 1941 two versions of the same message, which was nearly 4,000 characters long, were sent with the same wheel start positions.[10] This mistake was very useful to the research codebreakers. A codebreaker called John Tiltman was able to get the keystream from these messages.

The machine that was code named "Tunny" by the British. The Germans used it to code secret teleprinter communications. It was not seen by the Allies until the end of WWII when they learnt that it was the Lorenz SZ42. It had ten wheels each with a different number of cams. There were a total of 501 cams each of which could be put into the raised (active) position or the lowered (inactive) position.

The codebreakers tried to work out the details of the machine from this information, but at first they failed. They were then joined by a young codebreaker called Bill Tutte who was given the job. After a lot of work he succeeded, and produced a logical description of the unseen machine. This work has been described as "the greatest intellectual achievement of world war II". [11] Tutte worked out that the machine made each keystream character by combining the effects of two sets of five wheels. He used Greek letters to name the wheels. He called one set of five the χ ("chi") wheels, and the other set of five the ψ ("psi") wheels. He worked out that the χ wheels moved on one position for each new character coded. The ψ wheels, however, did not move regularly. They only moved on some of the time. Whether or not the ψ wheels moved on was controlled by two wheels that he called two the μ ("mu") or "motor wheels".

Max Newman was a mathematician and codebreaker at Bletchley Park. He was given the job of working out how a machine could break "Tunny" messages. The machine would do a calculation for many possible start positions of the χ wheels. The start position that gave the largest count from this calculation was likely to be the right one. The first machine was called "Heath Robinson". This did not work very well. It had two punched paper tapes that had to work exactly together. One tape contained the ciphertext in a continuous loop. The second looped tape contained patterns made by the wheels of the coding machine. The tapes would often stretch or break when going at 2000 characters each second. Sometimes the tapes would not line up; then the counts were wrong.

Building Colossus[change | change source]

Tommy Flowers worked at the Post Office Research Station at Dollis Hill in north-west London. He was asked to look at the Heath Robinson machine. He thought it was a weak machine. He designed an electronic machine to do the same job. It would make the patterns of the coding machine by electronics so that only one paper tape was needed. In February 1943 he showed Max Newman this design. The design needed 1,500 thermionic valves (vacuum tubes). Few people thought that so many valves could work without a lot failing. More Heath Robinson machines were ordered. Flowers, however, kept with the idea of an electronic machine. He got support from the person in charge of the Post Office Research Station who was called Gordon Radley. Tommy Flowers and his team started work on Colossus in February 1943.

The tape with the message on it had to be read at speed. Tommy Flowers tested the tape reader up to 9,700 letters/second (53 mph (85 km/h)) before the tape broke. He selected 5,000 characters each second as a good speed for regular work. This meant that the paper tape moved at 40 ft/s (12 m/s) or 27.3 mph (43.9 km/h). The electronic circuits were driven by a signal made from reading the sprocket holes of the punched tape.

The first Colossus worked at Dollis Hill in December 1943. Then they took Colossus apart and moved it to Bletchley Park. It got there on 18 January 1944. Harry Fensom and Don Horwood put it back together.[12] Colossus read its first message on 5 February.[13] After the first Colossus (Mark 1) there were nine Mark 2 machines. These each had 2,400 valves. They were easier too use. They could be programmed to work at five times the speed of the Mark 1. A Mark 2 Colossus fist worked on 1 June 1944.

At first Colossus was only used to find the starting wheel places used for a message (called wheel setting). Codebreakers worked out how to use the Mark 2 to help find the patterns of the cams on the wheels (wheel breaking). At the end of the war there were ten Colossus computers working at Bletchley Park. This meant that very many messages were decoded.

Design and use[change | change source]

Colossus used electronics that were new back then. It used vacuum tubes (also called thermionic valves), thyratrons and photomultipliers. It read a paper tape with light. It then used a programmable logical function on every letter. It counted how often this function was "true". Machines with many valves were known to break a lot. They break most when turning on, so the Colossus machines were only turned off[13] when a part broke.

Colossus was the first of the electronic digital machines that could have a program. It could not change as much as in later machines:[14]

  • it had no program inside itself. A person used plugs, wires and switches to change the program. This is how it was set it up for a new task.
  • Colossus was not a general-purpose machine. It was designed for only one code breaking task. That task was counting and Boolean operations.

It was not a general Turing-complete computer, even though Alan Turing was at Bletchley Park. This idea had not yet been invented, and most of the other early modern computing machines were not Turing-complete (for example: the Atanasoff–Berry Computer, the Harvard Mark I electro-mechanical relay machine, the Bell Labs relay machines by George Stibitz and others, or the first designs of Konrad Zuse). The idea of a computer as a general purpose machine—that is, as more than a calculator only for the solution of one hard problem—did not become common for many years.

Influence and fate[change | change source]

What the Colossus computers were used for was very secret. The Colossus itself was highly secret even for many years after the War. This is why Colossus could not be included in the history of computing hardware for a long time. Nobody knew how important that Flowers and the other people who helped make it were.

Not many people knew about this secret computer, so it had little direct effect on the new design of later computers; EDVAC was the early design which had the most effect on later computer design.

Once Colossus was made, some people now knew that high-speed electronic (no moving parts like electrical relays) digital computing devices could be made and they did not break too much. Just this knowledge was enough to have a big effect on the designs of early computers in Britain and probably in the US. People who knew about Colossus were important in the early computer field in Britain. In 1972, Herman Goldstine wrote that:

Britain had such vitality (energy or drive) that it could right after the war start so many well-planned and well-done projects in the computer field.[15]

In writing that, Goldstine did not know of Colossus. He did not know what it left to projects of people who knew about it. People such as Alan Turing (with the Pilot ACE and ACE), and Max Newman and I. J. Good (with the Manchester Mark 1 and other early Manchester computers). Brian Randell later wrote that:

the COLOSSUS project was an important source of this vitality (energy or drive), one that has not been well understood or known, as has the importance of its places in the time line of the invention of the digital computer.[16]

Colossus plans and machinery were secret from the when they were made. They stayed so after the War, when Winston Churchill ordered the destruction of most of the Colossus machines into "parts no bigger than a man's hand"; Tommy Flowers himself burned the designs in a fireplace at Dollis Hill. Some parts, changed to look innocent, were taken to Newman's Royal Society Computing Machine Laboratory at Manchester University.[17] The Colossus Mark 1 was taken apart and the parts were sent back to the Post Office. Two Colossus computers, along with two copied Tunny machines, were kept. They were moved to GCHQ's new head office at Eastcote in April 1946. They moved again with GCHQ to Cheltenham between 1952 and 1954.[18] One of the computers, known as Colossus Blue, was taken apart in 1959; the other in 1960.[18] In their later years, the computers were used for training. Before that, there had been attempts to change them (sometimes well) for other purposes.[19] Jack Good was the first to use it after the war, getting NSA to use Colossus to do something for which they were planning to build a special purpose machine.[18] Colossus was also used to perform letter counts on one-time pad tape to test for non-randomness.[18]

At this time the Colossus was still secret, long after any of its technical details were of any importance. This was due to the UK's intelligence agencies use of Enigma-like machines which they got other governments to buy. The agencies then broke the codes using different ways. Had the knowledge of the codebreaking machines been widely known, no one would have accepted these machines; rather, they would have developed their own methods for encryption, methods that the UK services might not have been able to break. The need for such secrets slowly went away as communications moved to digital transmission and all-digital encryption systems became common in the 1960s.

Colonel Winterbotham's book The Ultra Secret came out in 1975.[20] This broke the secrecy around the Colossus. After that, details about the computer began to become public in the late 1970s.

A 500-page technical report on the Tunny cipher and its code breaking – entitled General Report on Tunny – was given by GCHQ to the national Public Record Office in October 2000; the complete technical report is online.[21]

Making it again[change | change source]

In 2006, Tony Sale (right) is in charge. They are breaking an enciphered message with the completed machine. Since 1994 his team has been building a new Colossus computer at Bletchley Park.

A team led by Tony Sale built a working copy[22] of a Colossus Mark 2. The plans and machines had been destroyed, but a surprising amount of other material was not destroyed. It was mostly in engineers' notebooks, much of it in the U.S. The optical tape reader might have been the biggest problem, but Dr. Arnold Lynch, its designer, was able to redesign it from his own first writings. The rebuilt Colossus is on show at The National Museum of Computing, in H Block Bletchley Park in Milton Keynes, Buckinghamshire. This is where the Colossus No. 9 was used in the war.

In November 2007, to mark both the end of the work and the start of fundraising (asking for money) they ran a competition. The money would help The National Museum of Computing with a Cipher Competition[23] where the rebuilt Colossus competed with radio amateurs all around the world. The first to hear and decode three messages enciphered would win. They would be enciphered using the Lorenz SZ42 and transmitted from the radio station in the Heinz Nixdorf MuseumsForum computer museum in Germany. The competition was easily won by radio amateur Joachim Schüth. Schüth had gotten ready[24] for the event. He made his own signal processing and code-breaking program using Ada.[25] The Colossus team lost because they wanted to use World War II radios,.[26] They were a day late because of bad radio conditions. The winner's 1.4 GHz laptop, running his own program, took less than a minute to find the settings for all 12 wheels. The German codebreaker said: "My laptop worked on ciphertext at a speed of 1.2 million letters per second—240x faster than Colossus. If you compare the two computers, you could say Colossus had a speed of 5.8 MHz. That is very fast for a computer built in 1944."[27]

Other pages[change | change source]

References[change | change source]

  1. Copeland 2006, Copeland, Jack, Introduction p. 2.
  2. Codbreakers are people who work out how the meaning of some writing has been hidden. If they succeed, the meaning can be found. Another name for codebreaker is "cryptanalyst".
  3. German: Oberkommando der Wehrmacht (OKW)
  4. Flowers 1983, p. 244.
  5. Copeland 2006, Copeland, Jack, Machine against Machine p. 75.
  6. Good, Michie & Timms 1945, 1 Introduction: 11 German Tunny, 11A Fish Machines, (c) The German Ciphered Teleprinter, p. 4.
  7. Good 1993, pp. 162,163.
  8. Good, Michie & Timms 1945, 41 The First Break 41A Early Traffic Analysis (a) A first analysis, p. 297.
  9. The type of addition was "modulo 2" which is the same as the Boolean Exclusive Or (XOR) function.
  10. Good, Michie & Timms 1945, 41 The First Break 41C A Depth Read (b) The depth "HQIBPEXEZMUG", p. 298.
  11. O'Connor, J J; Robertson, E F (2003), MacTutor Biography: William Thomas Tutte, University of St Andrews, http://www-history.mcs.st-and.ac.uk/Biographies/Tutte.html, retrieved 28 April 2013
  12. The Colossus Rebuild http://www.tnmoc.org/colossus-rebuild.aspx
  13. 13.0 13.1 Jack Copeland, "Machine against Machine", p. 75 (entire article pp. 64-77) in B. Jack Copeland, ed., Colossus: The Secrets of Bletchley Park's Codebreaking Computers, Oxford University Press, 2006
  14. A Brief History of Computing. Jack Copeland, June 2000
  15. The Computer from Pascal to von Neuman (pp. 321)
  16. B. Randell, "The Colossus", in A History of Computing in the Twentieth Century (N. Metropolis, J. Howlett and G. C. Rota, Eds.), pp.47-92, Academic Press, New York, 1980., p. 87
  17. "A Brief History of Computing". alanturing.net. http://www.alanturing.net/turing_archive/pages/Reference%20Articles/BriefHistofComp.html#ACE. Retrieved 2010-01-26.
  18. 18.0 18.1 18.2 18.3 Copeland, 2006, p. 173-175
  19. Horwood, 1973
  20. Winterbotham, Frederick William (15 November 1975). The Ultra Secret. New York: Harper and Row. ISBN 978-0440190615.
  21. Good, Michie & Timms 1945.
  22. Sale, Tony. "The Colossus Rebuild Project". http://www.codesandciphers.org.uk/lorenz/rebuild.htm. Retrieved 30 October 2011.
  23. "Cipher Challenge". Archived from the original on August 1, 2008. http://web.archive.org/web/20080801175842/http://www.tnmoc.org/cipher1.htm. Retrieved February 1, 2012.
  24. "SZ42 Codebreaking Software". http://www.schlaupelz.de/SZ42/SZ42_software.html.
  25. "Cracking the Lorenz Code (interview with Schüth)". http://www.adacore.com/home/ada_answers/lorenz-code/.
  26. Ward, Mark (16 November 2007). "BBC News Article". http://news.bbc.co.uk/1/hi/technology/7098005.stm. Retrieved 2 January 2010.
  27. "German Codebreaker receives Bletchley Park Honours". http://www.bletchleypark.org.uk/news/docview.rhtm/487682.

Further reading[change | change source]

  • Harvey G. Cragon, From Fish to Colossus: How the German Lorenz Cipher was Broken at Bletchley Park (Cragon Books, Dallas, 2003; ISBN 0-9743045-0-6) – A detailed description of the cryptanalysis of Tunny, and some details of Colossus (contains some minor errors)
  • Ted Enever, Britain's Best Kept Secret: Ultra's Base at Bletchley Park (Sutton Publishing, Gloucestershire, 1999; ISBN 0-7509-2355-5) – A guided tour of the history and geography of the Park, written by one of the founder members of the Bletchley Park Trust
  • Tony Sale, The Colossus Computer 1943–1996: How It Helped to Break the German Lorenz Cipher in WWII (M.&M. Baldwin, Kidderminster, 2004; ISBN 0-947712-36-4) – A slender (20 page) booklet, containing the same material as Tony Sale's website (see below)
  • Michael Smith, Station X, 1998. ISBN 0-330-41929-3.
  • Gannon, Paul (2007), Colossus: Bletchley Park's Greatest Secret, Atlantic Books, ISBN 978 1843543312
  • Jack Copeland: Colossus. The Secrets of Bletchley Park's Codebreaking Computers. Oxford University Press 2006. ISBN 0-19-284055-X
  • R. Rojas, U. Hashagen (eds.): The First Computers: History and Architectures. MIT Press 2000. ISBN 0-262-18197-5. – Comparison of the first computers, with a chapter about Colossus and its reconstruction by Tony Sale.

Other websites[change | change source]