nav search
Data Center Software Security Transformation DevOps Business Personal Tech Science Emergent Tech Bootnotes BOFH

Global spy system ECHELON confirmed at last – by leaked Snowden files

Origins of automated surveillance

By Duncan Campbell, 3 Aug 2015

Special Report Duncan Campbell has spent decades unmasking Britain's super-secretive GCHQ, its spying programmes, and its cosy relationship with America's NSA. Today, he retells his life's work exposing the government's over-reaching surveillance, and reveals documents from the leaked Snowden files confirming the history of the fearsome ECHELON intercept project. This story is also published simultaneously today by The Intercept. Duncan's Register Christmas Lecture from last year is also, at long last, now available for viewing. In it, he tells the same fascinating story.

Update: Since this piece was published the Intercept have been in touch to say that it is "deceptive" of the Register to suggest that this is a "joint publication". We're very happy to confirm that there has never been any editorial collaboration between the Register and the Intercept.

I stepped from the warmth of our source's London flat. That February night in 1977, the air was damp and cool; the buzz of traffic muted in this leafy north London suburb, in the shadow of the iconic Alexandra Palace.

A fellow journalist and I had just spent three hours inside, drinking Chianti and talking about secret surveillance with our source, and now we stood on the doorstep discussing how to get back to the south coast town where I lived.

Events were about to take me on a different journey. Behind me, sharp footfalls broke the stillness. A squad was running, hard, toward the porch of the house we had left. Suited men surrounded us. A burly middle-aged cop held up his police ID. We had broken "Section 2" of Britain's secrecy law, he claimed.

These were Special Branch, the then-elite security division of the British police.

For a split second, I thought this was a hustle. I knew that a parliamentary commission had released a report five years earlier that concluded that the secrecy law, first enacted a century ago, should be changed. I pulled out my journalist identification card, ready to ask them to respect the press. But they already knew that my companion that evening, Time Out reporter Crispin Aubrey, and I were journalists. And they had been outside, watching our entire meeting with former British Army Signal Intelligence (SIGINT) operator John Berry, who at the time was a social worker.

Aubrey and I were arrested on suspicion of possessing unauthorized information. They said we'd be taken to the local police station. But after being forced into cars, we were driven in the wrong direction, towards the center of London. I became uneasy.

From left, journalists Duncan Campbell and John Crispin Aubrey, with former SIGINT operator John Berry in 1978
(Source: ANL/Re/REX Shutterstock)

It was soon apparent that the elite squad had no idea where the local police station was. They stopped and asked a taxi to lead them there. We were then locked up overnight, denied bail, and sent to London’s Brixton prison.

Aubrey had recorded our interview. During three hours of tapes that the cops took from Aubrey, Berry had revealed spying on Western allies. When the tape was transcribed, every page was stamped "SECRET" in red, top and bottom. Then, with a red felt-tip pen, "Top" was methodically written in front of each "SECRET."

Our discussion was considered so dangerous that we – two reporters and one social worker – were placed in the top floor of the prison maximum security wing, which guards told us had formerly held terrorists, serial murderers, gang leaders and child rapists.

Meanwhile, police stripped my home of every file, every piece of paper I had, and 400 books.

Our case became known as "ABC", named after our surnames Aubrey, Berry and Campbell. We hoped it would end quickly. We knew that the senior minister responsible, Home Secretary Merlyn Rees, had announced three months before that the “mere receipt of unauthorized information should no longer be an offense.”

The day after we were arrested, I was told he was furious to be woken with news that the security agencies had delivered a fait accompli.

Historian Richard Aldrich said the head of MI5 – Britain's Security Service – considered me the person of the greatest interest to see incarcerated.

In 40 years of reporting on mass surveillance, I have been raided three times, jailed once, had television programmes I made or assisted making banned from airing under government pressure five times, seen tapes seized, faced being shoved out of a helicopter, had my phone tapped for at least a decade, and — following my 1977 arrest — faced 30 years' imprisonment for alleged violations of secrecy laws.

And why do I keep going? Because from the beginning, my investigations revealed a once-unimaginable scope of governmental surveillance, collusion and concealment by the British and US governments – and practices that were always as much about domestic spying during times of peace as they were about keeping citizens safe from supposed foreign enemies, thus giving the British government the potential power to become, as our source that night had put it, a virtual “police state.”

Cuffed and booked ... The charges against Aubrey, Berry
and Campbell in the "ABC" trial (click to enlarge)

A decade later, in a parliamentary debate, Foreign Secretary David Owen revealed that he was initially against our being prosecuted, but was convinced to go along after being promised that we journalists could be jailed in secret:

Everybody came in and persuaded me that it would be terrible not to prosecute ... I eventually relented. But one of my reasons for doing so was that I was given an absolute promise that the case would be heard in camera [a secret hearing].

In the face of this security onslaught, the politicians collapsed and agreed we should all be charged with espionage – although there was no suggestion that we wanted to do anything other than write articles. I was alleged to be "a thoroughly subversive man who was quite prepared to publish information which was secret,” my lawyer later wrote in his memoir.

But my lawyer saw it differently himself.

"Campbell is a journalist ... a ferret, not a skunk," he told the magistrates' court in Tottenham, North London. But when he inquired about the possibility of a misdemeanor plea and a £50 ($75) fine, he was cut down: "That course might be acceptable for Berry and Aubrey. But the security services want Campbell in prison for a very long time."

They meant it. In March 1977, one month after our nighttime arrest, we were all charged with breaking Britain's Official Secrets Act, for the "unlawful receipt of information.” Then we were charged with espionage. Each espionage charge carried a maximum of 14 years. I was also charged with espionage for collecting open source information on UK government plans. In total, I faced 30 years.

The interview, and then our arrests, were a first encounter with the power of Government Communications Headquarters – better known by its acronym GCHQ – Britain's electronic surveillance agency.

Alan Turing, Britain's assistant spy chief, and my mother

I first heard of secret intelligence as a boy. My mother Mary, a mathematician, often reminisced about her wartime work in a top-secret establishment, including two years working alongside a man they called "the Prof." She portrayed an awkward, gangly fellow with a stutter who loved long-distance running and mushrooms he foraged from local woods that no one would touch – and who was a mathematical genius "out of her league.”

"The Prof" was Alan Turing, the wartime breaker of the German Enigma code, inventor of the modern computer, and hero of the recent Oscar-winning film, The Imitation Game.

Almost four decades passed before she found out who it was that she and the Prof had been working for. She had kept a war souvenir, a flirtatious poem given to her by a British general who visited her radio listening station. The poem inspired her army boss to joke that the general intended to propose. When official war records were finally released, we discovered that the general had actually been the assistant chief of Britain's Secret Intelligence Service.

I first stumbled across GCHQ's surveillance network while at school. On a bike outing in Scotland with another science student, we spotted a large hilltop radio station. We pedaled up to find fences, locked gates, and a meaningless sign hung on the wire that read: "CSOS Hawklaw.” Nearby, we found a ubiquitous British chippie – a fish-and-chip shop – and asked the proprietor, “What do they do there?”

“They never talk,” we were told. “It's a secret government place.”

 

Bombshell exclusive ... The Eavesdroppers article by Duncan Campbell in 1976.
Click here for the full PDF

At the public library, I checked every phone book in the country, looking for more sites with the same name. The initials stood for "Composite Signals Organisation Station" – hardly revealing. Among the sites I found was GCHQ's Bude station in Cornwall, England, now exposed as a global epicenter of NSA-GCHQ internet cable surveillance. Back then, it was called “CSOS Morwenstow.” Four years and a degree in physics later, I found a press report that CSOS was part of GCHQ.

Armed with these leads, in May 1976, I wrote The Eavesdroppers, the first-ever story about GCHQ, alongside American journalist Mark Hosenball, for London's then-radical entertainment magazine Time Out.

I was later told by high-level government contacts that I had been under surveillance while reporting The Eavesdroppers. The "watchers," from MI5, were first rate. I never spotted anything. But while following me and tapping my phone, British security learned an uncomfortable truth: all of the sources for my secret information were Americans, whose free speech was not controlled by British laws.

The Eavesdroppers put GCHQ in view as Britain's largest spy network organization. "With the huge US National Security Agency as partner, [GCHQ] intercepts and decodes communications throughout the world,” I wrote.

The very existence of GCHQ and the SIGINT network were then closely guarded secrets. My article was based on open sources and help from ex-NSA whistleblowers. One was Perry Fellwock, a former US Air Force analyst who helped expose the scale of illegal NSA surveillance during Watergate.

Deported

My co-author Mark Hosenball, a US citizen (now an investigative reporter for Reuters), was quickly slated for deportation as a threat to national security. He faced a security inquiry and then expulsion, knowing only that he was accused of having “sought information for publication which would be harmful for state security.” The ban was lifted more than 20 years ago.

One part of our article that caused concern was a centerpiece map (compiled from phone books) showing NSA and GCHQ monitoring stations scattered across Britain. One of the locations I identified, Menwith Hill Station, a tapping center in the heart of England, has now been revealed in Edward Snowden's papers to be a global center for planned cyberwar.

We also reported that electronic versions of the Enigma cypher were being sold to developing countries by European firms such as Crypto AG of Switzerland before those nations knew Britain had cracked the code.

The day after publication, GCHQ relayed my article around the world. At one major overseas center, I was later told that the local station chief came into a morning meeting, incoherent with rage and "frothing at the mouth,” according to a security official present. Unable to explain in grammatical sentences what had upset him, the chief pulled out and hurled down a telegraphed copy of my article.

After Hosenball was ordered to leave Britain in 1977 for his part in writing the piece, new whistleblowers came forward. One was John Berry, who had worked for GCHQ in Cyprus. Berry revealed in a letter to Britain's National Council for Civil Liberties that:

GCHQ ... monitors the radio networks of so-called friendly countries and even the commercial signals of UK companies. The extent of intelligence activities ... and the resources which the British Government deploys in this area are largely unknown. The apparatus could transform Britain into a police state overnight.

That is what led us to Berry’s flat that unforgettable February evening.

The trio on trial – and the explosive error that ended it

Before the ABC trial, GCHQ demanded that its key witness have his identity hidden "to protect national security.” He was to be "Lieutenant Colonel A.” When magistrates rejected this, a "Colonel B" was sent instead. From reading open army journals, I already knew who "Colonel B" was. In one article, he was named as Colonel Hugh Johnstone and identified as "the Don of the communications underworld.”

Johnstone’s name quickly leaked, provoking prosecutions for contempt of court against editors and our journalists' union. Johnstone was then named again during BBC live radio broadcasts from Parliament. Overnight, the top-secret GCHQ witness became the most famous officer in the British Army.

As our trial started, witness after witness from security sites tried to claim that openly published information was in fact secret. In a typical interchange, one SIGINT unit chief was shown a road sign outside his base:

Q: Is that the name of your unit?
A: I cannot answer that question, that is a secret.
Q: Is that the board which passersby on the main road see outside your unit's base?
A: Yes.
Q: Read it out to the jury, please.
A: I cannot do that. It is a secret.

Official panic set in. The Foreign Secretary who GCHQ had bullied into having us accused of spying now wrote that, "almost any accommodation is to be preferred" to allowing our trial to continue.

A Ministry of Defence report in September 1978, now released, disclosed that the “prosecuting counsel has come to the view that there have been so many published references to the information Campbell has acquired and the conclusions he has drawn from it that the chances of success with [the collection charge] are not good.”

My lawyer overheard the exasperated prosecutor saying that he would allow the government to continue with the espionage charge against me “over [his] dead body.”

The judge, a no-nonsense Welsh lawyer, was also fed up with the secrecy pantomime. He demanded the government scrap the espionage charges. They did.

That left only our taped discussion with Berry, which was mainly filled with trivia about his military life. Johnstone then said that a particular revelation – that GCHQ targeted NATO ally Turkey — could cause "exceptionally grave damage,” and could disrupt the NATO alliance.

Berry had indeed told us that after a coup in Greece: "We knew that a Turkish invasion fleet had sailed [to invade Cyprus].”

Johnstone assumed Berry knew this from top-secret intercepts. In fact, Berry's military record showed he had been in England when the Turks had moved on Cyprus. Johnstone was shown a newspaper article Berry had seen while in England that reported the sailing of the Turkish fleet.

Berry had told us only what he'd seen in a newspaper. But what "Colonel B" said had given away a damaging secret: Britain was spying on her allies.

The error was catastrophic. I watched as Johnstone slumped in the witness box. He then descended into "gloomy confusion,” according to a watching reporter. He condemned articles published in his own army unit's magazine as illegal, and finally confessed:

“To be frank, I am not certain what is a secret and what isn’t.”

We walked free. The judge ruled that we should face no punishment for technically breaking the discredited secrecy law, which was repealed 11 years later.

Spy base ... The distinctive radar domes on Menwith Hill in north Yorkshire, 1996
(Source: John Carter/ANL/REX Shutterstock)

The ABC trial helped pierce an iron veil of British secrecy, changing the political landscape and leading to important new whistleblowers coming forward. Since then, my inquiries have helped throw light on the secret world of surveillance, including uncovering ECHELON, the first-ever automated global mass surveillance system.

In February 1980, with help from new whistleblowers, I published the location of the UK's secret national phone-tapping center, "Tinkerbell.” This time, politicians and the national press put the focus where it belonged. The government admitted that there was then no legal basis for wiretapping in Britain. They were forced to legislate to regulate wiretapping four years later.

That same year, new sources told me that a secret NSA base in England – Menwith Hill Station (MHS) – had been identified by 1970s US congressional intelligence investigators as the larger of two NSA centers tapping telephones in Europe.

I teamed up with the British Sunday Times investigative reporter Linda Melvern, and we traveled to the US, where intelligence officials confirmed the role of the Menwith base. One ex-NSA analyst told us he had documents giving the base authority for "tapping the telephone lines to Europe.” A former British military officer who had visited Menwith said, "It intercepts telephone and other communications to and from the United States and Europe."

Britain and the FBI, arm in arm, monitoring civil-rights protesters

Some of our sources suspected that, due to its location and powerful access arrangements, the Menwith Hill station may have had a central role in the unlawful secret surveillance of US citizens in the 1970s – back when the NSA had helped the FBI target civil-rights activists and other protesters.

Our best source – impeccable – was a top intelligence consultant who then still worked with NSA. He told us he had officially inspected the Menwith site and confirmed, “for sure,” its elaborate tapping facilities. This whistleblower, whose identity has never before been revealed, was Oliver G Selfridge, a founder of the field of artificial intelligence and a member of NSA's Scientific Advisory Board until 1993.

We were discreetly introduced to Selfridge in a downtown Washington bar by an American colleague, who drove us around the National Mall and the city sights in darkness. Selfridge told us that powerful cables connected Menwith to the tapping network, and we should "go look for them.”

We raced back home, and confirmed the tip. We found and photographed an umbilical link between the NSA base and the national and international communications network. We suspected we were looking at the biggest tap on the planet, and headed our report The Billion Dollar Phone Tap.

Back at the Sunday Times newsroom, we celebrated. But the editor who had commissioned the investigation expressed concerns about exposing secrets without specific evidence of wrongdoing. He wanted to lead with a report about US spies helping Britain fight Irish terrorists. We believed we had uncovered a story of mass surveillance.

So we published the article in a small-circulation left-leaning weekly, the New Statesman, where I was working as a reporter. Although the piece was picked up by the Washington Post, and triggered an editorial in The Times in London, it didn’t have the impact we hoped for. But it did result in finding an important contact: Jim Bamford, an author who was writing about the NSA.

Bamford and I each worked from mainly open sources. We stayed in touch, and shared some significant leads, prompting the author of the first major book on GCHQ, Richard Aldrich, to write that: "Together, Duncan Campbell and James Bamford confirmed a fundamental truth; that there are no secrets, only lazy researchers.”

GCHQ's secret space programme dream, the BBC, and more raids by police

Seven years later, in February 1987, Special Branch police teams were sent to search my home and office for a third time. This time the trigger was a six-part programme the BBC had asked me to make, Secret Society. The programme revealed that GCHQ had violated financial accountability to try and gain “independence” from the NSA. Wanting their own space program, GCHQ had evaded legislators to get authority to build a $700m all-British spy satellite codenamed Zircon.

Zircon was to have been launched into a "geostationary" orbit, from where a giant antenna would unfold to collect signals from Asia, Europe and Africa. It was an ambitious project. Because of the tiny number of people who knew about Zircon, I had no documents to use to support the story.

Former defense scientific advisor Sir Ronald Mason did know about Zircon. I mentioned the name at the end of an innocuous interview question. His mouth dropped, and stayed open. He recovered his composure and said: “I can't talk to you about that, I'm afraid.”

He didn’t need to.

Under intense pressure from the government, BBC Director General Alasdair Milne agreed to ban my programme about Zircon. I then arranged to screen the film inside Parliament. My idea was to distract the censors and pull GCHQ off track while we got the Zircon story out in print in the New Statesman magazine.

Gagged by a desperate administration

At the last minute, government attorneys rushed to obtain court orders. The afternoon before publication, government lawyers suddenly arrived at our magazine offices, armed with a court order to gag us. They were shown to the elevator, while I raced down the stairs, jumped on my bicycle and disappeared. The magazine’s production manager left for a secret location, carrying emergency funds to pay new printers in case our normal printers were blocked.

Next morning, as the New Statesman hit the newsstands, I went early to Parliament to meet a friend and supporter, an MP called Robin Cook. He led me to a sanctuary in Parliament, where I could stay long enough for our story to get out safely. Meanwhile, the temperature in the Prime Minister Margaret Thatcher’s office reportedly went “incandescent.” Her rage was unleashed. Police raids began.

They spent days searching the New Statesman's offices. The government then ordered a raid on the BBC itself. On a Saturday night, in front of cameras, police wheeled out carts containing our programme tapes. News of the raid on the BBC went around the world, bolstering the image of British secrecy gone mad. Two weeks after we published the story in the New Statesman, BBC Director General Milne was sacked by the BBC governors. I was not prosecuted. The programme aired a year later. Zircon itself was never completed or launched.

Behind the Zircon scandal was deception. The government had previously been caught hiding weapons expenditure using false accounting. They then promised to report, in secret if needed, on any project costing more than £250 million (about $400 million). No sooner was this promise made than it was broken for GCHQ’s purposes. Operating Zircon would also have raised GCHQ’s costs by one third.

Revealed: The software sifting through the world's communications

In November 1987, San Francisco's Center for Investigative Reporting asked me over to show the Zircon program. My trip led to probably the most important surveillance story I have uncovered. I went to Sunnyvale to meet Margaret Newsham, a former Lockheed employee, and to hear about unconstitutional NSA activity.

I drove south on California Route 101. In Sunnyvale, close to where Google’s campus now stands, the highway ran past a huge windowless "Blue Cube" that controlled the NSA's constellation of surveillance satellites, run by Lockheed (it closed in 2010).

We sat on Newsham’s porch. She was a computer system manager who had worked for NSA contractor Lockheed for seven years before being forced out after challenging corruption. She had been assigned to Menwith Hill in 1978 to manage NSA databases, including something known as Project ECHELON.

Newsham explained that ECHELON was an automated computer driven system for sifting and sorting all types of international civilian communications intercepted from satellites, which were mainly operated by US companies.

The scale of the operation she described took my breath away (this was 1988, remember). The NSA and its partners had arranged for everything we communicated to be grabbed and potentially analyzed. ECHELON was at the heart of a massive, billion-dollar expansion of global electronic surveillance for the 21st century, she explained.

She feared the scale of automated surveillance:

"Its immensity almost defies comprehension. It is important for the truth to come out. I don't believe we should put up with being controlled by Big Brother."

Constitution violated

While sitting inside Building 36D at Menwith Hill Station, Newsham had been invited to listen live on headphones to a call from inside the US Senate. She recognized the voice of Republican Senator Strom Thurmond, and immediately realized the NSA had gone off track.

"Constitutional laws had been broken," she told me.

She explained how she had provided evidence to the House Permanent Select Committee on Intelligence. Investigators told her they had issued subpoenas, and had asked to see plans for ECHELON. But nothing had happened.

She handed me some of the plans for ECHELON. In technical jargon, one described a basic toolkit for surveillance: the "commonality of automated data processing equipment (ADPE) in the ECHELON system.” Others described the ECHELON "Dictionary" database, the heart of the system holding groups of keywords that, when detected in communications, would be flagged up to analysts.

"Dictionary" ran on networks of mini-computers. Newsham had managed these networks. Some plans listed equipment she had helped deploy for a secret project covernamed "CARBOY II." She did not know where CARBOY was.

On location ... Campbell outside the Bude station in 1977

The plans showed how ECHELON, also called Project P415, intercepted satellite connections, sorting phone calls, telex, telegraph and computer signals. Although the internet was then in early infancy, what was carried digitally was covered. The way ECHELON had been designed, she said, the targeting of US political figures was not an accident.

Back in Britain, I matched Newsham’s plans to other clues. Pictures of GCHQ's base at Bude in southwest England showed two satellite tracking dishes, pointing directly at Western satellites called Intelsat. Intelsat, the first commercial communications satellite (COMSAT) network, linked people and businesses around the globe; for example, it even relayed the moon landings live. It started in 1965. From planning records and a press report, I deduced that GCHQ had planned to intercept Intelsat from Bude, beginning in 1966.

Bamford provided me with letters from 1969 between the NSA and GCHQ that he'd obtained, showing that the Americans had helped GCHQ bully the British into building the Bude station. A new GCHQ source told me that the NSA paid for the station under a secret agreement — and that the job was given to the Brits because of fears about US communications privacy laws.

A second ECHELON nerve-centre

I figured that a second ECHELON site would be needed to complete global coverage, intercepting a third Intelsat satellite over the Pacific Ocean. Bamford and I both found the site — built in America, spying on US communications with Asia. In November 1970, a Washington state newspaper revealed the US Department of Defense's plans for a so-called “research station” in Yakima, about 150 miles from Seattle. I obtained photographs. They showed it was targeting the Pacific Intelsat. At the dawn of the era of mass surveillance, almost 50 years ago, the ECHELON stations at Bude and Yakima were the global mass-surveillance system.

I had also seen confidential papers from the Watergate investigations that revealed that GCHQ had fed into the NSA's unlawful SHAMROCK program of international surveillance on satellites and cables; and that this had supported unlawful FBI surveillance on US dissidents and civil-rights campaigners.

The evidence thus showed that the British had been paid by the NSA to build a station that spied on satellites run by the US and carrying mostly Western communications; and that GCHQ had supported unconstitutional surveillance of US citizens.

When I published the ECHELON story in August 1988, it got little mainstream attention. It was ignored for a decade, downplayed by many as European paranoia.

In 1999, at last, ECHELON attracted the concern of Europe's parliament, which commissioned an investigation. My report, Interception Capabilities 2000, outlined what ECHELON was and was not. With ECHELON under investigation in Europe, Newsham decided to reveal her identity as the whistleblower, and retold her story on CBS’s 60 Minutes.

The European Parliament then mandated extensive action against mass surveillance. Their recommendations were passed in full on 5 September, 2001.

Six days later, the Twin Towers in New York came down. Any plans for limiting mass surveillance were buried with the victims of 9/11, and never formally published. But proof of ECHELON became available.

ECHELON, the world's satellites, and the Snowden files

In December 2014, I asked fellow Scottish journalist and Intercept reporter Ryan Gallagher to check the documents leaked by NSA whistleblower Edward Snowden. Was there evidence of ECHELON?

There was: the documents included details of the "ECHELON agreement", and more – a batch of GCHQ and NSA documents confirming what whistleblower Margaret Newsham had revealed 27 years ago.

ECHELON was indeed "a system targeting communications satellites" beginning in 1966, secret summaries of NSA history reveal, according to a 2011 newsletter published by the NSA’s Yakima Research Station:

In 1966, NSA established the FROSTING program, an umbrella program for the collection and processing of all communications emanating from communication satellites. FROSTING’s two sub-programs were TRANSIENT, for all efforts against Soviet satellite targets, and ECHELON, for the collection and processing of INTELSAT communications.

Another report, published in the NSA's SID Today newsletter in 2005, stated "the extensive story of ECHELON will be part of the forthcoming history initiative."

A 2010 GCHQ report indicates that the NSA was still financing ECHELON at the time, noting that "NSA has been a large source of funding for COMSAT. Many current COMSAT assets were purchased by NSA and are supported by GCHQ under the Echelon Agreement." The documents also confirm the role of ECHELON Dictionaries, as "text keyword scanning engines.” They reveal that CARBOY, whose expansion plans Newsham gave me, was the very first GCHQ ECHELON site, at Bude.

The most shocking part of ECHELON, confirmed by the Snowden documents, is that it was built to target Intelsat satellites, which in the early years were used primarily by Western countries: the United States itself was the largest owner and user. The Soviet Union, China and their allies didn't have ground stations, nor the equipment to connect to Intelsat, until years later.

One document confirms that the Yakima site started operating in May 1973 and was “established under the ECHELON program to collect and process INTELSAT communications during the height of the Cold War.”

One more GCHQ document linked Snowden's archive to back to where my journey first began, with John Berry and the ABC case. The GCHQ station in Cyprus where Berry served has the cover-name "SOUNDER.” Here, too, the NSA was heavily involved: "Under the ECHELON Agreement, NSA provides 50 per cent of the funding for the SOUNDER Comsat facility."

The document concludes that the agency showed arrogance in evading public scrutiny. It recounts how ECHELON "caught the ire of Europeans", prompting a European Parliament investigation in 2000. The NSA writer suggested jokingly that when a European delegation came to Washington to visit the NSA and other agencies, their appointments were cancelled. “Our interests, and our SIGINT partners' interests, were protected throughout the ordeal,” reads the report.

The NSA claimed that "the final report of the EU Commission [sic] reflected not only that NSA played by the rules [and] that those characteristics were lacking when the Commission applied its investigatory criteria to other European nations." According to the NSA writer, the Europeans were "pigs":

"The 'pig rule' applied when dealing with this tacky matter: Don't wrestle in the mud with the pigs. They like it, and you both get dirty."

Attitudes like this have made the secret dirty world of electronic mass surveillance difficult to expose, and more difficult to get changed. Even today, neither GCHQ nor NSA will comment on ECHELON or other specific issues raised in the Snowden documents. ("It is long standing policy that we do not comment on intelligence matters," GCHQ said in a statement.)

But change has happened, and at increasing speed.

Two years after Snowden's revelations were first published, I was invited on behalf of a former "C" – Chief of the UK's Secret Intelligence Service – to co-introduce a conference on intelligence, security and privacy. Nearly three decades after almost going to prison for allegedly exposing GCHQ's secrets, my partner in starting the conference was the agency's newly appointed director, Robert Hannigan.

No one present argued against greater openness. Thanks to Snowden and those who courageously came before, the need for public accountability and review has become unassailable. ®

This story is also published by The Intercept.

The Register - Independent news and views for the tech community. Part of Situation Publishing