Snowden used ‘inexpensive’ web crawler software to access 1.7 mn secret NSA files

Snowden used Web Crawler software to scrape out sensitive data out of the NSA system while he went about his day job.

Washington | Published:February 9, 2014 8:07 pm

 

Snowden is reported to have accessed nearly 1.7 million NSA files. (AP) Snowden is reported to have accessed nearly 1.7 million NSA files. (AP)

US whistleblower Edward Snowden, who honed his hacking skills in India, used inexpensive and widely available software to “scrape” the National Security Agency’s networks, according to American intelligence officials probing his high-profile case. Using “web crawler” software designed to search, index and back up a website, 30-year-old Snowden “scraped data out of our systems” while he went about his day job, The New York Times quoted a senior intelligence official as saying.

“We do not believe this was an individual sitting at a machine and downloading this much material in sequence,” the official said. The process by which Snowden gained access to a huge trove of the country’s most highly classified documents was “quite automated” and the former CIA contractor kept at it even after he was briefly challenged by agency officials.

The findings are striking because the NSA’s mission includes protecting America’s most sensitive military and intelligence computer systems from cyber attacks, especially the sophisticated attacks that emanate from Russia and China, the report said. In contrast, Snowden’s “insider attack” was hardly sophisticated and should have been easily detected, investigators found. Snowden had broad access to the NSA’s complete files because he was working as a technology contractor for the agency in Hawaii, helping to manage the agency’s computer systems in an outpost that focuses on China and North Korea.

A web crawler, also called a spider, automatically moves from website to website, following links embedded in each document, and can be programmed to copy everything in its path. Snowden appears to have set the parameters for the searches, including which subjects to look for and how deeply to follow links to documents and other data on the NSA’s internal networks. US intelligence officials said that he accessed roughly 1.7 million files.

According to media reports, Snowden had traveled to India in 2010. He spent six days in New Delhi, taking courses in “ethical hacking,” where he learned advanced techniques for breaking into computer systems and exploiting flaws in software, the reports said. Among the materials prominent in the Snowden files are the agency’s shared “wikis,” databases to which intelligence analysts, operatives and others contributed their knowledge. Some of that material indicates that Snowden “accessed” the documents. But experts say they may well have been downloaded not by him, but by the programme acting on his behalf.

For all the latest World News, download Indian Express App

  1. T
    Templegate Limited
    Aug 28, 2014 at 3:05 am
    setup your business in Hong Kong. www.templegate
    Reply
  2. P
    Pete Pete
    Feb 10, 2014 at 2:25 am
    What search terms were used? This is in the stored caches.
    Reply
  3. L
    LoveNY2
    Feb 9, 2014 at 3:36 pm
    Snowden worked under cover while doing the job he was paid to do. That makes him a spy and traitor in my eyes. He has done un-repairable damage to the security of America. He thinks he was the chosen one by some unseen higher power to puke out everything he had learned while on his job. He should live in misery in Russia for the rest of his life, and should he ever step foot in the USA he should be put away never to see the light of day for the rest of his life.
    Reply
  4. L
    LoveNY2
    Feb 9, 2014 at 3:36 pm
    Snowden worked under cover while doing the job he was paid to do. That makes him a spy and traitor in my eyes. He has done un-repairable damage to the security of America. He thinks he was the chosen one by some unseen higher power to puke out everything he had learned while on his job. He should live in misery in Russia for the rest of his life, and should he ever step foot in the USA he should be put away never to see the light of day for the rest of his life.
    Reply