forked from typecode/wikileaks
-
Notifications
You must be signed in to change notification settings - Fork 1
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Andrew Mahon (Type/Code)
committed
Nov 29, 2010
1 parent
73d0e96
commit 73aa596
Showing
637 changed files
with
105,677 additions
and
51,533 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,35 @@ | ||
88888888888 d88P .d8888b. 888 | ||
888 d88P d88P Y88b 888 | ||
888 d88P 888 888 888 | ||
888 888 888 88888b. .d88b. d88P 888 .d88b. .d88888 .d88b. | ||
888 888 888 888 "88b d8P Y8b d88P 888 d88""88b d88" 888 d8P Y8b | ||
888 888 888 888 888 88888888 d88P 888 888 888 888 888 888 88888888 | ||
888 Y88b 888 888 d88P Y8b. d88P Y88b d88P Y88..88P Y88b 888 Y8b. | ||
888 "Y88888 88888P" "Y8888 d88P "Y8888P" "Y88P" "Y88888 "Y8888 | ||
888 888 | ||
Y8b d88P 888 | ||
"Y88P" 888 | ||
|
||
Wikileaks CableGate Processing | ||
[email protected] | ||
v0.0.0.0.0.1 | ||
|
||
Prerequisites: | ||
HTTrack (http://www.httrack.com/httrack-3.43-9C.tar.gz) | ||
*to update mirror of cablegate site | ||
MongoDB (www.mongodb.org) | ||
*database to store parsed cables | ||
*ouputs json dump | ||
|
||
Functionality: | ||
Will update Cablegate Web Mirror, and pull all existing cables into a | ||
MongoDB Collection where their 'Reference ID' is their '_id', and they | ||
contain the following properties: | ||
'reference_id','date_time','classification','origin','header','body' | ||
|
||
Usage: | ||
Make sure that mongod is running. The software is configured to access | ||
Mongod at it's default location, so change that if necessary. | ||
Confirm that httrack and mongoexport are accesable in your PATH. | ||
run 'python process.py' | ||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,16 @@ | ||
import tornado.httpserver | ||
import tornado.ioloop | ||
import tornado.web | ||
|
||
class MainHandler(tornado.web.RequestHandler): | ||
def get(self): | ||
self.write("Hello, world") | ||
|
||
application = tornado.web.Application([ | ||
(r"/", MainHandler), | ||
]) | ||
|
||
if __name__ == "__main__": | ||
http_server = tornado.httpserver.HTTPServer(application) | ||
http_server.listen(8888) | ||
tornado.ioloop.IOLoop.instance().start() |
Oops, something went wrong.