Alert Getter

Daily downloads the google alerts with RSS feeds. Idea is to download the RSS feed from google alerts. Push it all onto mongodb for analysis/NLP later. Also retrive raw text from those URLs.

Author

Manohar Kuse [email protected]

How to run

Setup a few RSS alerts in google alerts. Just Ctrl+S https://www.google.com/alerts from browser (I used chrome) in this folder with html file name as google-alerts.html. You can configure a few params from the file retrive_news_multi.py.

python retrive_news_multi.py

If you wish to just wish to retrive everything once, try running retrive_news.py

Prerequisits

• Pygoose (see https://github.com/grangier/python-goose)