python3 twitter downloader with mongodb

mongodb credit goes to Liam Bowen (original post: http://hut8.io/posts/mongodb-3-on-debian-jessie/) 1. install mongodb 3.0

sudo apt-key adv --keyserver keyserver.ubuntu.com --recv 7F0CEB10
echo 'deb http://repo.mongodb.org/apt/debian wheezy/mongodb-org/3.0 main' | sudo tee '/etc/apt/sources.list.d/mongodb-org-3.0.list'
sudo apt-get update
sudo apt-get install -y mongodb-org

2. tweak the settings

sudo mkdir /mongodb
sudo chown -R admin:admin /mongodb    # "admin" because of using AWS debian AMI
sudo nano /etc/mongod.conf            # change [storage.dbPath] and [systemLog.path], "wiredTiger" part is more optional

3. start mongodb in background

mongod --config /etc/mongod.conf --fork
# to report mongodb stats every 60 seconds
# mongostat 60
# to shutdown 
# mongo --eval "db.getSiblingDB('admin').shutdownServer()"

python and twitter 1. get the packages

sudo apt-get install python3-pip
sudo pip3 install twitter pymongo

2. tweaks

sudo nano /etc/hostname 
echo $HOSTNAME