So things seems to be running ok this mornining, BUT, we are behind in processing about 1Million rows of data.
The good news is we have the data and just need to go through it and put it into the right notebooks [thats the great part about now hooking directly into the Twitter Streaming API.]
The bad part is we have a million+ records that need to be slowly processed.
This may result in some data missing in the notebooks (though some will get filled in by our hybrid archiving process which is really cool that does some fancy things and searches the twitter cache… oh wait, you don’t care, you just want complete archives).
Just bear with us as we tune this thing…🙂