This afternoon we passed a major milestone, TwapperKeeper has now saved over 150 MILLION TWEETS.
And other than the disk space issue we have now, the system is running relatively smoothly and keeping up with the throughput of tweets, which often passes 150 tweets / second.
The only major issue we are concerned about is how fast @person archives fill up after first being created – and we will probably introduce a little more advanced logic to our archiving routines so users see those archives fill quickly after creation.
If anyone has any questions, don’t hesitate to ask.
And if you wonder how we are going to pay for all this extra needed disk space, get in line. We aren’t sure just yet either ;-) A P2P storage concept would be pretty nice about right now…🙂