Archive for the ‘Uncategorized’ Category

New Filtering Capability on Archives

April 9, 2011

Many people have requested that we allow filtering on not only begin / end dates of archives, but also by time. This has been added to the site as of this afternoon. Let us know if you have any questions or see any issues. It was a quick “afternoon” tweak… 🙂


Sometimes I jump the gun.. and sometimes I misinterpret rules… But better to push forward as fast as possible – and ask for forgiveness after the fact then to not push at all. Sorry.

March 30, 2011

Looks like my great idea of re-enabling the “Save as Excel” feature was a bad idea – as I just got additional clarification from Twitter that the only way I can export data is 1) if it is the actual user’s and if not 2) only the IDs.

Therefore, the “Save as Excel” will be removed tomorrow morning around 5:00 am ET.  Sorry I got everyone excited…

I have toyed with the idea of just exporting IDs and giving you guys scripts to do the lookups – but the rate limits will kill anyone trying to do that to grab all the actual tweet text.

Don’t really know what else to do at this point…!

“Save as Excel” feature has been brought back online

March 22, 2011

After reviewing the new Twitter ToS ( published on March 17, 2011, I have decided to bring the “Save as Excel” link back online when viewing an archive.

This will allow you to get the currently viewed content into an Excel file for review.

While it doesn’t replace the “Export and Download” feature completely (which could extract very large datasets), it will give you the ability to download smaller data sets, which is very useful for conference / chat transcripts, etc.

And remember you can change the view from different time periods to get different data sets.

Let us know if you have any questions.

Reminder: On March 20, we will be removing Export / Download and API features

March 15, 2011

This is just a reminder to all of our users that we will be removing all Export / Download and API features on March 20th.

This will also include the “view in Excel” feature which is basically a download of the tweets.

If you have any questions, please contact us at



A little more information about the Twitter TOS violations…

February 28, 2011

Our interview with WebProNews –

Removal of Export and Download / API Capabilities

February 22, 2011

We regret to inform our users that on March 20, 2011 we will be removing the “Export and Download” and “API” features of the website.

While we realize that these features are very important to many of our users, this change comes at the request of Twitter to bring our service into alignment with the API Terms of Service ( regarding redistribution and syndication of content.

If you require access to structured raw tweets for analysis, we highly recommend leveraging the open source version of TwapperKeeper (yourTwapperKeeper) created during our partnership with JISC.

If you have any questions, please contact us at

Help – please login to TwapperKeeper!

October 15, 2010

As noted yesterday, we are beginning to use the rate limits of the owner of each archive to help us increase our ability to query Twitter for tweets in our crawling process.  This crawling process is important as it also prioritizes which tweets are being watched by our streaming connection.

If you have created an archive and have not logged into the site since Oct 15, we ask that you at least login one time so we can properly capture your login information (of course, just the OAuth tokens per Twitter security)!

Your help is much appreciated!   And if you have any questions please contact us at

We need your rates and your help if you see missing tweets.

October 14, 2010

In the coming days we are going to be testing some new archiving processes that will leverage the rate limit of the user who created the archives, vs. using a single account which TwapperKeeper has been historically doing.

Therefore, we are going to start storing your OAuth tokens (most 3rd party apps do this, we just simply haven’t to date) and leverage your credentials to crawl your personal timeline (if you have an @person archive) or search hashtags / keywords for archives you have created.

This is in response to increased rate limiting we are seeing – and will be tested periodically for feasibility.

Also, if you see tweets missing in your archives let us know ASAP at so we can try to fix before they disappear from Twitter search.  Time is of the essence when it comes to missing tweets.

Output in Excel… why not?

August 23, 2010

A quick lunch time hack – and now you can view your archive in Excel.

IMPORTANT NOTE:  This will only work for results of  less than roughly 50k and therefore leverages the filter criteria. If you want a full dump, we still recommend the EXPORT AND DOWNLOAD feature which allows you to download EVERYTHING!

We are seeing some database issues occurring…

June 29, 2010

Need to take a small outage to fix.