@tim and I were discussing how it would be useful to follow a political figure’s social media, without actually connecting to them on said network. It is important to know what they say, without signaling agreement or having to use a proprietary system.
In that vain we are brainstorming methods to extract Twitter feeds into a usable format.
Here is an initial scan of possible tools to extract user feeds:
- Archive My Tweets - Archive your tweets to easily browse and search them - all on your own website and in your control.
- Corebird - Easy access to the Twitter REST API, Collections API, Streaming API, TON (Object Nest) API and Twitter Ads API — all from one PHP library.
- Ozh’ Tweet Archiver - Import and archive your tweets with WordPress
- Phirehose - PHP interface to Twitter Streaming API
- Python Twitter - A Python wrapper around the Twitter API.
- Tweepy - An easy-to-use Python library for accessing the Twitter API.
- tweet_dumper.py - A script to download all of a user’s tweets into a csv
Ideally we could use the streaming API for users to collect the messages and save them for publishing in a different system like WordPress, where we can leverage search and other tools for discovery.
The hosting for WordPress doesn’t really fit with the needs of a streaming capture service, and if we use WordPress to poll we run the risk of hitting a rate limit fairly quickly.
Initial thoughts on pipeline for this is to set up something to save the user stream into some storage, then periodically run a process that turns that data into a feed that we can slurp up from WordPress.