Spinn3r 3.1 – Now with Twitter Support and Social Media Ranking
Spinn3r 3.1 just went live today and we’re announcing two new features.
Twitter Firehose Support
Spinn3r listens to a new Twitter firehose API which is a sample of the full Twitter feed.
Further, it is language classified (using an algorithm we have developed) and includes all metadata from Twitter including publication time,
author name, handle, etc.
All content is real time and indexed and available within Spinn3r a few moments after it is published.
There were a lot of requests for this feature (Social Media is HOT) so I expect a lot of innovation from our customers.
Technically this is still in beta but we feel it’s ready for use in production applications (once we get some feedback from our users).
Here’s the current breakdown of Twitter vs other social media and blog content in Spinn3r. While Twitter is larger it’s important to realize this is much less content since Twitter posts are short.
Social Media Rank
We also published some of our new ranking technology which has been in development for a while now (more than a year).
We’re indexing social media sites and computing rank on users based on their social graph.
It’s also interesting how the founders of these social media properties consistently place high, even over celebrities. Ev Williams is still #5 on Twitter. Kevin Rose is still #1 on Digg. Paul is #16 on Friendfeed.
Sources (or nodes) are ranked by authority whereby the more friends or inbound links you have the higher your rank.
Our key differentiator is that we do not consider raw inbound link count to be an accurate representation of authority. This is highly vulnerable to spam and rank errors as users who attract a large number of links (either through black hat methods, link baiting, or viral marketing) can inflate their rankings (and harm other legitimate users).
We consider the quality of inbound links to be far more important. You can observe this in our results as the authority for a source is not a direct function of raw inbounds links. Some users can have high authority but very few (relative) inbound links.
We’re really eager for feedback here. If you have any comments on our ranking system feel free to contact us with your thoughts.