Spinn3r 2.2 is live!
We’ve been working on a much larger release which is still pending but wanted to release new functionality out the door for some of our more recent clients.
So what’s new?
We’ve added the ability to register weblogs directly within Spinn3r. All that’s necessary is to call a new source.register method with a link to a weblog or any URL that has an RSS feed and publishes dynamic content. Spinn3r will then do the rest. We’ll fetch the HTML feed, perform RSS autodiscovery, and then add it to our source list and start crawling in real time.