At DataSift we have spent years learning how to do real-time processing of links (going back to when we launched TweetMeme)
What We do ... (more)
Getting the data to the customer is one of the key fundamentals for us @DataSift (product). When dealing with things like historical jobs which can generate terabytes of data in minutes, the ability to buffer and reliably deliver is key.
We developed a delivery stack called 'Push' Push | DataSift Developers... (more)