The Multi Support Next storage engine is based on Haystack technology optimized for high-speed capture, efficient retention, and fast retrieval. It’s the same technology Facebook® uses to handle their massive volumes.
Haystack technology has enabled us to reach an impressive 4,600,000 document inserts per hour on a standard pc server (dual cpu eight core) running Windows. (We will release the performance figures for other servers, and distributed environments, as they become available.)
The “append only” nature of Haystack allows it to perform extremely well when inserting documents, and to be very efficient when storing.
Most of the documents sent to the Next storage engine are never to be changed again. For those allowed to be changed, we often have an interest in documenting both versions. Hence the “append only” nature of the Haystack technology is a great match.
