Process | Performance | Scalability |
Raw insert and indexing Multi-threaded | 4,600,000 docs/h | x1 |
Remote document capture using web services | 1,500,000 docs/h | x3 |
Import from file system controlled by CSV file | 131,000 docs/h | x34 |
Import from file system CSV — convert gif/tiff to pdf | 31,000 docs/h | x145 |
We demonstrated the raw performance of our Next Storage Engine measuring how fast we can insert and index their documents on our reference server. The result is 4,600,000 docs/h.
Our reference server is a pretty outdated office server running Windows Server 2012. You can see the specs here. If you need more performance than 4.6 million docs/h you can double this number by using a modern server, before you need to scale by adding more servers to the equation.
Typically, you feed a document repository from different locations using web services. We demonstrated how fast we can feed, insert, and index their documents over web services. The result was 1,500,000 docs/h.
To exploit the raw performance of the Next Storage Engine you’ll need at least 3 remote feeders each feeding 1.5 million docs/h.
Very often a number of the documents to be captured resides in a file system with a CSV (comma separated values) file identifying the actual documents. File systems are notoriously slow, and we demonstrated how fast we can capture documents in a file system. The result was 131,000 docs/h.
This means that Next Storage Engine can serve 34 file system document captures each doing 131,000 doc/h.Procurement contracts
Sometimes your operation uses a variety of document format. Even if Next is capable of handling multiple formats, you may find it appealing to store them in a unified archive friendly format. We demonstrated the combination of a file system and a document. The result was 31,000 docs/h.
The Next Storage Engine can serve 145 document captures reading from file system and converting to pdf. Each doing 31,000 docs/h.
The conclusion of our POC was that Multi Support Next easily fulfill the needs from a performance perspective. Even if you want to add processes as barcode recognition and OCR to the process. Next scales by simplicity, and allows you to build a setup that is easy to understand, easy to maintain, and easy to finance.
Remember that even the biggest installation of Next requires no additional software as for example SQL-server, DB2, or Oracle — but runs well together with all of them.