Import of Large Batches

TIBCO does not recommend importing large batches and recommends an optimal size of 200K to 500K.

Larger chunks of data require bigger demands on the cache and database so you should split batches into smaller chunks to improve performance. A chunk size of 500K, requires hardware setup and tuning.

When importing large batches, remember that new records take a longer time to import than existing records, and that records with relationships take a longer time than those without relationships.

As more data is imported into a repository, subsequent imports are slower. Collect database statistics whenever row count changes by about 10%.