Best Practices While Batch Loading

Best Practices – Batch Loading¶

Let us go through some of the best practices to perform batch load.

• We should minimize the number of connections to database.
• We should avoid executing queries using hard coded values. Rather, we should prefer bind variables.
• Too much committing is bad as commit incurs overhead.
• If we have to load considerable amount of data, we should consider committing every 1,000 records or 10,000 records or even more based up on the capacity of the database.
• Most of the mainstream databases perform direct path I/O or batch load which might perform better compare to looping, inserting and committing data. In some cases, we can use those features.