Current location - Loan Platform Complete Network - Big data management - SQLite will report memory overflow when inserting more than 10,000 pieces of data. How to solve this problem?
SQLite will report memory overflow when inserting more than 10,000 pieces of data. How to solve this problem?

The solution in short is to make the big one smaller.

Split the sql statement. If the sql text uses nio (take java as an example) or something else in the file Reading method. Insert one item at a time.

Mainly focus on the statement. Do not submit too many statements for one statement. In conjunction with the first statement, submit a small amount and execute it in small quantities, but keep it in a connection. Each statement After the execution of the first submission is completed, clear the statement (flush) or create a new statement.

It would also be good if you can call the command in the shell using the CLI... because its own tools should be non-blocking. Just execute the file directly.

Above

August 14, 2017 16:27:29