To edit pages or tickets please login with username/password: aaf/aaf

Ticket #24 (closed defect: fixed)

Opened 2 years ago

Last modified 2 years ago

rebuild_index wastes a huge ammount of memory

Reported by: pedrocr@gmail.com Assigned to: somebody
Priority: major Milestone:
Component: 0plugin Version:
Keywords: Cc:

Description

rebuild_index uses find_all to iterate all of the model's records. If you have just a few that's fine, but with 100 000 records it's a swap storm. This can be solved by batching the find_all call into several calls inside a transaction.

Attachments

aaf_rebuild_index_batched.diff (0.8 kB) - added by pedrocr@gmail.com on 07/06/06 09:50:11.
patch to implemen t batch rebuilding
aaf_rebuild_index_batched.2.diff (0.8 kB) - added by pedrocr@gmail.com on 07/06/06 16:34:58.
Updated patch with a transaction protecting the batching

Change History

07/06/06 09:50:11 changed by pedrocr@gmail.com

  • attachment aaf_rebuild_index_batched.diff added.

patch to implemen t batch rebuilding

07/06/06 16:34:58 changed by pedrocr@gmail.com

  • attachment aaf_rebuild_index_batched.2.diff added.

Updated patch with a transaction protecting the batching

07/06/06 16:35:52 changed by pedrocr@gmail.com

I had forgotten to use a transaction around the batching to protect it from concurrent modifications. The updated patch now has it.

07/10/06 19:55:41 changed by jk

  • status changed from new to closed.
  • resolution set to fixed.

fixed in 0.2.2, thanks for the patch!

To edit pages or tickets please login with username/password: aaf/aaf