Author Topic: find duplicates (dedupe) running out of memory (Read 1364 times)

brush · September 18, 2007, 01:53:02 am

allies,

i've been very excited to use 1.8 to finally tackle all the dupes in our DB! unfortunately, despite making sure indexes are set on all checked fields, the dedupe function continues to crash, with "Out of memory (Needed 8164 bytes)" in the logs.

phpinfo() says 128M memory_limit, but i'm assuming the problem is the mysql server, which is separate (we're on dreamhost).

troubleshooting ideas? there are ~5500 contacts, (mysql 5, php 5, drupal).

thanks
.b

Donald Lobo · September 18, 2007, 11:39:47 am

Brush:

You might want to check: http://forum.civicrm.org/index.php/topic,1132.0.html for some tips on dedupe memory issues and potential work arounds

lobo

brush · September 18, 2007, 12:18:47 pm

thanks, lobo. i had looked at that thread but the first few posts weren't relevant and i didn't explore further down; thanks for pointing it out to me. i'll try breaking into groups tonight, and report back.

.b

brush · September 25, 2007, 01:35:44 am

well, i finally got to this, with disappointing results. extremely small groups (ie. 20 contacts, 1 dupe) succeed, however groups as small as 100 contacts (and, by eye, around 4 or 5 dupes) still run out of memory.

suggestions on how to explore further?
.b

CiviCRM Community Forums (archive)

News:

Author Topic: find duplicates (dedupe) running out of memory (Read 1364 times)

brush

find duplicates (dedupe) running out of memory

Donald Lobo

Re: find duplicates (dedupe) running out of memory

brush

Re: find duplicates (dedupe) running out of memory

brush

Re: find duplicates (dedupe) running out of memory