CiviCRM Community Forums (archive)

*

News:

Have a question about CiviCRM?
Get it answered quickly at the new
CiviCRM Stack Exchange Q+A site

This forum was archived on 25 November 2017. Learn more.
How to get involved.
What to do if you think you've found a bug.



  • CiviCRM Community Forums (archive) »
  • Old sections (read-only, deprecated) »
  • Support »
  • Using CiviCRM »
  • Using Core CiviCRM Functions (Moderator: Yashodha Chaku) »
  • Memory issues with dedupe et. al.
Pages: [1]

Author Topic: Memory issues with dedupe et. al.  (Read 1086 times)

Blake

  • I post occasionally
  • **
  • Posts: 36
  • Karma: 5
    • LinkedIn Profile
Memory issues with dedupe et. al.
August 17, 2009, 02:36:06 pm
Using CiviCRM 2.28 with Drupal 6.13 I am consistently hitting memory issues, especially when using dedupe.

I try to merge contacts and select the field to be merged (only relationships for most of my duplicate contacts), I get the following memory error with htaccess set to 128M (or white screen when set to 96M), yet the merging is successful.
Code: [Select]
Fatal error: Allowed memory size of 134217728 bytes exhausted (tried to allocate 4 bytes) in /sites/all/modules/civicrm/packages/DB/DataObject.php on line 561
While this behavior is most prevalent when merging contacts, it has popped up in other places as well. Media Temple was having SQL memory issues on my cluster so right now I have a separate 128M container just for use of my sites, but the behavior is the same in both instances.

While the merging seems to work in spite of these errors, I would like to solve this problem as I have about 10,000 contacts to merge :P. Any ideas?

Blake

  • I post occasionally
  • **
  • Posts: 36
  • Karma: 5
    • LinkedIn Profile
Re: Memory issues with dedupe et. al.
August 19, 2009, 11:37:58 am
I disabled all non essential modules, installed the devel module, and am still hitting the memory limit issue with Memory used at: devel_init()=1.51 MB, devel_shutdown()=128 MB.

A MySQL report generates nothing unusual. How much memory does CiviCRM need to run? 160M?

Donald Lobo

  • Administrator
  • I’m (like) Lobo ;)
  • *****
  • Posts: 15963
  • Karma: 470
    • CiviCRM site
  • CiviCRM version: 4.2+
  • CMS version: Drupal 7, Joomla 2.5+
  • MySQL version: 5.5.x
  • PHP version: 5.4.x
Re: Memory issues with dedupe et. al.
August 19, 2009, 11:56:57 am

is the version 2.1.x. There were some significant scalability issues with the dedupe code in 2.0 which we rectified in 2.1

can u upgrade (the live site or a copy) to 2.2.8. If the problem still persists there, we'd love to take a look (either ssh access or a copy of the db) and figure out whats happening and why.

lobo
A new CiviCRM Q&A resource needs YOUR help to get started. Visit our StackExchange proposed site, sign up and vote on 5 questions

Blake

  • I post occasionally
  • **
  • Posts: 36
  • Karma: 5
    • LinkedIn Profile
Re: Memory issues with dedupe et. al.
August 19, 2009, 12:01:06 pm
I am using 2.2.8 with Drupal 6.13.

How shall I send the copy of the DB?

Donald Lobo

  • Administrator
  • I’m (like) Lobo ;)
  • *****
  • Posts: 15963
  • Karma: 470
    • CiviCRM site
  • CiviCRM version: 4.2+
  • CMS version: Drupal 7, Joomla 2.5+
  • MySQL version: 5.5.x
  • PHP version: 5.4.x
Re: Memory issues with dedupe et. al.
August 19, 2009, 12:14:12 pm
how big is the compressed DB? u can email it to my yahoo dot com address if not too big

if big, u might want to use something like yousendit http://www.yousendit.com/

also can u include steps to duplicate the issue :)

thanx

lobo
« Last Edit: August 19, 2009, 12:19:52 pm by Donald Lobo »
A new CiviCRM Q&A resource needs YOUR help to get started. Visit our StackExchange proposed site, sign up and vote on 5 questions

Pages: [1]
  • CiviCRM Community Forums (archive) »
  • Old sections (read-only, deprecated) »
  • Support »
  • Using CiviCRM »
  • Using Core CiviCRM Functions (Moderator: Yashodha Chaku) »
  • Memory issues with dedupe et. al.

This forum was archived on 2017-11-26.