CiviCRM Community Forums (archive)

*

News:

Have a question about CiviCRM?
Get it answered quickly at the new
CiviCRM Stack Exchange Q+A site
This forum was archived on 25 November 2017. Learn more.
How to get involved.
What to do if you think you've found a bug.



  • CiviCRM Community Forums (archive) »
  • Old sections (read-only, deprecated) »
  • Support »
  • Using CiviCRM »
  • Using Core CiviCRM Functions (Moderator: Yashodha Chaku) »
  • Export contacts hangs in 3.2, 3.3.5
Pages: [1]

Author Topic: Export contacts hangs in 3.2, 3.3.5  (Read 1074 times)

kindermaur

  • I’m new here
  • *
  • Posts: 16
  • Karma: 0
Export contacts hangs in 3.2, 3.3.5
February 23, 2011, 08:32:22 am
I'm doing an Advanced Search on contributions that returns a list of about 2000 contacts, but when I try to export it, just using the Primary Fields, CiviCRM never returns. This happened for me in 3.2 (see http://forum.civicrm.org/index.php/topic,15870.msg67933.html#msg67933), and now that we've upgraded to 3.3.5 I tried it again and it still happens.

If I wait long enough, eventually it will fail with an out of memory error.

Any suggestions on how to troubleshoot/get to the bottom of this? Should I try removing fields from the export to see which one(s) are causing the problem?

xcf33

  • I post frequently
  • ***
  • Posts: 181
  • Karma: 7
  • CiviCRM version: 3.3.2
  • CMS version: Drupal 6.19/6.20
  • MySQL version: 5.x
  • PHP version: 5.2.6
Re: Export contacts hangs in 3.2, 3.3.5
February 23, 2011, 11:24:45 am
A quick work-around is to use 

Report and export to csv if you don't much care about contact ID

Quick question, how many contacts are you trying to export and how many fields. (Because Civi has some scalability issues with import/export).


Cheers!

Donald Lobo

  • Administrator
  • I’m (like) Lobo ;)
  • *****
  • Posts: 15963
  • Karma: 470
    • CiviCRM site
  • CiviCRM version: 4.2+
  • CMS version: Drupal 7, Joomla 2.5+
  • MySQL version: 5.5.x
  • PHP version: 5.4.x
Re: Export contacts hangs in 3.2, 3.3.5
February 24, 2011, 05:02:56 pm

The export scalability / memory issues for contacts have been addressed fairly nicely in later versions of 3.2 (uses temp tables, optimized queries etc). Is this a contribution export or contact export?

the component search / export have not been optimized as yet

lobo
A new CiviCRM Q&A resource needs YOUR help to get started. Visit our StackExchange proposed site, sign up and vote on 5 questions

bdanza

  • I post frequently
  • ***
  • Posts: 135
  • Karma: 3
  • CiviCRM version: 3.4.6
  • CMS version: Joomla 1.5, Drupal 6.2x
Re: Export contacts hangs in 3.2, 3.3.5
March 31, 2011, 02:08:25 pm
I am having the same issue in 3.3.5 there are around 4000 contacts in the DB, we are trying to just get a primary field dump of all of them.

it's finds them just fine, but when we try to export them to CSV it simply stalls.

B.

petednz

  • Forum Godess / God
  • I’m (like) Lobo ;)
  • *****
  • Posts: 4899
  • Karma: 193
    • Fuzion
  • CiviCRM version: 3.x - 4.x
  • CMS version: Drupal 6 and 7
Re: Export contacts hangs in 3.2, 3.3.5
April 13, 2011, 05:02:27 pm
Quote from: Donald Lobo on February 24, 2011, 05:02:56 pm

The export scalability / memory issues for contacts have been addressed ....

the component search / export have not been optimized as yet

lobo

lobo - can you clarify this - not sure if i follow - if export scalability has been addressed, how can we benefit from that if 'export' tends to occur after 'search' - am i missing something really obvious - client is trying to export whole DB (primary fields) after a search and never gets the file
Sign up to StackExchange and get free expert advice: https://civicrm.org/blogs/colemanw/get-exclusive-access-free-expert-help

pete davis : www.fuzion.co.nz : connect + campaign + communicate

sanook

  • I post occasionally
  • **
  • Posts: 32
  • Karma: 1
Re: Export contacts hangs in 3.2, 3.3.5
May 19, 2011, 03:53:07 pm
I am using 3.3.6 and am running into similar issues.  trying to export all contacts from a group (approx 8000) and civicrm hangs.  I have changed the mem limit in civicrm.settings.php   but to no avail.

any other ideas?

I have heard about changing mem limits in PHP.ini   but cant figure out how to do that?  is that something that my host might have to change?   what should I be setting this limit at ?

the errors I am pulling from drupal logs are pasted below:

Code: [Select]
$backTrace = /home/wildsigh/public_html/sites/all/modules/civicrm/CRM/Core/Error.php, backtrace, 205 , handle, /home/wildsigh/public_html/sites/all/modules/civicrm/packages/PEAR.php, call_user_func, 931 /home/wildsigh/public_html/sites/all/modules/civicrm/packages/DB.php, PEAR_Error, 968 /home/wildsigh/public_html/sites/all/modules/civicrm/packages/PEAR.php, DB_Error, 564 /home/wildsigh/public_html/sites/all/modules/civicrm/packages/DB/common.php, raiseError, 1903 /home/wildsigh/public_html/sites/all/modules/civicrm/packages/DB/mysql.php, raiseError, 898 /home/wildsigh/public_html/sites/all/modules/civicrm/packages/DB/mysql.php, mysqlRaiseError, 327 /home/wildsigh/public_html/sites/all/modules/civicrm/packages/DB/common.php, simpleQuery, 1216 /home/wildsigh/public_html/sites/all/modules/civicrm/packages/DB/DataObject.php, query, 2421 /home/wildsigh/public_html/sites/all/modules/civicrm/packages/DB/DataObject.php, _query, 1607 /home/wildsigh/public_html/sites/all/modules/civicrm/CRM/Core/DAO.php, query, 145 /home/wildsigh/public_html/sites/all/modules/civicrm/CRM/Core/DAO.php, query, 868 /home/wildsigh/public_html/sites/all/modules/civicrm/CRM/Contact/Form/Task.php, executeQuery, 142 /home/wildsigh/public_html/sites/all/modules/civicrm/CRM/Export/Form/Select.php, preProcessCommon, 152 /home/wildsigh/public_html/sites/all/modules/civicrm/CRM/Core/Form.php, preProcess, 314 /home/wildsigh/public_html/sites/all/modules/civicrm/CRM/Core/StateMachine.php, buildForm, 143 /home/wildsigh/public_html/sites/all/modules/civicrm/CRM/Core/QuickForm/Action/Next.php, perform, 64 /home/wildsigh/public_html/sites/all/modules/civicrm/packages/HTML/QuickForm/Controller.php, perform, 203 /home/wildsigh/public_html/sites/all/modules/civicrm/packages/HTML/QuickForm/Page.php, handle, 103 /home/wildsigh/public_html/sites/all/modules/civicrm/CRM/Core/Controller.php, handle, 284 /home/wildsigh/public_html/sites/all/modules/civicrm/CRM/Core/Invoke.php, run, 219 /home/wildsigh/public_html/sites/all/modules/civicrm/drupal/civicrm.module, invoke, 355 , civicrm_invoke, /home/wildsigh/public_html/includes/menu.inc, call_user_func_array, 348 /home/wildsigh/public_html/index.php, menu_execute_active_handler, 18
and
Code: [Select]
$Fatal Error Details = Array ( [callback] => Array ( [0] => CRM_Core_Error [1] => handle ) [code] => -5 [message] => DB Error: already exists [mode] => 16 [debug_info] => CREATE TABLE civicrm_task_action_temp ( contact_id int primary key) ENGINE=MyISAM DEFAULT CHARACTER SET utf8 COLLATE utf8_unicode_ci [nativecode=1050 ** Table 'civicrm_task_action_temp' already exists] [type] => DB_Error [user_info] => CREATE TABLE civicrm_task_action_temp ( contact_id int primary key) ENGINE=MyISAM DEFAULT CHARACTER SET utf8 COLLATE utf8_unicode_ci [nativecode=1050 ** Table 'civicrm_task_action_temp' already exists] [to_string] => [db_error: message="DB Error: already exists" code=-5 mode=callback callback=CRM_Core_Error::handle prefix="" info="CREATE TABLE civicrm_task_action_temp ( contact_id int primary key) ENGINE=MyISAM DEFAULT CHARACTER SET utf8 COLLATE utf8_unicode_ci [nativecode=1050 ** Table 'civicrm_task_action_temp' already exists]"] )
any help would be greatly appreciated.  Thanks
Pages: [1]
  • CiviCRM Community Forums (archive) »
  • Old sections (read-only, deprecated) »
  • Support »
  • Using CiviCRM »
  • Using Core CiviCRM Functions (Moderator: Yashodha Chaku) »
  • Export contacts hangs in 3.2, 3.3.5

This forum was archived on 2017-11-26.