Author Topic: PHP out of memory error using import members > update memberships (Read 1265 times)

circlebails · July 04, 2011, 11:51:51 pm

Hi I saw this issue yesterday on one of our clients installations when trying to update 292 memberships via the > import members > update memberships function.

PHP memory limit was initially set at 256MB I upped this to 296MB but the problem persisted. I then went for a massive 512MB and the problem still persists.

This is currrently running CiviCRM-3.3.5!

mysql> select COUNT(*) from civicrm_membership;
+----------+
| COUNT(*) |
+----------+
| 8623 |

So updating 292 memberships consumes over 512MB of memory? It seems a remarkable amount.

Kurund Jalmi · July 05, 2011, 01:59:22 am

IMO import code is very old and there is room for lot of optimization. This might be the reason for memory errors. You might want to debug and potentially fix this code.

Thanks
Kurund

Donald Lobo · July 05, 2011, 09:00:02 am

hey bails:

can u get davej to look at the mysql query log and see if the code is doing something super stupid (most likely) and/or getting stuck in some infinite loop

thanx

lobo

CiviTeacher.com · July 05, 2011, 01:32:47 pm

IMHO this may be indicative of CiviCRM failing to handle a particular column of data during the import. Either the format of a column is off, or a particular row of data contains characters the import cannot handle. I would check your PHP error logs, and also see at what point the out of memory error chokes, normally some number of rows will update, check the row at or just before it fails.

For instance if at row 85 it fails, what is up with row 85 or 84?

Also I would attempt to import very few memberships - like 2. Does it still fail? Sometimes memberships must be updated in very small increments, less than 100 if you are importing a lot of data in the import, or the CSV is very large with extraneous columns.

circlebails · July 05, 2011, 11:39:09 pm

Stoob. I think you are incorrect. When the data is spread across 5 separate csv files and imported one by one, the import/update works correctly as expected.

Lobo. DaveJ will look at the logs and see if something silly is going on.

Thanks

Bails

CiviCRM Community Forums (archive)

News:

Author Topic: PHP out of memory error using import members > update memberships (Read 1265 times)

circlebails

PHP out of memory error using import members > update memberships

Kurund Jalmi

Re: PHP out of memory error using import members > update memberships

Donald Lobo

Re: PHP out of memory error using import members > update memberships

CiviTeacher.com

Re: PHP out of memory error using import members > update memberships

circlebails

Re: PHP out of memory error using import members > update memberships