Author Topic: Import fails partway through (Read 2601 times)

kassissieh · January 10, 2010, 02:04:27 pm

I am attempting to import 730 contact records. After about 30 seconds, a "page not found" error appears, the location bar stays the same (/civicrm/import/contact), and the site shows a "page not found" error. When I search for contact records, only 90 new records were imported. I could import 90 records at a time, but I'd rather solve the problem and import all 730 at once. I am running CiviCRM 3.0.2 and Drupal 6.15.

Can you suggest a way to allow CiviCRM to complete the import?

I have added the following lines to settings.php, but they don't appear to help.
ini_set('max_execution_time', '360');
set_time_limit(36000); // ten minutes

This site is running on a shared hosting plan at Dreamhost (I know, but budget constraints limit our hosting options, and aside from import, the site runs well).

Thanks,

Richard

kassissieh · January 10, 2010, 02:39:07 pm

Some more information:

The error appears after 45 seconds.
I followed Dreamhost's instructions to change resource limits.
phpinfo() reports the following:

Directive   Local Value   Master Value
max_execution_time   0   360
max_input_nesting_level   64   64
max_input_time   60   60
memory_limit   90M   90M

If timing out were the problem, wouldn't I see a "page did not respond" browser error instead of "page not found?"

kassissieh · January 10, 2010, 04:28:31 pm

I am really wondering whether timeout is the issue.

I have split the import file into only 50 records each. The first set imports fine, and I get the "page not found" error on the second set of 50 records. All of the records import successfully, but the error appears.

What else could cause this problem besides max_execution_time?

Richard

Donald Lobo · January 11, 2010, 03:02:34 pm

hey rich:

1. do u have access to your apache error logs? if so, would be great to see the stream of requests and who/what initiates the final redirect

2. can u scramble the data and do the smae import on the demo machine to ensure that it is not a data issue

lobo

kassissieh · January 31, 2010, 03:10:29 pm

I tried the same import on a dedicated server we have on campus, and it worked quickly and flawlessly.

I upgraded my organization's account at Dreamhost to VPS and was then able to import 200 records at a time without error. I still got an error halfway through a data set of 350 records.

Dreamhost support indicated to me that they run procwatch on their shared hosting accounts. They don't do it on VPS, which makes me still wonder why the import routine won't just run until completion. I feel like a configuration difference between our dedicated server and DreamhostPS might be the cause.

Here is the Apache error message:
premature end of script headers: index.php, referer: http://afmap.org/cms/civicrm/import/contact?_qf_Preview_display=true&qfKey=28e5cdfaa74fc515fd0d54e9314241ad

Ed van Leeuwen · February 01, 2010, 10:28:34 am

I have the same kind of error. Almost at the end I get the option to download a file which is in fact an HTML message which has the 'MySQL has gone away' error in it. I increased execution time and conenction time, but to avail. In 3.0.2 this did not occur. I have tried to import on the demo site, which succeeded.

c-c-m · March 17, 2010, 11:07:11 am

I'm having the same issue and same hosting provider (dreamhost). Did you find a solution other than importing in groups of 50 users?

Thank you

CiviCRM Community Forums (archive)

News:

Author Topic: Import fails partway through (Read 2601 times)

kassissieh

Import fails partway through

kassissieh

Re: Import fails partway through

kassissieh

Re: Import fails partway through

Donald Lobo

Re: Import fails partway through

kassissieh

Re: Import fails partway through

Ed van Leeuwen

Re: Import fails partway through

c-c-m

Re: Import fails partway through