CiviCRM Community Forums (archive)

Greetings,

I currently have civicrm setup on a more or less blank drupal site, and I've been attempting to move our organization's contacts into civicrm.

Overall, the site is running slowly; still usable, but barely so, which leads me to believe this may have another issue as well.

We have about 1900 contacts that I need to bring in, with about 5-6 fields (Email, First Name, Last Name, Geo 1, Geo 2, and 3 custom fields).  Import will go through and i can match fields, but as soon as I attempt to 'import now', the site will go through as if loading the next page, then kick pack to import step one.   In looking at the contacts, it appears there are about 12-30 additional contacts that have indeed been imported.

Thinking it might be a data size issue, I broke up the data in to sets of 500, then 200, and then 50 and the issue is still there.  I suppose that going to sets of 10 could work, but I really don't want to do 180+ imports...

I also attempted to reduce the fields being imported (about 1/4 only has email addresses); this gave the same result, of about 25 additional records.

The site is a vps dreamhost hosted site, with I believe 200mb of memory currently.

Any assistance would be appreciated.  Thanks

As JonGold noted, imports require a lot of RAM and also a lot of CPU. I don't recall seeing this particular issue you describe but it certainly seems clear you are running into a limit of either CPU or RAM and I would suggest you ask your host of there are any errors being recorded.

Alright; So I went through trying to diagnose this problem further after getting access to our VPS Memory setter.  I bumped up the memory limits to 800 MB (about 400 was being used previously of our 500 MB cap by the main site), and set the local php memory settings to 350MB.  Despite this, I am still getting the time out error; I think I got about 20 records to come into the system, so that didn't really fix the issue.

I tried dumping the data into the demo site,which the data went in without a problem -  so it looks like the data itself is fine;  This leads me to believe that there is some sort  issue with the server settings.  What would be some indicative settings to look for aside from memory limit on the phpinfo() page?

Or could this be a CPU limit?  Hard to believe but possible I suppose, though the host CPU monitor doesn't really show a large bump in memory usage when trying to import.