Author Topic: I can only Import 1000 contacts or so at a time Help Need to Create a Solution (Read 1025 times)

gsd · September 30, 2011, 09:26:35 pm

I am having some difficulty importing in Civicrm Joomla. Basically I have 5000 or so contacts and I am only able to import or export about 1000 at a time. I am using php5.29 mysql 5.19 and INNODB. I need to use the print mail labels functions and this database will grow. Is there a way to select 1000 contacts so I can I allow to make the adequate amount of labels and provide a way that the database can be effectively used? I have changed my timeout globally in php to 200 secs and in Adobe to 60. It is a dedicated server that I have full access to. Is there possibly a way to fix it so I can import export larger numbers? Help.

Donald Lobo · October 01, 2011, 08:12:35 am

u should be able to export quite a few contacts in 200 seconds if u have a dedicated server. I would check and see if your PHP timeout is indeed 200 seconds. u can use phpinfo( ); to do that. I suspect it might still be the default 30 seconds?

lobo

gsd · October 02, 2011, 09:00:07 am

Actually I cant. I get 500 redirect errors and it takes me up to twenty minutes to import 1000 contacts. I have been reading through the forums about using the api. Maybe that is the key but it is definitely not an answer for my clients. I am doing work for a Hatian relief organization that has sent millions and millions of dollars for relief in food, medical and support supplies. Having this system work in two places is critical. So far this forum is of no help. I cannot imagine I am the only one having to part out imports and upload in sections. Maybe I should just work with another platform as civicrm may not be the best option for them.

Hershel · October 02, 2011, 01:10:45 pm

"twenty minutes to import 1000 contacts" is far more than normal. Hopefully my response to your other post will be of help. Perhaps your CSV file is complicated to import somehow.

Eileen · October 02, 2011, 03:46:43 pm

I think Lobo alluded to the fact that php settings can be set in several places & your settings can be over-ridden - you can rule that out fairly easily by checking your system info from the help menu - the URL is

administrator/index.php?option=com_admin&task=sysinfo

You are looking to confirm these values (or similar)

max_input_time 200 200
memory_limit 192M 192M

gsd · October 07, 2011, 12:40:06 pm

Well I double checked and it is set to 60 in Apache, 120 in Mysql, and 60 in php. Takes way to long. I uninstalled deleted the database and reinstalled 3.45 civicrm. Same issue takes like up to 20 minutes sometimes to resolve imports or exports.

Hershel · October 08, 2011, 12:05:06 pm

Sounds like your server is not configured correctly. Can you ask your host or sysadmin why it's so slow?

DerekL · October 25, 2011, 08:19:58 pm

I'm working with a SQL member import with several if statements to properly concatenate and format phone numbers.
10K rows, strict dupe detection is taking me four plus hours on respectable hardware.

CiviCRM Community Forums (archive)

News:

Author Topic: I can only Import 1000 contacts or so at a time Help Need to Create a Solution (Read 1025 times)

gsd

I can only Import 1000 contacts or so at a time Help Need to Create a Solution

Donald Lobo

Re: I can only Import 1000 contacts or so at a time Help Need to Create a Solution

gsd

Re: I can only Import 1000 contacts or so at a time Help Need to Create a Solution

Hershel

Re: I can only Import 1000 contacts or so at a time Help Need to Create a Solution

Eileen

Re: I can only Import 1000 contacts or so at a time Help Need to Create a Solution

gsd

Re: I can only Import 1000 contacts or so at a time Help Need to Create a Solution

Hershel

Re: I can only Import 1000 contacts or so at a time Help Need to Create a Solution

DerekL

Re: I can only Import 1000 contacts or so at a time Help Need to Create a Solution