Support (offered by community volunteers) > Using CiviMail

Import Of Larger CSV Files Not Working

(1/4) > >>

b0b_z:
Good Afternoon All!

I've searched and found non-solutions in the form of work-arounds but no actual t fixes to this issue

I want to import 10000+ records into civimail

I've tweaked php by increasing the timeout and memory allocation and still get error 500 after the import fails

I'll get between 5% and 20% before the import pukes

Has anyone figured out a way to import larger csv's without having to break them into smaller file sizes?

I was going to duplicate the installation locally using WAMP, import then upload the new database

Has anyone had any success doing that?

Any suggestions?

Thanks!

Donald Lobo:

Might want to check this session out from the SF CiviCon

http://sf2012.civicrm.org/sessions/breaking-your-proprietary-software-habit-best-practices-data-import-civicrm

lobo

b0b_z:
I reviewed the material and nothing stands out in terms of a possible solution

I upped the amount of RAM and CPU power on the server to something that should more than handle anything I'd need

Seeing as the import is a csv is there a preferred encoding UTF-8 versus US ASCII et al?

Thanks

Hershel:

--- Quote from: b0b_z on July 17, 2012, 06:55:47 am ---I upped the amount of RAM and CPU power on the server to something that should more than handle anything I'd need

--- End quote ---

I have run imports which took as much as 30 minutes of CPU time. Just have to set the machine and be patient. :)


--- Quote from: b0b_z on July 17, 2012, 06:55:47 am ---Seeing as the import is a csv is there a preferred encoding UTF-8 versus US ASCII et al?

--- End quote ---

UTF-8 is probably the best.

b0b_z:
Thank you for your reply...

The waiting isn't the issue, it's the server timing out at between 5 and 20% of the import and generating a 500 error

Hmmm...

Navigation

[0] Message Index

[#] Next page