CiviCRM Community Forums (archive)

*

News:

Have a question about CiviCRM?
Get it answered quickly at the new
CiviCRM Stack Exchange Q+A site

This forum was archived on 25 November 2017. Learn more.
How to get involved.
What to do if you think you've found a bug.



  • CiviCRM Community Forums (archive) »
  • Old sections (read-only, deprecated) »
  • Support »
  • Using CiviCRM »
  • Post-installation Setup and Configuration (Moderator: Dave Greenberg) »
  • importing large amounts of data...
Pages: [1]

Author Topic: importing large amounts of data...  (Read 1056 times)

giftculture

  • Guest
importing large amounts of data...
July 30, 2008, 10:31:26 am
We have a large amount of contacts to import into Civi - the online documentation says that the CSV files need to be no larger than 8MB, but the import screen says they need to be no larger than 2MB.  When I try to import a small file (640k or so), the import works fine, but when I try to import an 8MB file either through firefox or safari, it bounces back to me with an error:

Please correct the following errors in the form fields below:

    * Import Data File is a required field.

Is there a way to bump up the max import filesize?  In the FAQ, it mentions setting CIVICRM_MAX_IMPORT_FILESIZE in civicrm.settings.php but that flag doesn't exist in there, I tried adding a:

define( 'CIVICRM_MAX_IMPORT_FILESIZE', 9000000 );

but it didn't seem to make a difference.

Right now, we're running civicrm 2.0.4. 

Is there any other way to load a large amount of data programatically given that we have the CSV files?  we have 60 or 70 8 MB files to load :^(


Donald Lobo

  • Administrator
  • I’m (like) Lobo ;)
  • *****
  • Posts: 15963
  • Karma: 470
    • CiviCRM site
  • CiviCRM version: 4.2+
  • CMS version: Drupal 7, Joomla 2.5+
  • MySQL version: 5.5.x
  • PHP version: 5.4.x
Re: importing large amounts of data...
July 30, 2008, 11:38:24 am

The max upload file size is also controlled by php.ini, you might want to check your setting there.

; Maximum allowed size for uploaded files.                                                                                                                         
upload_max_filesize = 8M

However, doing an 8M import might tax CiviCRM quite a bit. Import is not very efficient :(. Are all your 8M files in exactly the same format. Can you let us know what are the columns and how they match to CiviCRM. You might want to consider hiring a developer and building a custom import. Some import changes are being discussed here:

http://forum.civicrm.org/index.php/topic,4148.msg18195.html#msg18195

lobo
A new CiviCRM Q&A resource needs YOUR help to get started. Visit our StackExchange proposed site, sign up and vote on 5 questions

Pages: [1]
  • CiviCRM Community Forums (archive) »
  • Old sections (read-only, deprecated) »
  • Support »
  • Using CiviCRM »
  • Post-installation Setup and Configuration (Moderator: Dave Greenberg) »
  • importing large amounts of data...

This forum was archived on 2017-11-26.