CiviCRM Community Forums (archive)

*

News:

Have a question about CiviCRM?
Get it answered quickly at the new
CiviCRM Stack Exchange Q+A site

This forum was archived on 25 November 2017. Learn more.
How to get involved.
What to do if you think you've found a bug.



  • CiviCRM Community Forums (archive) »
  • Old sections (read-only, deprecated) »
  • Support »
  • Using CiviCRM »
  • Using Core CiviCRM Functions (Moderator: Yashodha Chaku) »
  • Hanging on large import then page not found
Pages: [1]

Author Topic: Hanging on large import then page not found  (Read 774 times)

gdoteof

  • Guest
Hanging on large import then page not found
December 29, 2009, 02:19:43 am
I tried to import a 19k row, 4 column csv file which was supposed to take ~30 minutes according to the little box.

After 8 or the import went away and it brought me to a 404 at mysite.com/civicrm/import/contact.


I tried cutting the file to 7k lines and had the same experience (is this too big?).  Some of the information was imported, but not all of it.

Any ideas?

Brand new install (imported ~2k rows of 8 columns before) of civicrm 3.0 on drupal 6.15.  Default php settings for hotdrupal

Thanks.

(btw this is my first time using this software, and other than this hiccup it's been truly a pleasure to work with)

Donald Lobo

  • Administrator
  • I’m (like) Lobo ;)
  • *****
  • Posts: 15963
  • Karma: 470
    • CiviCRM site
  • CiviCRM version: 4.2+
  • CMS version: Drupal 7, Joomla 2.5+
  • MySQL version: 5.5.x
  • PHP version: 5.4.x
Re: Hanging on large import then page not found
December 29, 2009, 04:52:29 am

whats your execution_time limit on your php install? can you increase it to 3600 seconds or so

thanx

lobo
A new CiviCRM Q&A resource needs YOUR help to get started. Visit our StackExchange proposed site, sign up and vote on 5 questions

gdoteof

  • Guest
Re: Hanging on large import then page not found
December 29, 2009, 01:57:33 pm
i ended up cutting the file size down to ~1k lines and they are importing fine.

Code: [Select]
#!/bin/bash

# check if an input filename was passed as a command
# line argument:
if [ ! $# == 1 ]; then
  echo "Please specify the name of a file to split!"
  exit
fi

# create a directory to store the output:
mkdir output

# create a temporary file containing the header without
# the content:
head -n 1 $1 > header.csv

# create a temporary file containing the content without
# the header:
tail -n +2 $1 > content.csv

# split the content file into multiple files of 5 lines each:
split -l 1000 content.csv output/$1_

# loop through the new split files, adding the header
# and a '.csv' extension:
for f in output/*; do cat header.csv $f > $f.csv; rm $f; done;

# remove the temporary files:
rm header.csv
rm content.csv
                 

Pages: [1]
  • CiviCRM Community Forums (archive) »
  • Old sections (read-only, deprecated) »
  • Support »
  • Using CiviCRM »
  • Using Core CiviCRM Functions (Moderator: Yashodha Chaku) »
  • Hanging on large import then page not found

This forum was archived on 2017-11-26.