CiviCRM Community Forums (archive)

Drupal 6.15
CiviCRM 3.1.1
MySQL 5.0.89-community
PHP 5.2.12
Safari 4.04
Litespeed server

I was originally trying to import 12,000+ records - the import status remained at 0% and I was only able to verify that records were, indeed, being imported at all by periodically doing a contact search from an additional browser window. Import seemed to stop at 2,900 records, so I then divided the import into several files of 2,500 records each.

In importing the first 2,500 contact .csv file, I encountered the following problems, first on my installation, then on the Civi sandbox.

- Civi reports only 1,763 records out of 2,500 - there were only 2 records that were deemed invalid. (Bad email addresses.)

- Upon import, progress meter remains at 0%.

- After import, page advanced to step 4, in French (Civi only - somebody else was probably testing!) On my installation, however, the browser remains stuck on step 3 forever.

- I don't speak French, but it looked like there were 1,763 records imported, with 27 duplications (doublons?)

Result: Almost one-third of the records failed to be imported. In examining the original .csv file, it's easy enough to find contacts that failed to import - there is no discernible difference between the non-imported contacts and the rest.

Summary: Import limit seems to be no more than 2,900 records in one go. With larger imports, up to a third of the contacts may fail to import for no discernible reason.

I wish I was a coder so I could shed more light on what might be happening - if there's a place where I can send the .csv file, I'm happy to do so, if that will help.

Looking forward very much to using 3.1.1 and thrilled about the hard work everyone has put into it - I'm hoping this will be the final (and very important!) piece of the puzzle. Thanks much for any guidance!

UPDATE: Looks like two likely unrelated issues, neither one of which has entirely to do with Civi.

1. Upload progress display is OK in Firefox (yes, I know - always use Firefox), so this is a Safari issue

2. I imported the .csv file into Filemaker Pro and re-exported as .csv and now the records are properly recognized. I've seen other posts here on bad Excel .csv files.

The import still "hangs" at 98 or 99%, so you never get to screen 4, but hey - I'll take it for now.

And as far as problems with a 12,000+ record import, it's probably a good idea to break it down into smaller imports anyway.

Hope this helps someone... good to have gotten past this one. Rock on!