CiviCRM Community Forums (archive)

*

News:

Have a question about CiviCRM?
Get it answered quickly at the new
CiviCRM Stack Exchange Q+A site

This forum was archived on 25 November 2017. Learn more.
How to get involved.
What to do if you think you've found a bug.



  • CiviCRM Community Forums (archive) »
  • Old sections (read-only, deprecated) »
  • Support »
  • Using CiviCRM »
  • Using Import (Moderator: Yashodha Chaku) »
  • HINT: Import seeming to stop - how to assess progress
Pages: [1]

Author Topic: HINT: Import seeming to stop - how to assess progress  (Read 909 times)

petednz

  • Forum Godess / God
  • I’m (like) Lobo ;)
  • *****
  • Posts: 4899
  • Karma: 193
    • Fuzion
  • CiviCRM version: 3.x - 4.x
  • CMS version: Drupal 6 and 7
HINT: Import seeming to stop - how to assess progress
March 21, 2010, 11:23:48 pm
Knowing the temperamental nature of importing, I chose to create a 'temp data' field which has incremental integer in my file to import. Then when firefox suddenly decided to show 'nothing' after the first 150 imports, I could whip in to Safari and run a Search Builder on that field and check progress - and yes, while FF suggested that things might have failed after 3 minutes (only 4% in to the import of 5000+) the Search Builder confirmed that progress was happening, and by simply reordering the 'import integer' column it would give me an update on how many records had gone in - sitting around 3000 of the 5000 as i speak (import completed now with all 5300 done!).

The other advantage of course with that integer field, is that if it does hang, i can quickly assess where it stopped.

I know this won't be a panacea for imports but may be worth the 1 minute of extra work to drop the column in to your data and the field in to civicrm.

Of course if the import does stop at some point, or even if it fully succeeds there is still the issue of getting the error/duplicate reports, but I am pretty sure they can be found at the backend. In this case, I don't need them

ADDENDUM: so while on FF i just observer a wsod when the import 'appears' to time out, in Safari I get the message "Safari can’t open the page." but in both cases the import continues successfully to its conclusion.
« Last Edit: March 22, 2010, 12:56:47 am by peterd »
Sign up to StackExchange and get free expert advice: https://civicrm.org/blogs/colemanw/get-exclusive-access-free-expert-help

pete davis : www.fuzion.co.nz : connect + campaign + communicate

petednz

  • Forum Godess / God
  • I’m (like) Lobo ;)
  • *****
  • Posts: 4899
  • Karma: 193
    • Fuzion
  • CiviCRM version: 3.x - 4.x
  • CMS version: Drupal 6 and 7
Re: HINT: Import seeming to stop - how to assess progress
March 25, 2010, 04:33:13 pm
Just adding the info here for finding Duplicate and Error reports for any imports that 'continue' but appear to timeout on the browser screen.

When the import is done, the import file is stored in the directory files/civicrm/uploads (or elsewhere if you specify where your temp folder is in the Resource Directories (/civicrm/admin/setting/path&reset=1)

If the original upload was
   xxx.csv

Then the remaining files will be named like
   xxx_(string of integers).csv.unknown
   xxx_(string of integers).csv.unknown.duplicates
   xxx_(string of integers).csv.unknown.error.log
   xxx_(string of integers).csv.unknown.errors
Sign up to StackExchange and get free expert advice: https://civicrm.org/blogs/colemanw/get-exclusive-access-free-expert-help

pete davis : www.fuzion.co.nz : connect + campaign + communicate

Pages: [1]
  • CiviCRM Community Forums (archive) »
  • Old sections (read-only, deprecated) »
  • Support »
  • Using CiviCRM »
  • Using Import (Moderator: Yashodha Chaku) »
  • HINT: Import seeming to stop - how to assess progress

This forum was archived on 2017-11-26.