CiviCRM Community Forums (archive)

*

News:

Have a question about CiviCRM?
Get it answered quickly at the new
CiviCRM Stack Exchange Q+A site

This forum was archived on 25 November 2017. Learn more.
How to get involved.
What to do if you think you've found a bug.



  • CiviCRM Community Forums (archive) »
  • Old sections (read-only, deprecated) »
  • Support »
  • Using CiviCRM »
  • Using Import (Moderator: Yashodha Chaku) »
  • Import Questions
Pages: [1]

Author Topic: Import Questions  (Read 919 times)

DerekL

  • I post frequently
  • ***
  • Posts: 132
  • Karma: 1
  • CiviCRM version: 4.5.5
  • CMS version: Drupal 7.34
  • MySQL version: 5.1.54
  • PHP version: 5.2.17
Import Questions
March 08, 2012, 10:50:13 am
I have a large contact import (10,577 records) that I'm doing via SQL import.

I started this at 11:00AM, and it is now 1:50 PM.

My browser says "Importing Records...".

I noticed that there is a status file inside default/files/civicrm/upload that has something to do with this import.

It contains the following:

[76,"\n<div class=\"description\">\n&nbsp; <strong>8100 of 10577 records - 14 minutes 2 seconds remaining<\/strong>\n<\/div>\n"]

And was last modified at 12:32, 1.5 hours after I started the import.

My question is:

Since the file has not been updated since, has the import process somehow failed/frozen?

Is there any way to dig deeper?

Donald Lobo

  • Administrator
  • I’m (like) Lobo ;)
  • *****
  • Posts: 15963
  • Karma: 470
    • CiviCRM site
  • CiviCRM version: 4.2+
  • CMS version: Drupal 7, Joomla 2.5+
  • MySQL version: 5.5.x
  • PHP version: 5.4.x
Re: Import Questions
March 08, 2012, 11:08:03 am

Seems like the import PHP process died approx at that time (either out of memory or time)

lobo
A new CiviCRM Q&A resource needs YOUR help to get started. Visit our StackExchange proposed site, sign up and vote on 5 questions

DerekL

  • I post frequently
  • ***
  • Posts: 132
  • Karma: 1
  • CiviCRM version: 4.5.5
  • CMS version: Drupal 7.34
  • MySQL version: 5.1.54
  • PHP version: 5.2.17
Re: Import Questions
March 08, 2012, 11:29:18 am
Hi Lobo!

I have PHP, Apache, and FastCGI set to no timeouts, and I've successfully eliminated all timeout errors from Drupals dblogs and Apache.

Here is what I'm seeing at around the same time as the failure from Drupal Debug Logs:

$IDS Detector Details = Array (
  • => Array ( [name] => sqlQuery [value] => SELECT m.Salutation AS Prefix, m.FirstName as First, m.MiddleName as Middle, m.LastName as Last, m.Suffix, m.CompanyTitle AS Title, m.CompanyName as Organization, m.DOB, m.Email1, m.Address1, m.Address1Line2, m.Address1Line3, m.City1, m.State1, m.State1Other, m.ZipCode1, m.Country1, m.EmailEvents,m.EmailBulletin, IF (m.Telefone1 IS NULL OR BIT_LENGTH(m.Telefone1)=0,NULL,IF (m.AreaCode1 IS NULL OR BIT_LENGTH(m.AreaCode1)=0,IF (m.Telefone1Ext IS NULL OR BIT_LENGTH(m.Telefone1Ext)=0,m.Telefone1,CONCAT(m.Telefone1 , ' xt :' , m.Telefone1Ext)), IF (m.Telefone1Ext IS NULL OR BIT_LENGTH(m.Telefone1Ext)=0,CONCAT(m.AreaCode1 , ' ' , m.Telefone1),CONCAT(m.AreaCode1 , ' ' , m.Telefone1 , ' xt :' , m.Telefone1Ext)))) AS Telephone1, IF (m.Telefone2 IS NULL OR BIT_LENGTH(m.Telefone2)=0,NULL,IF (m.AreaCode2 IS NULL OR BIT_LENGTH(m.AreaCode2)=0,IF (m.Telefone2Ext IS NULL OR BIT_LENGTH(m.Telefone2Ext)=0,m.Telefone2,CONCAT(m.Telefone2 , ' xt :' , m.Telefone2Ext)), IF (m.Telefone2Ext IS NULL OR BIT_LENGTH(m.Telefone2Ext)=0,CONCAT(m.AreaCode2 , ' ' , m.Telefone2),CONCAT(m.AreaCode2 , ' ' , m.Telefone2 , ' xt :' , m.Telefone2Ext)))) AS Telephone2, IF (m.Cellfone IS NULL OR BIT_LENGTH(m.Cellfone)=0,NULL,IF (m.AreaCodeCell IS NULL OR BIT_LENGTH(m.AreaCodeCell)=0,m.Telefone1, CONCAT(m.AreaCodeCell , ' ' , m.Cellfone))) As CellularPhone, IF (m.Fax1 IS NULL OR BIT_LENGTH(m.Fax1)=0,NULL,IF (m.FaxAreaCode1 IS NULL OR BIT_LENGTH(m.FaxAreaCode1)=0,m.Telefone1, CONCAT(m.FaxAreaCode1 , ' ' , m.Fax1))) As Fax1, IF(m.EmailBulletin,0,1) AS donotemailBulletin, IF(m.EmailEvents,0,1) AS donotemailEvents, m.Website1,m.Website2, m.Notes, m.MemberID AS oldMemberID FROM brazilcham_dbo.members m [page] => /civicrm/import/contact [userid] => 1 [session] => HWdXO7wwD6-IZbHfXDUby1INmwWtsWxWcBBAvJnxwu4 [ip] => 70.32.104.82 [reaction] => 2 [impact] => 65 ) )


And:

Notice: Undefined index: phone_type_id in create() (line 287 of /var/www/vhosts/brazilcham.com/stage/sites/all/modules/civicrm/CRM/Core/BAO/Block.php).

And:

Notice: Undefined index: phone_type_id in create() (line 287 of /var/www/vhosts/brazilcham.com/stage/sites/all/modules/civicrm/CRM/Core/BAO/Block.php).

Is there any chance these have anything to do with the import freeze-up?

Donald Lobo

  • Administrator
  • I’m (like) Lobo ;)
  • *****
  • Posts: 15963
  • Karma: 470
    • CiviCRM site
  • CiviCRM version: 4.2+
  • CMS version: Drupal 7, Joomla 2.5+
  • MySQL version: 5.5.x
  • PHP version: 5.4.x
Re: Import Questions
March 08, 2012, 12:47:08 pm

The IDS detector Details array has a non-civicrm query. so not sure where that request is coming in from.

The other two notices are fine and should not result in an abort

r u sure php did not run out of memory? can u check the apache error logs?

lobo
A new CiviCRM Q&A resource needs YOUR help to get started. Visit our StackExchange proposed site, sign up and vote on 5 questions

DerekL

  • I post frequently
  • ***
  • Posts: 132
  • Karma: 1
  • CiviCRM version: 4.5.5
  • CMS version: Drupal 7.34
  • MySQL version: 5.1.54
  • PHP version: 5.2.17
Re: Import Questions
March 08, 2012, 01:31:51 pm
Hi Lobo,

The query in the IDS log entry is mine, I'm doing a contact import from a local mysql DB.

I'll re-run the import and watch out for memory issues (I can't see anything in my apache logs though).
 I've got a 1GB VPS and PHP set to 512M...

Pages: [1]
  • CiviCRM Community Forums (archive) »
  • Old sections (read-only, deprecated) »
  • Support »
  • Using CiviCRM »
  • Using Import (Moderator: Yashodha Chaku) »
  • Import Questions

This forum was archived on 2017-11-26.