Updating 4.2 -> 4.3 - getting 'Retry - Skip' problem at 'Upgrade now' step

[2ways]

Hi Folks,

I started by upgrading Drupal to latest 7 release, then went on to upgrade CiviCRM.  I was on 4.2 and tried to go straight to 4.5.6.  After pressing the 'Upgrade now', I was presented with "[]" - a non-functioning progress bar - and 'Retry' and 'Skip' buttons at the end of that row.  Image attached.

This is a problem that has come up a lot in these forums, so it is only as I am at my wits end that I dare create a new topic.

After reading through the relevant forums, I decided to upgrade 'more slowly' by upgrading from 4.2 to 4.3 as a first step.  Had the same problem.

I have tried all the distinct suggestions I can find in the forums (one example below), but I am still having the same issue.

I deleted Config.IDS.ini and floder templates_c after
I have edit mysql
USE <yourdatabasename>;
UPDATE civicrm_domain SET config_backend = null;
and empty table civicrm_setting,

All help much appreciated.  Happy to send someone my database for a look, if that is useful.

Thanks,
Lewis

[ken]

Lewis,

Any items in your Apache or CiviCRM error logs? Any JavaScript errors? (Firebug can help)

Ken

[Hershel]

When you're using 4.2, does everything work correctly?

[ken]

Lewis,

After looking at this with you the other day, I'd suggest going back to 4.2 and ...

• listing differences between the set up of your production system and your test box

Prior to upgrading ...

• Empty the civicrm caches (Administer > System settings > Clean up caches and update paths > Clear caches)
• Remove the directories under template_c
• If Drupal is aggregating JS files it might help to turn that off (Configure > Performance > ...)
• Check that CiviCRM functionality is working and no JS issues are popping up in Firebug

[2ways]

@Hershel

Sorry for the tardy reply.

The reason I set about the upgrade was because I was getting the following error (below) whenever I tried to add a new group to the database.  For some reason, I get that error now when I try to do anything.  Also, just today, the database seems to have disappeared altogether as my list of groups under Manage Groups is empty.

The data is still there, of course.  I can verify that in phpMyAdmin.

--------------
Sorry but we are not able to provide this at the moment.
DB Error: no such field
Return to home page.
--------------

That was the presenting problem that caused me to set about the upgrade in the first place.

Thanks,
Lewis

[Hershel]

Can you enable debugging and send us the full error message?

[2ways]

Thanks, Hershel.

Here is the full error message.  To generate this error, I tried to create a 'New Individual' in the sidebar block.

Also, when I switched on debugging and saved the settings, a info box appeared in the top right of the screen telling me that it looks like my database may have been partially updated.

Here's the error message and below is the backtrace.

----------------
Database Error Code: Unknown column 'civicrm_dedupe_rule_group.used' in 'where clause', 1054
Additional Details:
Array
(
    [callback] => Array
        (
           

• => CRM_Core_Error
[1] => handle
        )

   

Code: [Select]

=> -19
    [message] => DB Error: no such field
    [mode] => 16
    [debug_info] => SELECT *
 FROM civicrm_dedupe_rule_group
 
 WHERE (  civicrm_dedupe_rule_group.contact_type  = 'Individual' )  AND (  civicrm_dedupe_rule_group.used  = 'Supervised' )
 
 
 
 [nativecode=1054 ** Unknown column 'civicrm_dedupe_rule_group.used' in 'where clause']
    [type] => DB_Error
    [user_info] => SELECT *
 FROM civicrm_dedupe_rule_group
 
 WHERE (  civicrm_dedupe_rule_group.contact_type  = 'Individual' )  AND (  civicrm_dedupe_rule_group.used  = 'Supervised' )
 
 
 
 [nativecode=1054 ** Unknown column 'civicrm_dedupe_rule_group.used' in 'where clause']
    [to_string] => [db_error: message="DB Error: no such field" code=-19 mode=callback callback=CRM_Core_Error::handle prefix="" info="SELECT *
 FROM civicrm_dedupe_rule_group
 
 WHERE (  civicrm_dedupe_rule_group.contact_type  = 'Individual' )  AND (  civicrm_dedupe_rule_group.used  = 'Supervised' )
 
 
 
 [nativecode=1054 ** Unknown column 'civicrm_dedupe_rule_group.used' in 'where clause']"]
)
----------------

In case this is useful, the backtrace is included below.

backTrace

#0 /home/euangelion/www/www/sites/all/modules/civicrm/CRM/Core/Error.php(148): CRM_Core_Error::backtrace()
#1 [internal function](): CRM_Core_Error::handle(Object(DB_Error))
#2 /home/euangelion/www/www/sites/all/modules/civicrm/packages/PEAR.php(931): call_user_func((Array:2), Object(DB_Error))
#3 /home/euangelion/www/www/sites/all/modules/civicrm/packages/DB.php(969): PEAR_Error->PEAR_Error("DB Error: no such field", -19, 16, (Array:2), "SELECT * \n FROM civicrm_dedupe_rule_group \n \n WHERE (  civicrm_dedupe_rule...")
#4 /home/euangelion/www/www/sites/all/modules/civicrm/packages/PEAR.php(564): DB_Error->DB_Error(-19, 16, (Array:2), "SELECT * \n FROM civicrm_dedupe_rule_group \n \n WHERE (  civicrm_dedupe_rule...")
#5 /home/euangelion/www/www/sites/all/modules/civicrm/packages/DB/common.php(1905): PEAR->raiseError(NULL, -19, NULL, NULL, "SELECT * \n FROM civicrm_dedupe_rule_group \n \n WHERE (  civicrm_dedupe_rule...", "DB_Error", TRUE)
#6 /home/euangelion/www/www/sites/all/modules/civicrm/packages/DB/mysql.php(898): DB_common->raiseError(-19, NULL, NULL, NULL, "1054 ** Unknown column 'civicrm_dedupe_rule_group.used' in 'where clause'")
#7 /home/euangelion/www/www/sites/all/modules/civicrm/packages/DB/mysql.php(327): DB_mysql->mysqlRaiseError()
#8 /home/euangelion/www/www/sites/all/modules/civicrm/packages/DB/common.php(1216): DB_mysql->simpleQuery("SELECT * \n FROM civicrm_dedupe_rule_group \n \n WHERE (  civicrm_dedupe_rule...")
#9 /home/euangelion/www/www/sites/all/modules/civicrm/packages/DB/DataObject.php(2421): DB_common->query("SELECT * \n FROM civicrm_dedupe_rule_group \n \n WHERE (  civicrm_dedupe_rule...")
#10 /home/euangelion/www/www/sites/all/modules/civicrm/packages/DB/DataObject.php(441): DB_DataObject->_query("SELECT * \n FROM civicrm_dedupe_rule_group \n \n WHERE (  civicrm_dedupe_rule...")
#11 /home/euangelion/www/www/sites/all/modules/civicrm/CRM/Dedupe/Finder.php(116): DB_DataObject->find(TRUE)
#12 /home/euangelion/www/www/sites/all/modules/civicrm/CRM/Contact/Form/Contact.php(1128): CRM_Dedupe_Finder::dupesByParams((Array:3), "Individual", "Supervised", (Array:1))
#13 /home/euangelion/www/www/sites/all/modules/civicrm/CRM/Contact/Form/Edit/Individual.php(152): CRM_Contact_Form_Contact::checkDuplicateContacts((Array:9), (Array:0), NULL, "Individual")
#14 [internal function](): CRM_Contact_Form_Edit_Individual::formRule((Array:9), (Array:0), NULL)
#15 /home/euangelion/www/www/sites/all/modules/civicrm/packages/HTML/QuickForm.php(1598): call_user_func((Array:2), (Array:9), (Array:0), NULL)
#16 /home/euangelion/www/www/sites/all/modules/civicrm/CRM/Core/Form.php(299): HTML_QuickForm->validate()
#17 /home/euangelion/www/www/sites/all/modules/civicrm/CRM/Core/StateMachine.php(142): CRM_Core_Form->validate()
#18 /home/euangelion/www/www/sites/all/modules/civicrm/CRM/Core/QuickForm/Action/Next.php(60): CRM_Core_StateMachine->perform(Object(CRM_Contact_Form_Contact), "next", "Next")
#19 /home/euangelion/www/www/sites/all/modules/civicrm/packages/HTML/QuickForm/Controller.php(203): CRM_Core_QuickForm_Action_Next->perform(Object(CRM_Contact_Form_Contact), "next")
#20 /home/euangelion/www/www/sites/all/modules/civicrm/packages/HTML/QuickForm/Page.php(103): HTML_QuickForm_Controller->handle(Object(CRM_Contact_Form_Contact), "next")
#21 /home/euangelion/www/www/sites/all/modules/civicrm/CRM/Core/Controller.php(316): HTML_QuickForm_Page->handle("next")
#22 /home/euangelion/www/www/sites/all/modules/civicrm/CRM/Utils/Wrapper.php(117): CRM_Core_Controller->run()
#23 /home/euangelion/www/www/sites/all/modules/civicrm/CRM/Core/Invoke.php(266): CRM_Utils_Wrapper->run("CRM_Contact_Form_Contact", "New Contact", (Array:1))
#24 /home/euangelion/www/www/sites/all/modules/civicrm/CRM/Core/Invoke.php(70): CRM_Core_Invoke::runItem((Array:13))
#25 /home/euangelion/www/www/sites/all/modules/civicrm/CRM/Core/Invoke.php(52): CRM_Core_Invoke::_invoke((Array:3))
#26 /home/euangelion/www/www/sites/all/modules/civicrm/drupal/civicrm.module(436): CRM_Core_Invoke::invoke((Array:3))
#27 [internal function](): civicrm_invoke("contact", "add")
#28 /home/euangelion/www/www/includes/menu.inc(517): call_user_func_array("civicrm_invoke", (Array:2))
#29 /home/euangelion/www/www/index.php(21): menu_execute_active_handler()
#30 {main}

[2ways]

Sorry.  The error didn't come through.

Here it is again.

------------------

Code: [Select]

Database Error Code: Unknown column 'civicrm_dedupe_rule_group.used' in 'where clause', 1054
Additional Details:
Array
(
    [callback] => Array
        (
            [0] => CRM_Core_Error
            [1] => handle
        )

    [code] => -19
    [message] => DB Error: no such field
    [mode] => 16
    [debug_info] => SELECT *
 FROM civicrm_dedupe_rule_group
 
 WHERE (  civicrm_dedupe_rule_group.contact_type  = 'Individual' )  AND (  civicrm_dedupe_rule_group.used  = 'Supervised' )
 
 
 
 [nativecode=1054 ** Unknown column 'civicrm_dedupe_rule_group.used' in 'where clause']
    [type] => DB_Error
    [user_info] => SELECT *
 FROM civicrm_dedupe_rule_group
 
 WHERE (  civicrm_dedupe_rule_group.contact_type  = 'Individual' )  AND (  civicrm_dedupe_rule_group.used  = 'Supervised' )
 
 
 
 [nativecode=1054 ** Unknown column 'civicrm_dedupe_rule_group.used' in 'where clause']
    [to_string] => [db_error: message="DB Error: no such field" code=-19 mode=callback callback=CRM_Core_Error::handle prefix="" info="SELECT *
 FROM civicrm_dedupe_rule_group
 
 WHERE (  civicrm_dedupe_rule_group.contact_type  = 'Individual' )  AND (  civicrm_dedupe_rule_group.used  = 'Supervised' )
 
 
 
 [nativecode=1054 ** Unknown column 'civicrm_dedupe_rule_group.used' in 'where clause']"]
)

[Hershel]

Hi. Your CiviCRM code version is 4.3.10 and your DB version is 4.2.2.upgrade which means that little box is precisely correct--your system seems to have been interrupted in the middle of an upgrade. This is often a problematic situation.

You could try to visit

civicrm/upgrade?reset=1

and see if it will finish the upgrade procedure. If not, then you would probably want to rebuild the schema for 4.2.2 or even a prior version and then upgrade from there. That might involve data loss. The schema rebuild procedure also you would probably want to ask a professional to handle for you.

[2ways]

Thanks, Hershel.

Yes.  civicrm/upgrade?reset=1 isn't working.  Complains the database has been partially upgraded.

Where did you find the database version information?  I'm happy to try to rebuild the 4.2.2 schema, but I'll need to know how to be certain of the version I'm restoring.

Thanks,
Lewis

[Hershel]

Where did you find the database version information?

This datum is stored in the civicrm_domain table. In phpMyAdmin, click "Browse" for that table and you will see it in one of the boxes--there is only one record in that table.

[ken]

Hi Lewis,

I hope you're having this problem with your test database and not production. If test, why not go back to home base?

Ken

[2ways]

Hi Folks,

Update:
From encouragement in this post [http://forum.civicrm.org/index.php?topic=14429.0], I disabled my custom theme, and, voila, I managed to upgrade from 4.2.0 to 4.2.1 without any errors.

I am now grinding my way through some incremental upgrades to get up-to-date.  I was just attempting to go from 4.2.1 to 4.2.19, in one jump, before moving on to 4.3.0, but am getting lots of complaints and can't get past 4.2.4.  The error message is below in case there is anything obvious someone wants to point out.

I am going to go back to 4.2.1 and move by one version number up through 4.5 to see if that has any better success.  Will update this thread once I have some reportable results.

The database is accessible, the data is all there, and I can use CiviMail, so things are in a much better state.  Thanks for the help.  It looks like I will have to reconstruct some of the display profiles, so that I can edit all the information in the records, but I'll concern myself with that when I get the code and database up to the current version.

Lewis

[Error: Upgrade DB to 4.2.5]
Error Field   Error Value
Type   DB_Error
Code   -19
Message   DB Error: no such field
Mode   16

UserInfo   SELECT cpse.entity_id, cpse.price_set_id FROM `civicrm_price_set_entity` cpse LEFT JOIN civicrm_price_set cps ON cps.id = cpse.price_set_id LEFT JOIN civicrm_price_set_entity cpse1 ON cpse1.price_set_id = cpse.price_set_id WHERE cpse.entity_table = 'civicrm_event' AND cps.is_quick_config = 1 GROUP BY cpse.id HAVING COUNT(cpse.price_set_id) > 1 AND MIN(cpse1.id) <> cpse.id [nativecode=1054 ** Unknown column 'cps.is_quick_config' in 'where clause']

DebugInfo   SELECT cpse.entity_id, cpse.price_set_id FROM `civicrm_price_set_entity` cpse LEFT JOIN civicrm_price_set cps ON cps.id = cpse.price_set_id LEFT JOIN civicrm_price_set_entity cpse1 ON cpse1.price_set_id = cpse.price_set_id WHERE cpse.entity_table = 'civicrm_event' AND cps.is_quick_config = 1 GROUP BY cpse.id HAVING COUNT(cpse.price_set_id) > 1 AND MIN(cpse1.id) <> cpse.id [nativecode=1054 ** Unknown column 'cps.is_quick_config' in 'where clause']

PEAR_Exception: DB Error: no such field in unknown on line unknown
DB_Error: DB Error: no such field in unknown on line unknown

[2ways]

Okay.  Trying at the moment to go from 4.2.1 to 4.2.2.

Getting the error below.  Why does it say it is trying to upgrade to 4.2.alpha1? 

Is the error skippable?

Thanks,
Lewis

[Error: Upgrade DB to 4.2.alpha1: Contributions (0 => 4999)]

Error Field   Error Value
Type   DB_Error
Code   -19
Message   DB Error: no such field
Mode   16

UserInfo   INSERT INTO civicrm_line_item(`entity_table` ,`entity_id` ,`price_field_id` ,`label` , `qty` ,`unit_price` ,`line_total` ,`participant_count` ,`price_field_value_id`) SELECT 'civicrm_contribution',cc.id, cpf.id as price_field_id, cpfv.label, 1, cc.total_amount, cc.total_amount line_total, 0, cpfv.id as price_field_value FROM civicrm_membership_payment cmp LEFT JOIN `civicrm_contribution` cc ON cc.id = cmp.contribution_id LEFT JOIN civicrm_line_item cli ON cc.id=cli.entity_id and cli.entity_table = 'civicrm_contribution' LEFT JOIN civicrm_membership cm ON cm.id=cmp.membership_id LEFT JOIN civicrm_membership_type cmt ON cmt.id = cm.membership_type_id LEFT JOIN civicrm_price_field cpf ON cpf.name = cmt.member_of_contact_id LEFT JOIN civicrm_price_field_value cpfv ON cpfv.membership_type_id = cm.membership_type_id AND cpf.id = cpfv.price_field_id WHERE (cc.id BETWEEN 0 AND 4999) AND cli.entity_id IS NULL ; [nativecode=1054 ** Unknown column 'cpfv.membership_type_id' in 'on clause']

DebugInfo   INSERT INTO civicrm_line_item(`entity_table` ,`entity_id` ,`price_field_id` ,`label` , `qty` ,`unit_price` ,`line_total` ,`participant_count` ,`price_field_value_id`) SELECT 'civicrm_contribution',cc.id, cpf.id as price_field_id, cpfv.label, 1, cc.total_amount, cc.total_amount line_total, 0, cpfv.id as price_field_value FROM civicrm_membership_payment cmp LEFT JOIN `civicrm_contribution` cc ON cc.id = cmp.contribution_id LEFT JOIN civicrm_line_item cli ON cc.id=cli.entity_id and cli.entity_table = 'civicrm_contribution' LEFT JOIN civicrm_membership cm ON cm.id=cmp.membership_id LEFT JOIN civicrm_membership_type cmt ON cmt.id = cm.membership_type_id LEFT JOIN civicrm_price_field cpf ON cpf.name = cmt.member_of_contact_id LEFT JOIN civicrm_price_field_value cpfv ON cpfv.membership_type_id = cm.membership_type_id AND cpf.id = cpfv.price_field_id WHERE (cc.id BETWEEN 0 AND 4999) AND cli.entity_id IS NULL ; [nativecode=1054 ** Unknown column 'cpfv.membership_type_id' in 'on clause']

[2ways]

Update:
1. 'skipped' past error in upgrading from 4.2.1 to 4.2.2 - was told I had successfully upgraded
2. upgraded from there to 4.2.4 with no complaints
3. stuck again going from 4.2.4 to 4.2.5 - error message same as two posts above (will include here anyway)

I can't get the upgrade script to go past this error.  'Skip' and 'Retry' both leave me hung at the same step.

Should I simply create the offending field in SQL and see if it can then cruise past that step?

Thanks,
Lewis

[Error: Upgrade DB to 4.2.5]

Error Field   Error Value
Type   DB_Error
Code   -19
Message   DB Error: no such field
Mode   16

UserInfo   SELECT cpse.entity_id, cpse.price_set_id FROM `civicrm_price_set_entity` cpse LEFT JOIN civicrm_price_set cps ON cps.id = cpse.price_set_id LEFT JOIN civicrm_price_set_entity cpse1 ON cpse1.price_set_id = cpse.price_set_id WHERE cpse.entity_table = 'civicrm_event' AND cps.is_quick_config = 1 GROUP BY cpse.id HAVING COUNT(cpse.price_set_id) > 1 AND MIN(cpse1.id) <> cpse.id [nativecode=1054 ** Unknown column 'cps.is_quick_config' in 'where clause']

DebugInfo   SELECT cpse.entity_id, cpse.price_set_id FROM `civicrm_price_set_entity` cpse LEFT JOIN civicrm_price_set cps ON cps.id = cpse.price_set_id LEFT JOIN civicrm_price_set_entity cpse1 ON cpse1.price_set_id = cpse.price_set_id WHERE cpse.entity_table = 'civicrm_event' AND cps.is_quick_config = 1 GROUP BY cpse.id HAVING COUNT(cpse.price_set_id) > 1 AND MIN(cpse1.id) <> cpse.id [nativecode=1054 ** Unknown column 'cps.is_quick_config' in 'where clause']