55% of mail bounced after 4.4.3 upgrade

[ericross]

691 of 1254 mails bounced after upgrade to version 4.4.3.

Had previously used this list through several upgrades without any issue. Would typically get ~2% bounced as there are almost always a few new inactive or changed addresses. Also, would almost always get some click-throughs and forwards but don't see any in this report.

There were no visible error, see send log attached, the scheduled mailer report simply indicated 691 bounces of type invalid, inactive, syntax, DNS.

[ericross]

I have been able to process all of my contacts by submitting the bounced list as a new scheduled mailing. Each bounced set was smaller and the last batch was 62 with 27 that bounced. A few of these are clearly bad so I'll validate these individually.


The only error I see is this note in my browser when I run scheduled jobs manually:


Failed Processing: Request received: Christmas Greetings, Action: r, Job ID: 104, Queue ID: 6561, Hash: f4f888efa4d4235c. Reason: DB Error: syntax error Failed Processing: Re: Christmas Greetings, Action: r, Job ID: 104, Queue ID: 6100, Hash: ae91a8ba70b35a85. Reason: DB Error: syntax error
[/size]
At this point, It looks like the emails didn't bounce from their host, just in CiviMail so my work around is to resend multiple batches until I clear all of the bounces.

I thought this might be a batch size issue, yet even the smaller batch of 62 bounced almost half of the contacts. I appears that CiviMail is mis-identifying or skipping contacts in the processing loop.

My system:
I have fairly long PHP processing times and never had a timeout.
I've been running CiviMail for a few years without any significant glitches - same contacts, similar content.
The only quirk is that the[/size] {action.optOutURL} and {action.unsubscribeUrl} tokens fail and the {action.optOut} and {action.unsubscribe} tokens work.


Any ideas about how to identify where the problem is or how to correct it?

[Donald Lobo]

check your civicrm log files (under the files/civicrm directory). there should be more details on the DB syntax error issue which should give u more of a clue

lobo

[ericross]

I've downgraded to 4.4.3 and am mostly running again.


Here is the log entry. I don't see any error in the data for this record so it is likely a code problem.




Dec 30 20:26:42  [info] $backTrace = #0 /home/ndpnyorg/public_html/wp-content/plugins/civicrm/civicrm/CRM/Core/Error.php(770): CRM_Core_Error::backtrace("backTrace", TRUE)
#1 [internal function](): CRM_Core_Error::exceptionHandler(Object(DB_Error))
#2 /home/ndpnyorg/public_html/wp-content/plugins/civicrm/civicrm/packages/PEAR.php(931): call_user_func((Array:2), Object(DB_Error))
#3 /home/ndpnyorg/public_html/wp-content/plugins/civicrm/civicrm/packages/DB.php(969): PEAR_Error->PEAR_Error("DB Error: syntax error", -2, 16, (Array:2), "SELECT     civicrm_contact.preferred_mail_format as format,\n                ...")
#4 /home/ndpnyorg/public_html/wp-content/plugins/civicrm/civicrm/packages/PEAR.php(564): DB_Error->DB_Error(-2, 16, (Array:2), "SELECT     civicrm_contact.preferred_mail_format as format,\n                ...")
#5 /home/ndpnyorg/public_html/wp-content/plugins/civicrm/civicrm/packages/DB/common.php(1905): PEAR->raiseError(NULL, -2, NULL, NULL, "SELECT     civicrm_contact.preferred_mail_format as format,\n                ...", "DB_Error", TRUE)
#6 /home/ndpnyorg/public_html/wp-content/plugins/civicrm/civicrm/packages/DB/mysql.php(898): DB_common->raiseError(-2, NULL, NULL, NULL, "1064 ** You have an error in your SQL syntax; check the manual that correspon...")
#7 /home/ndpnyorg/public_html/wp-content/plugins/civicrm/civicrm/packages/DB/mysql.php(327): DB_mysql->mysqlRaiseError()
#8 /home/ndpnyorg/public_html/wp-content/plugins/civicrm/civicrm/packages/DB/common.php(1216): DB_mysql->simpleQuery("SELECT     civicrm_contact.preferred_mail_format as format,\n                ...")
#9 /home/ndpnyorg/public_html/wp-content/plugins/civicrm/civicrm/packages/DB/DataObject.php(2421): DB_common->query("SELECT     civicrm_contact.preferred_mail_format as format,\n                ...")
#10 /home/ndpnyorg/public_html/wp-content/plugins/civicrm/civicrm/packages/DB/DataObject.php(1613): DB_DataObject->_query("SELECT     civicrm_contact.preferred_mail_format as format,\n                ...")
#11 /home/ndpnyorg/public_html/wp-content/plugins/civicrm/civicrm/CRM/Core/DAO.php(160): DB_DataObject->query("SELECT     civicrm_contact.preferred_mail_format as format,\n                ...")
#12 /home/ndpnyorg/public_html/wp-content/plugins/civicrm/civicrm/CRM/Mailing/Event/BAO/Reply.php(225): CRM_Core_DAO->query("SELECT     civicrm_contact.preferred_mail_format as format,\n                ...")
#13 /home/ndpnyorg/public_html/wp-content/plugins/civicrm/civicrm/CRM/Mailing/Event/BAO/Reply.php(82): CRM_Mailing_Event_BAO_Reply::autoRespond(Object(CRM_Mailing_BAO_Mailing), "6100", "HonDGS@Roadrunner.com")
#14 /home/ndpnyorg/public_html/wp-content/plugins/civicrm/civicrm/api/v3/Mailing.php(154): CRM_Mailing_Event_BAO_Reply::reply("104", "6100", "ae91a8ba70b35a85", "HonDGS@Roadrunner.com")
#15 /home/ndpnyorg/public_html/wp-content/plugins/civicrm/civicrm/api/api.php(87): civicrm_api3_mailing_event_reply((Array:)
#16 /home/ndpnyorg/public_html/wp-content/plugins/civicrm/civicrm/CRM/Utils/Mail/EmailProcessor.php(357): civicrm_api("Mailing", "event_reply", (Array:)
#17 /home/ndpnyorg/public_html/wp-content/plugins/civicrm/civicrm/CRM/Utils/Mail/EmailProcessor.php(55): CRM_Utils_Mail_EmailProcessor::_process(TRUE, Object(CRM_Core_DAO_MailSettings))
#18 /home/ndpnyorg/public_html/wp-content/plugins/civicrm/civicrm/api/v3/Job.php(357): CRM_Utils_Mail_EmailProcessor::processBounces()
#19 /home/ndpnyorg/public_html/wp-content/plugins/civicrm/civicrm/api/api.php(87): civicrm_api3_job_fetch_bounces((Array:1))
#20 /home/ndpnyorg/public_html/wp-content/plugins/civicrm/civicrm/CRM/Core/JobManager.php(132): civicrm_api("Job", "fetch_bounces", (Array:1))
#21 /home/ndpnyorg/public_html/wp-content/plugins/civicrm/civicrm/CRM/Core/JobManager.php(88): CRM_Core_JobManager->executeJob(Object(CRM_Core_ScheduledJob))
#22 /home/ndpnyorg/public_html/wp-content/plugins/civicrm/civicrm/CRM/Utils/System.php(1543): CRM_Core_JobManager->execute(FALSE)
#23 [internal function](): CRM_Utils_System::executeScheduledJobs((Array:3))
#24 /home/ndpnyorg/public_html/wp-content/plugins/civicrm/civicrm/CRM/Core/Invoke.php(289): call_user_func((Array:2), (Array:3))
#25 /home/ndpnyorg/public_html/wp-content/plugins/civicrm/civicrm/CRM/Core/Invoke.php(72): CRM_Core_Invoke::runItem((Array:12))
#26 /home/ndpnyorg/public_html/wp-content/plugins/civicrm/civicrm/CRM/Core/Invoke.php(52): CRM_Core_Invoke::_invoke((Array:3))
#27 /home/ndpnyorg/public_html/wp-content/plugins/civicrm/civicrm.php(466): CRM_Core_Invoke::invoke((Array:3))
#28 [internal function](): CiviCRM_For_WordPress->invoke("")
#29 /home/ndpnyorg/public_html/wp-includes/plugin.php(429): call_user_func_array((Array:2), (Array:1))
#30 /home/ndpnyorg/public_html/wp-admin/admin.php(217): do_action("toplevel_page_CiviCRM")
#31 {main}