CiviCRM Community Forums (archive)

*

News:

Have a question about CiviCRM?
Get it answered quickly at the new
CiviCRM Stack Exchange Q+A site

This forum was archived on 25 November 2017. Learn more.
How to get involved.
What to do if you think you've found a bug.



  • CiviCRM Community Forums (archive) »
  • Old sections (read-only, deprecated) »
  • Support »
  • Using CiviCRM »
  • Using CiviMail (Moderator: Piotr Szotkowski) »
  • 3.3 Beta 1 - Mass Mailing Process sends at only 200 recipients and stay Running
Pages: [1] 2

Author Topic: 3.3 Beta 1 - Mass Mailing Process sends at only 200 recipients and stay Running  (Read 3595 times)

jscm

  • Guest
3.3 Beta 1 - Mass Mailing Process sends at only 200 recipients and stay Running
November 15, 2010, 03:48:35 am
Hi,
I have installed and configured CiviCRM 3.3 Beta 1.
I done all tests using a group with 3 recipients (one is faked to perform tests), and CiviMail worked properly.

When I send mass mailing at 4100 recipients, Cronjob send only at first 190-210 recipients in Group and CiviMail Report Interface showa always Running Status.

The scheduling is not closed, cronjob process don't send email anymore.  All stay in pending!

I can track opens, bounces and click-troughts.. I can't track replies and forward.

I tried to set Mail Spool but I have the same problem.

I can send 10.000 email for a day using my SMTP Server on Webfaction.com

I used with successful CiviMail in CiviCRM 3.1.4

Can you help me?

jscm
Milan (Italy)
« Last Edit: November 15, 2010, 04:25:49 am by jscm »

xavier

  • Forum Godess / God
  • I’m (like) Lobo ;)
  • *****
  • Posts: 4453
  • Karma: 161
    • Tech To The People
  • CiviCRM version: yes probably
  • CMS version: drupal
Re: 3.3 Beta 1 - Mass Mailing Process sends at only 200 recipients and stay Running
November 15, 2010, 05:36:43 am
Hi

Can you run manually the page called by the cron and paste the result here ?

X+
-Hackathon and data journalism about the European parliament 24-26 jan. Watch out the result

jscm

  • Guest
Re: 3.3 Beta 1 - Mass Mailing Process sends at only 200 recipients and stay Running
November 15, 2010, 05:51:39 am
Hi,
Running Cron Manually I've got an error message.

Fatal error: Maximum execution time of 30 seconds exceeded in ~/101112_crm/sites/all/modules/civicrm/packages/Mail/RFC822.php on line 428

it sent at 198 recipients.
Status stay Running.
« Last Edit: November 15, 2010, 07:25:34 am by jscm »

jscm

  • Guest
Re: 3.3 Beta 1 - Mass Mailing Process sends at only 200 recipients and stay Running
November 15, 2010, 08:12:03 am
After the error messager on Cronjob... I tried also to set spool at 130, 100, and 80.

The problem is always there.

When Spool was at 100, I tried to run cronjob manually.... and I didn't get error messages... BUT ... next cronjob doesn't send email at remains recipients.

So the status is always Running... but email are not more sent.

What can I do?


xcf33

  • I post frequently
  • ***
  • Posts: 181
  • Karma: 7
  • CiviCRM version: 3.3.2
  • CMS version: Drupal 6.19/6.20
  • MySQL version: 5.x
  • PHP version: 5.2.6
Re: 3.3 Beta 1 - Mass Mailing Process sends at only 200 recipients and stay Running
November 15, 2010, 08:17:15 am
Hey jscm,

what's your mailer configuration settings?

3.3 uses divides the mailing into multiple jobs and each cron run it sends a limited amount of mails.

jscm

  • Guest
Re: 3.3 Beta 1 - Mass Mailing Process sends at only 200 recipients and stay Running
November 15, 2010, 08:24:25 am
Hi xcf33,

At the moment Mailer Settings are:

Mailer Batch Limit80
Mailer Job Size
VERP Separator.

I tried several times to reduce Mailber Batch Limit, at Beginning it was 1000.

Can you help me?

jscm

  • Guest
Re: 3.3 Beta 1 - Mass Mailing Process sends at only 200 recipients and stay Running
November 15, 2010, 08:31:53 am
it Seems like that after the first CronJob, that not complete the Mass Mailing Run, the next Cronjobs don't find any Mass Mailing Process to Complete.

xcf33

  • I post frequently
  • ***
  • Posts: 181
  • Karma: 7
  • CiviCRM version: 3.3.2
  • CMS version: Drupal 6.19/6.20
  • MySQL version: 5.x
  • PHP version: 5.2.6
Re: 3.3 Beta 1 - Mass Mailing Process sends at only 200 recipients and stay Running
November 15, 2010, 08:51:18 am
Hi jscm,

I think the first thing to do is enable email debugging,

http://wiki.civicrm.org/confluence/display/CRMDOC32/Debugging

Do that, and run the mailing again, but this time the mails should be written to your server instead of being sent out, we just have to find out what made the mailing stuck.


Cheers!

jscm

  • Guest
Re: 3.3 Beta 1 - Mass Mailing Process sends at only 200 recipients and stay Running
November 15, 2010, 08:58:04 am
Ok!.. I will try.
Maybe I don't understand english but if I send email at my server  (at mailbox sender) I can send only one email.
Can you explain?

I read... and I understand now!
« Last Edit: November 15, 2010, 09:03:22 am by jscm »

jscm

  • Guest
Re: 3.3 Beta 1 - Mass Mailing Process sends at only 200 recipients and stay Running
November 15, 2010, 09:41:29 am
Quote from: xcf33 on November 15, 2010, 08:51:18 am
Hi jscm,

I think the first thing to do is enable email debugging,

http://wiki.civicrm.org/confluence/display/CRMDOC32/Debugging

Do that, and run the mailing again, but this time the mails should be written to your server instead of being sent out, we just have to find out what made the mailing stuck.


Cheers!


I enabled Debug Mode like document guide explain.
So in civicrm.settings.php I enable CIVICRM_MAIL_LOG

I got this error message at the end of cronjob
<b>Fatal error</b>:  Maximum execution time of 30 seconds exceeded in <b>/home/jscm/webapps/101112_crm/sites/all/modules/civicrm/packages/DB/DataObject.php</b> on line <b>2362</b>

I can't attach the mail.log file because it is 1.7MB .tar.gz, but you can download it from Ubuntu One http://ubuntuone.com/p/PQ4/

Intended Recipient: 3141
Successful Deliveris: 496

Mailer Batch Limit
Mailer Job Size
VERP Separator   .


I hope this can help you!
If you need some tests let me know.
Thanks a lot.
« Last Edit: November 16, 2010, 06:31:16 pm by jscm »

jscm

  • Guest
Re: 3.3 Beta 1 - Mass Mailing Process sends at only 200 recipients and stay Running
November 16, 2010, 02:39:06 am
Someone have good news for me?

jscm

  • Guest
Re: 3.3 Beta 1 - Mass Mailing Process sends at only 200 recipients and stay Running
November 16, 2010, 06:30:30 pm
I'm testing also CiviMail in CiviCRM 3.2.4, using Debug Mode.
I see that cronjob works properly.

davej

  • Ask me questions
  • ****
  • Posts: 404
  • Karma: 21
Re: 3.3 Beta 1 - Mass Mailing Process sends at only 200 recipients and stay Running
December 13, 2010, 04:00:46 am
Similar problem here with 3.3.1 but in our case we are not hitting max_execution_time. This is on a site that has recently been upgraded from 3.2.3 to 3.3.1 . In 3.2.3, mailings were working correctly. Since the upgrade, mailings get stuck at 200 recipients. Visiting /civicrm/mailing/queue?reset=1 as uid 1 does not solve the problem, the mailings are still stuck. Mailer Batch Limit was set to 200. I tried changing this to 0 but this did not help. Mailer Job Size was empty, I tried setting this to 0 but this made no difference.

Code: [Select]
mysql> select * from civicrm_mailing_job j where j.is_test = 0 and ( j.status = 'Running' and j.end_date IS null );
+-----+------------+---------------------+---------------------+----------+---------+---------+----------+-----------+------------+-----------+
| id  | mailing_id | scheduled_date      | start_date          | end_date | status  | is_test | job_type | parent_id | job_offset | job_limit |
+-----+------------+---------------------+---------------------+----------+---------+---------+----------+-----------+------------+-----------+
| 712 |        332 | 2010-12-10 09:34:59 | 2010-12-10 09:39:04 | NULL     | Running |       0 | NULL     |      NULL |          0 |         0 |
| 713 |        332 | 2010-12-10 09:34:59 | 2010-12-10 09:39:04 | NULL     | Running |       0 | child    |       712 |          0 |       220 |
| 719 |        334 | 2010-12-10 11:47:55 | 2010-12-10 11:52:02 | NULL     | Running |       0 | NULL     |      NULL |          0 |         0 |
| 720 |        334 | 2010-12-10 11:47:55 | 2010-12-10 11:52:02 | NULL     | Running |       0 | child    |       719 |          0 |       326 |
+-----+------------+---------------------+---------------------+----------+---------+---------+----------+-----------+------------+-----------+

Is there anything extra that needs to be done to get mailings working after upgrading to 3.3? The client is getting annoyed that every time we upgrade their Civi, mailings break. (Happened going from 3.1 to 3.2 due to changes in permissions required for the cron job user, e.g. needing "view all contacts".)

Edit: have had a look at CRM/Mailing/BAO/Job.php in 3.3.1 and I don't understand how it's intended to deal with part-finished child jobs. The deficiency here may well be in my understanding rather than the code, but AFAICS:

runJobs_pre():
- select Scheduled parent jobs;
- for each, create 1 or more Scheduled child jobs and set parent to Running.

runJobs():
- select first Scheduled child job;
- if status isn't Running (we already know it isn't because we selected only Scheduled) then queue job, set start time and change to Running;
- deliver job;
- if delivery completed, mark job Complete.

runJobs_post():
- select Running parent jobs;
- for each, if there are no incomplete child jobs then mark parent job complete.

deliver():
- iterates through recipients & sends mails, returning false if it hits $config->mailerBatchLimit before completing the job.

So what is supposed to happen if a child job hits $config->mailerBatchLimit before completion? I can't find code in CRM/Mailing/BAO/Job.php that deals with this case, AFAICS they get left in limbo and that fits with what is happening on the site in question.

Thanks in advance for any advice,

Dave
« Last Edit: December 13, 2010, 05:51:49 am by davej »

bcobin

  • I post frequently
  • ***
  • Posts: 337
  • Karma: 9
    • InterCreative Media
  • CiviCRM version: 4.3.3
  • CMS version: Drupal 7.22
  • MySQL version: 5.5.9
  • PHP version: 5.3
Re: 3.3 Beta 1 - Mass Mailing Process sends at only 200 recipients and stay Runn
December 13, 2010, 07:26:11 am
I am having the same problem after upgrade to 3.3 (any version, including betas). Client is getting very upset their emails aren't going out - I currently have a mailing that's Running to 12,000+ that's stuck at 719 and I can't unstick it.

Bad news here...

Donald Lobo

  • Administrator
  • I’m (like) Lobo ;)
  • *****
  • Posts: 15963
  • Karma: 470
    • CiviCRM site
  • CiviCRM version: 4.2+
  • CMS version: Drupal 7, Joomla 2.5+
  • MySQL version: 5.5.x
  • PHP version: 5.4.x
Re: 3.3 Beta 1 - Mass Mailing Process sends at only 200 recipients and stay Running
December 13, 2010, 07:52:33 am

can u'll apply the following patch:

Code: [Select]
svn diff CRM/Mailing/BAO/Job.php
Index: CRM/Mailing/BAO/Job.php
===================================================================
--- CRM/Mailing/BAO/Job.php     (revision 31195)
+++ CRM/Mailing/BAO/Job.php     (working copy)
@@ -87,7 +87,8 @@
                           AND   j.is_test = 0
                           AND   ( ( j.start_date IS null
                           AND       j.scheduled_date <= $currentTime
-                          AND       j.status = 'Scheduled'
+                          AND       j.status = 'Scheduled' )
+                OR     ( j.status = 'Running'
                           AND       j.end_date IS null ) )
                           AND (j.job_type = 'child')
                           AND   {$mailingACL}

thanx

lobo
A new CiviCRM Q&A resource needs YOUR help to get started. Visit our StackExchange proposed site, sign up and vote on 5 questions

Pages: [1] 2
  • CiviCRM Community Forums (archive) »
  • Old sections (read-only, deprecated) »
  • Support »
  • Using CiviCRM »
  • Using CiviMail (Moderator: Piotr Szotkowski) »
  • 3.3 Beta 1 - Mass Mailing Process sends at only 200 recipients and stay Running

This forum was archived on 2017-11-26.