CiviCRM Community Forums (archive)

*

News:

Have a question about CiviCRM?
Get it answered quickly at the new
CiviCRM Stack Exchange Q+A site

This forum was archived on 25 November 2017. Learn more.
How to get involved.
What to do if you think you've found a bug.



  • CiviCRM Community Forums (archive) »
  • Old sections (read-only, deprecated) »
  • Support »
  • Using CiviCRM »
  • Using CiviMail (Moderator: Piotr Szotkowski) »
  • Appropriate value for Mailer Job Size
Pages: [1]

Author Topic: Appropriate value for Mailer Job Size  (Read 1748 times)

jase700

  • I post occasionally
  • **
  • Posts: 57
  • Karma: 3
Appropriate value for Mailer Job Size
December 20, 2010, 11:31:04 am
Can someone give me some guidance on how to set the Mailer Job Size value in the settings?  I have it set to 1000 and it seems to be speeding things up slightly. 

Donald Lobo

  • Administrator
  • I’m (like) Lobo ;)
  • *****
  • Posts: 15963
  • Karma: 470
    • CiviCRM site
  • CiviCRM version: 4.2+
  • CMS version: Drupal 7, Joomla 2.5+
  • MySQL version: 5.5.x
  • PHP version: 5.4.x
Re: Appropriate value for Mailer Job Size
December 20, 2010, 06:54:54 pm

In general you would set it to how many jobs in parallel you want trying to deliver one mailing. In some cases it depends on how many smtp connections your smtp provider allows. It also depends on the mailing size.

Basically number of jobs comes into play ONLY when your cronjob is fired more often than it takes to process one single job. If you are not sending a lot of mail on a constant basis, leaving the default value (i.e. 1 job) is recommened

lobo
A new CiviCRM Q&A resource needs YOUR help to get started. Visit our StackExchange proposed site, sign up and vote on 5 questions

jase700

  • I post occasionally
  • **
  • Posts: 57
  • Karma: 3
Re: Appropriate value for Mailer Job Size
December 20, 2010, 07:13:11 pm
Thank you for the response.  We typically have mailings of between 36k and 120k per send.  We are using CiviSMTP.  I'm looking for any advantage to speed this up on larger mailings.  We have a VPS server with 1.5 GB of RAM through Verio.

I'm looking mostly for the formula.  What should that value be and how long should I spread my Cron.  For reference, the best we could ever get was 6k sends/hour with the cron running every 15 minutes.

jA

Donald Lobo

  • Administrator
  • I’m (like) Lobo ;)
  • *****
  • Posts: 15963
  • Karma: 470
    • CiviCRM site
  • CiviCRM version: 4.2+
  • CMS version: Drupal 7, Joomla 2.5+
  • MySQL version: 5.5.x
  • PHP version: 5.4.x
Re: Appropriate value for Mailer Job Size
December 20, 2010, 07:26:12 pm

How about

#jobs = 10
cronjob fired every 3 minutes (u can reduce this to try to get more speed)

Note that this will put a fair load on your server and civismtp connections, so i would chat with them and ensure they are fine with it :)

lobo
A new CiviCRM Q&A resource needs YOUR help to get started. Visit our StackExchange proposed site, sign up and vote on 5 questions

kmarkley

  • I post frequently
  • ***
  • Posts: 178
  • Karma: 14
  • CiviCRM version: 4.4.3
  • CMS version: Drupal 7.24
  • MySQL version: 5.1.56
  • PHP version: 5.3.27
Re: Appropriate value for Mailer Job Size
December 29, 2010, 11:59:56 am
I'm still a little confused about the "Mailer Job Size" field.

This sounds like it should be the number of parallel jobs:
Quote from: Donald Lobo on December 20, 2010, 06:54:54 pm
In general you would set it to how many jobs in parallel you want trying to deliver one mailing. In some cases it depends on how many smtp connections your smtp provider allows. It also depends on the mailing size.

But the field help text makes it sound like it should be the number of emails for each parallel job:
Quote
If you want to utilize multi-threading enter the size you want your sub jobs to be split into


So just to clarify, let's say my batch limit is 100 and my smtp provider allows 5 connections.  Should "Mailer Job Size" be 5 (# of jobs) or 20 (batch limit/# of jobs)?

Thanks.

Donald Lobo

  • Administrator
  • I’m (like) Lobo ;)
  • *****
  • Posts: 15963
  • Karma: 470
    • CiviCRM site
  • CiviCRM version: 4.2+
  • CMS version: Drupal 7, Joomla 2.5+
  • MySQL version: 5.5.x
  • PHP version: 5.4.x
Re: Appropriate value for Mailer Job Size
December 29, 2010, 06:17:58 pm

the documentation is right, the job size indicates the number of emails that should be in each job

in general splitting a mailing into multiple smaller jobs allows an install to potentially have multiple threads each working on a different sub-job

in general if you want high speed, you probably dont want to set a batch limit (i.e. u want each thread to send as many emails as quickly as possible)

we currently dont restrict the number of threads that can be run in parallel, you'll need to modify civimail.cronjob.php to do so

lobo
A new CiviCRM Q&A resource needs YOUR help to get started. Visit our StackExchange proposed site, sign up and vote on 5 questions

Pages: [1]
  • CiviCRM Community Forums (archive) »
  • Old sections (read-only, deprecated) »
  • Support »
  • Using CiviCRM »
  • Using CiviMail (Moderator: Piotr Szotkowski) »
  • Appropriate value for Mailer Job Size

This forum was archived on 2017-11-26.