CiviCRM Community Forums (archive)

*

News:

Have a question about CiviCRM?
Get it answered quickly at the new
CiviCRM Stack Exchange Q+A site

This forum was archived on 25 November 2017. Learn more.
How to get involved.
What to do if you think you've found a bug.



  • CiviCRM Community Forums (archive) »
  • Old sections (read-only, deprecated) »
  • Support »
  • Installing CiviCRM »
  • CiviMail installation and configuration (Moderator: Donald Lobo) »
  • Looking for some clarity on civiMail settings (Plesk11 VPS)
Pages: [1] 2

Author Topic: Looking for some clarity on civiMail settings (Plesk11 VPS)  (Read 3561 times)

awasson

  • I post frequently
  • ***
  • Posts: 230
  • Karma: 7
  • Living in a world of Drupal / CiviCRM
    • My Company: Luna Design
  • CiviCRM version: Latest
  • CMS version: Drupal 6/7/8
  • MySQL version: 5.x
  • PHP version: 5.3.x
Looking for some clarity on civiMail settings (Plesk11 VPS)
February 21, 2013, 04:59:17 pm
Hi there,

I'll start out with the following (to make things efficient)
  • I am running the latest D7 with civiCRM 4.2.4
  • I have read several (and maybe all of the) wiki entries and articles about setting up civiMail and I'm pretty sure I've got everything set up correctly within civiCRM
  • I have set up my Scheduled Jobs appropriately: Send Scheduled Mailings (Always), Fetch Bounces (Always), Process Inbound Emails (Always)
  • I've set up my civiMail -> Mailer Settings: Mailer Throttle Time = 150000, Mailer Job Size: 5000, everything else is default.
  • I'm using mail() in Outbound Mail settings and have not received any errors when testing.
  • I have a Default email account used for bounce processing return@example.com using the settings described in the wki instructions
  • My email processor will not allow for dynamic emails like return+r.80.1467.20d9bc4caacdc096@example.com so I have set return@example.com as a catchall account as described in the instructions
  • I have enabled Track replies using VERP in Reply-To header in CiviMail Component Settings
  • I have set up a cron job that runs every 30 minutes and it does run successfully

So, with all that said, here's the issues:

  • When I schedule an email to go out, it send out the first 10 and sits in running status. I suppose if I let it continue running cron jobs it would complete the run but I'm impatient and instead I've used http://www.example.com/civicrm/mailing/queue?reset=1&name=name&pass=password&key=my_key to get it over the hump... That works. Should I be running Cron every minute or something? I'm not sure what is limiting it to 10 messages. I made my changes to Throttle and Job Size in the hopes to improve that but it appears that it hasn't made a difference.

  • When bounce processing is run, it checks for bounces and return messages. As far as I can see it is working as expected (reporting bounces and reporting/redirecting replies) however I receive an error if I run the job manually and I receive an emailed error when it runs from cron. The most recent message I have received is:

    Failed Processing: Re: SUBJECT_OF_MAILING, Action: r, Job ID: 80, Queue ID: 1467, Hash: 20d9bc4caacdc096. Reason: Queue event could not be found.

    The List of log entries for: Fetch Bounces always reports success and although I have a record of 25 or so bounces it always shows 0 Bounces.

  • My List of log entries for: Process Inbound Emails always shows Failure... I'm not sure why, what it is doing or whether I shouldn't be scheduling it to run. The Full Message is:

    Finished execution of Process Inbound Emails with result: Failure, Error message: Process Activities failed


I think those are the only concerns I have with my setup but I'm working on several similar installations and civiMail is pretty fantastic so I want to work out the kinks.

Thanks,
Andrew
My CiviCRM Extension Workshop: https://github.com/awasson

kharding

  • I post occasionally
  • **
  • Posts: 75
  • Karma: 4
  • CiviCRM version: 4.2.7
  • CMS version: Drupal 7
  • MySQL version: Recent
  • PHP version: 5.3.16
Re: Looking for some clarity on civiMail settings (Plesk11 VPS)
February 21, 2013, 05:50:09 pm
Quote from: awasson on February 21, 2013, 04:59:17 pm

  • When I schedule an email to go out, it send out the first 10 and sits in running status. I suppose if I let it continue running cron jobs it would complete the run but I'm impatient and instead I've used http://www.example.com/civicrm/mailing/queue?reset=1&name=name&pass=password&key=my_key to get it over the hump... That works. Should I be running Cron every minute or something? I'm not sure what is limiting it to 10 messages. I made my changes to Throttle and Job Size in the hopes to improve that but it appears that it hasn't made a difference.

I have the same issue, but it isn't *really* an issue - by the time the cron job is next run, all emails have been distributed. I honestly can't sort out why it sits as "running" with only ten sent for the first run of the cron.  This was brought up in the forums a while back, but no real answer came from it.

Quote
My List of log entries for: Process Inbound Emails always shows Failure... I'm not sure why, what it is doing or whether I shouldn't be scheduling it to run. The Full Message is:

Finished execution of Process Inbound Emails with result: Failure, Error message: Process Activities failed

Since upgrading to 4.2.4, I had had this issue with the dedicated email account I had set up for email-to-activity processing.  Sadly, that error message gave no details.

Other threads suggested a lot of chmod and chown fixes, none of which worked.  Oddly, my bounce processing was working correctly, so I set my ETAP account to the bounce processing account, and they seem to have thus far co-existed.

Donald Lobo

  • Administrator
  • I’m (like) Lobo ;)
  • *****
  • Posts: 15963
  • Karma: 470
    • CiviCRM site
  • CiviCRM version: 4.2+
  • CMS version: Drupal 7, Joomla 2.5+
  • MySQL version: 5.5.x
  • PHP version: 5.4.x
Re: Looking for some clarity on civiMail settings (Plesk11 VPS)
February 21, 2013, 05:58:23 pm

any idea why u'll are not using 4.2.7 or 4.2.8?

quite a few fixes to the code since 4.2.4 and my memory recalls some stuff in the activity things

awasson: do u also get 10 mail issue when throttle time is down to 0?

lobo
A new CiviCRM Q&A resource needs YOUR help to get started. Visit our StackExchange proposed site, sign up and vote on 5 questions

awasson

  • I post frequently
  • ***
  • Posts: 230
  • Karma: 7
  • Living in a world of Drupal / CiviCRM
    • My Company: Luna Design
  • CiviCRM version: Latest
  • CMS version: Drupal 6/7/8
  • MySQL version: 5.x
  • PHP version: 5.3.x
Re: Looking for some clarity on civiMail settings (Plesk11 VPS)
February 21, 2013, 06:07:39 pm
Quote from: kharding on February 21, 2013, 05:50:09 pm
Quote
My List of log entries for: Process Inbound Emails always shows Failure... I'm not sure why, what it is doing or whether I shouldn't be scheduling it to run. The Full Message is:

Finished execution of Process Inbound Emails with result: Failure, Error message: Process Activities failed

Since upgrading to 4.2.4, I had had this issue with the dedicated email account I had set up for email-to-activity processing.  Sadly, that error message gave no details.

Other threads suggested a lot of chmod and chown fixes, none of which worked.  Oddly, my bounce processing was working correctly, so I set my ETAP account to the bounce processing account, and they seem to have thus far co-existed.

Thanks for the tip, I made that change and I no longer have the error.... I'll see if it changes anything else. too.
My CiviCRM Extension Workshop: https://github.com/awasson

awasson

  • I post frequently
  • ***
  • Posts: 230
  • Karma: 7
  • Living in a world of Drupal / CiviCRM
    • My Company: Luna Design
  • CiviCRM version: Latest
  • CMS version: Drupal 6/7/8
  • MySQL version: 5.x
  • PHP version: 5.3.x
Re: Looking for some clarity on civiMail settings (Plesk11 VPS)
February 21, 2013, 06:10:14 pm
Quote from: Donald Lobo on February 21, 2013, 05:58:23 pm

any idea why u'll are not using 4.2.7 or 4.2.8?

quite a few fixes to the code since 4.2.4 and my memory recalls some stuff in the activity things

awasson: do u also get 10 mail issue when throttle time is down to 0?

lobo

I'll be updating probably over the weekend and yes with the default settings I was only getting 10 emails out and then it went into running. I'll see if things change on the next run. kharding indicated that this happens but by the time cron runs again all has been sent.

Are there any best practices regarding how often to run cron?

Thanks,
Andrew
My CiviCRM Extension Workshop: https://github.com/awasson

Donald Lobo

  • Administrator
  • I’m (like) Lobo ;)
  • *****
  • Posts: 15963
  • Karma: 470
    • CiviCRM site
  • CiviCRM version: 4.2+
  • CMS version: Drupal 7, Joomla 2.5+
  • MySQL version: 5.5.x
  • PHP version: 5.4.x
Re: Looking for some clarity on civiMail settings (Plesk11 VPS)
February 21, 2013, 08:54:50 pm

how often you run cron depends on the size of your mailings / number of mailings sent per day / volume of your mail pipe / how fast you want to get the mail out

So if you are sending multiple emails on a daily basis, with each blast going to 10K - 100K users, i'd set it the cron to every min (and maybe max it at 5-10 simultaneous cron jobs) and have each thread deliver 2K - 5K emails

if you just send once a week to 10K or so users, maybe doing cron every 10-30 mins is not a bad choice

lobo
A new CiviCRM Q&A resource needs YOUR help to get started. Visit our StackExchange proposed site, sign up and vote on 5 questions

awasson

  • I post frequently
  • ***
  • Posts: 230
  • Karma: 7
  • Living in a world of Drupal / CiviCRM
    • My Company: Luna Design
  • CiviCRM version: Latest
  • CMS version: Drupal 6/7/8
  • MySQL version: 5.x
  • PHP version: 5.3.x
Re: Looking for some clarity on civiMail settings (Plesk11 VPS)
February 21, 2013, 11:02:35 pm
Thanks Lobo,

I think we're probably fine with this particular organization because we're sending only ~1000 users once or twice a week. I think I'll up the cron to every 10 minutes just to be safe though.

Andrew
My CiviCRM Extension Workshop: https://github.com/awasson

kharding

  • I post occasionally
  • **
  • Posts: 75
  • Karma: 4
  • CiviCRM version: 4.2.7
  • CMS version: Drupal 7
  • MySQL version: Recent
  • PHP version: 5.3.16
Re: Looking for some clarity on civiMail settings (Plesk11 VPS)
February 22, 2013, 02:46:35 pm
Quote from: awasson on February 21, 2013, 06:07:39 pm
Quote from: kharding on February 21, 2013, 05:50:09 pm
Quote
My List of log entries for: Process Inbound Emails always shows Failure... I'm not sure why, what it is doing or whether I shouldn't be scheduling it to run. The Full Message is:

Finished execution of Process Inbound Emails with result: Failure, Error message: Process Activities failed

Since upgrading to 4.2.4, I had had this issue with the dedicated email account I had set up for email-to-activity processing.  Sadly, that error message gave no details.

Other threads suggested a lot of chmod and chown fixes, none of which worked.  Oddly, my bounce processing was working correctly, so I set my ETAP account to the bounce processing account, and they seem to have thus far co-existed.

Thanks for the tip, I made that change and I no longer have the error.... I'll see if it changes anything else. too.

The biggest issue that I ran into with this was that I was using a catch-all email for bounce processing.  When I set that to the ETAP account, bazillions of false contacts and spam emails entered into Civi as activities.

I just now created a new ETAP mail account and set it up - and it seems to have executed the fetch incoming with success. No idea why the original one ceased functioning.  In any event, it's working again, and I've split bounce processing and ETAP again, to save my poor database.

awasson

  • I post frequently
  • ***
  • Posts: 230
  • Karma: 7
  • Living in a world of Drupal / CiviCRM
    • My Company: Luna Design
  • CiviCRM version: Latest
  • CMS version: Drupal 6/7/8
  • MySQL version: 5.x
  • PHP version: 5.3.x
Re: Looking for some clarity on civiMail settings (Plesk11 VPS)
February 22, 2013, 03:26:15 pm
Thanks for the info kharding. I'll keep an eye on this.

I don't think I have any option other than using my catchall for bounce processing because my email server doesn't recognize variations on an email address like return+r.80.1467.20d9bc4caacdc096@example.com. It will bounce that right back so I've set return@example.com as a catchall and it seems to be working fine.

NOTE: I do recall another issue that I wanted to include in my initial posting and that is when I send out a mailing with response tracking and someone send a response, I receive the response but the html from the original mailer is garbled and the message is prefixed with the following text:

This message is in MIME format. Since your mail reader does not understand
this format, some or all of this message may not be legible.


I'm not sure if that is a result of my email client or something else that caused that.
« Last Edit: February 22, 2013, 04:51:31 pm by awasson »
My CiviCRM Extension Workshop: https://github.com/awasson

kharding

  • I post occasionally
  • **
  • Posts: 75
  • Karma: 4
  • CiviCRM version: 4.2.7
  • CMS version: Drupal 7
  • MySQL version: Recent
  • PHP version: 5.3.16
Re: Looking for some clarity on civiMail settings (Plesk11 VPS)
February 22, 2013, 03:35:39 pm
It seems to work fine. I don't know if the bounce processing and ETAP routines peacefully co-exist - ie, bounce-processing moves non-bounces into an "ignored" folder when it runs, and I know that ETAP moves them to a "processed" and "ignored" folders too. 

I didn't send any mailings during the ~36 hours I had set the ETAP and bounce routines to the same address so I can't definitively say that they peacefully co-exist.

Donald Lobo

  • Administrator
  • I’m (like) Lobo ;)
  • *****
  • Posts: 15963
  • Karma: 470
    • CiviCRM site
  • CiviCRM version: 4.2+
  • CMS version: Drupal 7, Joomla 2.5+
  • MySQL version: 5.5.x
  • PHP version: 5.4.x
Re: Looking for some clarity on civiMail settings (Plesk11 VPS)
February 22, 2013, 05:02:59 pm

I took a quick look at the code and i dont think you can safely use the same email account to process bounces and "activities"

lobo
A new CiviCRM Q&A resource needs YOUR help to get started. Visit our StackExchange proposed site, sign up and vote on 5 questions

awasson

  • I post frequently
  • ***
  • Posts: 230
  • Karma: 7
  • Living in a world of Drupal / CiviCRM
    • My Company: Luna Design
  • CiviCRM version: Latest
  • CMS version: Drupal 6/7/8
  • MySQL version: 5.x
  • PHP version: 5.3.x
Re: Looking for some clarity on civiMail settings (Plesk11 VPS)
February 22, 2013, 05:06:22 pm
Ok, good to know.

I wonder do I really need to have ETAP account for my needs? I'm not sure how it fits into the scheme of things.
My CiviCRM Extension Workshop: https://github.com/awasson

kharding

  • I post occasionally
  • **
  • Posts: 75
  • Karma: 4
  • CiviCRM version: 4.2.7
  • CMS version: Drupal 7
  • MySQL version: Recent
  • PHP version: 5.3.16
Re: Looking for some clarity on civiMail settings (Plesk11 VPS)
February 22, 2013, 06:53:07 pm
Quote from: Donald Lobo on February 22, 2013, 05:02:59 pm

I took a quick look at the code and i dont think you can safely use the same email account to process bounces and "activities"

lobo

Good to know. I'm going to see if I can add this to the documentation. I had thought that this might be the case.

awasson

  • I post frequently
  • ***
  • Posts: 230
  • Karma: 7
  • Living in a world of Drupal / CiviCRM
    • My Company: Luna Design
  • CiviCRM version: Latest
  • CMS version: Drupal 6/7/8
  • MySQL version: 5.x
  • PHP version: 5.3.x
Re: Looking for some clarity on civiMail settings (Plesk11 VPS)
February 22, 2013, 07:12:16 pm
I've disabled processing inbound and removed my ETAP account for now as I don't think it's necessary for what we're doing. If I find that it's necessary I'll use the account that the admin of the organization uses as I think that is the way civi intended it to be used.
My CiviCRM Extension Workshop: https://github.com/awasson

kharding

  • I post occasionally
  • **
  • Posts: 75
  • Karma: 4
  • CiviCRM version: 4.2.7
  • CMS version: Drupal 7
  • MySQL version: Recent
  • PHP version: 5.3.16
Re: Looking for some clarity on civiMail settings (Plesk11 VPS)
February 23, 2013, 07:10:20 pm
I think that the suggested use-mode was an email address you could BCC or "bounce" messages at, so that there's a sort of filter on things.  Perhaps.

Pages: [1] 2
  • CiviCRM Community Forums (archive) »
  • Old sections (read-only, deprecated) »
  • Support »
  • Installing CiviCRM »
  • CiviMail installation and configuration (Moderator: Donald Lobo) »
  • Looking for some clarity on civiMail settings (Plesk11 VPS)

This forum was archived on 2017-11-26.