CiviCRM Community Forums (archive)

*

News:

Have a question about CiviCRM?
Get it answered quickly at the new
CiviCRM Stack Exchange Q+A site
This forum was archived on 25 November 2017. Learn more.
How to get involved.
What to do if you think you've found a bug.



  • CiviCRM Community Forums (archive) »
  • Old sections (read-only, deprecated) »
  • Support »
  • Using CiviCRM »
  • Using CiviMail (Moderator: Piotr Szotkowski) »
  • Mail running very slowly
Pages: [1]

Author Topic: Mail running very slowly  (Read 1256 times)

joshathedone

  • I post occasionally
  • **
  • Posts: 50
  • Karma: 0
  • CiviCRM version: Civicrm4
  • CMS version: Drupal 7
  • MySQL version: 5.1.41
  • PHP version: 5
Mail running very slowly
October 14, 2012, 08:59:55 pm
I have recently started having a problem where civicrm is sending my emails very slowly.  It is currently taking my server over an hour to send about a hundred emails, a process that used to take a couple of minutes.  The email's are going through eventually.  I have no idea what may have changed.  I am using the php mail() function.  Hosts file is OK.  Does anyone have any idea where I can look to find out what the problem is?

Thanks

Hershel

  • Forum Godess / God
  • I’m (like) Lobo ;)
  • *****
  • Posts: 4640
  • Karma: 176
    • CiviHosting
  • CiviCRM version: Latest
  • CMS version: Mostly WordPress and Drupal
Re: Mail running very slowly
October 15, 2012, 05:25:49 am
Have you asked your host if they can determine what the problem is?
CiviHosting and CiviOnline -- The CiviCRM hosting experts, since 2007

See here for the official: What to do if you think you've found a bug.

joshathedone

  • I post occasionally
  • **
  • Posts: 50
  • Karma: 0
  • CiviCRM version: Civicrm4
  • CMS version: Drupal 7
  • MySQL version: 5.1.41
  • PHP version: 5
Re: Mail running very slowly
October 19, 2012, 08:33:38 pm
I checked with them today; they advised that they think it is a configuration issue.  I'm more than willing to put work into fixing it, I just don't know where else to look. 

Here's what they sent me:
Quote
I don't see any issues with this VPS related to resource availability or responsiveness. The VPS itself is responding rapidly. The bandwidth and disk speeds are both normal. The only possible issue I noticed was that two of the DNS servers in /etc/resolv.conf have been known to be a bit sluggish in their response times. I replaced them with some that have generally been a bit quicker. Hopefully that will help. If not, it is likely a configuration issue.

top - 03:43:22 up 3 days, 13:17,  0 users,  load average: 0.01, 0.02, 0.00
Tasks:  33 total,   1 running,  32 sleeping,   0 stopped,   0 zombie
Cpu(s):  0.0%us,  0.0%sy,  0.0%ni,100.0%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Mem:   1573600k total,   933896k used,   639704k free,        0k buffers
Swap:        0k total,        0k used,        0k free,        0k cached

root@hedone /: pstree -A
init-+-cron
     |-master-+-2*[cleanup]
     |        |-pickup
     |        |-qmgr
     |        |-2*[smtp]
     |        `-trivial-rewrite
     |-memcached---5*[{memcached}]
     |-mysqld---17*[{mysqld}]
     |-nginx---4*[nginx]
     |-php5-fpm---10*[php5-fpm]
     |-sshd
     |-vzctl---bash---pstree
     `-xinetd
root@hedone /: cat /proc/user_beancounters
Version: 2.5
       uid  resource                     held              maxheld              barrier                limit              failcnt
   254186:  kmemsize                  8247637             13919735             51200000             51200000                    0
            lockedpages                     0                  431                 2048                 2048                    0
            privvmpages                233133               311546               393400               393400                    0
            shmpages                    10763                15259               128000               128000                    0
            dummy                           0                    0                    0                    0                    0
            numproc                        55                  116                  700                  700                    0
            physpages                  157744               234956                    0  9223372036854775807                    0
            vmguarpages                     0                    0               512000               512000                    0
            oomguarpages               157770               234981               512000               512000                    0
            numtcpsock                      8                   60                 4096                 4096                    0
            numflock                       10                   51                 2048                 2048                    0
            numpty                          1                    4                   32                   32                    0
            numsiginfo                      0                   23                 1024                 1024                    0
            tcpsndbuf                  140032              6437096             20480000             20480000                    0
            tcprcvbuf                  131072              3153664             20480000             20480000                    0
            othersockbuf               169944              2373640             20480000             20480000                    0
            dgramrcvbuf                     0                56048             10240000             10240000                    0
            numothersock                  115                  276                 2048                 2048                    0
            dcachesize                 435696               760590             10240000             10240000                    0
            numfile                      1683                 3721                50000                50000                    0
            dummy                           0                    0                    0                    0                    0
            dummy                           0                    0                    0                    0                    0
            dummy                           0                    0                    0                    0                    0
            numiptent                      35                   35                 2048                 2048                    0
root@hedone /: time sync

real    0m0.127s
user    0m0.001s
sys     0m0.004s
root@hedone /: wget http://184.82.225.2/bigtest.tgz
--2012-10-19 03:44:26--  http://184.82.225.2/bigtest.tgz
Connecting to 184.82.225.2:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 129674464 (124M) [application/x-gzip]
Saving to: `bigtest.tgz'

100%[=====================================================================================================================================================================>] 129,674,464 8.52M/s   in 14s

2012-10-19 03:44:40 (8.80 MB/s) - `bigtest.tgz' saved [129674464/129674464]

root@hedone /: dd bs=1M count=128 if=/dev/zero of=test conv=fdatasync
128+0 records in
128+0 records out
134217728 bytes (134 MB) copied, 2.26014 s, 59.4 MB/s
root@hedone /:

joshathedone

  • I post occasionally
  • **
  • Posts: 50
  • Karma: 0
  • CiviCRM version: Civicrm4
  • CMS version: Drupal 7
  • MySQL version: 5.1.41
  • PHP version: 5
Re: Mail running very slowly
October 19, 2012, 08:52:56 pm
Also, the host changes did not have an effect.  I just did another mailing tonight: still taking about an hour for about a hundred emails.

planetwebb

  • I post occasionally
  • **
  • Posts: 62
  • Karma: 2
  • CiviCRM version: 4.5.8
  • CMS version: Joomla 2.5.28 / Drupal 7.34
  • MySQL version: 5.5.34-cll-lve
  • PHP version: 5.3.22
Re: Mail running very slowly
October 19, 2012, 09:02:17 pm
I recently had a mailing of 240 emails, initially it sent 10 emails and stopped.  I waited to see if it would complete but I needed to execute a manual send.  Afterward the remaining emails were sent.  When you say it took about an hour, I'm wondering if your run was interrupted, then completed on the cron run.  Just wondering...

joshathedone

  • I post occasionally
  • **
  • Posts: 50
  • Karma: 0
  • CiviCRM version: Civicrm4
  • CMS version: Drupal 7
  • MySQL version: 5.1.41
  • PHP version: 5
Re: Mail running very slowly
October 20, 2012, 04:24:09 am
@planetwebb - Seems like you are right.  I checked and all my jobs are taking about three minutes past an hour (my mailing scheduler runs hourly).  I ran a job last night and the following appeared in my logs.

Code: [Select]
civicrm 10/19/2012 - 11:22pm Ending processQueue run rigel
php 10/19/2012 - 11:22pm Notice: Undefined property: CRM_Core_Config::... rigel
php 10/19/2012 - 11:22pm Notice: Undefined property: CRM_Core_Config::... rigel
php 10/19/2012 - 11:22pm Notice: Undefined property: CRM_Core_Config::... rigel
php 10/19/2012 - 11:22pm Notice: Undefined property: CRM_Core_Config::... rigel
php 10/19/2012 - 11:22pm Notice: Undefined property: CRM_Core_Config::... rigel
php 10/19/2012 - 11:22pm Notice: Undefined property: CRM_Core_Config::... rigel
php 10/19/2012 - 11:22pm Notice: Undefined property: CRM_Core_Config::... rigel
php 10/19/2012 - 11:22pm Notice: Undefined property: CRM_Core_Config::... rigel
php 10/19/2012 - 11:22pm Notice: Undefined property: CRM_Core_Config::... rigel
civicrm 10/19/2012 - 11:22pm Beginning processQueue run: 0, 0 rigel
The error messages read like this:
Code: [Select]
Type php
Date Friday, October 19, 2012 - 11:22pm
User rigel
Location https://hedone.us/civicrm/admin/job?action=export&id=2&reset=1
Referrer https://hedone.us/civicrm/admin/job?reset=1
Message Notice: Undefined property: CRM_Core_Config::$mailThrottleTime in CRM_Mailing_BAO_Job->deliverGroup() (line 720 of /home/eros/public_html/hedone.us/public/sites/all/modules/civicrm/CRM/Mailing/BAO/Job.php).
Severity notice
Hostname ********
An hour later (the mailing scheduler is set to run hourly) the job fires again and completes without issue:
Code: [Select]
cron 10/20/2012 - 12:26am Cron run completed. Unidentified Ki... (not verified)
civicrm 10/20/2012 - 12:25am Ending processQueue run civimail
civicrm 10/20/2012 - 12:25am Beginning processQueue run: 0, 0 civimail
I don't know if it's making any difference, but I executed the job manually to save time.  I have only been seeing this problem since the new scheduler was added to civi. 

joshathedone

  • I post occasionally
  • **
  • Posts: 50
  • Karma: 0
  • CiviCRM version: Civicrm4
  • CMS version: Drupal 7
  • MySQL version: 5.1.41
  • PHP version: 5
Re: Mail running very slowly
October 22, 2012, 06:45:10 pm
Can staff advise, is this a bug?? Should I file on Jira?

Donald Lobo

  • Administrator
  • I’m (like) Lobo ;)
  • *****
  • Posts: 15963
  • Karma: 470
    • CiviCRM site
  • CiviCRM version: 4.2+
  • CMS version: Drupal 7, Joomla 2.5+
  • MySQL version: 5.5.x
  • PHP version: 5.4.x
Re: Mail running very slowly
October 22, 2012, 08:26:27 pm

CiviCRM is a free, libre and open source software project (FLOSS).  There is no staff per se :) So please do consider contributing back to the community in ways that you can. Some ideas are listed in this book chapter:

http://book.civicrm.org/user/current/the-civicrm-community/civicrm-community/

Seems like your issue could potentially be some interface issues between civi and the mailing subsystem. You'll need to investigate and debug to find out where the issue is

please do report back when you find and fix the issue

lobo
A new CiviCRM Q&A resource needs YOUR help to get started. Visit our StackExchange proposed site, sign up and vote on 5 questions

planetwebb

  • I post occasionally
  • **
  • Posts: 62
  • Karma: 2
  • CiviCRM version: 4.5.8
  • CMS version: Joomla 2.5.28 / Drupal 7.34
  • MySQL version: 5.5.34-cll-lve
  • PHP version: 5.3.22
Re: Mail running very slowly
October 23, 2012, 05:17:53 am
@joshathedone,

It appears that the mail throttle setting is not being set in the database initially, please see this reference:

http://forum.civicrm.org/index.php/topic,26234.msg111021.html#msg111021

While I would love to contribute a fix, I do not know where to begin but suspect it should be part of the database upgrade procedure after revision upgrade.

Hershel

  • Forum Godess / God
  • I’m (like) Lobo ;)
  • *****
  • Posts: 4640
  • Karma: 176
    • CiviHosting
  • CiviCRM version: Latest
  • CMS version: Mostly WordPress and Drupal
Re: Mail running very slowly
October 23, 2012, 06:29:10 am
joshathedone, if you would set your cron to run more often then this wouldn't be an issue for you I think.
CiviHosting and CiviOnline -- The CiviCRM hosting experts, since 2007

See here for the official: What to do if you think you've found a bug.
Pages: [1]
  • CiviCRM Community Forums (archive) »
  • Old sections (read-only, deprecated) »
  • Support »
  • Using CiviCRM »
  • Using CiviMail (Moderator: Piotr Szotkowski) »
  • Mail running very slowly

This forum was archived on 2017-11-26.