CiviCRM Community Forums (archive)

*

News:

Have a question about CiviCRM?
Get it answered quickly at the new
CiviCRM Stack Exchange Q+A site

This forum was archived on 25 November 2017. Learn more.
How to get involved.
What to do if you think you've found a bug.



  • CiviCRM Community Forums (archive) »
  • Old sections (read-only, deprecated) »
  • Support »
  • Using CiviCRM »
  • Using CiviMail (Moderator: Piotr Szotkowski) »
  • Observations and Questions from our first large CiviMail
Pages: [1]

Author Topic: Observations and Questions from our first large CiviMail  (Read 2692 times)

Denver Dave

  • Ask me questions
  • ****
  • Posts: 471
  • Karma: 9
Observations and Questions from our first large CiviMail
January 03, 2008, 09:29:06 am
There is nothing like real data to raise new questions.  We did dozens of tests with a few select people and a couple of runs with small sub sets of the data.  Yesterday, we ran a full mailing.  We have about 2,100 contacts, with 1,300 having email addresses.

I was excited because we did get 13 "bounces" which I thought was odd because we don't have the Soap / IMAP installed.  Turned out that there is a problem because we have some quotes at the end of the last name which occurred someplace in our conversion.   Since the "bounces" created email on hold, I just created a group of them, we'll fix the names and re-send the 13.

The real failures to deliver were about 85 so far and came back to me.  I'm not sure why the failures came back to my email address because another person, our organization's administrator ran the cycle.  Is it because the cron job has my logon and password?  Seems like we set the reply address someplace, maybe I'm still in there - can't remember where that was.  We'll handle manually (maybe) and look into the Soap / IMap

We ran 20 emails every 10 minutes, so by this morning after about 11 hours, the cycle was finished.  Fantastic!

Our organization's administrator seems to have really caught on to sending civimails and she seems to have an easier time copying html from her Mac without the Microsoft "stuff" than I do from my PC.

Open tracking (subject to email client security of displaying images) seem to be working and are very interesting and has the unexpected benefit of letting us know when people are on their PCs.

Click through tracking seems to be working.

I am somewhat concerned about database size as we collect all this information for mailings that become out of date.  Do others have a trim process for activity?

Click throughs on links seem to be working fine, but interesting there are not as many as we thought there would be - only 31 so far.  But a very useful feature.

This is where we are - now trying to tune our process.

Comments or Suggestions?

Piotr Szotkowski

  • Moderator
  • I live on this forum
  • *****
  • Posts: 1497
  • Karma: 57
Re: Observations and Questions from our first large CiviMail
January 07, 2008, 02:11:54 am
Quote from: Denver Dave on January 03, 2008, 09:29:06 am
Turned out that there is a problem because we have some quotes at the end of the last name which occurred someplace in our conversion.

This is a bug – we should escape the quotes before quoting the names themselves; please file an issue in our issue tracker.

Quote from: Denver Dave on January 03, 2008, 09:29:06 am
I'm not sure why the failures came back to my email address because another person, our organization's administrator ran the cycle.  Is it because the cron job has my logon and password?  Seems like we set the reply address someplace, maybe I'm still in there - can't remember where that was.

Please check Administer CiviCRM → CiviMail → Domain Information → FROM Email Address.

Quote from: Denver Dave on January 03, 2008, 09:29:06 am
Open tracking (subject to email client security of displaying images) seem to be working and are very interesting and has the unexpected benefit of letting us know when people are on their PCs.

Yeah, that’s one of the reasons why I personally use a text email client (Mutt, but plan to migrate to Sup). ;)

Quote from: Denver Dave on January 03, 2008, 09:29:06 am
I am somewhat concerned about database size as we collect all this information for mailings that become out of date.

What are your database size limits? These entries shouldn’t take too much disk space, really.

Thanks a lot for your report! Most people don’t bother, so we assume CiviMail is working for them, but it’s really great to see a report with so many ‘green marks’ for stuff that’s working outside our testing setups. :)
If you found the above helpful, please consider helping us in return – you can even steer CiviCRM’s future and help us extend CiviCRM in ways useful to you.

Denver Dave

  • Ask me questions
  • ****
  • Posts: 471
  • Karma: 9
Re: Observations and Questions from our first large CiviMail
January 07, 2008, 08:16:40 am
I really appreciate all of the help that I have received in the forums and feel that the least I can do is give reports back that may help others that are going through the same process.  Also, posting what we have done provides an opportunity for others to let us know where we can improve.

Like many on this forum, the access to health care movement does not have a lot of money, but we do have thousands of people, even just in Colorado.  CiviCRM is already helping us be more effective.

How can organizations that are benefiting from CiviCRM help?
http://forum.civicrm.org/index.php/topic,1579.0.html

Thank you and all of the CiviCRM Team for your help.

xavier

  • Forum Godess / God
  • I’m (like) Lobo ;)
  • *****
  • Posts: 4453
  • Karma: 161
    • Tech To The People
  • CiviCRM version: yes probably
  • CMS version: drupal
Re: Observations and Questions from our first large CiviMail
January 08, 2008, 08:07:11 am
Quote
We ran 20 emails every 10 minutes, so by this morning after about 11 hours, the cycle was finished.  Fantastic!

Is that on purpose that you put such a low limitation ? I would expect the system to be able to send at least 1000 per hour to be useful.

Why didn't you send more per batch ?

Thanks for sharing, I haven't run a real live sending on a big address list yet.

X+
-Hackathon and data journalism about the European parliament 24-26 jan. Watch out the result

MacRonin

  • I post frequently
  • ***
  • Posts: 153
  • Karma: 14
Re: Observations and Questions from our first large CiviMail
January 08, 2008, 11:10:35 am
I don't remember if this is the reason in Denver Dave's case, but some ISP's will limit the amount of email that you can send per hour. It's to keep out SPAMers

Denver Dave

  • Ask me questions
  • ****
  • Posts: 471
  • Karma: 9
Re: Observations and Questions from our first large CiviMail
January 08, 2008, 12:10:07 pm
Quote
We ran 20 emails every 10 minutes, so by this morning after about 11 hours, the cycle was finished.
I really didn't have any idea where to start or how many resources are involved with running a cron job or sending out the emails.  I have a suspicion that the email process is probably less resource intensive than a person or two looking at a few pictures on a web page, but I don't know.

This works for us now and I wanted to minimize the exposure.  I had to start someplace.  What types of settings are others using?

Dennis Gray

  • Ask me questions
  • ****
  • Posts: 472
  • Karma: 1
  • CiviCRM version: Various. See post.
  • CMS version: Drupal, Wordpress and Joomla. See post.
  • MySQL version: TBA
  • PHP version: TBA
Re: Observations and Questions from our first large CiviMail - More observations
January 13, 2008, 01:13:49 am
With a lot of help from my friends, including Denver Dave, we got our first large email out today. So far, 9,000 of approximately 21,000 mails have gone out. Earlier in the day I sent another "blast" of about 3,000. This was a success, as far as I am concerned.

There are quite a few bounces but I expect 10% is not that bad considering this mail is going to a large group of American ex-pats living overseas.

I will report more on our results later but, in general, CiviMail is working pretty good!

One question I do have:

There is a column in the click-through summary that says "Success Rate". For every line it is set to 0.00%. What is it supposed to mean?

I'd also like to see a way of gathering more statistics as an extension of the reporting. Our management is going to ask questions that I cannot answer without doing some DB queries. Any help will be appreciated and any stuff I do will be contributed.

Update: the "blast" finished and took approximately 6.5 hours for all 21,000 or so emails
« Last Edit: January 13, 2008, 11:53:28 am by Ozyank »

Dave Greenberg

  • Administrator
  • I’m (like) Lobo ;)
  • *****
  • Posts: 5760
  • Karma: 226
    • My CiviCRM Blog
Re: Observations and Questions from our first large CiviMail
January 13, 2008, 08:55:00 am
One option for additional stats / reporting is to create one or more reports via BIRT. The sample reports distributed with 1.9 do NOT include any related to mailings - but you can still use them as a starting point for constructing your reports. The key will be understanding the schema and determining the queries you want to run to get the desired info.

A good place to start getting your arms around the schema is the "Mailing Tables" section of this doc:
http://wiki.civicrm.org/confluence/display/CRMDOC/CiviCRM+ERD

As you'll see, all tables related to mailing results are prefixed civicrm_mailing_* (with civicrm_mailing being the base table).
Protect your investment in CiviCRM by  becoming a Member!

Dennis Gray

  • Ask me questions
  • ****
  • Posts: 472
  • Karma: 1
  • CiviCRM version: Various. See post.
  • CMS version: Drupal, Wordpress and Joomla. See post.
  • MySQL version: TBA
  • PHP version: TBA
Re: Observations and Questions from our first large CiviMail
January 13, 2008, 11:56:22 am
BIRT looks interesting. I wan't aware of it.

I'm still wondering what "Success Rate" means.
« Last Edit: January 13, 2008, 05:23:27 pm by Ozyank »

Piotr Szotkowski

  • Moderator
  • I live on this forum
  • *****
  • Posts: 1497
  • Karma: 57
Re: Observations and Questions from our first large CiviMail
January 14, 2008, 06:14:42 am
Quote from: Ozyank on January 13, 2008, 11:56:22 am
I'm still wondering what "Success Rate" means.

From a quick glance at our sources, it supposed to list the ratio of unique clicks per the number of delivered emails. If it doesn’t show the right value (i.e., you have links that were clicked at least thrice, so the ratio is >= 0.01% for them) and the value still shows 0.00%, then this is a bug; please file it in our issue tracker.
If you found the above helpful, please consider helping us in return – you can even steer CiviCRM’s future and help us extend CiviCRM in ways useful to you.

Pages: [1]
  • CiviCRM Community Forums (archive) »
  • Old sections (read-only, deprecated) »
  • Support »
  • Using CiviCRM »
  • Using CiviMail (Moderator: Piotr Szotkowski) »
  • Observations and Questions from our first large CiviMail

This forum was archived on 2017-11-26.