CiviCRM Community Forums (archive)

*

News:

Have a question about CiviCRM?
Get it answered quickly at the new
CiviCRM Stack Exchange Q+A site
This forum was archived on 25 November 2017. Learn more.
How to get involved.
What to do if you think you've found a bug.



  • CiviCRM Community Forums (archive) »
  • Old sections (read-only, deprecated) »
  • General Discussion (please no support requests here!) (Moderator: Michał Mach) »
  • CiviCRM scaling limits
Pages: [1]

Author Topic: CiviCRM scaling limits  (Read 7413 times)

outinsun

  • Guest
CiviCRM scaling limits
September 22, 2008, 12:35:52 pm
I'm wondering where CiviCRM 2.0's scaling limits are. Understand it depends somewhat on underlying hardware/database/etc. But I'm interested in where people have seen the software fall over in terms of:

1.Number of contacts
2.Number of groups
3.Size of a group
4.Size of a search result set
5.Number of mail recipients in a CiviMail mailing
6.Number of mailings
7.Number of tags
8.Number of custom fields
9.Number of search critieria
10.Number of relationships
11.Number of profiles
12.Number of ACL's/roles

petednz

  • Forum Godess / God
  • I’m (like) Lobo ;)
  • *****
  • Posts: 4899
  • Karma: 193
    • Fuzion
  • CiviCRM version: 3.x - 4.x
  • CMS version: Drupal 6 and 7
Re: CiviCRM scaling limits
September 22, 2008, 04:23:41 pm
Here's ours to start ball rolling
       
1Number of contacts50000
2Number of groups250 groups of which 144 Mailing Lists
3Size of a group30000
4Size of a search result set30000
5Number of mail recipients in a CiviMail mailing10000
6Number of mailingsper day? total?
7Number of tags10
8Number of custom fields
11 custom data groups, ranging from 5-20 custom fields, with some having 100 multi-select options
9Number of search critieria
not clear what you mean but not hit any problems stacking four large smart groups
10Number of relationships10 types
11Number of profiles50 and rising
12Number of ACL's/roles
used a different approach to get around difficulties of this
Sign up to StackExchange and get free expert advice: https://civicrm.org/blogs/colemanw/get-exclusive-access-free-expert-help

pete davis : www.fuzion.co.nz : connect + campaign + communicate

geilhufe

  • I post frequently
  • ***
  • Posts: 293
  • Karma: 33
    • Social Source Software
Re: CiviCRM scaling limits
September 22, 2008, 04:57:53 pm
2.4M contacts back in 1.4
http://groups.drupal.org/node/811


Drupal and CiviCRM consulting, strategy and configuration
http://www.social-source.com/

outinsun

  • Guest
Re: CiviCRM scaling limits
September 22, 2008, 06:47:23 pm
Quote
Number of mailings: per day? total?
Total, as it might effect the Browse Mailings page

Quote
Number of search critieria: not clear what you mean but not hit any problems stacking four large smart groups
I mean a complex search with lots of criteria AND'd and OR'd together

Quote
Number of ACL's/roles: used a different approach to get around difficulties of this
Can you say more about what the difficulties were and how you got around them? At what sizing point did you run into difficulties?

petednz

  • Forum Godess / God
  • I’m (like) Lobo ;)
  • *****
  • Posts: 4899
  • Karma: 193
    • Fuzion
  • CiviCRM version: 3.x - 4.x
  • CMS version: Drupal 6 and 7
Re: CiviCRM scaling limits
September 23, 2008, 03:43:30 am
Quote from: outinsun on September 22, 2008, 06:47:23 pm
Quote
Number of mailings: per day? total?
Total, as it might effect the Browse Mailings page
250 so far (that haven't been deleted0. Don't think it would be an issue really as in there is a search function which quickly rattles through to help find earlier emails.
Quote
Quote
Number of search critieria: not clear what you mean but not hit any problems stacking four large smart groups
I mean a complex search with lots of criteria AND'd and OR'd together
Have to get back to you on that. But I have used the 'or SQL' on custom data that had 100 checkboxes - ie all 100 custom data options ticked and 'or SQL' selected - and didn't spot it running in to any problems on that.

Quote
Quote
Number of ACL's/roles: used a different approach to get around difficulties of this
Can you say more about what the difficulties were and how you got around them? At what sizing point did you run into difficulties?
Follow this thread. http://forum.civicrm.org/index.php/topic,3695.0.html Only downside that I can recall is that Users have access to the Tab that controls access. We haven't done any work to ensure this is not accessible. So as it stands it provides control ie people only see the subset of contacts that they should, but cannot yet lock them out of giving themselves access to more.
« Last Edit: September 23, 2008, 03:46:44 am by peterd »
Sign up to StackExchange and get free expert advice: https://civicrm.org/blogs/colemanw/get-exclusive-access-free-expert-help

pete davis : www.fuzion.co.nz : connect + campaign + communicate

outinsun

  • Guest
Re: CiviCRM scaling limits
September 23, 2008, 06:52:04 am
Quote from: peterd on September 23, 2008, 03:43:30 am
Follow this thread. http://forum.civicrm.org/index.php/topic,3695.0.html Only downside that I can recall is that Users have access to the Tab that controls access. We haven't done any work to ensure this is not accessible. So as it stands it provides control ie people only see the subset of contacts that they should, but cannot yet lock them out of giving themselves access to more.
Apologies in advance if this is a naive n00b question, but would CiviCRM-OG integration solve the problem you were addressing in that thread? I also need to have groups of contacts where a contact can edit a subset of their own data and one or more "group admins" can edit a different subset of every contact's data within their group. I expect to have hundreds of such groups. This is the last piece of the puzzle to determine whether CiviCRM can work for me. Everything else (including the scalability responses in this thread) looks really good. Overall, based on initial evaluation, this is an extremely impressive piece of software.
« Last Edit: September 23, 2008, 07:02:11 am by outinsun »

Donald Lobo

  • Administrator
  • I’m (like) Lobo ;)
  • *****
  • Posts: 15963
  • Karma: 470
    • CiviCRM site
  • CiviCRM version: 4.2+
  • CMS version: Drupal 7, Joomla 2.5+
  • MySQL version: 5.5.x
  • PHP version: 5.4.x
Re: CiviCRM scaling limits
September 23, 2008, 10:04:38 am

the below can be done via profiles and using acls on profiles. i dont think it is related to OG at all

lobo
A new CiviCRM Q&A resource needs YOUR help to get started. Visit our StackExchange proposed site, sign up and vote on 5 questions

outinsun

  • Guest
Re: CiviCRM scaling limits
September 23, 2008, 10:16:20 am
Quote from: Donald Lobo on September 23, 2008, 10:04:38 am

the below can be done via profiles and using acls on profiles. i dont think it is related to OG at all

lobo
Can I do the following with profiles/acl's:

1. member of group A can edit fields 1-3 of their own contact data
2. member of group X can edit fields 2-4 of contact data for any member of group A
3. apply same logic to group B/Y pair
4. member of group A or B can't see any other contacts at all
5. member of group X can't see group B contacts
6. member of group Y can't see group A contacts

Donald Lobo

  • Administrator
  • I’m (like) Lobo ;)
  • *****
  • Posts: 15963
  • Karma: 470
    • CiviCRM site
  • CiviCRM version: 4.2+
  • CMS version: Drupal 7, Joomla 2.5+
  • MySQL version: 5.5.x
  • PHP version: 5.4.x
Re: CiviCRM scaling limits
September 23, 2008, 10:32:23 am

yes, you can do all the below with a combination of drupal my account (for group A/B editing own data), CiviCRM profiles with ACLs (for group X editing data for A and Y for B)

I'm assuming u r using 2.1 (if not i'd recommend using it :). For large number of groups, u can implement your own specialized ACL hook (which is what the NZ green party did). This will be way more efficient and scalable that the civicrm acl structure (which in more generalized etc)

lobo
A new CiviCRM Q&A resource needs YOUR help to get started. Visit our StackExchange proposed site, sign up and vote on 5 questions

outinsun

  • Guest
Re: CiviCRM scaling limits
September 23, 2008, 12:37:45 pm
Quote from: Donald Lobo on September 23, 2008, 10:32:23 am

yes, you can do all the below with a combination of drupal my account (for group A/B editing own data), CiviCRM profiles with ACLs (for group X editing data for A and Y for B)
Fabulous.

Quote
I'm assuming u r using 2.1 (if not i'd recommend using it :). For large number of groups, u can implement your own specialized ACL hook (which is what the NZ green party did). This will be way more efficient and scalable that the civicrm acl structure (which in more generalized etc
I am not using 2.1. I'm still on Drupal 5. Not all the modules I need have been ported to 6. Most notably LDAP Integration. I am expecting that integrating LDAP, Drupal, OG, and CiviCRM will be most entertaining. At the moment, however, knowing that by hook or by crook I can accomplish the things I need in CiviCRM at the scaling level I need is good news.

geilhufe

  • I post frequently
  • ***
  • Posts: 293
  • Karma: 33
    • Social Source Software
Re: CiviCRM scaling limits
September 24, 2008, 11:33:07 am
check this for LDAP:
http://wiki.civicrm.org/confluence/display/CRMDOC/CiviCRM+LDAP+Integration
Drupal and CiviCRM consulting, strategy and configuration
http://www.social-source.com/

outinsun

  • Guest
Re: CiviCRM scaling limits
September 24, 2008, 11:39:32 am
Quote from: geilhufe on September 24, 2008, 11:33:07 am
check this for LDAP:
http://wiki.civicrm.org/confluence/display/CRMDOC/CiviCRM+LDAP+Integration
"No support for CiviCRM groups exists." Hmm..I'm hoping to use LDAP as a canonical repository for user AND group information that needs to be used by multiple systems, including but not limited to Drupal/OG and CiviCRM. Sounds like I may be pointing myself in the code contribution direction again.  ;)

outinsun

  • Guest
Re: CiviCRM scaling limits
October 03, 2008, 09:17:53 am
Quote from: outinsun on September 22, 2008, 12:35:52 pm
I'm wondering where CiviCRM 2.0's scaling limits are.
I forgot to ask about:

1. number of simultaneous events
2. number of events that can be mapped at once (I'm assuming you can map a group of events and not just one)
3. number of contacts that can be mapped at once

Thx.

petednz

  • Forum Godess / God
  • I’m (like) Lobo ;)
  • *****
  • Posts: 4899
  • Karma: 193
    • Fuzion
  • CiviCRM version: 3.x - 4.x
  • CMS version: Drupal 6 and 7
Re: CiviCRM scaling limits
October 04, 2008, 09:38:10 pm
From memory I have selected hundreds and mapped them no problem.
Sign up to StackExchange and get free expert advice: https://civicrm.org/blogs/colemanw/get-exclusive-access-free-expert-help

pete davis : www.fuzion.co.nz : connect + campaign + communicate

GingerFeet

  • I post occasionally
  • **
  • Posts: 78
  • Karma: 4
  • CiviCRM version: 3.4.6 / 3.4.7
  • CMS version: Drupal 6.22
  • MySQL version: 5.1
  • PHP version: 5.3.6
Re: CiviCRM scaling limits
July 03, 2011, 12:33:25 pm
8.Number of custom fields

MySQL with stock compile will limit you to 64 indexed custom fields.
Indexes are created when you check the 'searchable' box.

An export 'field mapping' is limited to 70 fields.

GF
« Last Edit: July 03, 2011, 02:30:59 pm by GingerFeet »
Pages: [1]
  • CiviCRM Community Forums (archive) »
  • Old sections (read-only, deprecated) »
  • General Discussion (please no support requests here!) (Moderator: Michał Mach) »
  • CiviCRM scaling limits

This forum was archived on 2017-11-26.