CiviCRM Community Forums (archive)

I'm using Drupal 6.16/CiviCRM 3.14 with about 120,000 contacts.

Recently I've just installed SSL and configured a contribution page (Using dummy payment processor). However, I'm getting a 502 Proxy error whenever I submit click submit on the final step. It looks like a timeout because it takes a while (probably more than 30 seconds then throws the error). No contribution is recorded.

This happens on both the http and https protocol and it seems like it is related to the amount of contacts in the database, I have another site setup exactly the same with a live payment processor but only with about 100 contacts and it is running fine.

I'm also getting the 502 error when performing other operations such as trying to merge 3 or more contacts from the contact search result screen (usually it should take me to the deduping screen)
Once again this does not happen on the installation with less contacts.


My hosting environment is as follows:

Rackspace cloud hosting:
512 MB memory
Apache 2.2/PHP 5.26

Hi Lobo,

Just on a side note, probably due to my own ignorance, but why is there such complicated de-duping query for creating contribution?

is it not possible to do something like

select c.id FROM civicrm_contact c JOIN civicrm_email e ON c.id = e.contact_id
where email = 'email@address.com' and first_name = First name' and last_name = 'Last name'

I guess because it is using the de-duping engine so it is consistent throughout the system?

Code: [Select]

SELECT t1.id id1, t2.id id2, 7 weight
FROM civicrm_contact t1 JOIN civicrm_contact t2 ON t1.last_name = t2.last_name
WHERE t1.id < t2.id AND t1.last_name IS NOT NULL AND
(t1.id IN (2,3,4) OR t2.id IN (2,3,4));


The above query can be sped up significantly by rewriting it as follows:

SELECT t1.id id1, t2.id id2, 7 weight
FROM civicrm_contact t1 JOIN civicrm_contact t2 ON t1.last_name = t2.last_name
WHERE t1.id < t2.id AND t1.last_name IS NOT NULL AND
t1.id IN (2,3,4)
UNION
SELECT t1.id id1, t2.id id2, 7 weight
FROM civicrm_contact t1 JOIN civicrm_contact t2 ON t1.last_name = t2.last_name
WHERE t1.id < t2.id AND t1.last_name IS NOT NULL AND
t2.id IN (2,3,4)


Thanks lobo I'll get back to you!


Chang

The plot thickens,

So what I have done from the last time:

Cleaned out around 55,000 blank organization contacts

Created another donation page with dummy processor with test payment gateway configurations


The donation processing time in total for the dummy processor was lightning fast (within 2 seconds from confirmation page to thank you page)

So I have concluded that it must be a payment processor code right?

But no,

So I wrote the time (using date function) before each function call etc in the do_direct_payment function in the payment processor file for our custom payment processor. I consistently got 2 seconds or less for the entire process.

Using the Devel module in drupal, I logged it only takes about 60 millsecs for all the queries.


All this doesn't add up to a processing time of around 30 seconds to me.


I guess the next step is to record time from the contribution processing code itself, any idea where to insert the timestamp?




P.S. we have one person in the office with I.E 7 consistently gets the 502. In other browsers this happens from time to time.

Could it be the SSL version and incompatibility between SSL provider and our host? We purchased SSL from a third party and not directly from our hosting company.


Chang

Ha, that was very inspirational Lobo,

I actually might now know what's causing this. (But of course I'll have to confirm).


Our SMTP server has some problem with CiviCRM.

We we do our mailing, at send test mailing step, from time to time we would get the 502 (or time out after 30 seconds, even though the test mail would be sent out)
Other times we get a time out when trying to access SMTP settings page.

This also happens with send email from the activity menu.



The only difference between this installation and the other one we have (Which has the same payment gateway) is that the other one uses localhost for SMTP because we do not do bulk mailing on that one.



Let me disable thank you email and see if this problem still persist. If this is the problem I think I can nail down and diagnose why the SMTP call takes a long time



Thanks a lot


Chang