CiviCRM Community Forums (archive)

*

News:

Have a question about CiviCRM?
Get it answered quickly at the new
CiviCRM Stack Exchange Q+A site

This forum was archived on 25 November 2017. Learn more.
How to get involved.
What to do if you think you've found a bug.



  • CiviCRM Community Forums (archive) »
  • Old sections (read-only, deprecated) »
  • Support »
  • Using CiviCRM »
  • Using Core CiviCRM Functions (Moderator: Yashodha Chaku) »
  • Address geocoder failing
Pages: [1]

Author Topic: Address geocoder failing  (Read 820 times)

lesliejmatthews

  • I’m new here
  • *
  • Posts: 14
  • Karma: 1
  • CiviCRM version: 4.4.6
  • CMS version: drupal 7
  • MySQL version: 5.5.31
  • PHP version: 5.3.1
Address geocoder failing
October 01, 2014, 07:27:10 am
Hi I'm using Google maps for geocoding; Civicrm v. 4.4.6.  Used to work fine but stopped at some point - not sure exactly when - and no new contacts are getting geocoded.  I have the following parameters for the scheduled job:
geocoding=1
parse=1
start=20000
end=31800
throttle=0

I get error message "Hit the over query limit on geocoder" no matter what, even when I do not believe I exceed the 25,000 request limit per day.
Looking on the google developer console, I have 0 requests so I don't believe the error message about over query limit is correct.
If I set throttle=1, the address geocoder job starts but never finishes - it just seems to run indefinitely.

Can anyone help?

Thanks!

Leslie
« Last Edit: October 01, 2014, 07:49:49 am by lesliejmatthews »

JonGold

  • Ask me questions
  • ****
  • Posts: 638
  • Karma: 81
    • Palante Technology
  • CiviCRM version: 4.1 to the latest
  • CMS version: Drupal 6-7, Wordpress 4.0+
  • PHP version: PHP 5.3-5.5
Re: Address geocoder failing
October 01, 2014, 07:33:57 am
Hi Leslie,

2 things:
* The limit is 2,500/day, not 25,000/day, which may be part of the confusion.
* How long did you give it to time out with throttling?  It'll run for several hours a day in my experience until it hits the limit.
* Finally - while geocoding is running, are you checking to see if addresses are getting geocoded?  Could you please post before/after counts so we know if it's not working at all, or just working minimally?  You can get a count by using Search Builder - "Geo Code 1" "is not null".
Sign up to StackExchange and get free expert CiviCRM advice: https://civicrm.org/blogs/colemanw/get-exclusive-access-free-expert-help

lesliejmatthews

  • I’m new here
  • *
  • Posts: 14
  • Karma: 1
  • CiviCRM version: 4.4.6
  • CMS version: drupal 7
  • MySQL version: 5.5.31
  • PHP version: 5.3.1
Re: Address geocoder failing
October 01, 2014, 08:04:17 am
Hi Jon thanks for the reply!!!

To answer your questions:
* The limit is 2,500/day, not 25,000/day, which may be part of the confusion.
This is indeed confusing, because if you look on the google Developer APIs Console under Services it says for Google Maps JavaScript API v3, Courtesy limit: 25,000 requests/day • Max billable limit: 1,000,000 requests/day.  Is that referring to a different kind of mapping request than the CiviCRM geocoding requests?  Or do I not have the correct Service turned on for Geocoding?

* How long did you give it to time out with throttling?  It'll run for several hours a day in my experience until it hits the limit.
Not sure I understand this question?  You mean I need to let it run much longer when I have throttle=1, before I give up?  I don't know how to cancel it once it starts running but I think the longest I've waited before assuming it's failed is probably about an hour.   Not long enough maybe?

* Finally - while geocoding is running, are you checking to see if addresses are getting geocoded?  Could you please post before/after counts so we know if it's not working at all, or just working minimally?  You can get a count by using Search Builder - "Geo Code 1" "is not null".
Yes - I've actually checked in the backend using MySql query (not sure Geo code is a field option in Search Builder in my version?).  Doesn't look like anything is getting geocoded.

I'm going to set throttle=1 and let job run for several hours now and see what I get.  Maybe I'm just not giving it enough time...

Thanks again for your help!!!

Leslie

JonGold

  • Ask me questions
  • ****
  • Posts: 638
  • Karma: 81
    • Palante Technology
  • CiviCRM version: 4.1 to the latest
  • CMS version: Drupal 6-7, Wordpress 4.0+
  • PHP version: PHP 5.3-5.5
Re: Address geocoder failing
October 01, 2014, 08:11:19 am
Hi Leslie,

I'm finding the limits here: https://developers.google.com/maps/documentation/geocoding/#Limits.  Not sure why the APIs Console says otherwise.

Actually - do you have a Google API key you're using?  Google Maps v3 (the current version) works without an API key.  Might want to try without the API key and see if it makes a difference.

I'm pretty sure you can get the overlimit error both on queries/seconds and on queries/day - so I think you might be seeing a queries/second overlimit error.  That would be fixed by throttling, which I believe is one every 5 seconds.  That's 600/hour, or a little over 4 hours for 2,500 requests.  However, the requests are made individually, so you SHOULD see an increase in geocoded addresses when you do your SQL queries, so you shouldn't need to wait 4 hours.
Sign up to StackExchange and get free expert CiviCRM advice: https://civicrm.org/blogs/colemanw/get-exclusive-access-free-expert-help

lesliejmatthews

  • I’m new here
  • *
  • Posts: 14
  • Karma: 1
  • CiviCRM version: 4.4.6
  • CMS version: drupal 7
  • MySQL version: 5.5.31
  • PHP version: 5.3.1
Re: Address geocoder failing
October 01, 2014, 12:10:34 pm
Hi Jon - Thanks!  That worked!  I took out the API key and now it seems that my geocodes are gradually getting generated, with throttle=1.

Not sure why the API key would have cause a problem.  I had tried it with both with the original key I've been using all along, and when that failed, a newly regenerated key on the Google developer site, which also apparently didn't work (copy and paste, so no typos).  Not sure why the key caused a failure, but without the key it seems to be running, and my sql queries are indicating that the number of records with geo_code_1=null is decreasing so problem seems to be solved.

Thanks so much for help!  Really appreciated it.

Leslie

JonGold

  • Ask me questions
  • ****
  • Posts: 638
  • Karma: 81
    • Palante Technology
  • CiviCRM version: 4.1 to the latest
  • CMS version: Drupal 6-7, Wordpress 4.0+
  • PHP version: PHP 5.3-5.5
Re: Address geocoder failing
October 01, 2014, 06:17:25 pm
Glad to hear it Leslie!
Sign up to StackExchange and get free expert CiviCRM advice: https://civicrm.org/blogs/colemanw/get-exclusive-access-free-expert-help

Pages: [1]
  • CiviCRM Community Forums (archive) »
  • Old sections (read-only, deprecated) »
  • Support »
  • Using CiviCRM »
  • Using Core CiviCRM Functions (Moderator: Yashodha Chaku) »
  • Address geocoder failing

This forum was archived on 2017-11-26.