CiviCRM Community Forums (archive)

*

News:

Have a question about CiviCRM?
Get it answered quickly at the new
CiviCRM Stack Exchange Q+A site

This forum was archived on 25 November 2017. Learn more.
How to get involved.
What to do if you think you've found a bug.



  • CiviCRM Community Forums (archive) »
  • Old sections (read-only, deprecated) »
  • Support »
  • Using CiviCRM »
  • Using Core CiviCRM Functions (Moderator: Yashodha Chaku) »
  • Duplicate match delivering random results
Pages: [1]

Author Topic: Duplicate match delivering random results  (Read 3020 times)

petednz

  • Forum Godess / God
  • I’m (like) Lobo ;)
  • *****
  • Posts: 4899
  • Karma: 193
    • Fuzion
  • CiviCRM version: 3.x - 4.x
  • CMS version: Drupal 6 and 7
Duplicate match delivering random results
May 04, 2008, 03:24:45 pm
My duplicate rules are as follows

Last name = 7
Email = 10
City = 10

Threshhold = 15

The result it gives includes lots where none of these occur. For example
Last name = Blennerhassett
Email=eliot@blennerhassett.gen.nz
City = Christchurch

when I click select , the people it offers to merge with are

Last name = Black
Email= - blank -
City = Christchurch

and

Last name - Dann
Email = christine@horomaka.org   
City = christchurch


Have i lost the plot or are things going awry?
Sign up to StackExchange and get free expert advice: https://civicrm.org/blogs/colemanw/get-exclusive-access-free-expert-help

pete davis : www.fuzion.co.nz : connect + campaign + communicate

Piotr Szotkowski

  • I live on this forum
  • *****
  • Posts: 1497
  • Karma: 57
Re: Duplicate match delivering random results
May 08, 2008, 02:08:08 am
If there aren’t any length limits on the rules, then this is not how it’s supposed to work. I’ll try to reproduce this in my local 2.0 sandbox and let you know.
If you found the above helpful, please consider helping us in return – you can even steer CiviCRM’s future and help us extend CiviCRM in ways useful to you.

Piotr Szotkowski

  • I live on this forum
  • *****
  • Posts: 1497
  • Karma: 57
Re: Duplicate match delivering random results
May 08, 2008, 04:51:09 am
I created these three contacts in my 2.0 sandbox, altered the default rule to match your above and no duplicates were found. The three were found after lowering the threshold to 10, so it works for me properly…
If you found the above helpful, please consider helping us in return – you can even steer CiviCRM’s future and help us extend CiviCRM in ways useful to you.

petednz

  • Forum Godess / God
  • I’m (like) Lobo ;)
  • *****
  • Posts: 4899
  • Karma: 193
    • Fuzion
  • CiviCRM version: 3.x - 4.x
  • CMS version: Drupal 6 and 7
Re: Duplicate match delivering random results
May 09, 2008, 05:06:45 pm
Are you suggesting the threshold is not being applied correctly? That might make sense as being the source of the problem but I think it would have shown even more if that was the problem as we would have an lot of 'city' duplicates
Sign up to StackExchange and get free expert advice: https://civicrm.org/blogs/colemanw/get-exclusive-access-free-expert-help

pete davis : www.fuzion.co.nz : connect + campaign + communicate

Piotr Szotkowski

  • I live on this forum
  • *****
  • Posts: 1497
  • Karma: 57
Re: Duplicate match delivering random results
May 11, 2008, 03:07:09 pm
Hm, maybe I’m missing something obvious. Can you replicate this issue on the demo (i.e., create the three contacts, setup the rules and let me know whether it works as it should or as in your install)?

If it works differently on demo and in your setup, I can investigate further if I have your database dump (if that’s an acceptable option for you). If so, please send it to shot@civicrm.org (you can encrypt the email with my GPG key of D128F14A if you wish).
If you found the above helpful, please consider helping us in return – you can even steer CiviCRM’s future and help us extend CiviCRM in ways useful to you.

petednz

  • Forum Godess / God
  • I’m (like) Lobo ;)
  • *****
  • Posts: 4899
  • Karma: 193
    • Fuzion
  • CiviCRM version: 3.x - 4.x
  • CMS version: Drupal 6 and 7
Re: Duplicate match delivering random results
May 11, 2008, 11:59:45 pm
SO i just set Dupe Rules in Demo as above and ran it. gave me duplicate match for #128 and #129 which I can see have same Email address but their Last and City are different - ah ha, or are they, when I choose 'city' which 'city' does it use? primary? any?

I see that in the case above both show no home address though it is set as primary - is it matching 'city' because they are both blank because their 'city' details are in their 'billing' field?


Any chance you can make the fields that are used in the Duplicate Rule show as columns in the "Potentially Duplicate Contacts" table? That would certainly help in spotting which contacts to merge.

It certainly makes it harder when they don't even appear in a-z order - what order are they showing in? Are they divided up depending on which bits of the rule caused the match to be identified?
Sign up to StackExchange and get free expert advice: https://civicrm.org/blogs/colemanw/get-exclusive-access-free-expert-help

pete davis : www.fuzion.co.nz : connect + campaign + communicate

Piotr Szotkowski

  • I live on this forum
  • *****
  • Posts: 1497
  • Karma: 57
Re: Duplicate match delivering random results
May 12, 2008, 03:02:30 am
Quote from: peterd on May 11, 2008, 11:59:45 pm
So I just set Dupe Rules in Demo as above and ran it. gave me duplicate match for #128 and #129 which I can see have same Email address but their Last and City are different - ah ha, or are they, when I choose 'city' which 'city' does it use? primary? any?

Aaargh, right. It uses any city, as it matches the city against a contact id, not against a (contact id, location type) pair. I assume the latter would make more sense – i.e., consider this a valid match iff the location types match as well.

(That’s what you end up with when the default setting is just one location per contact, period; you miss such situations easily.)

Quote from: peterd on May 11, 2008, 11:59:45 pm
I see that in the case above both show no home address though it is set as primary - is it matching 'city' because they are both blank because their 'city' details are in their 'billing' field?

It’s matching them because these two contact ids share the same city in the address table.

I’m thinking now whether it would make more sense (use-case-wise) that the requirement was that the location types match or that the primariness of the address matches… Thoughts?

Quote from: peterd on May 11, 2008, 11:59:45 pm
Any chance you can make the fields that are used in the Duplicate Rule show as columns in the "Potentially Duplicate Contacts" table? That would certainly help in spotting which contacts to merge.

Hm, that’s an idea worth considering – and I like it. I’ll see how it flies with the default rules we’ll ship in CiviCRM 2.1.

Quote from: peterd on May 11, 2008, 11:59:45 pm
It certainly makes it harder when they don't even appear in a-z order - what order are they showing in? Are they divided up depending on which bits of the rule caused the match to be identified?

No, I’m afraid they show up in the order the dedupe engine returns them, which you can assume is more or less random. I’ll make sure it’s fixed in CiviCRM 2.1.
« Last Edit: May 13, 2008, 04:42:49 am by Piotr Szotkowski »
If you found the above helpful, please consider helping us in return – you can even steer CiviCRM’s future and help us extend CiviCRM in ways useful to you.

petednz

  • Forum Godess / God
  • I’m (like) Lobo ;)
  • *****
  • Posts: 4899
  • Karma: 193
    • Fuzion
  • CiviCRM version: 3.x - 4.x
  • CMS version: Drupal 6 and 7
Re: Duplicate match delivering random results
May 12, 2008, 01:38:13 pm
Good to know that may have shed some light on the situation.

Quote from: peterd on May 11, 2008, 11:59:45 pm
It certainly makes it harder when they don't even appear in a-z order - what order are they showing in? Are they divided up depending on which bits of the rule caused the match to be identified?

No, I’m afraid they show up in the order the dedupe engine returns them, which you can assume is more or less random. I’ll make sure it’s fixed in CiviCRM 2.1.
[/quote]

I guess the ideal would be to make the columns sortable ;-)
Sign up to StackExchange and get free expert advice: https://civicrm.org/blogs/colemanw/get-exclusive-access-free-expert-help

pete davis : www.fuzion.co.nz : connect + campaign + communicate

Pages: [1]
  • CiviCRM Community Forums (archive) »
  • Old sections (read-only, deprecated) »
  • Support »
  • Using CiviCRM »
  • Using Core CiviCRM Functions (Moderator: Yashodha Chaku) »
  • Duplicate match delivering random results

This forum was archived on 2017-11-26.