CiviCRM Community Forums (archive)

*

News:

Have a question about CiviCRM?
Get it answered quickly at the new
CiviCRM Stack Exchange Q+A site

This forum was archived on 25 November 2017. Learn more.
How to get involved.
What to do if you think you've found a bug.



  • CiviCRM Community Forums (archive) »
  • Old sections (read-only, deprecated) »
  • Support »
  • Using CiviCRM »
  • Using Import (Moderator: Yashodha Chaku) »
  • Fields not showing up in import
Pages: [1] 2

Author Topic: Fields not showing up in import  (Read 7719 times)

onion

  • I’m new here
  • *
  • Posts: 9
  • Karma: 0
    • multi.lectical
Fields not showing up in import
October 03, 2009, 08:22:02 pm
I'm trying to import members of a library into a new civi install. However, after setting up new fields to match all the fields in the spreadsheet, i only get half the fields (that is none of my custom fields) i need when trying the import. Though the import works, I end up losing half my data. When i try it via  Import Members (as opposed to contacts), I ONLY get the custom fields (without the other fields such as First Name etc.), so i can't even use that to update the contacts i already added. I know i must be missing something elementary, but not sure what it is.

Donald Lobo

  • Administrator
  • I’m (like) Lobo ;)
  • *****
  • Posts: 15963
  • Karma: 470
    • CiviCRM site
  • CiviCRM version: 4.2+
  • CMS version: Drupal 7, Joomla 2.5+
  • MySQL version: 5.5.x
  • PHP version: 5.4.x
Re: Fields not showing up in import
October 04, 2009, 07:35:34 am

so i assume your custom fields are extending membership (based on the behavior described below)

u will have to do two imports. First import the contact and then import the membership with membership details and custom data and use the match-to-contact fields in the import

lobo
A new CiviCRM Q&A resource needs YOUR help to get started. Visit our StackExchange proposed site, sign up and vote on 5 questions

onion

  • I’m new here
  • *
  • Posts: 9
  • Karma: 0
    • multi.lectical
Re: Fields not showing up in import
October 04, 2009, 11:16:18 am
The problem is I don't see how to add the contact fields to the member import. eg: First Name and Last Name (from contacts) isn't available for example when i try and import my csv file while importing members. so it would create new members who don't have names. on the other hand my new member form seem to work as it should.

My main issue i guess is: how can i add pre-existing fields from contacts into my member import page?

Maybe i'm doing this backasswards.

xavier

  • Forum Godess / God
  • I’m (like) Lobo ;)
  • *****
  • Posts: 4453
  • Karma: 161
    • Tech To The People
  • CiviCRM version: yes probably
  • CMS version: drupal
Re: Fields not showing up in import
October 04, 2009, 12:27:14 pm
Try to import them as contact first, be sure they are all them and then import them again, as members, with their membership information.

While importing the members, you can tell to match the existing contacts, so it doesn't recreate them (ideally, you have an external ID and you try to match on that, instead of the first name/last name).

Alternatively, developing a small code to import and use the apis isn't very complicated if you know a bit of PHP.
-Hackathon and data journalism about the European parliament 24-26 jan. Watch out the result

onion

  • I’m new here
  • *
  • Posts: 9
  • Karma: 0
    • multi.lectical
Re: Fields not showing up in import
October 04, 2009, 01:08:46 pm
i guess my main question is how to add member info if there's no available field in the member import page to match up the users to the correct records?

where would one tell the import to "match existing contacts"?

Donald Lobo

  • Administrator
  • I’m (like) Lobo ;)
  • *****
  • Posts: 15963
  • Karma: 470
    • CiviCRM site
  • CiviCRM version: 4.2+
  • CMS version: Drupal 7, Joomla 2.5+
  • MySQL version: 5.5.x
  • PHP version: 5.4.x
Re: Fields not showing up in import
October 04, 2009, 01:38:21 pm

In the map field step, there are a bunch of fields that you can select as "match to contact". have you tried using the member import and seen the various options there?

lobo
A new CiviCRM Q&A resource needs YOUR help to get started. Visit our StackExchange proposed site, sign up and vote on 5 questions

onion

  • I’m new here
  • *
  • Posts: 9
  • Karma: 0
    • multi.lectical
Re: Fields not showing up in import
October 04, 2009, 02:46:57 pm
yep, only my custom "member" fields are there, but none of the native civi fields.

Dave Greenberg

  • Administrator
  • I’m (like) Lobo ;)
  • *****
  • Posts: 5760
  • Karma: 226
    • My CiviCRM Blog
Re: Fields not showing up in import
October 04, 2009, 04:50:20 pm
If you select "Insert New Memberships" from Step 1 of Import Members - then on step 2 you should get a few "key" fields as "Match to Contact" options (internal contact id, external contact id) - and the field or fields that are set up in your Strict Individual Duplicate Matching rule (Email address by default).

You can see this on the public demo - Memberships >> Import Members` (http://drupal.demo.civicrm.org/civicrm/member/import&reset=1)

Keep in mind the following:
- Contacts are the base record in CiviCRM. Contacts can have one or more memberships, can make contributions (i.e. they can be donors), can register for events (participants), etc.
- Contact records must exist before you can import new memberships. So in your case you would Import Contacts first (ideally including an external id from your old system which you can then use to link to the contacts when importing membership data for them).
- Then use Import Memberships -> New Memberships to add the membership data

Use "Update Existing Memberships" only if you are importing updated info for existing membership records.
« Last Edit: October 04, 2009, 05:42:58 pm by Donald Lobo »
Protect your investment in CiviCRM by  becoming a Member!

onion

  • I’m new here
  • *
  • Posts: 9
  • Karma: 0
    • multi.lectical
Re: Fields not showing up in import
October 06, 2009, 01:22:54 pm
Thanks for the tips. I added strict email matching and tried again. but still have no email field under the "Matching CiviCRM Field" column. Now that I've tried a million things, I'm wondering why I can't figure out where I added those fields. If they're from a profile, only some of them are appearing. The membership relevant fields do show up. Just nothing to connect them to the already existing data.

this is the error i get:

Please correct the following errors in the form fields below:

    * Missing required contact matching fields. email(weight 10) (Sum of all weights should be greater than or equal to threshold: 10). (OR Membership ID if update mode.)

This screenshot of my issue might make more sense than trying to explain it.

http://drupal.westphillytools.org/sites/default/files/civihell.png

Donald Lobo

  • Administrator
  • I’m (like) Lobo ;)
  • *****
  • Posts: 15963
  • Karma: 470
    • CiviCRM site
  • CiviCRM version: 4.2+
  • CMS version: Drupal 7, Joomla 2.5+
  • MySQL version: 5.5.x
  • PHP version: 5.4.x
Re: Fields not showing up in import
October 06, 2009, 03:59:46 pm

can we get ssh access to your machine. We will need write access to add some debugging code

if so please ping us on IRC

lobo
A new CiviCRM Q&A resource needs YOUR help to get started. Visit our StackExchange proposed site, sign up and vote on 5 questions

onion

  • I’m new here
  • *
  • Posts: 9
  • Karma: 0
    • multi.lectical
Re: Fields not showing up in import
October 06, 2009, 06:18:31 pm
sorry, i don't even have ssh access on this one myself

Ed van Leeuwen

  • I post occasionally
  • **
  • Posts: 68
  • Karma: 1
  • CiviCRM version: 4.7
  • CMS version: Drupal 7.x
  • MySQL version: MariaDB 10
Re: Fields not showing up in import
October 21, 2009, 01:23:06 pm
I had the same issue when importing contacts. Solved the vanishing custom fields by saving them again (going to the definition and submitting without changing). Perhaps that works for you as well.

Donald Lobo

  • Administrator
  • I’m (like) Lobo ;)
  • *****
  • Posts: 15963
  • Karma: 470
    • CiviCRM site
  • CiviCRM version: 4.2+
  • CMS version: Drupal 7, Joomla 2.5+
  • MySQL version: 5.5.x
  • PHP version: 5.4.x
Re: Fields not showing up in import
October 21, 2009, 02:58:24 pm

argh, that is definitely buggy behavior. not sure why things did not get rebuilt propertly from import

would love to be able to check this bug out, so if someone has this bug and can give us ssh access, do contact us

lobo
A new CiviCRM Q&A resource needs YOUR help to get started. Visit our StackExchange proposed site, sign up and vote on 5 questions

Ed van Leeuwen

  • I post occasionally
  • **
  • Posts: 68
  • Karma: 1
  • CiviCRM version: 4.7
  • CMS version: Drupal 7.x
  • MySQL version: MariaDB 10
Re: Fields not showing up in import
October 22, 2009, 01:55:59 am
I am trying to replicate my website to my (Synology) NAS to give you access. I am faced with some slow response issues on the NAS, so this could take me some time.

matth3wh

  • I’m new here
  • *
  • Posts: 24
  • Karma: 0
Re: Fields not showing up in import
December 08, 2009, 09:49:08 pm
Unfortunately we are also experiencing this issue with the custom field data disappearing from import mappings ...

In export mappings it also seems to have an issue as the genuine column name gets turned in to custom_50 and no data is exported to csv for this column.
see what Raphy posted on this issue here - http://forum.civicrm.org/index.php/topic,11217.html

I can arrange for SSH access if needed.
« Last Edit: December 08, 2009, 10:05:10 pm by matth3wh »

Pages: [1] 2
  • CiviCRM Community Forums (archive) »
  • Old sections (read-only, deprecated) »
  • Support »
  • Using CiviCRM »
  • Using Import (Moderator: Yashodha Chaku) »
  • Fields not showing up in import

This forum was archived on 2017-11-26.