CiviCRM Community Forums (archive)

*

News:

Have a question about CiviCRM?
Get it answered quickly at the new
CiviCRM Stack Exchange Q+A site
This forum was archived on 25 November 2017. Learn more.
How to get involved.
What to do if you think you've found a bug.



  • CiviCRM Community Forums (archive) »
  • Discussion »
  • Internationalization and Localization (Moderators: Michał Mach, mathieu) »
  • Export contacts wizard does not deal with non-English characters
Pages: [1]

Author Topic: Export contacts wizard does not deal with non-English characters  (Read 1974 times)

SarahG (FountainTribe)

  • Ask me questions
  • ****
  • Posts: 782
  • Karma: 29
  • CiviCRM version: 4.4.7
  • CMS version: Drupal 6, Drupal 7
  • MySQL version: 5.5
  • PHP version: 5.3
Export contacts wizard does not deal with non-English characters
March 26, 2012, 03:46:45 pm
I am running CiviCRM 4.1.1 under Drupal6. The default language is English-US, as this is a US-based organization.    In a handful of contact custom fields, they are using Hebrew.  This is working fine, except when I try to export to a CSV file (using the search batch action of "Export Contacts" )

The resulting exported file has ? characters for each Hebrew letter.  I have reproduced this issue in the 4.1.1. civicrm.org running under Drupal 7. (The link to the 4.1.1. sandbox under Drupal 6 leads to the civicrm.org homepage.)

This same field also produces garbage when used as a mail merge token when generating a PDF letter, which may be related to my first issue.

Is there any setup steps I should check?
Did I help you? Please donate to the Civi-Make-It-Happen campaign  CiviCRM for mobile devices! 

thomjoh

  • I’m new here
  • *
  • Posts: 8
  • Karma: 0
Re: Export contacts wizard does not deal with non-English characters
May 02, 2012, 03:55:25 pm
I have the same problem with Chinese characters. I use Drupal 6, CiviCRM 4.1.1 and MySQL 5.5. It used to work fine when we were on CiviCRM 3.x.

Donald Lobo

  • Administrator
  • I’m (like) Lobo ;)
  • *****
  • Posts: 15963
  • Karma: 470
    • CiviCRM site
  • CiviCRM version: 4.2+
  • CMS version: Drupal 7, Joomla 2.5+
  • MySQL version: 5.5.x
  • PHP version: 5.4.x
Re: Export contacts wizard does not deal with non-English characters
May 02, 2012, 06:17:20 pm

1. can u check and see if they are saved properly in the DB

2. Can u save to a file and see what the character is via a text editor

would be good if u can help debug and trace this issue. ping us on irc if u need help

lobo
A new CiviCRM Q&A resource needs YOUR help to get started. Visit our StackExchange proposed site, sign up and vote on 5 questions

xavier

  • Forum Godess / God
  • I’m (like) Lobo ;)
  • *****
  • Posts: 4453
  • Karma: 161
    • Tech To The People
  • CiviCRM version: yes probably
  • CMS version: drupal
Re: Export contacts wizard does not deal with non-English characters
May 02, 2012, 11:01:33 pm
Hi,

For the export, are you sure it isn't on the reader side? Try open it with open/libreoffice, and choose utf8.

Excel assumes it's ascii/latin1, and doesn't offer you the option to change the charset.

The workaround involves a wax doll of Ballmer, a long pin, lots of crude words an changing the extension from .csv to .txt

For the pdf, don't recall having had the problem and we printed badges with a lot of non ascii chars. Might be there is an option somewhere to specify to use ascii
-Hackathon and data journalism about the European parliament 24-26 jan. Watch out the result

Hershel

  • Forum Godess / God
  • I’m (like) Lobo ;)
  • *****
  • Posts: 4640
  • Karma: 176
    • CiviHosting
  • CiviCRM version: Latest
  • CMS version: Mostly WordPress and Drupal
Re: Export contacts wizard does not deal with non-English characters
May 03, 2012, 06:38:46 am
Definitely try OpenOffice. I have outputted Hebrew data from CiviCRM for years.
CiviHosting and CiviOnline -- The CiviCRM hosting experts, since 2007

See here for the official: What to do if you think you've found a bug.

thomjoh

  • I’m new here
  • *
  • Posts: 8
  • Karma: 0
Re: Export contacts wizard does not deal with non-English characters
June 15, 2012, 07:12:04 am
I tired both, saving as a text file or opening with OpenOffice. It doesn't work in neither case. It worked before we upgraded to version 4. I checked the database, everything is correct here. As an information, our non-Latin data is in custom fields, so its in a civicrm_value_... table.

Any help is much appreciated. We need to export to print mailing labels externally in Chinese. It's now for several weeks that this doesn't work anymore. I already regret that I updated.

Hershel

  • Forum Godess / God
  • I’m (like) Lobo ;)
  • *****
  • Posts: 4640
  • Karma: 176
    • CiviHosting
  • CiviCRM version: Latest
  • CMS version: Mostly WordPress and Drupal
Re: Export contacts wizard does not deal with non-English characters
June 15, 2012, 07:20:49 am
You could of course try to export CSV by developing the MySQL query for the data and then using phpMyAdmin or another MySQL client.
CiviHosting and CiviOnline -- The CiviCRM hosting experts, since 2007

See here for the official: What to do if you think you've found a bug.

Donald Lobo

  • Administrator
  • I’m (like) Lobo ;)
  • *****
  • Posts: 15963
  • Karma: 470
    • CiviCRM site
  • CiviCRM version: 4.2+
  • CMS version: Drupal 7, Joomla 2.5+
  • MySQL version: 5.5.x
  • PHP version: 5.4.x
Re: Export contacts wizard does not deal with non-English characters
June 15, 2012, 07:30:29 am

In general responding to questions immediately rather than after more than a month helps everyone involved.

Can you try and replicate this on our demo server. Seems a bit wierd that the system cant export utf-8 characters. Would be great if you can try and help trace this down

lobo
A new CiviCRM Q&A resource needs YOUR help to get started. Visit our StackExchange proposed site, sign up and vote on 5 questions
Pages: [1]
  • CiviCRM Community Forums (archive) »
  • Discussion »
  • Internationalization and Localization (Moderators: Michał Mach, mathieu) »
  • Export contacts wizard does not deal with non-English characters

This forum was archived on 2017-11-26.