Non-latin characters in csv import

General discussion about MantisBT Plugins

Moderators: Developer, Contributor

Post Reply
mhamburg
Posts: 1
Joined: 13 Apr 2021, 19:46

Non-latin characters in csv import

Post by mhamburg »

Hi,
My csv import does not work with non-latin characters. Even though I am using Unicode UTF-8 in the csv file as indicated, and the special characters are displayed correctly by OpenOffice, the import fails with an error message that the number of collumns varies in the rows. The special characters lead to more columns, line breaks and other issues.
Especially I have trouble with:
- Apostrophes and special quotation marks
- Ellipsis (dot-dot-dot)
- Chinese characters
- Extended Latin characters (Danish, Hungarian, etc.)
- Line breaks.
Can anyone help me?
tet-com@freemail.hu
Posts: 22
Joined: 07 Feb 2019, 11:44

Re: Non-latin characters in csv import

Post by tet-com@freemail.hu »

Hi Dou you stil have trouble?
I have also problem with special characters.
tet-com@freemail.hu
Posts: 22
Joined: 07 Feb 2019, 11:44

Re: Non-latin characters in csv import

Post by tet-com@freemail.hu »

I imported more hundreds of issues with csv import.
When I want to search / filter it is no result, except I click the imported issue edit button and save it manually.
When I search/filter again, only the edited issues will be results.
How can I solve these problem?

I realised, that the international charachters are stored in the database as "&aacute".
But when edit, is stored as "á"

I suppose here something in import_issues_inc.php:
# Convert special chars to html entities
$t_file_content = mb_convert_encoding($t_file_raw_content, 'HTML-ENTITIES', "UTF-8");
Post Reply