Modify

Opened 5 years ago

Closed 5 years ago

Last modified 5 years ago

#10214 closed defect (fixed)

Loading utf-8 shape: chars like: à è ì ò ù seems have some codepage issue...

Reported by: marcobra.ubuntu@… Owned by: Don-vip
Priority: normal Milestone:
Component: Plugin opendata Version:
Keywords: template_report Cc:

Description

What steps will reproduce the problem?

  1. Load the attached utf8 5 points shape file then read the "some_text" tag contents
  2. There are some wrong reading: à, è, ì, ò, ù chars

What is the expected result?
Good utf8 read

What happens instead?
Mangled chars due some issue

Please provide any additional information below. Attach a screenshot if
possible.

Repository Root: http://josm.openstreetmap.de/svn
Build-Date: 2014-06-29 23:08:43
Last Changed Author: Don-vip
Revision: 7276
Repository UUID: 0c6e7542-c601-0410-84e7-c038aed88b3b
URL: http://josm.openstreetmap.de/svn/trunk
Last Changed Date: 2014-06-30 01:06:11 +0200 (Mon, 30 Jun 2014)
Last Changed Rev: 7276

Identification: JOSM/1.5 (7276 it) Linux Ubuntu 14.04 LTS
Memory Usage: 181 MB / 455 MB (59 MB allocated, but free)
Java version: 1.7.0_55, Oracle Corporation, Java HotSpot(TM) Server VM
VM arguments: [-Xmx512M]

Plugin: AddrInterpolation (30416)
Plugin: CommandLine (30436)
Plugin: FastDraw (30416)
Plugin: FixAddresses (30416)
Plugin: ImportImagePlugin (30416)
Plugin: OpeningHoursEditor (30416)
Plugin: PicLayer (30436)
Plugin: SimplifyArea (30416)
Plugin: buildings_tools (30485)
Plugin: conflation (0.1.7)
Plugin: continuosDownload (28565)
Plugin: contourmerge (1010)
Plugin: dataimport (30416)
Plugin: download_along (30416)
Plugin: geotools (30416)
Plugin: jts (30416)
Plugin: junctionchecking (30416)
Plugin: log4j (30416)
Plugin: mapdust (30416)
Plugin: merge-overlap (30416)
Plugin: mirrored_download (30495)
Plugin: namemanager (30416)
Plugin: notes (v0.9.2)
Plugin: opendata (30436)
Plugin: pbf (30495)
Plugin: poly (30495)
Plugin: print (30416)
Plugin: proj4j (30483)
Plugin: reltoolbox (30416)
Plugin: reverter (30436)
Plugin: scripting (30604)
Plugin: tageditor (30488)
Plugin: tagging-preset-tester (30416)
Plugin: terracer (30416)
Plugin: turnrestrictions (30454)
Plugin: undelete (30416)
Plugin: utilsplugin2 (30460)
Plugin: walkingpapers (30416)
Plugin: waydownloader (30416)
Plugin: waypoint_search (30416)
Plugin: wikipedia (30449)

Attachments (1)

utf8_test.tar.gz (152.5 KB) - added by marcobra.ubuntu@… 5 years ago.
Files to test utf8 loading of opendata plugin shape, gpx, kml

Download all attachments as: .zip

Change History (5)

Changed 5 years ago by marcobra.ubuntu@…

Attachment: utf8_test.tar.gz added

Files to test utf8 loading of opendata plugin shape, gpx, kml

comment:1 Changed 5 years ago by Don-vip

Resolution: fixed
Status: newclosed

Fixed in [o30508:30509].

comment:2 Changed 5 years ago by anonymous

Confirm fixed, many thanks

Marco

comment:3 Changed 5 years ago by marcobra.ubuntu@…

This fix works only if there is a proper codepage fileshapename.cpg with "utf8" in it... ok good, but i have some questions:

What is the Josm/opendata shape default codepage without any .cpg file ?

Is the codepage read or related to the system defined locale vars my: LANG=it_IT.UTF-8 ?

Thank you

Marco

comment:4 in reply to:  3 Changed 5 years ago by Don-vip

Replying to marcobra.ubuntu@…:

What is the Josm/opendata shape default codepage without any .cpg file ?

It is undefined and chosen by the underlying library. I don't know. Either the platform default encoding, either another one hardcoded.

Is the codepage read or related to the system defined locale vars my: LANG=it_IT.UTF-8 ?

Same, I don't know, you can do the test.

.cpg files are the proper way to define encoding and I won't do anything more on the subject :)

Modify Ticket

Change Properties
Set your email in Preferences
Action
as closed The owner will remain Don-vip.
as The resolution will be set.
The resolution will be deleted.

Add Comment


E-mail address and name can be saved in the Preferences.

 
Note: See TracTickets for help on using tickets.