id	summary	reporter	owner	description	type	status	priority	milestone	component	version	resolution	keywords	cc
9960	JOSM not seeing differences with special characters like LRM	glenn@…	glenn@…	"Certain tags seem to contain special chars like [http://www.fileformat.info/info/unicode/char/200e/index.htm LRM] in the content.

== What steps will reproduce the problem? ==
 1. Use this overpass query to find problematic entries: http://overpass-turbo.eu/s/3c4
 2. Fix the website tag: notice that you need to hit backspace twice to remove the last character in the URLs for each of the entries
Taglink has more of those entries: http://taginfo.openstreetmap.org/search?q=website%3D%E2%80%8E

 3. Try uploading the results, JOSM will not do it, it's not seeing the differences. I tried: adding dummy note tag, but josm does not include those keys in the diff.  Tried manual fixing in osm file, open in new layer, merge them (works).  But josm also refuses to upload that result.

Take a look at attached osm files with a decent editor that sees them like vim.  There is a extraneous LRM char after the url.  This was noticed on the OSM-Talk list. The person that spotted this in the data (John Packer) also states: ""It seems this also affect other keys (like phone), but the problem is not as bad as in the keys 'website' and 'contact:website'.""

== What is the expected result? ==

Josm should account for differences outside the visible character set, special characters should be accounted for.

A nice to have is to prevent those type of special characters from being introduced, they have no merit.

== What happens instead? ==

Refuses to upload

Please provide any additional information below. Attach a screenshot if
possible.

{{{
Revision: 6942
Repository Root: http://josm.openstreetmap.de/svn
Last Changed Author: Don-vip
Last Changed Date: 2014-03-29 00:45:51 +0100 (Sat, 29 Mar 2014)
Build-Date: 2014-03-29 02:35:49
URL: http://josm.openstreetmap.de/svn/trunk
Repository UUID: 0c6e7542-c601-0410-84e7-c038aed88b3b
Last Changed Rev: 6942

Identification: JOSM/1.5 (6942 en) Linux Ubuntu 13.10
Memory Usage: 132 MB / 1749 MB (41 MB allocated, but free)
Java version: 1.8.0, Oracle Corporation, Java HotSpot(TM) 64-Bit Server VM
VM arguments: [-Djosm.restart=true, -Djosm.home=/home/glenn/.josm-latest, -Djava.net.useSystemProxies=true]
Dataset consistency test: No problems found

Plugin: FixAddresses (30277)
Plugin: PicLayer (30277)
Plugin: RoadSigns (30320)
Plugin: buildings_tools (30277)
Plugin: mapdust (30277)
Plugin: mirrored_download (30197)
Plugin: notes (v0.9.2)
Plugin: openstreetbugs (30277)
Plugin: terracer (30277)
Plugin: turnlanes (30277)
Plugin: turnrestrictions (30307)
Plugin: utilsplugin2 (30370)
}}}"	defect	closed	normal		Core		irreproducible	template_report unicode lrm character