Opened 2 years ago
Last modified 2 years ago
#23448 new defect
JOSM uploaded thousands of duplicate ways and relations — at Initial Version
| Reported by: | nkamapper | Owned by: | team |
|---|---|---|---|
| Priority: | normal | Milestone: | |
| Component: | Core | Version: | |
| Keywords: | template_report | Cc: |
Description
Not sure if this is a problem in JOSM or in the OSM api, but the handling in OSM was at least unusual.
What steps will reproduce the problem?
Please have a look at topo in the municipality of Alta in Norway (Overpass provided below). I did a large topo update this morning. OSM now contains multiple copies of the uploaded data (thousands of ways and relations).
There was no such problem with the data in JOSM before or after the upload (I still have a copy of the saved file without duplicates, and I have considerable experience in working with large datasets in OSM). JOSM was latest stable version, 18940.
During uploading from JOSM, a couple of unusual things happened:
- I hit the new rate limit.
- When continuing after one hour, JOSM after a while retried several times. It kept repeating Retry 1 for the same changeset number as display in the popup window (never getting to retry 2, 3 etc) until I halted it (cancel during a waiting period). This happened around the stage where ways and relations are being uploaded from JOSM, after nodes, before deletions. JOSM continued after I reduced changeset size.
It seems that one (or a few) changesets got uploaded several times, each time producing a new duplicate of ways and relations.
The duplicates in OSM have been reported to DWG.
What is the expected result?
Uploads without duplicates.
What happens instead?
See above.
Please provide any additional information below. Attach a screenshot if possible.
Here is the Overpass api used (shows the affected data):
[out:xml][timeout:200]; (area[name="Alta"][place=municipality];)->.searchArea; ( nwr["natural"](area.searchArea); nwr["landuse"](area.searchArea); nwr["waterway"](area.searchArea); nwr["leisure"](area.searchArea); nwr["aerodrome"](area.searchArea); nwr["man_made"](area.searchArea); ); (._;>;<;); out meta;
Revision:18940 Build-Date:2024-01-17 12:45:24 Identification: JOSM/1.5 (18940 en_GB) Mac OS X 12.7.2 OS Build number: macOS 12.7.2 (21G1974) Memory Usage: 2828 MB / 8192 MB (1542 MB allocated, but free) Java version: 17.0.10+7-LTS, Azul Systems, Inc., OpenJDK 64-Bit Server VM Look and Feel: com.apple.laf.AquaLookAndFeel Screen: Display 69733568 1440×900 (scaling 2.00×2.00) Maximum Screen Size: 1440×900 Best cursor sizes: 16×16→16×16, 32×32→32×32 System property file.encoding: UTF-8 System property sun.jnu.encoding: UTF-8 Locale info: en_GB Numbers with default locale: 1234567890 -> 1234567890 VM arguments: [-Djpackage.app-version=18940, --add-modules=java.scripting,java.sql,javafx.controls,javafx.media,javafx.swing,javafx.web, --add-exports=java.base/sun.security.action=ALL-UNNAMED, --add-exports=java.desktop/com.apple.eawt=ALL-UNNAMED, --add-exports=java.desktop/com.sun.imageio.plugins.jpeg=ALL-UNNAMED, --add-exports=java.desktop/com.sun.imageio.spi=ALL-UNNAMED, --add-opens=java.base/java.lang=ALL-UNNAMED, --add-opens=java.base/java.nio=ALL-UNNAMED, --add-opens=java.base/jdk.internal.loader=ALL-UNNAMED, --add-opens=java.base/jdk.internal.ref=ALL-UNNAMED, --add-opens=java.desktop/javax.imageio.spi=ALL-UNNAMED, --add-opens=java.desktop/javax.swing.text.html=ALL-UNNAMED, --add-opens=java.prefs/java.util.prefs=ALL-UNNAMED, -Djpackage.app-path=/Applications/JOSM.app/Contents/MacOS/JOSM] Dataset consistency test: No problems found Plugins: + PicLayer (1.0.3) + RelationDissolve (0.2.0) + apache-commons (36176) + apache-http (36176) + changeset-viewer (0.0.7) + conflation (0.6.11) + ejml (36176) + ext_tools (36126) + geotools (36176) + imagery-xml-bounds (36196) + jackson (36176) + jaxb (36118) + jna (36176) + jts (36004) + log4j (36176) + opendata (36200) + pdfimport (36200) + reverter (36196) + scripting (v0.3.1) + todo (137) + utilsplugin2 (36200) Tagging presets: + https://josm.openstreetmap.de/josmfile?page=Presets/LaneAttributes&zip=1 + https://raw.githubusercontent.com/OpenNauticalChart/josm/master/INT-1-preset.xml Map paint styles: + https://josm.openstreetmap.de/josmfile?page=Styles/Lane_and_Road_Attributes&zip=1 - https://raw.githubusercontent.com/OpenSeaMap/josm/master/CEVNI_MapCSS.mapcss - https://raw.githubusercontent.com/OpenSeaMap/josm/master/INT1_Seamark.mapcss - https://josm.openstreetmap.de/josmfile?page=Styles/PublicTransport&zip=1


