Modify

Ticket #2766 (closed enhancement: fixed)

Opened 3 years ago

Last modified 3 years ago

Provide configuration checkbox in upload dialog for enabling/disabling changesets

Reported by: email@… Owned by: team
Priority: minor Component: Core
Version: latest Keywords: atomic upload
Cc: karl.guggisberg@…

Description

I traced the lake "Qiandao Lake" (see wiki) newly because there was only a ~750-node lake (AND data). Upload seems to stall with a timeout after 60 to 80 seconds without josm giving any error.

(Data included)

Attachments

lake.osm.gz Download (141.8 KB) - added by email@… 3 years ago.
osm file of new Qiandao Lake

Change History

Changed 3 years ago by email@…

osm file of new Qiandao Lake

comment:1 Changed 3 years ago by stoecker

  • Owner changed from team to email@…
  • Status changed from new to needinfo

I think this is plainly a server timeout or something like that due to a large number of data. You should retry.

A note: the relation should be "type=multipolygon and natural=water" instead of "type=lake".

comment:2 Changed 3 years ago by katpatuka

I tried more than 10 times to upload... I don't get no error, nothing, just sort of timeout. Feel free to try an upload yourself...

comment:3 Changed 3 years ago by Gubaer

  • Go to Preferences -> "Einstein dialog"
  • set osm-server.atomic-upload to false
  • try to upload again. This will use a lot of small uploads instead of one gigantic diff upload.

comment:4 Changed 3 years ago by katpatuka

With osm-server.atomic-upload=false I get error:

PUT http://www.openstreetmap.org/api/0.6/node/create... Bad Request
Error header: Cannot parse valid node from xml string <node visible="true" version="0" lat="29.662" lon="118.93175"/>. Changeset id is missing
got exception: org.openstreetmap.josm.io.OsmApiException: ResponseCode=400, Error Header=<Cannot parse valid node from xml string <node visible="true" version="0" lat="29.662" lon="118.93175"/>. Changeset id is missing>,Error Body=<Cannot parse valid node from xml string <node visible="true" version="0" lat="29.662" lon="118.93175"/>. Changeset id is missing>

comment:5 Changed 3 years ago by Gubaer

You'll have to update to JOSM latest. I've recently fixed that in in r1682.

Be careful with JOSM latest, though. It's less stable than the tested version.

comment:6 Changed 3 years ago by katpatuka

  • Keywords atomic upload added

Ok, with osm-server.atomic-upload=false and r1682 it finally worked (the old before-changesets-existed way of life) - but it took me 6 hours! There also had been conflicts against the end of the upload sequence which had to be resolved... and duplicated ways have been created which I manually deleted in potlatch (joms drove me nuts saying node x is still used by way y!)

Strange thing is, that I didn't get any error or hint by josm during the normal upload that something is going wrong...

Recommendation: The setting osm-server.atomic-upload could be implemented into Preferences of josm - as a last resort.

comment:7 Changed 3 years ago by Gubaer

  • Cc karl.guggisberg@… added
  • Priority changed from major to minor
  • Type changed from defect to enhancement
  • Summary changed from upload of 76x201-node-lake not possible to Provide configuration checkbox in upload dialog for enabling/disabling changesets

I'm not really astonished about the 6 hours it took. You have ~ 25-30 K primitivies to upload in your file!

There also had been conflicts against the end of the upload sequence which had to be resolved... and duplicated ways have been created which I manually deleted in potlatch (joms drove me nuts saying node x is still used by way y!)

I'm not astonished either that you have to resolve conflicts. With 30K updates it's likely that in the meantime another mapper touched a couple of primitives too. But I'd be interested to hear more about the conflict you couldn't resolve with JOSM. Perhaps I can improve the conflict resolution code in JOSM.

Strange thing is, that I didn't get any error or hint by josm during the normal upload that something is going wrong...

That's normal too. The API is reporting back only after it has processed the entire changeset - in your case probably only after a couple of hours.

Recommendation: The setting osm-server.atomic-upload could be implemented into Preferences of josm - as a last resort.

I think it would even be better if the upload dialog had two radio boxes:

use [ ] changesets | [ ] this time / [ ] always

I turn this into an enhancement.

comment:8 Changed 3 years ago by katpatuka

...in the meantime another mapper touched a couple of primitives too.

Not likely: I just tried to upload lakewalker trace of the lake (~16.000 nodes) - so there weren't any ways someone else could have changed in the meantime.

But I'd be interested to hear more about the conflict you couldn't resolve with JOSM...

The non-atomic-upload worked more or less well (despite an electric outage) till it reached the moment where the way-ids start to get transfered. There were lots of "node x is still used by way y" which I tried to resolve. At one time I had a controlling look in potlatch and the coastline was already there. I downloaded the already viewable data in a new layer to check it and saw that about have of the 76 201-node-ccoastlines had dublicates - I first tried to delete the dups in josm but again got these ominous "node x is still used by way y" - therefore I decided to delete the dups in potlatch manually. That process is still slow but more simple than to fight with josm's validator/conflict resolver. BTW: after each resolve and click on upload I had to wait half a minute to get the upload dialogue... After manually deleting in potlatch I reloaded again in josm to fix some duplicate nodes left over and finally could add a relation for the lake.

comment:9 Changed 3 years ago by stoecker

  • Owner changed from email@… to team
  • Status changed from needinfo to new

comment:10 Changed 3 years ago by Gubaer

  • Status changed from new to closed
  • Resolution set to fixed

fixed in r1870

View

Add a comment

Modify Ticket

Change Properties
<Author field>
Action
as closed
as The resolution will be set. Next status will be 'closed'
The resolution will be deleted. Next status will be 'reopened'
Author


E-mail address and user name can be saved in the Preferences.

 
Note: See TracTickets for help on using tickets.