Changes between Version 36 and Version 37 of Help/Action/Upload
- Timestamp:
- 2010-07-04T12:56:10+02:00 (16 years ago)
Legend:
- Unmodified
- Added
- Removed
- Modified
-
Help/Action/Upload
v36 v37 7 7 '''Upload new, modified, and deleted objects in the current data layer to the server.''' 8 8 9 Geo data edited in JOSM is only available locally and only usable by the user who entered the data unless the user decides to make it available to the community too. In order to publish data the user has to '''upload''' it. Uploading means that the geo data is transferred to a central server run by the OSM community where it is integra ded with geo data from other mappers in a central database. It's by uploading data that locally edited geo data both becomes part of the [http://www.openstreetmap.org public maps] and can be used by other members of the OSM community.9 Geo data edited in JOSM is only available locally and only usable by the user who entered the data unless the user decides to make it available to the community too. In order to publish data the user has to '''upload''' it. Uploading means that the geo data is transferred to a central server run by the OSM community where it is integrated with geo data from other mappers in a central database. It's by uploading data that locally edited geo data both becomes part of the [http://www.openstreetmap.org public maps] and can be used by other members of the OSM community. 10 10 11 11 {{{ 12 12 #!html 13 13 <p style="background-color:rgb(253,255,221);padding: 10pt; border-color:rgb(128,128,128);border-style: solid; border-width: 1px;"> 14 Please be careful with editing and uploading data. When in doubt that everything is ok , ratherrefrain from uploading and save the area locallyon disk tocheckback to itlater.14 Please be careful with editing and uploading data. When in doubt that everything is okay, refrain from uploading and save the area locally to disk, check what you need and try again later. 15 15 </p> 16 16 }}} … … 19 19 20 20 == Changesets, upload requests, and upload strategies == 21 Geo data contributed to the OSM server consists of [wiki:/Help/Concepts/Object nodes, ways, and relations]. Because there are hundreds of mappers publishing their geo data on the OSM server it is important to track who published what data in which context. It would be tedious for mappers to describe for every single node and every single way why it is published. A more convenient approach is to package a group of related objects and assign the packagea comment,notthe individual objects.22 23 The OSM project calls such a package a '''[wiki:/Help/Concepts/Changeset changeset]'''. A '''changeset''' is a collection of related changes (new objects, object modifications, or object deleti ngs) applied to OSM data.24 25 Changesets are different from '''upload requests'''. A changeset is a '''logical''' grouping of [wiki:/Help/Concepts/Object objects] whereas an upload request is a '''technical grouping''' for the purpose oftransferring geo data to the central OSM server only. In JOSM we say, that objects are uploaded '''using''' upload requests '''to''' a changeset. The JOSM Upload Dialog allowsone to configureaspects of the upload requeststo be used and aspects of thechangeset objectsare uploaded to. Some of the settings are compulsory (i.e. the user has to configure them beforehe or she can upload geo data) but most of them are optional and JOSM works with reasonable default values.26 27 Geo data can be retrieved later by the changeset it was uploaded to, it can't be retrieved by theupload request used. Changesets have a unique id, upload requests have not. For instance, [http://www.openstreetmap.org/browse/changeset/3274448 this changeset] includes geo data from tracing over orthofotos of the city of Bern, Switzerland. It isn't possible, though, to seewhich and how manyupload requestshave be used to fill it in.21 Geo data contributed to the OSM server consists of [wiki:/Help/Concepts/Object nodes, ways, and relations]. Because there are hundreds of mappers publishing their geo data on the OSM server it is important to track who published what data in which context. It would be tedious for mappers to describe why every single node and every single way is published. A more convenient approach is to package a group of related objects and assign the package itself a comment, instead of the individual objects. 22 23 The OSM project calls such a package a '''[wiki:/Help/Concepts/Changeset changeset]'''. A '''changeset''' is a collection of related changes (new objects, object modifications, or object deletions) applied to OSM data. 24 25 Changesets are different from '''upload requests'''. A changeset is a '''logical''' grouping of [wiki:/Help/Concepts/Object objects], whereas an upload request is a '''technical grouping''' for transferring geo data to the central OSM server only. In JOSM we say, that objects are uploaded '''using''' upload requests '''to''' a changeset. The JOSM Upload Dialog allows aspects of the upload requests and changeset objects to be configured. Some of the settings are compulsory (i.e. the user has to configure them before geo data can be uploaded) but most of them are optional and JOSM works with reasonable default values. 26 27 Geo data can be retrieved later via the changeset it was uploaded to, though it can't be retrieved by the upload request used. Changesets have a unique identifier, upload requests have not. For instance, [http://www.openstreetmap.org/browse/changeset/3274448 this changeset] includes geo data from tracing over orthofotos of the city of Bern, Switzerland. It isn't possible, though, to see the upload requests that were used to fill it. 28 28 29 29 === One upload request into one changeset === … … 49 49 [[Image(one-changeset-individual-object-upload-request.png)]] 50 50 51 Please note that this is a legacy feature. Until recently, this was the only upload option in OSM. Technically, it uses a slightly different approach to communicate with the OSM server. It is still available in JOSM although the OSM server now supports upload requests with up to 50 '000 objects. For the casual and normal user it is almost obsolete. In rare cases, it could be useful for power users.51 Please note that this is a legacy feature. Until recently, this was the only upload option in OSM. Technically, it uses a slightly different approach to communicate with the OSM server. It is still available in JOSM although the OSM server now supports upload requests with up to 50,000 objects. For the casual and normal user it is almost obsolete. In rare cases, it could be useful for power users. 52 52 53 53 === Uploading large datasets into multiple changeset === 54 JOSM also supports uploading large datasets whichdon't fit intoone changesetonly.54 JOSM also supports uploading large datasets that don't fit into a single changeset. 55 55 56 56 [[Image(multiple-changesets.png)]] 57 57 58 This is an advanced option which only isuseful for power users. They can select this configuration if they have to upload a dataset with more than 50'000 new, modified, or deleted objects.59 60 == Choosing your upload strategy - when and how often to upload ==58 This is an advanced option which is only useful for power users. They can select this configuration if they have to upload a dataset with more than 50,000 new, modified, or deleted objects. 59 60 == Choosing your upload strategy - when and how often to upload == 61 61 There is no simple answer to the question when and how often to upload. You neither should edit the whole day and then upload everything at once nor upload every minute after adding a way. 62 62 63 63 Here are some rules of thumb: 64 64 65 * '''Time required to upload''': the smaller the upload requests you choose the longer it takes to upload. It takes more time to upload 100 objects with100 individual upload requests than to upload them in one requestincluding 100 objects.66 67 * '''Collisions with other mappers''': if you upload 30 '000 objects in one request and if the server encounters a problem on the 29'999th object the whole upload is rolled back. One has to fix the problem (i.e. by resolving a [wiki:/Help/Concepts/Conflict conflict]). The whole 30'000 objects will have to be uploaded again. On the other hand, if you upload 30'000 object with 10 request à 1000 objects and if the server encounters a problem on the 29'999th object then you only have to repeat the last upload request including the 29000th to the 30000th objects. Object 1-28999 are already successfully uploaded. If you're mapping in areas where other mappers are active too you should therefore prefer smaller sizes for upload requests.65 * '''Time required to upload''': the smaller the upload requests you choose the longer it takes to upload. It takes more time to upload 100 objects using 100 individual upload requests than to upload them in one request containing 100 objects. 66 67 * '''Collisions with other mappers''': if you upload 30,000 objects in one request and if the server encounters a problem on the 29,999th object the whole upload is rolled back. The problem has to be fixed first (i.e. by resolving a [wiki:/Help/Concepts/Conflict conflict]). The whole 30,000 objects will then have to be uploaded again. On the other hand, if you upload 30,000 objects with 10 requests containing 1,000 objects each and the server encounters a problem on the 29,999th object then you only have to repeat the last upload request for the 29,000th to 30,000th objects. Objects 1-28,999 are already successfully uploaded. If you're mapping in areas where other mappers are active too you should therefore prefer smaller sizes for upload requests. 68 68 69 69 == Uploading data == … … 78 78 If the [http://wiki.openstreetmap.org/index.php/JOSM/Plugins/Validator Validator plugin] is installed, JOSM performs a quick check on the data. If it finds warnings or errors you'll be presented with a list of them and get the chance to correct the problems and try again or upload anyway. It's not necessary to fix all of that, but please don't go over it easily, especially not the errors. 79 79 80 JOSM also checks for limit itations imposed by the OSM server:80 JOSM also checks for limitations imposed by the OSM server: 81 81 * tag names and tag values must be shorter than 255 characters 82 82 * ways can't consist of too many nodes … … 84 84 If the objects you're uploading have cyclic dependencies (relation 1 refers to relation 2, relation 2 refers to relation 3, relation 3 refers to relation 1) JOSM can't upload them. JOSM will ask you to break up these dependencies first. 85 85 86 '''Note''': On large dataset these checks can take some time and for the time being they don't provide user feedback. Please be patient if it takes a couple of seconds to launch the Upload Dialog on large datasets. This will be fixed soon. 86 '''Note''': On large datasets these checks can take some time and for the time being they don't provide user feedback. Please be patient if it takes a couple of seconds to launch the Upload Dialog on large datasets. This will be fixed soon. 87 87 88 88 === The Upload Dialog === … … 127 127 If you want to upload to an existing changeset you have to select one of the available changesets from the drop down list. This list is only enabled if there are open changesets which you can upload data to because you own them. Click on [[Image(source:/trunk/images/dialogs/refresh.png)]] ''Refresh'' to load the list of available open changesets from the server. If there is at least one open changeset available you can select the radio button '''Upload to an existing changeset''' and select a changeset. 128 128 129 Click on [[Image(source:/trunk/images/closechangeset.png)]]''Close Changeset'' to close the currently selected open changeset. This is for convenience only. You don't have to close a changeset here in order to run a succesful upload. 129 Click on [[Image(source:/trunk/images/closechangeset.png)]]''Close Changeset'' to close the currently selected open changeset. This is for convenience only. You don't have to close a changeset here in order to run a successful upload. 130 130 131 131 After a successful upload JOSM can either close the changeset used or leave it open for another upload. The default setting is to close it. You can configure whether JOSM should leave it open by unselecting the checkbox '''Close changeset after upload'''. … … 139 139 Select '''Upload data in one request''' to upload all object in one request. If you're uploading a medium to large number of objects this might take some time and JOSM will not be able to inform you about the progress. There are only two outcomes of such an upload: the upload either succeeded or it didn't. In the former case everything is fine, in the later no objects at all have been uploaded. This kind of upload will never lead to a partial upload which is both its strength and its weakness. It can be its weakness if the entire upload fails because there is a problem in the very last object in the upload request. 140 140 141 Select '''Upload data in chunks of objects''' to upload the objects in a sequence of requests with a predefined size. You can enter a preferred size for an upload request (called the "chunk size"). Depending on its value JOSM will submit a number of upload request (the number is displayed on the right of the input field for the "chunk size"). In contrast to the former option, every upload of a chunk can either succeed or fail. You will get some coarse grained progress feedback because JOSM will inform you when an individual chunk has been uploaded successfully or when its upload has failed. Uploading in chunks is in most cases slower than uploading in one requests, though. 141 Select '''Upload data in chunks of objects''' to upload the objects in a sequence of requests with a predefined size. You can enter a preferred size for an upload request (called the "chunk size"). Depending on its value JOSM will submit a number of upload requests (the number is displayed on the right of the input field for the "chunk size"). In contrast to the former option, every upload of a chunk can either succeed or fail. You will get some coarse grained progress feedback because JOSM will inform you when an individual chunk has been uploaded successfully or when its upload has failed. Uploading in chunks is in most cases slower than uploading in one requests, though. 142 142 143 143 Select '''Upload each object individually''' to upload each object with an individual upload request. You will get very fine grained progress feedback because JOSM will inform you when an individual object was uploaded successfully or when its upload has failed. Note that this option is in most cases the slowest option. 144 144 145 145 '''Recommendations''' 146 * For small (<1000 objects) to medium upload sizes (<5000 objects), choose '''Upload data in one request''' 147 * For medium to large upload sizes (> 5000 objects) choose '''Upload data in chunks of objects'''. A chunk size of 1000 is a good value to start with. 146 * For small (<1,000 objects) to medium upload sizes (<5,000 objects), choose '''Upload data in one request''' 147 * For medium to large upload sizes (> 5,000 objects) choose '''Upload data in chunks of objects'''. A chunk size of 1,000 is a good value to start with. 148 148 * Don't use '''Upload each object individually''' unless you have a specific reason to do so. This is basically a legacy strategy from former versions of the OSM server. 149 149 150 150 === Running a very large upload === 151 An upload is considered to be very large if its size exceeds the maximum size of a changeset on the OSM server. Currently, the upper limit for the size of a changeset is 50 '000 objects and if JOSM detectes that your upload is bigger it displays the following information in the Upload Dialog:151 An upload is considered to be very large if its size exceeds the maximum size of a changeset on the OSM server. Currently, the upper limit for the size of a changeset is 50,000 objects and if JOSM detects that your upload is bigger it displays the following information in the Upload Dialog: 152 152 153 153 [[Image(large-upload-basic-settings.png)]] … … 157 157 [[Image(large-upload-advanced-settings.png)]] 158 158 159 For very large uploads, uploading in one request isn't possible and the respective option is therefore disabled. Please select a chunk size to be used in the upload. It has to be smaller than 50 '000, too, because the upper limit for the size of a changeset also applies to the chunk size. You can upload a very large dataset with an individual request per object but you're not recommended to do so.159 For very large uploads, uploading in one request isn't possible and the respective option is therefore disabled. Please select a chunk size to be used in the upload. It has to be smaller than 50,000, too, because the upper limit for the size of a changeset also applies to the chunk size. You can upload a very large dataset with an individual request per object but you're not recommended to do so. 160 160 161 161 A very large upload doesn't fit within a single changeset. Please select … … 168 168 169 169 === Uploading to a closed changeset ===#ChangesetClosed 170 If you upload to an open changeset, the upload may fail because the changeset has been closed in the meantime. It could have been closed by the server because of a timeout (changesets don't stay open for more than 24 hours) or because you closed it explicitly in another JOSM instance. 170 If you upload to an open changeset, the upload may fail because the changeset has been closed in the meantime. It could have been closed by the server because of a timeout (changesets don't stay open for more than 24 hours and are also closed after an hour of inactivity) or because you closed it explicitly in another JOSM instance. 171 171 172 172 JOSM displays the following error message: … … 180 180 181 181 === Changeset becomes full during upload ===#ChangesetFull 182 There is an upper limit for the size of changesets. On the OSM server it's currently set to 50 '000 objects per changeset. An upload may exceed this limit while uploading, mainly if you are uploading a sequence of upload requests to the same changeset.182 There is an upper limit for the size of changesets. On the OSM server it's currently set to 50,000 objects per changeset. An upload may exceed this limit while uploading, mainly if you are uploading a sequence of upload requests to the same changeset. 183 183 184 184 If JOSM detects that a changeset became full it displays the following warning message: … … 192 192 193 193 194 === Deleting node which isstill in use ===194 === Deleting nodes that are still in use === 195 195 {{{ 196 196 #!html
