Context Navigation

Modify ↓

#20246 closed defect (othersoftware)

microdata_scraping plugin crash

Reported by:	pyrog	Owned by:	team
Priority:	normal	Milestone:
Component:	Plugin microdata_scraping	Version:
Keywords:	template_report gitlab	Cc:

Description

What steps will reproduce the problem?

add website=https://au-cha-lheureux-restaurant.eatbu.com/?lang=fr to an osm object
menu tools -> scrap website

What is the expected result?

Parse microdata here in ld+json

What happens instead?

Display an exception.

Please provide any additional information below. Attach a screenshot if possible.

Revision:17329
Is-Local-Build:true
Build-Date:2020-11-22 22:31:51

Identification: JOSM/1.5 (17329 SVN fr) Mac OS X 10.14.6
OS Build number: Mac OS X 10.14.6 (18G4032)
Memory Usage: 1076 MB / 8192 MB (603 MB allocated, but free)
Java version: 15.0.1+9, Azul Systems, Inc., OpenJDK 64-Bit Server VM
Look and Feel: com.apple.laf.AquaLookAndFeel
Screen: Display 69732928 1280x800 (scaling 2.0x2.0)
Maximum Screen Size: 1280x800
Best cursor sizes: 16x16 -> 16x16, 32x32 -> 32x32
VM arguments: [-Dapple.awt.application.appearance=system, --module-path=/Applications/JOSM.app/Contents/app/mods]
Dataset consistency test: No problems found

Plugins:
+ PicLayer (2a9aa7a)
+ SeaMapEditor (35543)
+ apache-commons (35524)
+ apache-http (35589)
+ areaselector (368)
+ austriaaddresshelper (1597341117)
+ buildings_tools (35669)
+ cadastre-fr (35645)
+ conflation (0.6.6)
+ ejml (35458)
+ geotools (35458)
+ gridify (1606242219)
+ jaxb (35543)
+ jna (35662)
+ jts (35458)
+ log4j (35458)
+ measurement (35640)
+ microdata_scraping (1570137897)
+ opendata (35640)
+ pt_assistant (2.1.10-80-g7d9bba3)
+ reverter (35640)
+ utilsplugin2 (35671)
+ wikipedia (1.1.4)

Tagging presets:
+ https://raw.githubusercontent.com/OpenNauticalChart/josm/master/INT-1-preset.xml
+ https://josm.openstreetmap.de/josmfile?page=Presets/Telecom&zip=1
+ https://josm.openstreetmap.de/josmfile?page=Presets/Healthcare&zip=1
+ https://raw.githubusercontent.com/osmlab/name-suggestion-index/master/dist/name-suggestions.presets.xml

Map paint styles:
- https://josm.openstreetmap.de/josmfile?page=Styles/NumberedWalkingNodeNetworks&zip=1
- https://josm.openstreetmap.de/josmfile?page=Styles/Coloured_Streets&zip=1

Validator rules:
+ https://github.com/Jungle-Bus/transport_mapcss/raw/gh-pages/transport.validator.zip
+ ${HOME}/Downloads/Rules_Pictures.validator.mapcss

Last errors/warnings:
- 143852.195 E: Thread main-worker-0 raised java.lang.NoClassDefFoundError: Could not initialize class org.openstreetmap.josm.plugins.fr.cadastre.edigeo.EdigeoCharset
- 143853.199 E: Thread main-worker-0 raised java.lang.NoClassDefFoundError: Could not initialize class org.openstreetmap.josm.plugins.fr.cadastre.edigeo.EdigeoCharset
- 143853.200 E: java.util.concurrent.ExecutionException: java.lang.NoClassDefFoundError: Could not initialize class org.openstreetmap.josm.plugins.fr.cadastre.edigeo.EdigeoCharset. Cause : java.lang.NoClassDefFoundError: Could not initialize class org.openstreetmap.josm.plugins.fr.cadastre.edigeo.EdigeoCharset
- 143853.201 E: java.util.concurrent.ExecutionException: java.lang.NoClassDefFoundError: Could not initialize class org.openstreetmap.josm.plugins.fr.cadastre.edigeo.EdigeoCharset. Cause : java.lang.NoClassDefFoundError: Could not initialize class org.openstreetmap.josm.plugins.fr.cadastre.edigeo.EdigeoCharset
- 144058.394 W: javax.net.ssl.SSLException: Received fatal alert: internal_error
- 148650.785 E: Handled by bug report queue: com.google.gson.JsonSyntaxException: com.google.gson.stream.MalformedJsonException: Unterminated object at line 14 column 55 path $.address.streetAddress. Cause : com.google.gson.stream.MalformedJsonException: Unterminated object at line 14 column 55 path $.address.streetAddress
- 148660.647 W: Avertissement - <html>JOSM ne parvient pas à trouver d’information sur les greffons suivants :<ul><li>SeaMapEditor</li><li>apache-commons</li><li>conflation</li><li>geotools</li><li>opendata</li><li>jts</li><li>ejml</li><li>cadastre-fr</li><li>microdata_scraping</li><li>reverter</li><li>measurement</li><li>jaxb</li><li>pt_assistant</li><li>utilsplugin2</li><li>gridify</li><li>areaselector</li><li>buildings_tools</li><li>wikipedia</li><li>jna</li><li>austriaaddresshelper</li><li>PicLayer</li><li>apache-http</li><li>log4j</li></ul>Les greffons ne seront pas chargés.</html>
- 148758.899 E: Handled by bug report queue: com.google.gson.JsonSyntaxException: com.google.gson.stream.MalformedJsonException: Unterminated object at line 14 column 55 path $.address.streetAddress. Cause : com.google.gson.stream.MalformedJsonException: Unterminated object at line 14 column 55 path $.address.streetAddress
- 148816.987 W: javax.net.ssl.SSLException: Received fatal alert: internal_error
- 148824.634 E: Handled by bug report queue: com.google.gson.JsonSyntaxException: com.google.gson.stream.MalformedJsonException: Unterminated object at line 14 column 55 path $.address.streetAddress. Cause : com.google.gson.stream.MalformedJsonException: Unterminated object at line 14 column 55 path $.address.streetAddress


=== REPORTED CRASH DATA ===
BugReportExceptionHandler#handleException:
No data collected.

Warning issued by: BugReportExceptionHandler#handleException

=== STACK TRACE ===
Thread: AWT-EventQueue-0 (20) of main
com.google.gson.JsonSyntaxException: com.google.gson.stream.MalformedJsonException: Unterminated object at line 14 column 55 path $.address.streetAddress
	at com.google.gson.Gson.fromJson(Gson.java:825)
	at com.google.gson.Gson.fromJson(Gson.java:775)
	at com.google.gson.Gson.fromJson(Gson.java:724)
	at com.google.schemaorg.JsonLdSerializer.deserialize(JsonLdSerializer.java:152)
	at com.github.mautini.pickaxe.extractor.JsonLdExtractor.parseThings(JsonLdExtractor.java:55)
	at com.github.mautini.pickaxe.extractor.JsonLdExtractor.lambda$getThings$0(JsonLdExtractor.java:31)
	at java.base/java.util.stream.ReferencePipeline$7$1.accept(Unknown Source)
	at java.base/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(Unknown Source)
	at java.base/java.util.stream.AbstractPipeline.copyInto(Unknown Source)
	at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(Unknown Source)
	at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(Unknown Source)
	at java.base/java.util.stream.AbstractPipeline.evaluate(Unknown Source)
	at java.base/java.util.stream.ReferencePipeline.collect(Unknown Source)
	at com.github.mautini.pickaxe.extractor.JsonLdExtractor.getThings(JsonLdExtractor.java:32)
	at com.github.mautini.pickaxe.Scraper.lambda$scrap$0(Scraper.java:47)
	at java.base/java.util.stream.ReferencePipeline$7$1.accept(Unknown Source)
	at java.base/java.util.Spliterators$ArraySpliterator.forEachRemaining(Unknown Source)
	at java.base/java.util.stream.AbstractPipeline.copyInto(Unknown Source)
	at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(Unknown Source)
	at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(Unknown Source)
	at java.base/java.util.stream.AbstractPipeline.evaluate(Unknown Source)
	at java.base/java.util.stream.ReferencePipeline.collect(Unknown Source)
	at com.github.mautini.pickaxe.Scraper.scrap(Scraper.java:48)
	at com.github.mautini.pickaxe.Scraper.extract(Scraper.java:42)
	at org.openstreetmap.josm.plugins.microdata_scraping.ScraperUtil.scrap(ScraperUtil.java:60)
	at org.openstreetmap.josm.plugins.microdata_scraping.MicroDataAction.loadData(MicroDataAction.java:105)
	at org.openstreetmap.josm.plugins.microdata_scraping.MicroDataAction.actionPerformed(MicroDataAction.java:80)
	at java.desktop/javax.swing.AbstractButton.fireActionPerformed(Unknown Source)
	at java.desktop/javax.swing.AbstractButton$Handler.actionPerformed(Unknown Source)
	at java.desktop/javax.swing.DefaultButtonModel.fireActionPerformed(Unknown Source)
	at java.desktop/javax.swing.DefaultButtonModel.setPressed(Unknown Source)
	at java.desktop/javax.swing.AbstractButton.doClick(Unknown Source)
	at java.desktop/com.apple.laf.ScreenMenuItem.actionPerformed(Unknown Source)
	at java.desktop/java.awt.MenuItem.processActionEvent(Unknown Source)
	at java.desktop/java.awt.MenuItem.processEvent(Unknown Source)
	at java.desktop/java.awt.MenuComponent.dispatchEventImpl(Unknown Source)
	at java.desktop/java.awt.MenuComponent.dispatchEvent(Unknown Source)
	at java.desktop/java.awt.EventQueue.dispatchEventImpl(Unknown Source)
	at java.desktop/java.awt.EventQueue$4.run(Unknown Source)
	at java.desktop/java.awt.EventQueue$4.run(Unknown Source)
	at java.base/java.security.AccessController.doPrivileged(Unknown Source)
	at java.base/java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
	at java.base/java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
	at java.desktop/java.awt.EventQueue$5.run(Unknown Source)
	at java.desktop/java.awt.EventQueue$5.run(Unknown Source)
	at java.base/java.security.AccessController.doPrivileged(Unknown Source)
	at java.base/java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
	at java.desktop/java.awt.EventQueue.dispatchEvent(Unknown Source)
	at java.desktop/java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
	at java.desktop/java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
	at java.desktop/java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
	at java.desktop/java.awt.EventDispatchThread.pumpEvents(Unknown Source)
	at java.desktop/java.awt.EventDispatchThread.pumpEvents(Unknown Source)
	at java.desktop/java.awt.EventDispatchThread.run(Unknown Source)
Caused by: com.google.gson.stream.MalformedJsonException: Unterminated object at line 14 column 55 path $.address.streetAddress
	at com.google.gson.stream.JsonReader.syntaxError(JsonReader.java:1573)
	at com.google.gson.stream.JsonReader.doPeek(JsonReader.java:495)
	at com.google.gson.stream.JsonReader.hasNext(JsonReader.java:418)
	at com.google.schemaorg.JsonLdSerializer$JsonLdTypeAdapter.readObject(JsonLdSerializer.java:428)
	at com.google.schemaorg.JsonLdSerializer$JsonLdTypeAdapter.readInternal(JsonLdSerializer.java:593)
	at com.google.schemaorg.JsonLdSerializer$JsonLdTypeAdapter.readObject(JsonLdSerializer.java:438)
	at com.google.schemaorg.JsonLdSerializer$JsonLdTypeAdapter.read(JsonLdSerializer.java:408)
	at com.google.schemaorg.JsonLdSerializer$JsonLdTypeAdapter.read(JsonLdSerializer.java:162)
	at com.google.gson.Gson.fromJson(Gson.java:810)
	... 53 more

Attachments (0)

Change History (8)

comment:1 by GerdP, 5 years ago

Seems to be caused by plugin microdata_scraping. This is not managed by the JOSM team, please try to contact the plugin developer.

comment:2 by GerdP, 5 years ago

Component:	Core → Plugin
Summary:	micro-data plugin crash → microdata_scraping plugin crash

comment:3 by Klumbumbus, 5 years ago

Component:	Plugin → Plugin microdata_scraping

comment:4 by pyrog, 5 years ago

https://gitlab.com/vucod/microdata-scraping/-/issues/11

comment:5 by Klumbumbus, 5 years ago

Keywords:	gitlab added
Resolution:	→ othersoftware
Status:	new → closed

As the ticket is on gitlab now we can close this one.

comment:6 by GerdP, 5 years ago

@Klumbumbus: I wonder how you managed to change the component to "Plugin microdata_scraping". I searched the list three times and couldn't find this entry. Is this list generated somewhere or is manually maintained?

comment:7 by Klumbumbus, 5 years ago

Manually. I created the component on https://josm.openstreetmap.de/admin/ticket/components

comment:8 by GerdP, 5 years ago

OK, thanks

Modify Ticket

Change Properties

Summary:
Type:		Priority:
Milestone:		Component:
Version:		Keywords:
Cc:	Set your email in Preferences

Action

leave as closed The owner will remain team.

change resolution as The resolution will be set.

reopen The resolution will be deleted. Next status will be 'reopened'.

Add Comment

Your email or username:

E-mail address and name can be saved in the Preferences .

You may use WikiFormatting here.

Attachments ↑ Description ↑

Note: See TracTickets for help on using tickets.

Download in other formats: