Feeder 0.5.0 Runtime issue: org.n52.oxf.ows.ExceptionReport: null

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Feeder 0.5.0 Runtime issue: org.n52.oxf.ows.ExceptionReport: null

Rich Farren
Hi,

I'm having an issue when running the feeder to import a csv file (the example CSV file in fact).
I'm running a Linux Debian 7 VPS with:
Apache Tomcat 7 running 52N SOS 4 (version 2.0.0 SOS spec)
OpenJDK Java 1.7.0_101
PostGres 9.5

I've compiled using Maven the 0.5.0 version of the feeder and wizard as with the 0.4.0 version of the wizard I had problems saving the config file that it produced.
As the build guide says, I need to also compile the OX-Framework because I'm using the 0.5.0-SNAPSHOT wizard and Feeder. I have cloned the repo and built with Maven before building the Wizard/Feeder. I believe I've followed the instructions closely on the guide, but when I run the feeder with my config file and the example dataset I get the following error:

17:39:02.911 [OneTimeFeeder] DEBUG SensorObservationService - Handling CSV line #6985: [03.11.1984 09:45,     12.3489,     21.9825,      9.6337]
17:39:02.911 [OneTimeFeeder] DEBUG SensorObservationService - Parsing measured value column 1
17:39:02.911 [OneTimeFeeder] DEBUG SensorObservationService - Sensor: Sensor [name=PropanSensor, uri=urn:ogc:def:sensor:PropanSensor]
17:39:02.911 [OneTimeFeeder] DEBUG SensorObservationService - Feature of Interest: FeatureOfInterest [p=Position [values=[-1.1100000143051147, 50.58000183105469, 0.0], units=[deg, deg, meters], epsgCode=4326], name=WaterSampler, uri=urn:ogc:def:feature:WaterSampler]
17:39:02.913 [OneTimeFeeder] DEBUG SensorObservationService - Value: 12.3489
17:39:02.913 [OneTimeFeeder] DEBUG SensorObservationService - Timestamp: 1984-11-03T09:45:00+00:00
17:39:02.913 [OneTimeFeeder] DEBUG SensorObservationService - UomCode: 'UnitOfMeasurement [name=l, uri=urn:ogc:def:uom:litre]'
17:39:02.913 [OneTimeFeeder] DEBUG SensorObservationService - ObservedProperty: ObservedProperty [name=Propan, uri=urn:ogc:def:ObservedProperty:Propan]
17:39:02.913 [OneTimeFeeder] DEBUG SensorObservationService - Offering: Offering [name=PropanSensor, uri=urn:ogc:def:sensor:PropanSensor]
17:39:02.913 [OneTimeFeeder] DEBUG SensorObservationService - Parsing measured value column 2
17:39:02.913 [OneTimeFeeder] DEBUG SensorObservationService - Sensor: Sensor [name=WaterSensor, uri=urn:ogc:def:sensor:WaterSensor]
17:39:02.913 [OneTimeFeeder] DEBUG SensorObservationService - Feature of Interest: FeatureOfInterest [p=Position [values=[-1.1100000143051147, 50.58000183105469, 0.0], units=[deg, deg, meters], epsgCode=4326], name=WaterSampler, uri=urn:ogc:def:feature:WaterSampler]
17:39:02.913 [OneTimeFeeder] DEBUG SensorObservationService - Value: 21.9825
17:39:02.913 [OneTimeFeeder] DEBUG SensorObservationService - Timestamp: 1984-11-03T09:45:00+00:00
17:39:02.913 [OneTimeFeeder] DEBUG SensorObservationService - UomCode: 'UnitOfMeasurement [name=l, uri=urn:ogc:def:uom:litre]'
17:39:02.913 [OneTimeFeeder] DEBUG SensorObservationService - ObservedProperty: ObservedProperty [name=Water, uri=urn:ogc:def:ObservedProperty:Water]
17:39:02.913 [OneTimeFeeder] DEBUG SensorObservationService - Offering: Offering [name=WaterSensor, uri=urn:ogc:def:sensor:WaterSensor]
17:39:02.913 [OneTimeFeeder] DEBUG SensorObservationService - Parsing measured value column 3
17:39:02.913 [OneTimeFeeder] DEBUG SensorObservationService - Sensor: Sensor [name=KryptonSensor, uri=urn:ogc:def:sensor:KryptonSensor]
17:39:02.914 [OneTimeFeeder] DEBUG SensorObservationService - Feature of Interest: FeatureOfInterest [p=Position [values=[-1.1100000143051147, 50.58000183105469, 0.0], units=[deg, deg, meters], epsgCode=4326], name=WaterSampler, uri=urn:ogc:def:feature:WaterSampler]
17:39:02.914 [OneTimeFeeder] DEBUG SensorObservationService - Value: 9.6337
17:39:02.914 [OneTimeFeeder] DEBUG SensorObservationService - Timestamp: 1984-11-03T09:45:00+00:00
17:39:02.914 [OneTimeFeeder] DEBUG SensorObservationService - UomCode: 'UnitOfMeasurement [name=kg, uri=urn:ogc:def:uom:kilogram]'
17:39:02.914 [OneTimeFeeder] DEBUG SensorObservationService - ObservedProperty: ObservedProperty [name=Krypton, uri=urn:ogc:def:ObservedProperty:Krypton]
17:39:02.914 [OneTimeFeeder] DEBUG SensorObservationService - Offering: Offering [name=KryptonSensor, uri=urn:ogc:def:sensor:KryptonSensor]
17:39:02.914 [OneTimeFeeder] DEBUG SensorObservationService - HeapSize Information: max: 483MB; total now: 31MB; free now: 13MB; used now: 18MB
17:39:02.914 [OneTimeFeeder] TRACE SensorObservationService - insertTimeSeries()
17:39:02.954 [OneTimeFeeder] DEBUG SimpleHttpClient - executing POST method to 'http://swe.****.**:8080/sos/service/pox'.
17:39:03.090 [OneTimeFeeder] ERROR SensorObservationService - Exception thrown: null
org.n52.oxf.ows.ExceptionReport: null
        at org.n52.oxf.sos.adapter.SOSAdapter.parseOws110ExceptionReport(SOSAdapter.java:562) ~[52n-sos-importer-feeder-bin.jar:0.5.0-SNAPSHOT]
        at org.n52.oxf.sos.adapter.SOSAdapter.doOperation(SOSAdapter.java:383) ~[52n-sos-importer-feeder-bin.jar:0.5.0-SNAPSHOT]
        at org.n52.oxf.sos.adapter.SOSAdapter.doOperation(SOSAdapter.java:437) ~[52n-sos-importer-feeder-bin.jar:0.5.0-SNAPSHOT]
        at org.n52.oxf.sos.adapter.wrapper.SOSWrapper.doInsertSensor(SOSWrapper.java:234) ~[52n-sos-importer-feeder-bin.jar:0.5.0-SNAPSHOT]
        at org.n52.sos.importer.feeder.SensorObservationService.registerSensor(SensorObservationService.java:945) [52n-sos-importer-feeder-bin.jar:0.5.0-SNAPSHOT]
        at org.n52.sos.importer.feeder.SensorObservationService.insertTimeSeries(SensorObservationService.java:625) [52n-sos-importer-feeder-bin.jar:0.5.0-SNAPSHOT]
        at org.n52.sos.importer.feeder.SensorObservationService.importData(SensorObservationService.java:376) [52n-sos-importer-feeder-bin.jar:0.5.0-SNAPSHOT]
        at org.n52.sos.importer.feeder.task.OneTimeFeeder.run(OneTimeFeeder.java:203) [52n-sos-importer-feeder-bin.jar:0.5.0-SNAPSHOT]
        at java.lang.Thread.run(Thread.java:745) [na:1.7.0_101]
17:39:03.090 [OneTimeFeeder] ERROR SensorObservationService - Sensor 'PropanSensor'[urn:ogc:def:sensor:PropanSensor] could not be registered at SOS 'http://swe.oceanwise.eu:8080/sos/service'. Skipping insert observation for this timeseries 'TimeSeries [sensor=urn:ogc:def:sensor:PropanSensor, observedProperty=ObservedProperty [name=Propan, uri=urn:ogc:def:ObservedProperty:Propan], feature=urn:ogc:def:feature:WaterSampler]'.
17:39:03.107 [OneTimeFeeder] DEBUG SimpleHttpClient - executing POST method to 'http://swe.****.**:8080/sos/service/pox'.
17:39:03.141 [OneTimeFeeder] ERROR SensorObservationService - Exception thrown: null
org.n52.oxf.ows.ExceptionReport: null
        at org.n52.oxf.sos.adapter.SOSAdapter.parseOws110ExceptionReport(SOSAdapter.java:562) ~[52n-sos-importer-feeder-bin.jar:0.5.0-SNAPSHOT]
        at org.n52.oxf.sos.adapter.SOSAdapter.doOperation(SOSAdapter.java:383) ~[52n-sos-importer-feeder-bin.jar:0.5.0-SNAPSHOT]
        at org.n52.oxf.sos.adapter.SOSAdapter.doOperation(SOSAdapter.java:437) ~[52n-sos-importer-feeder-bin.jar:0.5.0-SNAPSHOT]
        at org.n52.oxf.sos.adapter.wrapper.SOSWrapper.doInsertSensor(SOSWrapper.java:234) ~[52n-sos-importer-feeder-bin.jar:0.5.0-SNAPSHOT]
        at org.n52.sos.importer.feeder.SensorObservationService.registerSensor(SensorObservationService.java:945) [52n-sos-importer-feeder-bin.jar:0.5.0-SNAPSHOT]
        at org.n52.sos.importer.feeder.SensorObservationService.insertTimeSeries(SensorObservationService.java:625) [52n-sos-importer-feeder-bin.jar:0.5.0-SNAPSHOT]
        at org.n52.sos.importer.feeder.SensorObservationService.importData(SensorObservationService.java:376) [52n-sos-importer-feeder-bin.jar:0.5.0-SNAPSHOT]
        at org.n52.sos.importer.feeder.task.OneTimeFeeder.run(OneTimeFeeder.java:203) [52n-sos-importer-feeder-bin.jar:0.5.0-SNAPSHOT]
        at java.lang.Thread.run(Thread.java:745) [na:1.7.0_101]
17:39:03.141 [OneTimeFeeder] ERROR SensorObservationService - Sensor 'WaterSensor'[urn:ogc:def:sensor:WaterSensor] could not be registered at SOS 'http://swe.****.**:8080/sos/service'. Skipping insert observation for this timeseries 'TimeSeries [sensor=urn:ogc:def:sensor:WaterSensor, observedProperty=ObservedProperty [name=Water, uri=urn:ogc:def:ObservedProperty:Water], feature=urn:ogc:def:feature:WaterSampler]'.
17:39:03.157 [OneTimeFeeder] DEBUG SimpleHttpClient - executing POST method to 'http://swe.oceanwise.eu:8080/sos/service/pox'.
17:39:03.193 [OneTimeFeeder] ERROR SensorObservationService - Exception thrown: null
org.n52.oxf.ows.ExceptionReport: null
        at org.n52.oxf.sos.adapter.SOSAdapter.parseOws110ExceptionReport(SOSAdapter.java:562) ~[52n-sos-importer-feeder-bin.jar:0.5.0-SNAPSHOT]
        at org.n52.oxf.sos.adapter.SOSAdapter.doOperation(SOSAdapter.java:383) ~[52n-sos-importer-feeder-bin.jar:0.5.0-SNAPSHOT]
        at org.n52.oxf.sos.adapter.SOSAdapter.doOperation(SOSAdapter.java:437) ~[52n-sos-importer-feeder-bin.jar:0.5.0-SNAPSHOT]
        at org.n52.oxf.sos.adapter.wrapper.SOSWrapper.doInsertSensor(SOSWrapper.java:234) ~[52n-sos-importer-feeder-bin.jar:0.5.0-SNAPSHOT]
        at org.n52.sos.importer.feeder.SensorObservationService.registerSensor(SensorObservationService.java:945) [52n-sos-importer-feeder-bin.jar:0.5.0-SNAPSHOT]
        at org.n52.sos.importer.feeder.SensorObservationService.insertTimeSeries(SensorObservationService.java:625) [52n-sos-importer-feeder-bin.jar:0.5.0-SNAPSHOT]
        at org.n52.sos.importer.feeder.SensorObservationService.importData(SensorObservationService.java:376) [52n-sos-importer-feeder-bin.jar:0.5.0-SNAPSHOT]
        at org.n52.sos.importer.feeder.task.OneTimeFeeder.run(OneTimeFeeder.java:203) [52n-sos-importer-feeder-bin.jar:0.5.0-SNAPSHOT]
        at java.lang.Thread.run(Thread.java:745) [na:1.7.0_101]
17:39:03.194 [OneTimeFeeder] ERROR SensorObservationService - Sensor 'KryptonSensor'[urn:ogc:def:sensor:KryptonSensor] could not be registered at SOS 'http://swe.****.**:8080/sos/service'. Skipping insert observation for this timeseries 'TimeSeries [sensor=urn:ogc:def:sensor:KryptonSensor, observedProperty=ObservedProperty [name=Krypton, uri=urn:ogc:def:ObservedProperty:Krypton], feature=urn:ogc:def:feature:WaterSampler]'.
17:39:03.194 [OneTimeFeeder] DEBUG SensorObservationService - Timing:
Start File: Thu Jun 30 17:38:32 UTC 2016
Finished importing: Thu Jun 30 17:39:03 UTC 2016
17:39:03.194 [OneTimeFeeder] INFO  SensorObservationService - New observations in SOS: 20952. Failed observations: 0.
17:39:03.195 [OneTimeFeeder] INFO  OneTimeFeeder - OneTimeFeeder: save read lines count: 6985 to '/home/owladmin/.SOSImporter/a2736b9c75f54ea676efee774132f073'
17:39:03.195 [OneTimeFeeder] INFO  OneTimeFeeder - Feeding data from file example-data.csv to SOS instance finished.

The issue seems to be within the oxf module during the insert of the sensor, but I'm not sure from there. I've enabled all definitions within the SOS service so it's not that. No data are recorded in the SOS database following this despite the number of lines read being incremented and the number of failures at 0.

I'm a bit stumped so would appreciate some guidance. Do I need to build the OX-Framework inside the SOS-importer build?

Thanks for helping

Rich
Reply | Threaded
Open this post in threaded view
|

Re: Feeder 0.5.0 Runtime issue: org.n52.oxf.ows.ExceptionReport: null

Rich Farren
FYI I have now tested this using the Feeder 0.4.0 (master) version and the error response is exactly the same and the sensor data are not inserted. So it looks like it's nothing to do with my OX-Framework setup as this version uses the built-in OXF. It must therefore be something else causing the parse exception?

Rich
Reply | Threaded
Open this post in threaded view
|

Re: Feeder 0.5.0 Runtime issue: org.n52.oxf.ows.ExceptionReport: null

Rich Farren
In reply to this post by Rich Farren
OK - I think I've solved this.
I checked in the SOS service logs and it says it refused the connection because transactional queries were disabled.
Went to the admin panel in the SOS and enabled transactional queries and now it works, well, I have data going into the SOS but it's not registering the sensors correctly, a separate investigation!