skorper opened a new pull request #153: URL: https://github.com/apache/incubator-sdap-nexus/pull/153
Apache ticket: [SDAP-366](https://issues.apache.org/jira/browse/SDAP-366) These changes fix the CSV output for matchup. The issue was that `doms.ResultStorage` was using the old json format, so I updated it to use the new json format. Note: this does not fix the NetCDF output. The NetCDF output issue seems to be a bit more complicated so I'm going to continue working that separately. Testing: Matchup request: ``` {{big_data_url}}/match_spark?primary=MUR25-JPL-L4-GLOB-v04.2&startTime=2018-09-24T00:00:00Z&endTime=2018-09-30T00:00:00Z&tt=2592000&rt=1000&b=160,-30,180,-25&platforms=1,2,3,4,5,6,7,8,9¶meter=sst&depthMin=0&depthMax=5&matchOnce=true&secondary=icoads&resultSizeLimit=6000 ``` Used execution ID from the above request to do `/domsresults` request: ``` {{big_data_url}}/domsresults?id=39b92414-6054-46de-91b4-fd23f4503622&output=NETCDF ``` Result: ```csv product_version,1.0 Conventions,"CF-1.6, ACDD-1.3" title,DOMS satellite-insitu machup output file history,"Processing_Version = V1.0, Software_Name = DOMS, Software_Version = 1.03" institution,"JPL, FSU, NCAR" source,doms.jpl.nasa.gov standard_name_vocabulary,"CF Standard Name Table v27, BODC controlled vocabulary" cdm_data_type,"Point/Profile, Swath/Grid" processing_level,4 project,Distributed Oceanographic Matchup System (DOMS) keywords_vocabulary,NASA Global Change Master Directory (GCMD) Science Keywords keywords,"SATELLITES, OCEAN PLATFORMS, SHIPS, BUOYS, MOORINGS, AUVS, ROV, NASA/JPL/PODAAC, FSU/COAPS, UCAR/NCAR, SALINITY, SEA SURFACE TEMPERATURE, SURFACE WINDS" creator_name,NASA PO.DAAC creator_email,[email protected] creator_url,https://podaac.jpl.nasa.gov/ publisher_name,NASA PO.DAAC publisher_email,[email protected] publisher_url,https://podaac.jpl.nasa.gov acknowledgment,DOMS is a NASA/AIST-funded project. NRA NNH14ZDA001N. Platform,"drifting surface float, orbiting satellite" time_coverage_start,2018-09-24T00:00:00+0000 time_coverage_end,2018-09-30T00:00:00+0000 time_coverage_resolution,point geospatial_lon_min,160 geospatial_lat_min,-30 geospatial_lon_max,180 geospatial_lat_max,-25 geospatial_lat_resolution,point geospatial_lon_resolution,point geospatial_lat_units,degrees_north geospatial_lon_units,degrees_east geospatial_vertical_min,0.0 geospatial_vertical_max,5.0 geospatial_vertical_units,m geospatial_vertical_resolution,point geospatial_vertical_positive,down DOMS_matchID,39b92414-6054-46de-91b4-fd23f4503622 DOMS_TimeWindow,720.0 DOMS_TimeWindow_Units,hours DOMS_platforms,"1,2,3,4,5,6,7,8,9" DOMS_SearchRadius,1000.0 DOMS_SearchRadius_Units,m DOMS_DatasetMetadata,https://rda.ucar.edu/datasets/ds548.1/ DOMS_primary,MUR25-JPL-L4-GLOB-v04.2 DOMS_match_up,['icoads'] DOMS_ParameterPrimary,sst DOMS_time_to_complete,39 DOMS_time_to_complete_units,seconds DOMS_num_matchup_matched,54 DOMS_num_primary_matched,54 date_modified,2022-02-18T01:31:42+0000 date_created,2022-02-18T01:31:42+0000 URI_Matchup,http://{webservice}/domsresults?id=39b92414-6054-46de-91b4-fd23f4503622&output=CSV id,source,lon (degrees_east),lat (degrees_north),time,platform,sea_surface_salinity (1e-3),sea_surface_temperature (degree_C),wind_speed (m s-1),wind_direction,wind_u (m s-1),wind_v (m s-1),id,source,lon (degrees_east),lat (degrees_north),time,platform,depth (m),sea_water_salinity (1e-3),sea_water_temperature (degree_C),wind_speed (m s-1),wind_direction,wind_u (m s-1),wind_v (m s-1) bcdae738-b6f2-30f1-a2cc-8a6123828582[[ 0 7 15]],MUR25-JPL-L4-GLOB-v04.2,161.375,-28.125,2018-09-24T09:00:00+0000,orbiting satellite,,,,,,,PA5672,icoads,161.38,-28.13,2018-09-29T01:00:00+0000,drifting surface float,,,18.6,,,, 04331b1a-16b5-3186-badf-9f15d39ecfe1[[ 0 11 27]],MUR25-JPL-L4-GLOB-v04.2,179.375,-27.125,2018-09-29T09:00:00+0000,orbiting satellite,,,,,,,P9C8DU,icoads,179.38,-27.12,2018-09-22T14:00:00+0000,drifting surface float,,,19.8,,,, 1eaa976f-0908-3309-8c66-a4122d381b3f[[ 0 5 24]],MUR25-JPL-L4-GLOB-v04.2,178.625,-28.625,2018-09-28T09:00:00+0000,orbiting satellite,,,,,,,P7NKMT,icoads,178.63,-28.63,2018-09-09T18:00:00+0000,drifting surface float,,,19.2,,,, 4da039fd-28f2-3fd5-8a04-fe78a49d5e68[[ 0 8 15]],MUR25-JPL-L4-GLOB-v04.2,161.375,-27.875,2018-09-25T09:00:00+0000,orbiting satellite,,,,,,,PCY3CI,icoads,161.38,-27.88,2018-10-23T10:00:00+0000,drifting surface float,,,20.0,,,, 9c08c026-eff7-30a7-ab1e-413a64f507ff[[ 0 11 27]],MUR25-JPL-L4-GLOB-v04.2,179.375,-27.125,2018-09-27T09:00:00+0000,orbiting satellite,,,,,,,P9C8DU,icoads,179.38,-27.12,2018-09-22T14:00:00+0000,drifting surface float,,,19.8,,,, 90ca81e5-850d-3a37-9aed-3e3f5c365aec[[ 0 5 17]],MUR25-JPL-L4-GLOB-v04.2,161.875,-28.625,2018-09-29T09:00:00+0000,orbiting satellite,,,,,,,PD40VK,icoads,161.88,-28.62,2018-10-24T20:00:00+0000,drifting surface float,,,21.1,,,, 22a9a434-f569-3aa6-988a-98c651f9139e[[ 0 11 27]],MUR25-JPL-L4-GLOB-v04.2,179.375,-27.125,2018-09-25T09:00:00+0000,orbiting satellite,,,,,,,P9C8DU,icoads,179.38,-27.12,2018-09-22T14:00:00+0000,drifting surface float,,,19.8,,,, 2142b9f2-9438-346d-abf1-27a74d3addbf[[ 0 6 24]],MUR25-JPL-L4-GLOB-v04.2,178.625,-28.375,2018-09-26T09:00:00+0000,orbiting satellite,,,,,,,P8JCJW,icoads,178.62,-28.38,2018-09-16T21:00:00+0000,drifting surface float,,,20.3,,,, 8ff1b246-16de-34e2-87bb-600c4107a7f8[[ 0 7 15]],MUR25-JPL-L4-GLOB-v04.2,161.375,-28.125,2018-09-28T09:00:00+0000,orbiting satellite,,,,,,,PA5672,icoads,161.38,-28.13,2018-09-29T01:00:00+0000,drifting surface float,,,18.6,,,, 9c08c026-eff7-30a7-ab1e-413a64f507ff[[ 0 5 24]],MUR25-JPL-L4-GLOB-v04.2,178.625,-28.625,2018-09-27T09:00:00+0000,orbiting satellite,,,,,,,P7NKMT,icoads,178.63,-28.63,2018-09-09T18:00:00+0000,drifting surface float,,,19.2,,,, bcdae738-b6f2-30f1-a2cc-8a6123828582[[ 0 6 14]],MUR25-JPL-L4-GLOB-v04.2,161.125,-28.375,2018-09-24T09:00:00+0000,orbiting satellite,,,,,,,PAWNVF,icoads,161.12,-28.37,2018-10-06T00:00:00+0000,drifting surface float,,,18.9,,,, bdeb0d98-e3a3-3038-bf8a-633ca92bb809[[ 0 6 14]],MUR25-JPL-L4-GLOB-v04.2,161.125,-28.375,2018-09-26T09:00:00+0000,orbiting satellite,,,,,,,PAWNVF,icoads,161.12,-28.37,2018-10-06T00:00:00+0000,drifting surface float,,,18.9,,,, bdeb0d98-e3a3-3038-bf8a-633ca92bb809[[ 0 7 15]],MUR25-JPL-L4-GLOB-v04.2,161.375,-28.125,2018-09-26T09:00:00+0000,orbiting satellite,,,,,,,PA5672,icoads,161.38,-28.13,2018-09-29T01:00:00+0000,drifting surface float,,,18.6,,,, 04331b1a-16b5-3186-badf-9f15d39ecfe1[[ 0 6 24]],MUR25-JPL-L4-GLOB-v04.2,178.625,-28.375,2018-09-29T09:00:00+0000,orbiting satellite,,,,,,,P8JCJW,icoads,178.62,-28.38,2018-09-16T21:00:00+0000,drifting surface float,,,20.3,,,, 4e45863f-c39f-3004-8105-b96035196632[[ 0 11 27]],MUR25-JPL-L4-GLOB-v04.2,179.375,-27.125,2018-09-24T09:00:00+0000,orbiting satellite,,,,,,,P9C8DU,icoads,179.38,-27.12,2018-09-22T14:00:00+0000,drifting surface float,,,19.8,,,, bdeb0d98-e3a3-3038-bf8a-633ca92bb809[[ 0 8 15]],MUR25-JPL-L4-GLOB-v04.2,161.375,-27.875,2018-09-26T09:00:00+0000,orbiting satellite,,,,,,,PCY3CI,icoads,161.38,-27.88,2018-10-23T10:00:00+0000,drifting surface float,,,20.0,,,, 8ff1b246-16de-34e2-87bb-600c4107a7f8[[ 0 5 17]],MUR25-JPL-L4-GLOB-v04.2,161.875,-28.625,2018-09-28T09:00:00+0000,orbiting satellite,,,,,,,PD40VK,icoads,161.88,-28.62,2018-10-24T20:00:00+0000,drifting surface float,,,21.1,,,, 90ca81e5-850d-3a37-9aed-3e3f5c365aec[[ 0 8 15]],MUR25-JPL-L4-GLOB-v04.2,161.375,-27.875,2018-09-29T09:00:00+0000,orbiting satellite,,,,,,,PCY3CI,icoads,161.38,-27.88,2018-10-23T10:00:00+0000,drifting surface float,,,20.0,,,, 43428176-e15c-32c1-9e03-f9b113506312[[ 0 5 17]],MUR25-JPL-L4-GLOB-v04.2,161.875,-28.625,2018-09-27T09:00:00+0000,orbiting satellite,,,,,,,PD40VK,icoads,161.88,-28.62,2018-10-24T20:00:00+0000,drifting surface float,,,21.1,,,, 2142b9f2-9438-346d-abf1-27a74d3addbf[[0 0 3]],MUR25-JPL-L4-GLOB-v04.2,173.375,-29.875,2018-09-26T09:00:00+0000,orbiting satellite,,,,,,,PCEWYL,icoads,173.38,-29.88,2018-10-18T20:00:00+0000,drifting surface float,,,19.6,,,, 1eaa976f-0908-3309-8c66-a4122d381b3f[[ 0 11 27]],MUR25-JPL-L4-GLOB-v04.2,179.375,-27.125,2018-09-28T09:00:00+0000,orbiting satellite,,,,,,,P9C8DU,icoads,179.38,-27.12,2018-09-22T14:00:00+0000,drifting surface float,,,19.8,,,, 4e45863f-c39f-3004-8105-b96035196632[[ 0 19 27]],MUR25-JPL-L4-GLOB-v04.2,179.375,-25.125,2018-09-24T09:00:00+0000,orbiting satellite,,,,,,,P5Y64K,icoads,179.37,-25.13,2018-08-25T18:00:00+0000,drifting surface float,,,21.1,,,, 9c08c026-eff7-30a7-ab1e-413a64f507ff[[ 0 6 24]],MUR25-JPL-L4-GLOB-v04.2,178.625,-28.375,2018-09-27T09:00:00+0000,orbiting satellite,,,,,,,P8JCJW,icoads,178.62,-28.38,2018-09-16T21:00:00+0000,drifting surface float,,,20.3,,,, 1eaa976f-0908-3309-8c66-a4122d381b3f[[0 0 3]],MUR25-JPL-L4-GLOB-v04.2,173.375,-29.875,2018-09-28T09:00:00+0000,orbiting satellite,,,,,,,PCEWYL,icoads,173.38,-29.88,2018-10-18T20:00:00+0000,drifting surface float,,,19.6,,,, 22a9a434-f569-3aa6-988a-98c651f9139e[[ 0 11 29]],MUR25-JPL-L4-GLOB-v04.2,179.875,-27.125,2018-09-25T09:00:00+0000,orbiting satellite,,,,,,,P9I7BH,icoads,179.88,-27.13,2018-09-23T22:00:00+0000,drifting surface float,,,20.4,,,, 4da039fd-28f2-3fd5-8a04-fe78a49d5e68[[ 0 6 14]],MUR25-JPL-L4-GLOB-v04.2,161.125,-28.375,2018-09-25T09:00:00+0000,orbiting satellite,,,,,,,PAWNVF,icoads,161.12,-28.37,2018-10-06T00:00:00+0000,drifting surface float,,,18.9,,,, 4e45863f-c39f-3004-8105-b96035196632[[0 0 3]],MUR25-JPL-L4-GLOB-v04.2,173.375,-29.875,2018-09-24T09:00:00+0000,orbiting satellite,,,,,,,PCEWYL,icoads,173.38,-29.88,2018-10-18T20:00:00+0000,drifting surface float,,,19.6,,,, 04331b1a-16b5-3186-badf-9f15d39ecfe1[[ 0 11 29]],MUR25-JPL-L4-GLOB-v04.2,179.875,-27.125,2018-09-29T09:00:00+0000,orbiting satellite,,,,,,,P9I7BH,icoads,179.88,-27.13,2018-09-23T22:00:00+0000,drifting surface float,,,20.4,,,, 04331b1a-16b5-3186-badf-9f15d39ecfe1[[ 0 5 24]],MUR25-JPL-L4-GLOB-v04.2,178.625,-28.625,2018-09-29T09:00:00+0000,orbiting satellite,,,,,,,P7NKMT,icoads,178.63,-28.63,2018-09-09T18:00:00+0000,drifting surface float,,,19.2,,,, 43428176-e15c-32c1-9e03-f9b113506312[[ 0 6 14]],MUR25-JPL-L4-GLOB-v04.2,161.125,-28.375,2018-09-27T09:00:00+0000,orbiting satellite,,,,,,,PAWNVF,icoads,161.12,-28.37,2018-10-06T00:00:00+0000,drifting surface float,,,18.9,,,, 4da039fd-28f2-3fd5-8a04-fe78a49d5e68[[ 0 7 15]],MUR25-JPL-L4-GLOB-v04.2,161.375,-28.125,2018-09-25T09:00:00+0000,orbiting satellite,,,,,,,PA5672,icoads,161.38,-28.13,2018-09-29T01:00:00+0000,drifting surface float,,,18.6,,,, bdeb0d98-e3a3-3038-bf8a-633ca92bb809[[ 0 5 17]],MUR25-JPL-L4-GLOB-v04.2,161.875,-28.625,2018-09-26T09:00:00+0000,orbiting satellite,,,,,,,PD40VK,icoads,161.88,-28.62,2018-10-24T20:00:00+0000,drifting surface float,,,21.1,,,, 9c08c026-eff7-30a7-ab1e-413a64f507ff[[0 0 3]],MUR25-JPL-L4-GLOB-v04.2,173.375,-29.875,2018-09-27T09:00:00+0000,orbiting satellite,,,,,,,PCEWYL,icoads,173.38,-29.88,2018-10-18T20:00:00+0000,drifting surface float,,,19.6,,,, 1eaa976f-0908-3309-8c66-a4122d381b3f[[ 0 11 29]],MUR25-JPL-L4-GLOB-v04.2,179.875,-27.125,2018-09-28T09:00:00+0000,orbiting satellite,,,,,,,P9I7BH,icoads,179.88,-27.13,2018-09-23T22:00:00+0000,drifting surface float,,,20.4,,,, 4e45863f-c39f-3004-8105-b96035196632[[ 0 5 24]],MUR25-JPL-L4-GLOB-v04.2,178.625,-28.625,2018-09-24T09:00:00+0000,orbiting satellite,,,,,,,P7NKMT,icoads,178.63,-28.63,2018-09-09T18:00:00+0000,drifting surface float,,,19.2,,,, 8ff1b246-16de-34e2-87bb-600c4107a7f8[[ 0 6 14]],MUR25-JPL-L4-GLOB-v04.2,161.125,-28.375,2018-09-28T09:00:00+0000,orbiting satellite,,,,,,,PAWNVF,icoads,161.12,-28.37,2018-10-06T00:00:00+0000,drifting surface float,,,18.9,,,, 2142b9f2-9438-346d-abf1-27a74d3addbf[[ 0 11 27]],MUR25-JPL-L4-GLOB-v04.2,179.375,-27.125,2018-09-26T09:00:00+0000,orbiting satellite,,,,,,,P9C8DU,icoads,179.38,-27.12,2018-09-22T14:00:00+0000,drifting surface float,,,19.8,,,, 4da039fd-28f2-3fd5-8a04-fe78a49d5e68[[ 0 5 17]],MUR25-JPL-L4-GLOB-v04.2,161.875,-28.625,2018-09-25T09:00:00+0000,orbiting satellite,,,,,,,PD40VK,icoads,161.88,-28.62,2018-10-24T20:00:00+0000,drifting surface float,,,21.1,,,, 4e45863f-c39f-3004-8105-b96035196632[[ 0 11 29]],MUR25-JPL-L4-GLOB-v04.2,179.875,-27.125,2018-09-24T09:00:00+0000,orbiting satellite,,,,,,,P9I7BH,icoads,179.88,-27.13,2018-09-23T22:00:00+0000,drifting surface float,,,20.4,,,, 22a9a434-f569-3aa6-988a-98c651f9139e[[ 0 5 24]],MUR25-JPL-L4-GLOB-v04.2,178.625,-28.625,2018-09-25T09:00:00+0000,orbiting satellite,,,,,,,P7NKMT,icoads,178.63,-28.63,2018-09-09T18:00:00+0000,drifting surface float,,,19.2,,,, bcdae738-b6f2-30f1-a2cc-8a6123828582[[ 0 8 15]],MUR25-JPL-L4-GLOB-v04.2,161.375,-27.875,2018-09-24T09:00:00+0000,orbiting satellite,,,,,,,PCY3CI,icoads,161.38,-27.88,2018-10-23T10:00:00+0000,drifting surface float,,,20.0,,,, 22a9a434-f569-3aa6-988a-98c651f9139e[[ 0 6 24]],MUR25-JPL-L4-GLOB-v04.2,178.625,-28.375,2018-09-25T09:00:00+0000,orbiting satellite,,,,,,,P8JCJW,icoads,178.62,-28.38,2018-09-16T21:00:00+0000,drifting surface float,,,20.3,,,, 22a9a434-f569-3aa6-988a-98c651f9139e[[0 0 3]],MUR25-JPL-L4-GLOB-v04.2,173.375,-29.875,2018-09-25T09:00:00+0000,orbiting satellite,,,,,,,PCEWYL,icoads,173.38,-29.88,2018-10-18T20:00:00+0000,drifting surface float,,,19.6,,,, 90ca81e5-850d-3a37-9aed-3e3f5c365aec[[ 0 7 15]],MUR25-JPL-L4-GLOB-v04.2,161.375,-28.125,2018-09-29T09:00:00+0000,orbiting satellite,,,,,,,PA5672,icoads,161.38,-28.13,2018-09-29T01:00:00+0000,drifting surface float,,,18.6,,,, 8ff1b246-16de-34e2-87bb-600c4107a7f8[[ 0 8 15]],MUR25-JPL-L4-GLOB-v04.2,161.375,-27.875,2018-09-28T09:00:00+0000,orbiting satellite,,,,,,,PCY3CI,icoads,161.38,-27.88,2018-10-23T10:00:00+0000,drifting surface float,,,20.0,,,, 90ca81e5-850d-3a37-9aed-3e3f5c365aec[[ 0 6 14]],MUR25-JPL-L4-GLOB-v04.2,161.125,-28.375,2018-09-29T09:00:00+0000,orbiting satellite,,,,,,,PAWNVF,icoads,161.12,-28.37,2018-10-06T00:00:00+0000,drifting surface float,,,18.9,,,, 2142b9f2-9438-346d-abf1-27a74d3addbf[[ 0 5 24]],MUR25-JPL-L4-GLOB-v04.2,178.625,-28.625,2018-09-26T09:00:00+0000,orbiting satellite,,,,,,,P7NKMT,icoads,178.63,-28.63,2018-09-09T18:00:00+0000,drifting surface float,,,19.2,,,, 1eaa976f-0908-3309-8c66-a4122d381b3f[[ 0 6 24]],MUR25-JPL-L4-GLOB-v04.2,178.625,-28.375,2018-09-28T09:00:00+0000,orbiting satellite,,,,,,,P8JCJW,icoads,178.62,-28.38,2018-09-16T21:00:00+0000,drifting surface float,,,20.3,,,, 2142b9f2-9438-346d-abf1-27a74d3addbf[[ 0 11 29]],MUR25-JPL-L4-GLOB-v04.2,179.875,-27.125,2018-09-26T09:00:00+0000,orbiting satellite,,,,,,,P9I7BH,icoads,179.88,-27.13,2018-09-23T22:00:00+0000,drifting surface float,,,20.4,,,, 4e45863f-c39f-3004-8105-b96035196632[[ 0 6 24]],MUR25-JPL-L4-GLOB-v04.2,178.625,-28.375,2018-09-24T09:00:00+0000,orbiting satellite,,,,,,,P8JCJW,icoads,178.62,-28.38,2018-09-16T21:00:00+0000,drifting surface float,,,20.3,,,, 43428176-e15c-32c1-9e03-f9b113506312[[ 0 8 15]],MUR25-JPL-L4-GLOB-v04.2,161.375,-27.875,2018-09-27T09:00:00+0000,orbiting satellite,,,,,,,PCY3CI,icoads,161.38,-27.88,2018-10-23T10:00:00+0000,drifting surface float,,,20.0,,,, 04331b1a-16b5-3186-badf-9f15d39ecfe1[[0 0 3]],MUR25-JPL-L4-GLOB-v04.2,173.375,-29.875,2018-09-29T09:00:00+0000,orbiting satellite,,,,,,,PCEWYL,icoads,173.38,-29.88,2018-10-18T20:00:00+0000,drifting surface float,,,19.6,,,, 43428176-e15c-32c1-9e03-f9b113506312[[ 0 7 15]],MUR25-JPL-L4-GLOB-v04.2,161.375,-28.125,2018-09-27T09:00:00+0000,orbiting satellite,,,,,,,PA5672,icoads,161.38,-28.13,2018-09-29T01:00:00+0000,drifting surface float,,,18.6,,,, 9c08c026-eff7-30a7-ab1e-413a64f507ff[[ 0 11 29]],MUR25-JPL-L4-GLOB-v04.2,179.875,-27.125,2018-09-27T09:00:00+0000,orbiting satellite,,,,,,,P9I7BH,icoads,179.88,-27.13,2018-09-23T22:00:00+0000,drifting surface float,,,20.4,,,, ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
