[GitHub] [incubator-sdap-nexus] skorper merged pull request #170: fix bugs in helm chart after update for proxy feature

2022-07-06 Thread GitBox
skorper merged PR #170: URL: https://github.com/apache/incubator-sdap-nexus/pull/170 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@sda

[GitHub] [incubator-sdap-nexus] RKuttruff opened a new pull request, #171: Fix for null count field in return for matchup_spark request

2022-07-06 Thread GitBox
RKuttruff opened a new pull request, #171: URL: https://github.com/apache/incubator-sdap-nexus/pull/171 Set to be the length of the matches passed as results. Ran a quick test and it seems to be working (not null anymore and equal to number of matches returned) -- This is an automa

[GitHub] [incubator-sdap-nexus] tloubrieu-jpl commented on pull request #170: fix bugs in helm chart after update for proxy feature

2022-07-06 Thread GitBox
tloubrieu-jpl commented on PR #170: URL: https://github.com/apache/incubator-sdap-nexus/pull/170#issuecomment-1176812055 > Can you update the changelog? We are trying to keep the changelog up to date as a new thing Hi @skorper , I updated the changelog. Thanks that is a good improvem

[GitHub] [incubator-sdap-in-situ-data-services] ngachung merged pull request #6: fix: SDAP-394 - added meta as default column in in-situ endpoint response

2022-07-05 Thread GitBox
ngachung merged PR #6: URL: https://github.com/apache/incubator-sdap-in-situ-data-services/pull/6 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-un

[GitHub] [incubator-sdap-in-situ-data-services] wphyojpl opened a new pull request, #6: fix: CDMS-154 - added meta as default column in in-situ endpoint response

2022-07-05 Thread GitBox
wphyojpl opened a new pull request, #6: URL: https://github.com/apache/incubator-sdap-in-situ-data-services/pull/6 - also added CLI script to ingest data -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [incubator-sdap-mudrod] dependabot[bot] opened a new pull request, #54: Bump elasticsearch from 5.2.0 to 6.8.17

2022-06-23 Thread GitBox
dependabot[bot] opened a new pull request, #54: URL: https://github.com/apache/incubator-sdap-mudrod/pull/54 Bumps [elasticsearch](https://github.com/elastic/elasticsearch) from 5.2.0 to 6.8.17. Release notes Sourced from https://github.com/elastic/elasticsearch/releases";>elastics

[GitHub] [incubator-sdap-nexus] tloubrieu-jpl opened a new pull request, #170: fix bugs in helm chart after update for proxy feature

2022-06-23 Thread GitBox
tloubrieu-jpl opened a new pull request, #170: URL: https://github.com/apache/incubator-sdap-nexus/pull/170 2 bugs that I missed to push before I merged the PR https://github.com/apache/incubator-sdap-nexus/pull/162 The deployment of the helm chart fails without these fixes. -- Thi

[GitHub] [incubator-sdap-nexus] tloubrieu-jpl opened a new pull request, #169: Monthly report 202207

2022-06-23 Thread GitBox
tloubrieu-jpl opened a new pull request, #169: URL: https://github.com/apache/incubator-sdap-nexus/pull/169 I created the report on a branch, markdown is easier to edit on github... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

[GitHub] [incubator-sdap-in-situ-data-services] ngachung merged pull request #5: feat: CLI script to ingest S3 files

2022-06-22 Thread GitBox
ngachung merged PR #5: URL: https://github.com/apache/incubator-sdap-in-situ-data-services/pull/5 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-un

[GitHub] [incubator-sdap-in-situ-data-services] wphyojpl opened a new pull request, #5: feat: CLI script to ingest S3 files

2022-06-22 Thread GitBox
wphyojpl opened a new pull request, #5: URL: https://github.com/apache/incubator-sdap-in-situ-data-services/pull/5 - While lambda infrastructure is being tested in JPL cloud, CLI can be used to ingest files from personal laptop or from a different EC2 instance in AWS. -- This is an automa

[GitHub] [incubator-sdap-nexus] dependabot[bot] commented on pull request #164: Bump numpy from 1.17.0 to 1.21.0 in /integrations/python-client

2022-06-21 Thread GitBox
dependabot[bot] commented on PR #164: URL: https://github.com/apache/incubator-sdap-nexus/pull/164#issuecomment-1162608986 Superseded by #168. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [incubator-sdap-nexus] dependabot[bot] closed pull request #164: Bump numpy from 1.17.0 to 1.21.0 in /integrations/python-client

2022-06-21 Thread GitBox
dependabot[bot] closed pull request #164: Bump numpy from 1.17.0 to 1.21.0 in /integrations/python-client URL: https://github.com/apache/incubator-sdap-nexus/pull/164 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[GitHub] [incubator-sdap-nexus] dependabot[bot] opened a new pull request, #168: Bump numpy from 1.17.0 to 1.22.0 in /integrations/python-client

2022-06-21 Thread GitBox
dependabot[bot] opened a new pull request, #168: URL: https://github.com/apache/incubator-sdap-nexus/pull/168 Bumps [numpy](https://github.com/numpy/numpy) from 1.17.0 to 1.22.0. Release notes Sourced from https://github.com/numpy/numpy/releases";>numpy's releases. v1.22.0

[GitHub] [incubator-sdap-ingester] dependabot[bot] closed pull request #58: Bump numpy from 1.15.4 to 1.21.0 in /granule_ingester

2022-06-21 Thread GitBox
dependabot[bot] closed pull request #58: Bump numpy from 1.15.4 to 1.21.0 in /granule_ingester URL: https://github.com/apache/incubator-sdap-ingester/pull/58 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[GitHub] [incubator-sdap-ingester] dependabot[bot] commented on pull request #58: Bump numpy from 1.15.4 to 1.21.0 in /granule_ingester

2022-06-21 Thread GitBox
dependabot[bot] commented on PR #58: URL: https://github.com/apache/incubator-sdap-ingester/pull/58#issuecomment-1162595605 Superseded by #59. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [incubator-sdap-ingester] dependabot[bot] opened a new pull request, #59: Bump numpy from 1.15.4 to 1.22.0 in /granule_ingester

2022-06-21 Thread GitBox
dependabot[bot] opened a new pull request, #59: URL: https://github.com/apache/incubator-sdap-ingester/pull/59 Bumps [numpy](https://github.com/numpy/numpy) from 1.15.4 to 1.22.0. Release notes Sourced from https://github.com/numpy/numpy/releases";>numpy's releases. v1.22.0

[GitHub] [incubator-sdap-nexus] ngachung merged pull request #167: chore: add insitu application to ingress template

2022-06-21 Thread GitBox
ngachung merged PR #167: URL: https://github.com/apache/incubator-sdap-nexus/pull/167 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@sd

[GitHub] [incubator-sdap-ingester] dependabot[bot] opened a new pull request, #58: Bump numpy from 1.15.4 to 1.21.0 in /granule_ingester

2022-06-21 Thread GitBox
dependabot[bot] opened a new pull request, #58: URL: https://github.com/apache/incubator-sdap-ingester/pull/58 Bumps [numpy](https://github.com/numpy/numpy) from 1.15.4 to 1.21.0. Release notes Sourced from https://github.com/numpy/numpy/releases";>numpy's releases. v1.21.0

[GitHub] [incubator-sdap-ingester] dependabot[bot] opened a new pull request, #57: Bump aiohttp from 3.7.2 to 3.7.4 in /collection_manager

2022-06-21 Thread GitBox
dependabot[bot] opened a new pull request, #57: URL: https://github.com/apache/incubator-sdap-ingester/pull/57 Bumps [aiohttp](https://github.com/aio-libs/aiohttp) from 3.7.2 to 3.7.4. Release notes Sourced from https://github.com/aio-libs/aiohttp/releases";>aiohttp's releases.

[GitHub] [incubator-sdap-ingester] dependabot[bot] opened a new pull request, #56: Bump aiohttp from 3.6.2 to 3.7.4 in /granule_ingester

2022-06-21 Thread GitBox
dependabot[bot] opened a new pull request, #56: URL: https://github.com/apache/incubator-sdap-ingester/pull/56 Bumps [aiohttp](https://github.com/aio-libs/aiohttp) from 3.6.2 to 3.7.4. Release notes Sourced from https://github.com/aio-libs/aiohttp/releases";>aiohttp's releases.

[GitHub] [incubator-sdap-ingester] dependabot[bot] opened a new pull request, #53: Bump pyyaml from 5.3.1 to 5.4 in /granule_ingester

2022-06-21 Thread GitBox
dependabot[bot] opened a new pull request, #53: URL: https://github.com/apache/incubator-sdap-ingester/pull/53 Bumps [pyyaml](https://github.com/yaml/pyyaml) from 5.3.1 to 5.4. Changelog Sourced from https://github.com/yaml/pyyaml/blob/master/CHANGES";>pyyaml's changelog. 5.

[GitHub] [incubator-sdap-ingester] dependabot[bot] opened a new pull request, #54: Bump urllib3 from 1.26.2 to 1.26.5 in /granule_ingester

2022-06-21 Thread GitBox
dependabot[bot] opened a new pull request, #54: URL: https://github.com/apache/incubator-sdap-ingester/pull/54 Bumps [urllib3](https://github.com/urllib3/urllib3) from 1.26.2 to 1.26.5. Release notes Sourced from https://github.com/urllib3/urllib3/releases";>urllib3's releases.

[GitHub] [incubator-sdap-ingester] dependabot[bot] opened a new pull request, #55: Bump pyyaml from 5.3.1 to 5.4 in /collection_manager

2022-06-21 Thread GitBox
dependabot[bot] opened a new pull request, #55: URL: https://github.com/apache/incubator-sdap-ingester/pull/55 Bumps [pyyaml](https://github.com/yaml/pyyaml) from 5.3.1 to 5.4. Changelog Sourced from https://github.com/yaml/pyyaml/blob/master/CHANGES";>pyyaml's changelog. 5.

[GitHub] [incubator-sdap-ingester] tloubrieu-jpl merged pull request #52: Issue 388 proxy

2022-06-21 Thread GitBox
tloubrieu-jpl merged PR #52: URL: https://github.com/apache/incubator-sdap-ingester/pull/52 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr

[GitHub] [incubator-sdap-nexus] JordanGethers commented on pull request #166: CDMS - 150 NETCDF Reader Updates

2022-06-20 Thread GitBox
JordanGethers commented on PR #166: URL: https://github.com/apache/incubator-sdap-nexus/pull/166#issuecomment-1160567896 When I run the code in my linux environment, there are some harmless warning messages (pertaining to numPy and occasionally variable conversion) I wanted to ask for appr

[GitHub] [incubator-sdap-nexus] JordanGethers opened a new pull request, #166: CDMS - 150 NETCDF Reader Updates

2022-06-20 Thread GitBox
JordanGethers opened a new pull request, #166: URL: https://github.com/apache/incubator-sdap-nexus/pull/166 cdms_reader.py is the original doms_reader.py code with additional functionality provided for the user to make each run of the program more customizable. The user may now select, with

[GitHub] [incubator-sdap-nexusproto] dependabot[bot] opened a new pull request, #9: Bump protobuf from 3.2.0 to 3.15.0 in /src/main/python/nexusproto

2022-06-17 Thread GitBox
dependabot[bot] opened a new pull request, #9: URL: https://github.com/apache/incubator-sdap-nexusproto/pull/9 Bumps [protobuf](https://github.com/protocolbuffers/protobuf) from 3.2.0 to 3.15.0. Release notes Sourced from https://github.com/protocolbuffers/protobuf/releases";>proto

[GitHub] [incubator-sdap-nexus] skorper opened a new pull request, #165: Fix matchup bugs

2022-06-15 Thread GitBox
skorper opened a new pull request, #165: URL: https://github.com/apache/incubator-sdap-nexus/pull/165 - Fixed openapi issues that was causing unusual swagger behavior - Updated `/domslist` to use AWS insitu datasets rather than DOMS - Updated `matchup_spark` to use the above endpoint so

[GitHub] [incubator-sdap-nexus] dependabot[bot] opened a new pull request, #163: Bump urllib3 from 1.25.3 to 1.26.5 in /integrations/python-client

2022-06-14 Thread GitBox
dependabot[bot] opened a new pull request, #163: URL: https://github.com/apache/incubator-sdap-nexus/pull/163 Bumps [urllib3](https://github.com/urllib3/urllib3) from 1.25.3 to 1.26.5. Release notes Sourced from https://github.com/urllib3/urllib3/releases";>urllib3's releases.

[GitHub] [incubator-sdap-nexus] dependabot[bot] opened a new pull request, #164: Bump numpy from 1.17.0 to 1.21.0 in /integrations/python-client

2022-06-14 Thread GitBox
dependabot[bot] opened a new pull request, #164: URL: https://github.com/apache/incubator-sdap-nexus/pull/164 Bumps [numpy](https://github.com/numpy/numpy) from 1.17.0 to 1.21.0. Release notes Sourced from https://github.com/numpy/numpy/releases";>numpy's releases. v1.21.0

[GitHub] [incubator-sdap-nexus] tloubrieu-jpl merged pull request #162: Sdap 388 proxy

2022-06-14 Thread GitBox
tloubrieu-jpl merged PR #162: URL: https://github.com/apache/incubator-sdap-nexus/pull/162 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr.

[GitHub] [incubator-sdap-in-situ-data-services] ngachung merged pull request #4: breaking: multiple new features and performance enhancement attempts

2022-06-13 Thread GitBox
ngachung merged PR #4: URL: https://github.com/apache/incubator-sdap-in-situ-data-services/pull/4 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-un

[GitHub] [incubator-sdap-nexus] tloubrieu-jpl opened a new pull request, #162: Sdap 388 proxy

2022-06-13 Thread GitBox
tloubrieu-jpl opened a new pull request, #162: URL: https://github.com/apache/incubator-sdap-nexus/pull/162 Implementation of a redirection feature which enable to seamlessly present collections hosted by alternate SDAP as provided by a main SDAP. This pull request requires https://g

[GitHub] [incubator-sdap-ingester] tloubrieu-jpl opened a new pull request, #52: Issue 388 proxy

2022-06-13 Thread GitBox
tloubrieu-jpl opened a new pull request, #52: URL: https://github.com/apache/incubator-sdap-ingester/pull/52 This pull request enable to support the configuration of the remote collections in collection-config configmap. See https://issues.apache.org/jira/browse/SDAP-388 In addition,

[GitHub] [incubator-sdap-in-situ-data-services] ngachung merged pull request #3: Action Items [5/27/2022]

2022-06-10 Thread GitBox
ngachung merged PR #3: URL: https://github.com/apache/incubator-sdap-in-situ-data-services/pull/3 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-un

[GitHub] [incubator-sdap-in-situ-data-services] wphyojpl opened a new pull request, #4: breaking: multiple new features and performance enhancement attempts

2022-06-10 Thread GitBox
wphyojpl opened a new pull request, #4: URL: https://github.com/apache/incubator-sdap-in-situ-data-services/pull/4 - new pagination idea imitating Elasticsearch's search_after - limit number of spark executors for each Flask node + scaling nodes accordingly. -- This is an automated me

[GitHub] [incubator-sdap-in-situ-data-services] wphyojpl commented on a diff in pull request #3: Action Items [5/27/2022]

2022-06-10 Thread GitBox
wphyojpl commented on code in PR #3: URL: https://github.com/apache/incubator-sdap-in-situ-data-services/pull/3#discussion_r894765655 ## k8s_spark/parquet.spark.helm/values.yaml: ## @@ -110,8 +120,19 @@ affinity: {} # initialDelaySeconds: 5 bitnami-spark: + enabled: true

[GitHub] [incubator-sdap-in-situ-data-services] wphyojpl commented on a diff in pull request #3: Action Items [5/27/2022]

2022-06-10 Thread GitBox
wphyojpl commented on code in PR #3: URL: https://github.com/apache/incubator-sdap-in-situ-data-services/pull/3#discussion_r894764676 ## k8s_spark/parquet.spark.helm/templates/deployment.yaml: ## @@ -57,8 +57,10 @@ spec: {{- end }} - name: parquet_file

[GitHub] [incubator-sdap-nexus] skorper merged pull request #161: Fixed failing matchup unit test

2022-06-08 Thread GitBox
skorper merged PR #161: URL: https://github.com/apache/incubator-sdap-nexus/pull/161 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@sda

[GitHub] [incubator-sdap-nexus] skorper opened a new pull request, #161: Fixed failing matchup unit test

2022-06-08 Thread GitBox
skorper opened a new pull request, #161: URL: https://github.com/apache/incubator-sdap-nexus/pull/161 Fixed failing matchup test. Matchup now uses 'lon' instead of 'x', which I forgot to update in the unit tests. -- This is an automated message from the Apache Git Service. To respond to t

[GitHub] [incubator-sdap-nexus] skorper merged pull request #160: SDAP-372 Updated match_spark_doms to interface with samos_cdms endpoint

2022-06-07 Thread GitBox
skorper merged PR #160: URL: https://github.com/apache/incubator-sdap-nexus/pull/160 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@sda

[GitHub] [incubator-sdap-nexus] ngachung opened a new pull request, #160: SDAP-372 Updated match_spark_doms to interface with samos_cdms endpoint

2022-06-07 Thread GitBox
ngachung opened a new pull request, #160: URL: https://github.com/apache/incubator-sdap-nexus/pull/160 For matchup validation, CDMS team would like to use https://doms.coaps.fsu.edu/ws/search/samos_cdms which has additional variables. -- This is an automated message from the Apache Git Se

[GitHub] [incubator-sdap-in-situ-data-services] briansaildrone commented on a diff in pull request #3: Action Items [5/27/2022]

2022-06-07 Thread GitBox
briansaildrone commented on code in PR #3: URL: https://github.com/apache/incubator-sdap-in-situ-data-services/pull/3#discussion_r891543369 ## k8s_spark/parquet.spark.helm/values.yaml: ## @@ -110,8 +120,19 @@ affinity: {} # initialDelaySeconds: 5 bitnami-spark: + enabled

[GitHub] [incubator-sdap-nexus] ngachung merged pull request #158: SDAP-372: Integrate AWS insitu API

2022-06-01 Thread GitBox
ngachung merged PR #158: URL: https://github.com/apache/incubator-sdap-nexus/pull/158 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@sd

[GitHub] [incubator-sdap-nexus] skorper commented on pull request #158: SDAP-372: Integrate AWS insitu API

2022-06-01 Thread GitBox
skorper commented on PR #158: URL: https://github.com/apache/incubator-sdap-nexus/pull/158#issuecomment-1144320844 @ngachung Updated! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [incubator-sdap-nexus] ngachung commented on pull request #158: SDAP-372: Integrate AWS insitu API

2022-06-01 Thread GitBox
ngachung commented on PR #158: URL: https://github.com/apache/incubator-sdap-nexus/pull/158#issuecomment-1144304337 Let's go with a single top level changelog. Not sure that component level changelog will get enough attention. -- This is an automated message from the Apache Git Service.

[GitHub] [incubator-sdap-nexus] skorper commented on pull request #158: SDAP-372: Integrate AWS insitu API

2022-06-01 Thread GitBox
skorper commented on PR #158: URL: https://github.com/apache/incubator-sdap-nexus/pull/158#issuecomment-1144299359 @ngachung I added two changelogs -- one for `data-access` and one for `analysis`. I'm not sure if we want to do it this way or do a single changelog for the entire repo due to

[GitHub] [incubator-sdap-in-situ-data-services] briansaildrone commented on a diff in pull request #3: Action Items [5/27/2022]

2022-06-01 Thread GitBox
briansaildrone commented on code in PR #3: URL: https://github.com/apache/incubator-sdap-in-situ-data-services/pull/3#discussion_r887366919 ## k8s_spark/parquet.spark.helm/values.yaml: ## @@ -110,8 +120,19 @@ affinity: {} # initialDelaySeconds: 5 bitnami-spark: + enabled

[GitHub] [incubator-sdap-in-situ-data-services] briansaildrone commented on a diff in pull request #3: Action Items [5/27/2022]

2022-06-01 Thread GitBox
briansaildrone commented on code in PR #3: URL: https://github.com/apache/incubator-sdap-in-situ-data-services/pull/3#discussion_r887334513 ## k8s_spark/parquet.spark.helm/templates/deployment.yaml: ## @@ -57,8 +57,10 @@ spec: {{- end }} - name: parque

[GitHub] [incubator-sdap-in-situ-data-services] wphyojpl commented on a diff in pull request #3: Action Items [5/27/2022]

2022-06-01 Thread GitBox
wphyojpl commented on code in PR #3: URL: https://github.com/apache/incubator-sdap-in-situ-data-services/pull/3#discussion_r887309479 ## k8s_spark/parquet.spark.helm/values.yaml: ## @@ -110,8 +120,19 @@ affinity: {} # initialDelaySeconds: 5 bitnami-spark: + enabled: true

[GitHub] [incubator-sdap-nexus] skorper merged pull request #159: SDAP-387: Update NetCDF matchup output format

2022-06-01 Thread GitBox
skorper merged PR #159: URL: https://github.com/apache/incubator-sdap-nexus/pull/159 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@sda

[GitHub] [incubator-sdap-nexus] skorper commented on pull request #158: SDAP-372: Integrate AWS insitu API

2022-05-24 Thread GitBox
skorper commented on PR #158: URL: https://github.com/apache/incubator-sdap-nexus/pull/158#issuecomment-1136492386 Tested with the insitu API now that the parallel issue has been resolved -- it's working now. The following request: ``` {{big_data_url}}/match_spark?primary=MUR25-J

[GitHub] [incubator-sdap-nexus] ngachung merged pull request #152: Hotfix: Handle mismatched dataset listing and specification example

2022-05-24 Thread GitBox
ngachung merged PR #152: URL: https://github.com/apache/incubator-sdap-nexus/pull/152 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@sd

[GitHub] [incubator-sdap-nexus] skorper opened a new pull request, #159: SDAP-387: Update NetCDF matchup output format

2022-05-24 Thread GitBox
skorper opened a new pull request, #159: URL: https://github.com/apache/incubator-sdap-nexus/pull/159 Fixed failing NetCDF matchup. Tested like so: ``` {{big_data_url}}/domsresults?id=99a4c9ae-2b7f-4fd8-a0be-26cbcb69b84c&output=NETCDF ``` Result is as expected. Implemente

[GitHub] [incubator-sdap-mudrod] dependabot[bot] opened a new pull request, #53: Bump gson from 2.8.4 to 2.8.9

2022-05-20 Thread GitBox
dependabot[bot] opened a new pull request, #53: URL: https://github.com/apache/incubator-sdap-mudrod/pull/53 Bumps [gson](https://github.com/google/gson) from 2.8.4 to 2.8.9. Release notes Sourced from https://github.com/google/gson/releases";>gson's releases. Gson 2.8.9

[GitHub] [incubator-sdap-in-situ-data-services] briansaildrone opened a new pull request, #3: Allowing for further configuration variations

2022-05-17 Thread GitBox
briansaildrone opened a new pull request, #3: URL: https://github.com/apache/incubator-sdap-in-situ-data-services/pull/3 * Added notes to values.yaml for enabling AWS EKS IRSA * Notes reflect the general configuration that appears to be working for us * Allowed for ClusterIP k8s servi

[GitHub] [incubator-sdap-ingester] joshgarde opened a new pull request, #51: Initial Preprocess Pipeline Work

2022-05-13 Thread GitBox
joshgarde opened a new pull request, #51: URL: https://github.com/apache/incubator-sdap-ingester/pull/51 Initial reprocess pipeline work for converting non-standard datasets to CF standard forms. Unit tests are unfinished. -- This is an automated message from the Apache Git Service. To re

[GitHub] [incubator-sdap-nexus] skorper commented on pull request #158: SDAP-372: Integrate AWS insitu API

2022-05-11 Thread GitBox
skorper commented on PR #158: URL: https://github.com/apache/incubator-sdap-nexus/pull/158#issuecomment-1124171764 @skorper This is currently blocked by an issue with 504 errors when rapidly hitting the CDMS insitu API. @wphyojpl is looking into this issue. -- This is an automated messag

[GitHub] [incubator-sdap-in-situ-data-services] ngachung merged pull request #2: Simplifying deployment pattern

2022-05-11 Thread GitBox
ngachung merged PR #2: URL: https://github.com/apache/incubator-sdap-in-situ-data-services/pull/2 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-un

[GitHub] [incubator-sdap-in-situ-data-services] briansaildrone commented on a diff in pull request #2: Simplifying deployment pattern

2022-05-10 Thread GitBox
briansaildrone commented on code in PR #2: URL: https://github.com/apache/incubator-sdap-in-situ-data-services/pull/2#discussion_r869729677 ## k8s_spark/parquet.spark.helm/templates/secret.yaml: ## @@ -1,9 +1,11 @@ +{{ with .Values.aws_creds }} apiVersion: v1 kind: Secret ty

[GitHub] [incubator-sdap-in-situ-data-services] wphyojpl commented on a diff in pull request #2: Simplifying deployment pattern

2022-05-10 Thread GitBox
wphyojpl commented on code in PR #2: URL: https://github.com/apache/incubator-sdap-in-situ-data-services/pull/2#discussion_r869723629 ## k8s_spark/parquet.spark.helm/templates/secret.yaml: ## @@ -1,9 +1,11 @@ +{{ with .Values.aws_creds }} apiVersion: v1 kind: Secret type: Op

[GitHub] [incubator-sdap-in-situ-data-services] briansaildrone opened a new pull request, #2: Simplifying deployment pattern

2022-04-28 Thread GitBox
briansaildrone opened a new pull request, #2: URL: https://github.com/apache/incubator-sdap-in-situ-data-services/pull/2 * Nested the `bitnami-spark` helm chart within `parquet-spark-helm` * Allows for single command deployment of both helm charts and single location for values * Rem

[GitHub] [incubator-sdap-nexus] wphyojpl commented on pull request #158: SDAP-372: Integrate AWS insitu API

2022-04-15 Thread GitBox
wphyojpl commented on PR #158: URL: https://github.com/apache/incubator-sdap-nexus/pull/158#issuecomment-1100243672 Hi @skorper So, I created this URL from the example in the description: ``` https://doms.jpl.nasa.gov/insitu/1.0/query_data_doms_custom_pagination?startIndex=0&i

[GitHub] [incubator-sdap-nexus] skorper opened a new pull request, #158: SDAP-372: Integrate AWS insitu API

2022-04-12 Thread GitBox
skorper opened a new pull request, #158: URL: https://github.com/apache/incubator-sdap-nexus/pull/158 In this PR, I've integrated the AWS Parquet insitu API to the matchup algorithm. Please be aware that the insitu API is very slow as of now, so we may want to hold off on merging/de

[GitHub] [incubator-sdap-nexus] tloubrieu-jpl merged pull request #156: SDAP-318 Updated timeSeriesSpark algorithm to find tiles by bounding box instead of polygon

2022-04-06 Thread GitBox
tloubrieu-jpl merged PR #156: URL: https://github.com/apache/incubator-sdap-nexus/pull/156 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr.

[GitHub] [incubator-sdap-nexus] ngachung merged pull request #157: Updated ICOADS url

2022-04-05 Thread GitBox
ngachung merged PR #157: URL: https://github.com/apache/incubator-sdap-nexus/pull/157 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@sd

[GitHub] [incubator-sdap-nexus] skorper commented on pull request #157: Updated ICOADS url

2022-04-05 Thread GitBox
skorper commented on PR #157: URL: https://github.com/apache/incubator-sdap-nexus/pull/157#issuecomment-1089408823 In addition to ICOADS, I've also fixed the SAMOS doms insitu endpoint as part of this branch -- This is an automated message from the Apache Git Service. To respond to the m

[GitHub] [incubator-sdap-nexus] skorper opened a new pull request #157: Updated ICOADS url

2022-03-30 Thread GitBox
skorper opened a new pull request #157: URL: https://github.com/apache/incubator-sdap-nexus/pull/157 Updated ICOADS url to `http://rda-work.ucar.edu` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [incubator-sdap-in-situ-data-services] ngachung merged pull request #1: breaking: adding multiple new features to the main incubator

2022-03-30 Thread GitBox
ngachung merged pull request #1: URL: https://github.com/apache/incubator-sdap-in-situ-data-services/pull/1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe

[GitHub] [incubator-sdap-nexus] kevinmarlis commented on pull request #156: SDAP-318 Updated timeSeriesSpark algorithm to find tiles by bounding box instead of polygon

2022-03-18 Thread GitBox
kevinmarlis commented on pull request #156: URL: https://github.com/apache/incubator-sdap-nexus/pull/156#issuecomment-1071770069 I temporarily deployed a test web app image to AQACF with the code changes. I tested on a dataset known to fail the time series algorithm when using a large bou

[GitHub] [incubator-sdap-nexus] kevinmarlis commented on pull request #156: SDAP-318 Updated timeSeriesSpark algorithm to find tiles by bounding box instead of polygon

2022-03-17 Thread GitBox
kevinmarlis commented on pull request #156: URL: https://github.com/apache/incubator-sdap-nexus/pull/156#issuecomment-1071770069 I temporarily deployed a test web app image to AQACF with the code changes. I tested on a dataset known to fail the time series algorithm when using a large bou

[GitHub] [incubator-sdap-nexus] kevinmarlis opened a new pull request #156: SDAP-318 Updated timeSeriesSpark algorithm to find tiles by bounding box instead of polygon

2022-03-17 Thread GitBox
kevinmarlis opened a new pull request #156: URL: https://github.com/apache/incubator-sdap-nexus/pull/156 Apache ticket: [SDAP-318](https://issues.apache.org/jira/browse/SDAP-318) This updates the timeSeriesSpark algorithm to use the bounding box (instead of polygon) to perform spatia

[GitHub] [incubator-sdap-nexus] ngachung merged pull request #153: SDAP-366: Fix CSV output for matchup

2022-03-10 Thread GitBox
ngachung merged pull request #153: URL: https://github.com/apache/incubator-sdap-nexus/pull/153 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: de

[GitHub] [incubator-sdap-nexus] skorper commented on pull request #153: SDAP-366: Fix CSV output for matchup

2022-03-10 Thread GitBox
skorper commented on pull request #153: URL: https://github.com/apache/incubator-sdap-nexus/pull/153#issuecomment-1064705140 @ngachung This PR is ready for review, all feedback has been incorporated. Sample output: ``` product_version,1.0 Conventions,"CF-1.6, ACD

[GitHub] [incubator-sdap-nexus] tloubrieu-jpl merged pull request #154: Add toJson in data-in-bounds api

2022-03-10 Thread GitBox
tloubrieu-jpl merged pull request #154: URL: https://github.com/apache/incubator-sdap-nexus/pull/154 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mai

[GitHub] [incubator-sdap-nexus] skorper commented on pull request #153: SDAP-366: Fix CSV output for matchup

2022-03-10 Thread GitBox
skorper commented on pull request #153: URL: https://github.com/apache/incubator-sdap-nexus/pull/153#issuecomment-1063766212 Latest CSV: (icoads is down so I used spurs2 as the secondary dataset instead) ``` product_version,1.0 Conventions,"CF-1.6, ACDD-1.3" title,CDM

[GitHub] [incubator-sdap-nexus] skorper commented on a change in pull request #155: SDAP-367: Updated deletebyquery tool to improve speed

2022-03-08 Thread GitBox
skorper commented on a change in pull request #155: URL: https://github.com/apache/incubator-sdap-nexus/pull/155#discussion_r822232997 ## File path: tools/deletebyquery/deletebyquery.py ## @@ -160,16 +161,15 @@ def do_solr_query(query): break else:

[GitHub] [incubator-sdap-nexus] frankinspace commented on a change in pull request #155: SDAP-367: Updated deletebyquery tool to improve speed

2022-03-08 Thread GitBox
frankinspace commented on a change in pull request #155: URL: https://github.com/apache/incubator-sdap-nexus/pull/155#discussion_r86270 ## File path: tools/deletebyquery/deletebyquery.py ## @@ -160,16 +161,15 @@ def do_solr_query(query): break else:

[GitHub] [incubator-sdap-nexus] skorper opened a new pull request #155: SDAP-367: Updated deletebyquery tool to improve speed

2022-03-08 Thread GitBox
skorper opened a new pull request #155: URL: https://github.com/apache/incubator-sdap-nexus/pull/155 * Improved speed of deletebyquery tool by moving cassandra delete to each solr page delete * Added `-f` and `--force` flag that will skip the prompts before deleting -- This is an auto

[GitHub] [incubator-sdap-nexus] skorper edited a comment on pull request #153: SDAP-366: Fix CSV output for matchup

2022-02-23 Thread GitBox
skorper edited a comment on pull request #153: URL: https://github.com/apache/incubator-sdap-nexus/pull/153#issuecomment-1049300659 Updated CSV header to use CF standard name, if available. Otherwise, the variable name will be used. Examples (without metadata): MUR -> icoads

[GitHub] [incubator-sdap-nexus] skorper commented on pull request #153: SDAP-366: Fix CSV output for matchup

2022-02-23 Thread GitBox
skorper commented on pull request #153: URL: https://github.com/apache/incubator-sdap-nexus/pull/153#issuecomment-1049300659 Updated CSV header to use CF standard name, if available. Otherwise, the variable name will be used. Examples (without headers): MUR -> icoads

[GitHub] [incubator-sdap-nexus] jasonmlkang opened a new pull request #154: Add toJson in data-in-bounds api

2022-02-23 Thread GitBox
jasonmlkang opened a new pull request #154: URL: https://github.com/apache/incubator-sdap-nexus/pull/154 This should fix the issue in data-in-bounds api endpoint -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [incubator-sdap-nexus] skorper commented on pull request #153: SDAP-366: Fix CSV output for matchup

2022-02-23 Thread GitBox
skorper commented on pull request #153: URL: https://github.com/apache/incubator-sdap-nexus/pull/153#issuecomment-1049126719 I have updated this branch to only include variables that are in the DOMS result. I also added a unit test. Here's the new output: ```csv id,x,y,so

[GitHub] [incubator-sdap-nexus] skorper commented on pull request #153: SDAP-366: Fix CSV output for matchup

2022-02-17 Thread GitBox
skorper commented on pull request #153: URL: https://github.com/apache/incubator-sdap-nexus/pull/153#issuecomment-1043710575 We may want to consider changing the format of this output CSV file. It seems the columns are hardcoded with variables (similar to how the JSON was hardcoded before

[GitHub] [incubator-sdap-nexus] skorper commented on pull request #153: SDAP-366: Fix CSV output for matchup

2022-02-17 Thread GitBox
skorper commented on pull request #153: URL: https://github.com/apache/incubator-sdap-nexus/pull/153#issuecomment-1043709722 @ngachung FYI -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

[GitHub] [incubator-sdap-nexus] skorper opened a new pull request #153: SDAP-366: Fix CSV output for matchup

2022-02-17 Thread GitBox
skorper opened a new pull request #153: URL: https://github.com/apache/incubator-sdap-nexus/pull/153 Apache ticket: [SDAP-366](https://issues.apache.org/jira/browse/SDAP-366) These changes fix the CSV output for matchup. The issue was that `doms.ResultStorage` was using the old json

[GitHub] [incubator-sdap-nexus] joshgarde opened a new pull request #152: Hotfix: Handle mismatched dataset listing and specification example

2022-02-04 Thread GitBox
joshgarde opened a new pull request #152: URL: https://github.com/apache/incubator-sdap-nexus/pull/152 Fixes bug where a deselected parameter appears in queries -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [incubator-sdap-nexus] skorper closed pull request #151: SDAP-362: Update tile format for gridded and L2 data

2022-01-26 Thread GitBox
skorper closed pull request #151: URL: https://github.com/apache/incubator-sdap-nexus/pull/151 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev

[GitHub] [incubator-sdap-nexus] skorper commented on pull request #151: SDAP-362: Update tile format for gridded and L2 data

2022-01-26 Thread GitBox
skorper commented on pull request #151: URL: https://github.com/apache/incubator-sdap-nexus/pull/151#issuecomment-1022607116 This work is going to be implemented at a later date. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH

[GitHub] [incubator-sdap-ingester] tloubrieu-jpl commented on pull request #48: Read time from filename

2022-01-21 Thread GitBox
tloubrieu-jpl commented on pull request #48: URL: https://github.com/apache/incubator-sdap-ingester/pull/48#issuecomment-1018723859 Hi @jasonmlkang , are you still working on this pull request ? I think you were trying to deploy that on your laptop to test from completelly the new featu

[GitHub] [incubator-sdap-nexus] skorper edited a comment on pull request #151: SDAP-362: Update tile format for gridded and L2 data

2022-01-18 Thread GitBox
skorper edited a comment on pull request #151: URL: https://github.com/apache/incubator-sdap-nexus/pull/151#issuecomment-1015860092 @ngachung Re-ran the benchmarks on a larger L2 request. ``` {{big_data_url}}/match_spark?primary=ASCATB-L2-Coastal&startTime=2017-02-27T12:03:16Z&e

[GitHub] [incubator-sdap-nexus] skorper commented on pull request #151: SDAP-362: Update tile format for gridded and L2 data

2022-01-18 Thread GitBox
skorper commented on pull request #151: URL: https://github.com/apache/incubator-sdap-nexus/pull/151#issuecomment-1015860092 Re-ran the benchmarks on a larger L2 request. ``` {{big_data_url}}/match_spark?primary=ASCATB-L2-Coastal&startTime=2017-02-27T12:03:16Z&endTime=2017-02-28

[GitHub] [incubator-sdap-nexus] ngachung merged pull request #149: SDAP-363: Update SwaggerUI to display list of available datasets dynamically

2022-01-18 Thread GitBox
ngachung merged pull request #149: URL: https://github.com/apache/incubator-sdap-nexus/pull/149 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: de

[GitHub] [incubator-sdap-in-situ-data-services] wphyojpl opened a new pull request #1: breaking: adding multiple new features to the main incubator

2022-01-11 Thread GitBox
wphyojpl opened a new pull request #1: URL: https://github.com/apache/incubator-sdap-in-situ-data-services/pull/1 - using Kubernetes Spark server - adding Helm chart for Parquet Flask server - Multiple new features on the flask server -- This is an automated message from the Apache

[GitHub] [incubator-sdap-nexus] skorper opened a new pull request #151: SDAP-362: Update tile format for gridded and L2 data

2022-01-03 Thread GitBox
skorper opened a new pull request #151: URL: https://github.com/apache/incubator-sdap-nexus/pull/151 [SDAP-362](https://issues.apache.org/jira/browse/SDAP-362) ### Changes made Updated tiles to new format. - Updated gridded tiles so they are reformatted to be in a swath

[GitHub] [incubator-sdap-nexus] skorper commented on pull request #149: SDAP-363: Update SwaggerUI to display list of available datasets dynamically

2021-12-20 Thread GitBox
skorper commented on pull request #149: URL: https://github.com/apache/incubator-sdap-nexus/pull/149#issuecomment-998220337 Could we also populate the `secondary` field with satellite + insitu datasets retrieved from the `/domslist` endpoint? -- This is an automated message from the Apa

[GitHub] [incubator-sdap-nexus] ngachung merged pull request #150: SDAP-364: Upgrade Solr to 8.11.1

2021-12-17 Thread GitBox
ngachung merged pull request #150: URL: https://github.com/apache/incubator-sdap-nexus/pull/150 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: de

[GitHub] [incubator-sdap-nexus] skorper opened a new pull request #150: SDAP-364: Upgrade Solr to 8.11.1

2021-12-16 Thread GitBox
skorper opened a new pull request #150: URL: https://github.com/apache/incubator-sdap-nexus/pull/150 https://issues.apache.org/jira/browse/SDAP-364 Bump Solr version to address log4j vulnerability. Pushed bumped solr image to dockerhub: `nexusjpl/solr:8.11.1` Note: This has no

[GitHub] [incubator-sdap-nexus] joshgarde opened a new pull request #149: SDAP-363: Update SwaggerUI to display list of available datasets dynamically

2021-12-15 Thread GitBox
joshgarde opened a new pull request #149: URL: https://github.com/apache/incubator-sdap-nexus/pull/149 Update SwaggerUI API documentation to display datasets available on the current Nexus node dynamically and independent of the API specification via a SwaggerUI plugin -- This is an aut

[GitHub] [incubator-sdap-nexus] ngachung merged pull request #148: SDAP-361 Time series spark algorithm unit test

2021-12-08 Thread GitBox
ngachung merged pull request #148: URL: https://github.com/apache/incubator-sdap-nexus/pull/148 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: de

<    1   2   3   4   5   6   7   8   9   10   >