[jira] [Work logged] (SDAP-220) Add temporal variance to analytic capabilities
[ https://issues.apache.org/jira/browse/SDAP-220?focusedWorklogId=417155&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-417155 ] ASF GitHub Bot logged work on SDAP-220: --- Author: ASF GitHub Bot Created on: 06/Apr/20 21:54 Start Date: 06/Apr/20 21:54 Worklog Time Spent: 10m Work Description: jjacob7734 commented on pull request #93: SDAP-220: temporal variance algorithm URL: https://github.com/apache/incubator-sdap-nexus/pull/93 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 417155) Time Spent: 20m (was: 10m) > Add temporal variance to analytic capabilities > -- > > Key: SDAP-220 > URL: https://issues.apache.org/jira/browse/SDAP-220 > Project: Apache Science Data Analytics Platform > Issue Type: New Feature >Reporter: Maya Debellis >Assignee: Maya DeBellis >Priority: Major > Time Spent: 20m > Remaining Estimate: 0h > > Adaptation of timeAvgMap -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (SDAP-229) Support ingesting ECCO native grid data
[ https://issues.apache.org/jira/browse/SDAP-229?focusedWorklogId=409200&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-409200 ] ASF GitHub Bot logged work on SDAP-229: --- Author: ASF GitHub Bot Created on: 25/Mar/20 00:00 Start Date: 25/Mar/20 00:00 Worklog Time Spent: 10m Work Description: ntquach commented on pull request #5: SDAP-229: Ecco support URL: https://github.com/apache/incubator-sdap-nexusproto/pull/5 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 409200) Remaining Estimate: 0h Time Spent: 10m > Support ingesting ECCO native grid data > --- > > Key: SDAP-229 > URL: https://issues.apache.org/jira/browse/SDAP-229 > Project: Apache Science Data Analytics Platform > Issue Type: New Feature >Reporter: Eamon Ford >Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (SDAP-227) Support ingesting ECCOv4r4 data
[ https://issues.apache.org/jira/browse/SDAP-227?focusedWorklogId=409177&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-409177 ] ASF GitHub Bot logged work on SDAP-227: --- Author: ASF GitHub Bot Created on: 24/Mar/20 23:26 Start Date: 24/Mar/20 23:26 Worklog Time Spent: 10m Work Description: eamonford commented on pull request #5: SDAP-227: Ecco support URL: https://github.com/apache/incubator-sdap-nexusproto/pull/5 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 409177) Time Spent: 0.5h (was: 20m) > Support ingesting ECCOv4r4 data > --- > > Key: SDAP-227 > URL: https://issues.apache.org/jira/browse/SDAP-227 > Project: Apache Science Data Analytics Platform > Issue Type: Bug >Reporter: Eamon Ford >Priority: Major > Time Spent: 0.5h > Remaining Estimate: 0h > > Change ningesterpy to support ingesting netcdf files that use i, j indices -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (SDAP-228) Root webpage should be made optional
[ https://issues.apache.org/jira/browse/SDAP-228?focusedWorklogId=406670&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-406670 ] ASF GitHub Bot logged work on SDAP-228: --- Author: ASF GitHub Bot Created on: 20/Mar/20 00:30 Start Date: 20/Mar/20 00:30 Worklog Time Spent: 10m Work Description: ntquach commented on pull request #97: SDAP-228 Optional rootwebpage URL: https://github.com/apache/incubator-sdap-nexus/pull/97 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 406670) Time Spent: 20m (was: 10m) > Root webpage should be made optional > > > Key: SDAP-228 > URL: https://issues.apache.org/jira/browse/SDAP-228 > Project: Apache Science Data Analytics Platform > Issue Type: Improvement >Reporter: Eamon Ford >Priority: Minor > Time Spent: 20m > Remaining Estimate: 0h > > The NEXUS helm chart should have an option to enable or disable the root > webpage. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (SDAP-228) Root webpage should be made optional
[ https://issues.apache.org/jira/browse/SDAP-228?focusedWorklogId=406643&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-406643 ] ASF GitHub Bot logged work on SDAP-228: --- Author: ASF GitHub Bot Created on: 19/Mar/20 23:34 Start Date: 19/Mar/20 23:34 Worklog Time Spent: 10m Work Description: eamonford commented on pull request #97: SDAP-228 Optional rootwebpage URL: https://github.com/apache/incubator-sdap-nexus/pull/97 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 406643) Remaining Estimate: 0h Time Spent: 10m > Root webpage should be made optional > > > Key: SDAP-228 > URL: https://issues.apache.org/jira/browse/SDAP-228 > Project: Apache Science Data Analytics Platform > Issue Type: Improvement >Reporter: Eamon Ford >Priority: Minor > Time Spent: 10m > Remaining Estimate: 0h > > The NEXUS helm chart should have an option to enable or disable the root > webpage. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (SDAP-227) Support ingesting ECCOv4r4 data
[ https://issues.apache.org/jira/browse/SDAP-227?focusedWorklogId=406636&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-406636 ] ASF GitHub Bot logged work on SDAP-227: --- Author: ASF GitHub Bot Created on: 19/Mar/20 22:36 Start Date: 19/Mar/20 22:36 Worklog Time Spent: 10m Work Description: ntquach commented on pull request #14: SDAP-227 Support indexed latlon URL: https://github.com/apache/incubator-sdap-ningester/pull/14 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 406636) Time Spent: 20m (was: 10m) > Support ingesting ECCOv4r4 data > --- > > Key: SDAP-227 > URL: https://issues.apache.org/jira/browse/SDAP-227 > Project: Apache Science Data Analytics Platform > Issue Type: Bug >Reporter: Eamon Ford >Priority: Major > Time Spent: 20m > Remaining Estimate: 0h > > Change ningesterpy to support ingesting netcdf files that use i, j indices -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (SDAP-227) Support ingesting ECCOv4r4 data
[ https://issues.apache.org/jira/browse/SDAP-227?focusedWorklogId=406604&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-406604 ] ASF GitHub Bot logged work on SDAP-227: --- Author: ASF GitHub Bot Created on: 19/Mar/20 21:34 Start Date: 19/Mar/20 21:34 Worklog Time Spent: 10m Work Description: ntquach commented on pull request #12: SDAP-227 Support indexed latlon URL: https://github.com/apache/incubator-sdap-ningesterpy/pull/12 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 406604) Remaining Estimate: 0h Time Spent: 10m > Support ingesting ECCOv4r4 data > --- > > Key: SDAP-227 > URL: https://issues.apache.org/jira/browse/SDAP-227 > Project: Apache Science Data Analytics Platform > Issue Type: Bug >Reporter: Eamon Ford >Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > > Change ningesterpy to support ingesting netcdf files that use i, j indices -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (SDAP-226) Zookeeper scaling via Helm fails
[ https://issues.apache.org/jira/browse/SDAP-226?focusedWorklogId=404938&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-404938 ] ASF GitHub Bot logged work on SDAP-226: --- Author: ASF GitHub Bot Created on: 17/Mar/20 20:09 Start Date: 17/Mar/20 20:09 Worklog Time Spent: 10m Work Description: ntquach commented on pull request #96: SDAP-226: pass in the configured number of zookeeper replicas to zook… URL: https://github.com/apache/incubator-sdap-nexus/pull/96 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 404938) Time Spent: 20m (was: 10m) > Zookeeper scaling via Helm fails > > > Key: SDAP-226 > URL: https://issues.apache.org/jira/browse/SDAP-226 > Project: Apache Science Data Analytics Platform > Issue Type: Bug >Reporter: Eamon Ford >Priority: Major > Time Spent: 20m > Remaining Estimate: 0h > > Setting .Values.zookeeper.replicas does not scale zookeeper properly because > the Zookeeper container arguments are hardcoded with `--servers=3`. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (SDAP-226) Zookeeper scaling via Helm fails
[ https://issues.apache.org/jira/browse/SDAP-226?focusedWorklogId=404929&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-404929 ] ASF GitHub Bot logged work on SDAP-226: --- Author: ASF GitHub Bot Created on: 17/Mar/20 19:57 Start Date: 17/Mar/20 19:57 Worklog Time Spent: 10m Work Description: eamonford commented on pull request #96: SDAP-226: pass in the configured number of zookeeper replicas to zook… URL: https://github.com/apache/incubator-sdap-nexus/pull/96 …eeper container args This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 404929) Remaining Estimate: 0h Time Spent: 10m > Zookeeper scaling via Helm fails > > > Key: SDAP-226 > URL: https://issues.apache.org/jira/browse/SDAP-226 > Project: Apache Science Data Analytics Platform > Issue Type: Bug >Reporter: Eamon Ford >Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > > Setting .Values.zookeeper.replicas does not scale zookeeper properly because > the Zookeeper container arguments are hardcoded with `--servers=3`. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (SDAP-221) Make ingress subchart optional
[ https://issues.apache.org/jira/browse/SDAP-221?focusedWorklogId=396309&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-396309 ] ASF GitHub Bot logged work on SDAP-221: --- Author: ASF GitHub Bot Created on: 02/Mar/20 19:06 Start Date: 02/Mar/20 19:06 Worklog Time Spent: 10m Work Description: jjacob7734 commented on pull request #91: SDAP-221: Add Helm configuration value to enable/disable nginx-ingress subchart installation URL: https://github.com/apache/incubator-sdap-nexus/pull/91 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 396309) Time Spent: 40m (was: 0.5h) > Make ingress subchart optional > -- > > Key: SDAP-221 > URL: https://issues.apache.org/jira/browse/SDAP-221 > Project: Apache Science Data Analytics Platform > Issue Type: Task >Reporter: Eamon Ford >Priority: Minor > Time Spent: 40m > Remaining Estimate: 0h > > The installation of the nginx-ingress subchart should be made optional to the > user when installing the SDAP Helm chart. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (SDAP-221) Make ingress subchart optional
[ https://issues.apache.org/jira/browse/SDAP-221?focusedWorklogId=396308&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-396308 ] ASF GitHub Bot logged work on SDAP-221: --- Author: ASF GitHub Bot Created on: 02/Mar/20 19:06 Start Date: 02/Mar/20 19:06 Worklog Time Spent: 10m Work Description: eamonford commented on pull request #91: SDAP-221: Add Helm configuration value to enable/disable nginx-ingress subchart installation URL: https://github.com/apache/incubator-sdap-nexus/pull/91 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 396308) Time Spent: 0.5h (was: 20m) > Make ingress subchart optional > -- > > Key: SDAP-221 > URL: https://issues.apache.org/jira/browse/SDAP-221 > Project: Apache Science Data Analytics Platform > Issue Type: Task >Reporter: Eamon Ford >Priority: Minor > Time Spent: 0.5h > Remaining Estimate: 0h > > The installation of the nginx-ingress subchart should be made optional to the > user when installing the SDAP Helm chart. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (SDAP-221) Make ingress subchart optional
[ https://issues.apache.org/jira/browse/SDAP-221?focusedWorklogId=396307&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-396307 ] ASF GitHub Bot logged work on SDAP-221: --- Author: ASF GitHub Bot Created on: 02/Mar/20 19:05 Start Date: 02/Mar/20 19:05 Worklog Time Spent: 10m Work Description: jjacob7734 commented on pull request #91: SDAP-221: Add Helm configuration value to enable/disable nginx-ingress subchart installation URL: https://github.com/apache/incubator-sdap-nexus/pull/91 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 396307) Time Spent: 20m (was: 10m) > Make ingress subchart optional > -- > > Key: SDAP-221 > URL: https://issues.apache.org/jira/browse/SDAP-221 > Project: Apache Science Data Analytics Platform > Issue Type: Task >Reporter: Eamon Ford >Priority: Minor > Time Spent: 20m > Remaining Estimate: 0h > > The installation of the nginx-ingress subchart should be made optional to the > user when installing the SDAP Helm chart. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (SDAP-220) Add data anomaly to analytic capabilities
[ https://issues.apache.org/jira/browse/SDAP-220?focusedWorklogId=396281&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-396281 ] ASF GitHub Bot logged work on SDAP-220: --- Author: ASF GitHub Bot Created on: 02/Mar/20 18:26 Start Date: 02/Mar/20 18:26 Worklog Time Spent: 10m Work Description: mayadebellis commented on pull request #93: SDAP-220: add data anomaly algorithm URL: https://github.com/apache/incubator-sdap-nexus/pull/93 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 396281) Remaining Estimate: 0h Time Spent: 10m > Add data anomaly to analytic capabilities > - > > Key: SDAP-220 > URL: https://issues.apache.org/jira/browse/SDAP-220 > Project: Apache Science Data Analytics Platform > Issue Type: New Feature >Reporter: Maya Debellis >Assignee: Maya DeBellis >Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > > Based off timeAvgMap - subtract the overall mean from all of the tile means -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (SDAP-222) Add support for nodeSelectors and tolerations to Helm chart
[ https://issues.apache.org/jira/browse/SDAP-222?focusedWorklogId=394425&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-394425 ] ASF GitHub Bot logged work on SDAP-222: --- Author: ASF GitHub Bot Created on: 27/Feb/20 19:32 Start Date: 27/Feb/20 19:32 Worklog Time Spent: 10m Work Description: eamonford commented on pull request #92: SDAP-222: Add support for nodeSelectors and tolerations in the Helm chart URL: https://github.com/apache/incubator-sdap-nexus/pull/92 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 394425) Remaining Estimate: 0h Time Spent: 10m > Add support for nodeSelectors and tolerations to Helm chart > --- > > Key: SDAP-222 > URL: https://issues.apache.org/jira/browse/SDAP-222 > Project: Apache Science Data Analytics Platform > Issue Type: New Feature >Reporter: Eamon Ford >Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > > The SDAP Helm chart should be able to support optional nodeSelectors and > tolerations for all workload components. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (SDAP-221) Make ingress subchart optional
[ https://issues.apache.org/jira/browse/SDAP-221?focusedWorklogId=393885&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-393885 ] ASF GitHub Bot logged work on SDAP-221: --- Author: ASF GitHub Bot Created on: 27/Feb/20 01:25 Start Date: 27/Feb/20 01:25 Worklog Time Spent: 10m Work Description: eamonford commented on pull request #91: SDAP-221: Add Helm configuration value to enable/disable nginx-ingress subchart installation URL: https://github.com/apache/incubator-sdap-nexus/pull/91 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 393885) Remaining Estimate: 0h Time Spent: 10m > Make ingress subchart optional > -- > > Key: SDAP-221 > URL: https://issues.apache.org/jira/browse/SDAP-221 > Project: Apache Science Data Analytics Platform > Issue Type: Task >Reporter: Eamon Ford >Priority: Minor > Time Spent: 10m > Remaining Estimate: 0h > > The installation of the nginx-ingress subchart should be made optional to the > user when installing the SDAP Helm chart. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (SDAP-216) Update the quickstart guide after deployment test on my laptop
[ https://issues.apache.org/jira/browse/SDAP-216?focusedWorklogId=390357&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-390357 ] ASF GitHub Bot logged work on SDAP-216: --- Author: ASF GitHub Bot Created on: 21/Feb/20 01:08 Start Date: 21/Feb/20 01:08 Worklog Time Spent: 10m Work Description: fgreg commented on pull request #89: SDAP-216: Update the quickstart guide URL: https://github.com/apache/incubator-sdap-nexus/pull/89 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 390357) Remaining Estimate: 0h Time Spent: 10m > Update the quickstart guide after deployment test on my laptop > -- > > Key: SDAP-216 > URL: https://issues.apache.org/jira/browse/SDAP-216 > Project: Apache Science Data Analytics Platform > Issue Type: Bug >Reporter: thomas loubrieu >Priority: Minor > Time Spent: 10m > Remaining Estimate: 0h > > Test new single node deployment from the quickstart guide: > [https://incubator-sdap-nexus.readthedocs.io/en/latest/quickstart.html] > > Update read the doc consequently. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (SDAP-215) Fix performance issues with Spark on Kubernetes
[ https://issues.apache.org/jira/browse/SDAP-215?focusedWorklogId=376001&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-376001 ] ASF GitHub Bot logged work on SDAP-215: --- Author: ASF GitHub Bot Created on: 23/Jan/20 00:52 Start Date: 23/Jan/20 00:52 Worklog Time Spent: 10m Work Description: jjacob7734 commented on pull request #88: SDAP-215 Use k8s as Spark scheduler and create helm chart URL: https://github.com/apache/incubator-sdap-nexus/pull/88 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 376001) Time Spent: 20m (was: 10m) > Fix performance issues with Spark on Kubernetes > --- > > Key: SDAP-215 > URL: https://issues.apache.org/jira/browse/SDAP-215 > Project: Apache Science Data Analytics Platform > Issue Type: Improvement > Components: nexus >Reporter: Eamon Ford >Priority: Major > Time Spent: 20m > Remaining Estimate: 0h > > When running Spark algorithms on a Kubernetes deployment of SDAP, performance > is slow and Spark is constrained to using a single Kubernetes pod. Upgrade > the Spark version and change the deployment so that Spark can use Kubernetes > as its scheduler. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (SDAP-214) Simplify EDGE directory structure
[ https://issues.apache.org/jira/browse/SDAP-214?focusedWorklogId=352307&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-352307 ] ASF GitHub Bot logged work on SDAP-214: --- Author: ASF GitHub Bot Created on: 02/Dec/19 23:40 Start Date: 02/Dec/19 23:40 Worklog Time Spent: 10m Work Description: lewismc commented on pull request #10: SDAP-214 Simplify EDGE directory structure URL: https://github.com/apache/incubator-sdap-edge/pull/10 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 352307) Time Spent: 20m (was: 10m) > Simplify EDGE directory structure > -- > > Key: SDAP-214 > URL: https://issues.apache.org/jira/browse/SDAP-214 > Project: Apache Science Data Analytics Platform > Issue Type: Wish > Components: edge >Affects Versions: 0.1 >Reporter: Lewis John McGibbney >Assignee: Lewis John McGibbney >Priority: Major > Time Spent: 20m > Remaining Estimate: 0h > > Also, it occurred to me that the build system for EDGE doesn't make much > sense... > I'm thinking about removing the pom.xml and then just moving everything under > [main|https://github.com/apache/incubator-sdap-edge/tree/master/src/main] to > the top level. > Everything under > [site|https://github.com/apache/incubator-sdap-edge/tree/master/src/site] can > be moved to a wiki. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (SDAP-215) Fix performance issues with Spark on Kubernetes
[ https://issues.apache.org/jira/browse/SDAP-215?focusedWorklogId=352230&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-352230 ] ASF GitHub Bot logged work on SDAP-215: --- Author: ASF GitHub Bot Created on: 02/Dec/19 21:29 Start Date: 02/Dec/19 21:29 Worklog Time Spent: 10m Work Description: eamonford commented on pull request #88: SDAP-215 Use k8s as Spark scheduler and create helm chart URL: https://github.com/apache/incubator-sdap-nexus/pull/88 This branch updates Spark to v2.4.4 to be natively compatible with Kubernetes, so Spark now uses Kubernetes as a scheduler. This branch also adds a Helm chart so that nexus can be deployed using helm install. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 352230) Remaining Estimate: 0h Time Spent: 10m > Fix performance issues with Spark on Kubernetes > --- > > Key: SDAP-215 > URL: https://issues.apache.org/jira/browse/SDAP-215 > Project: Apache Science Data Analytics Platform > Issue Type: Improvement > Components: nexus >Reporter: Eamon Ford >Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > > When running Spark algorithms on a Kubernetes deployment of SDAP, performance > is slow and Spark is constrained to using a single Kubernetes pod. Upgrade > the Spark version and change the deployment so that Spark can use Kubernetes > as its scheduler. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (SDAP-214) Simplify EDGE directory structure
[ https://issues.apache.org/jira/browse/SDAP-214?focusedWorklogId=349995&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-349995 ] ASF GitHub Bot logged work on SDAP-214: --- Author: ASF GitHub Bot Created on: 26/Nov/19 20:20 Start Date: 26/Nov/19 20:20 Worklog Time Spent: 10m Work Description: lewismc commented on pull request #10: SDAP-214 Simplify EDGE directory structure URL: https://github.com/apache/incubator-sdap-edge/pull/10 @ntquach @fgreg this addresses https://issues.apache.org/jira/browse/SDAP-214 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 349995) Remaining Estimate: 0h Time Spent: 10m > Simplify EDGE directory structure > -- > > Key: SDAP-214 > URL: https://issues.apache.org/jira/browse/SDAP-214 > Project: Apache Science Data Analytics Platform > Issue Type: Wish > Components: edge >Affects Versions: 0.1 >Reporter: Lewis John McGibbney >Assignee: Lewis John McGibbney >Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > > Also, it occurred to me that the build system for EDGE doesn't make much > sense... > I'm thinking about removing the pom.xml and then just moving everything under > [main|https://github.com/apache/incubator-sdap-edge/tree/master/src/main] to > the top level. > Everything under > [site|https://github.com/apache/incubator-sdap-edge/tree/master/src/site] can > be moved to a wiki. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (SDAP-212) Update EDGE to Python 3.7
[ https://issues.apache.org/jira/browse/SDAP-212?focusedWorklogId=349993&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-349993 ] ASF GitHub Bot logged work on SDAP-212: --- Author: ASF GitHub Bot Created on: 26/Nov/19 20:09 Start Date: 26/Nov/19 20:09 Worklog Time Spent: 10m Work Description: lewismc commented on pull request #9: SDAP-212 Update EDGE to Python 3.7 URL: https://github.com/apache/incubator-sdap-edge/pull/9 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 349993) Time Spent: 20m (was: 10m) > Update EDGE to Python 3.7 > - > > Key: SDAP-212 > URL: https://issues.apache.org/jira/browse/SDAP-212 > Project: Apache Science Data Analytics Platform > Issue Type: Wish > Components: edge >Affects Versions: 0.1 >Reporter: Lewis John McGibbney >Assignee: Lewis John McGibbney >Priority: Blocker > Time Spent: 20m > Remaining Estimate: 0h > > Pytjhon 2.7 EOL is at the end of this year. I was looking at EDGE and tried > to install it and couldn't. It turns out that is supports Python 2.7. > I'm going to run the 2to3-3.7 tool on it and submit a pull request for this > code. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (SDAP-212) Update EDGE to Python 3.7
[ https://issues.apache.org/jira/browse/SDAP-212?focusedWorklogId=349577&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-349577 ] ASF GitHub Bot logged work on SDAP-212: --- Author: ASF GitHub Bot Created on: 26/Nov/19 05:39 Start Date: 26/Nov/19 05:39 Worklog Time Spent: 10m Work Description: lewismc commented on pull request #9: SDAP-212 Update EDGE to Python 3.7 URL: https://github.com/apache/incubator-sdap-edge/pull/9 Bulk result of running Python's 2to3-3.7 tooling on the codebase. This issue addresses https://issues.apache.org/jira/browse/SDAP-212 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 349577) Remaining Estimate: 0h Time Spent: 10m > Update EDGE to Python 3.7 > - > > Key: SDAP-212 > URL: https://issues.apache.org/jira/browse/SDAP-212 > Project: Apache Science Data Analytics Platform > Issue Type: Wish > Components: edge >Affects Versions: 0.1 >Reporter: Lewis John McGibbney >Assignee: Lewis John McGibbney >Priority: Blocker > Time Spent: 10m > Remaining Estimate: 0h > > Pytjhon 2.7 EOL is at the end of this year. I was looking at EDGE and tried > to install it and couldn't. It turns out that is supports Python 2.7. > I'm going to run the 2to3-3.7 tool on it and submit a pull request for this > code. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (SDAP-192) Create DOMS netCDF reader tool
[ https://issues.apache.org/jira/browse/SDAP-192?focusedWorklogId=326566&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-326566 ] ASF GitHub Bot logged work on SDAP-192: --- Author: ASF GitHub Bot Created on: 10/Oct/19 20:37 Start Date: 10/Oct/19 20:37 Worklog Time Spent: 10m Work Description: fgreg commented on pull request #83: SDAP-192 Create DOMS netCDF reader tool URL: https://github.com/apache/incubator-sdap-nexus/pull/83 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 326566) Time Spent: 40m (was: 0.5h) > Create DOMS netCDF reader tool > -- > > Key: SDAP-192 > URL: https://issues.apache.org/jira/browse/SDAP-192 > Project: Apache Science Data Analytics Platform > Issue Type: New Feature > Components: doms >Reporter: Jocelyn Elya >Priority: Major > Time Spent: 40m > Remaining Estimate: 0h > > Create a reader tool for the DOMS netCDF output files to load data into > memory and assemble satellite-to-in situ matched data pairs from separate > groups. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (SDAP-209) Fix mapping of SAMOS quality flag fields
[ https://issues.apache.org/jira/browse/SDAP-209?focusedWorklogId=300392&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-300392 ] ASF GitHub Bot logged work on SDAP-209: --- Author: ASF GitHub Bot Created on: 23/Aug/19 17:12 Start Date: 23/Aug/19 17:12 Worklog Time Spent: 10m Work Description: fgreg commented on pull request #7: SDAP-209 Fix mapping of SAMOS quality flag fields URL: https://github.com/apache/incubator-sdap-edge/pull/7 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 300392) Time Spent: 20m (was: 10m) > Fix mapping of SAMOS quality flag fields > > > Key: SDAP-209 > URL: https://issues.apache.org/jira/browse/SDAP-209 > Project: Apache Science Data Analytics Platform > Issue Type: Bug > Components: edge >Reporter: Nga Chung >Assignee: Nga Chung >Priority: Major > Time Spent: 20m > Remaining Estimate: 0h > > The SAMOS quality flag values are not being returned correctly in the json > response. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (SDAP-209) Fix mapping of SAMOS quality flag fields
[ https://issues.apache.org/jira/browse/SDAP-209?focusedWorklogId=300388&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-300388 ] ASF GitHub Bot logged work on SDAP-209: --- Author: ASF GitHub Bot Created on: 23/Aug/19 17:01 Start Date: 23/Aug/19 17:01 Worklog Time Spent: 10m Work Description: ntquach commented on pull request #7: SDAP-209 Fix mapping of SAMOS quality flag fields URL: https://github.com/apache/incubator-sdap-edge/pull/7 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 300388) Remaining Estimate: 0h Time Spent: 10m > Fix mapping of SAMOS quality flag fields > > > Key: SDAP-209 > URL: https://issues.apache.org/jira/browse/SDAP-209 > Project: Apache Science Data Analytics Platform > Issue Type: Bug > Components: edge >Reporter: Nga Chung >Assignee: Nga Chung >Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > > The SAMOS quality flag values are not being returned correctly in the json > response. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (SDAP-208) ICOADS Plugin Misconfiguration
[ https://issues.apache.org/jira/browse/SDAP-208?focusedWorklogId=299714&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-299714 ] ASF GitHub Bot logged work on SDAP-208: --- Author: ASF GitHub Bot Created on: 22/Aug/19 20:23 Start Date: 22/Aug/19 20:23 Worklog Time Spent: 10m Work Description: ntquach commented on pull request #6: SDAP-208 ICOADS plugin misconfiguration URL: https://github.com/apache/incubator-sdap-edge/pull/6 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 299714) Time Spent: 20m (was: 10m) > ICOADS Plugin Misconfiguration > -- > > Key: SDAP-208 > URL: https://issues.apache.org/jira/browse/SDAP-208 > Project: Apache Science Data Analytics Platform > Issue Type: Bug > Components: edge >Reporter: Frank Greguska >Assignee: Frank Greguska >Priority: Major > Time Spent: 20m > Remaining Estimate: 0h > > ICOADS plugin causing 400 error when trying to query using qualityFlag > parameter -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (SDAP-208) ICOADS Plugin Misconfiguration
[ https://issues.apache.org/jira/browse/SDAP-208?focusedWorklogId=299711&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-299711 ] ASF GitHub Bot logged work on SDAP-208: --- Author: ASF GitHub Bot Created on: 22/Aug/19 20:16 Start Date: 22/Aug/19 20:16 Worklog Time Spent: 10m Work Description: fgreg commented on pull request #6: SDAP-208 ICOADS plugin misconfiguration URL: https://github.com/apache/incubator-sdap-edge/pull/6 I think the wrong document fields were being used for the Solr query. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 299711) Remaining Estimate: 0h Time Spent: 10m > ICOADS Plugin Misconfiguration > -- > > Key: SDAP-208 > URL: https://issues.apache.org/jira/browse/SDAP-208 > Project: Apache Science Data Analytics Platform > Issue Type: Bug > Components: edge >Reporter: Frank Greguska >Assignee: Frank Greguska >Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > > ICOADS plugin causing 400 error when trying to query using qualityFlag > parameter -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (SDAP-207) GDAL Import error
[
https://issues.apache.org/jira/browse/SDAP-207?focusedWorklogId=299111&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-299111
]
ASF GitHub Bot logged work on SDAP-207:
---
Author: ASF GitHub Bot
Created on: 22/Aug/19 01:58
Start Date: 22/Aug/19 01:58
Worklog Time Spent: 10m
Work Description: fgreg commented on pull request #82: SDAP-207 GDAL
Import error
URL: https://github.com/apache/incubator-sdap-nexus/pull/82
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 299111)
Time Spent: 20m (was: 10m)
> GDAL Import error
> -
>
> Key: SDAP-207
> URL: https://issues.apache.org/jira/browse/SDAP-207
> Project: Apache Science Data Analytics Platform
> Issue Type: Bug
> Components: nexus
>Reporter: Frank Greguska
>Assignee: Frank Greguska
>Priority: Major
> Time Spent: 20m
> Remaining Estimate: 0h
>
> Getting an import error from GDAL at runtime:
>
> Traceback (most recent call last):
> File "/usr/local/anaconda2/lib/python2.7/runpy.py", line 174, in
> _run_module_as_main
> "__main__", fname, loader, pkg_name)
> File "/usr/local/anaconda2/lib/python2.7/runpy.py", line 72, in _run_code
> exec code in run_globals
> File "/tmp/incubator-sdap-nexus/analysis/webservice/webapp.py", line 233,
> in
> importlib.import_module(moduleDir)
> File "/usr/local/anaconda2/lib/python2.7/importlib/__init__.py", line 37,
> in import_module
> __import__(name)
> File "webservice/algorithms/doms/__init__.py", line 17, in
> import BaseDomsHandler
> File "webservice/algorithms/doms/BaseDomsHandler.py", line 40, in
> import gdal
> File "/usr/local/anaconda2/lib/python2.7/site-packages/gdal.py", line 2, in
>
> from osgeo.gdal import deprecation_warn
> File "/usr/local/anaconda2/lib/python2.7/site-packages/osgeo/__init__.py",
> line 21, in
> _gdal = swig_import_helper()
> File "/usr/local/anaconda2/lib/python2.7/site-packages/osgeo/__init__.py",
> line 17, in swig_import_helper
> _mod = imp.load_module('_gdal', fp, pathname, description)
> ImportError: libpoppler.so.71: cannot open shared object file: No such file
> or directory
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
[jira] [Work logged] (SDAP-207) GDAL Import error
[
https://issues.apache.org/jira/browse/SDAP-207?focusedWorklogId=299110&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-299110
]
ASF GitHub Bot logged work on SDAP-207:
---
Author: ASF GitHub Bot
Created on: 22/Aug/19 01:58
Start Date: 22/Aug/19 01:58
Worklog Time Spent: 10m
Work Description: fgreg commented on pull request #82: SDAP-207 GDAL
Import error
URL: https://github.com/apache/incubator-sdap-nexus/pull/82
Updated anaconda and used new option `conda config --set channel_priority
strict` to fix some of the errors. Also created a conda environment to execute
inside of instead of using base.
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 299110)
Remaining Estimate: 0h
Time Spent: 10m
> GDAL Import error
> -
>
> Key: SDAP-207
> URL: https://issues.apache.org/jira/browse/SDAP-207
> Project: Apache Science Data Analytics Platform
> Issue Type: Bug
> Components: nexus
>Reporter: Frank Greguska
>Assignee: Frank Greguska
>Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Getting an import error from GDAL at runtime:
>
> Traceback (most recent call last):
> File "/usr/local/anaconda2/lib/python2.7/runpy.py", line 174, in
> _run_module_as_main
> "__main__", fname, loader, pkg_name)
> File "/usr/local/anaconda2/lib/python2.7/runpy.py", line 72, in _run_code
> exec code in run_globals
> File "/tmp/incubator-sdap-nexus/analysis/webservice/webapp.py", line 233,
> in
> importlib.import_module(moduleDir)
> File "/usr/local/anaconda2/lib/python2.7/importlib/__init__.py", line 37,
> in import_module
> __import__(name)
> File "webservice/algorithms/doms/__init__.py", line 17, in
> import BaseDomsHandler
> File "webservice/algorithms/doms/BaseDomsHandler.py", line 40, in
> import gdal
> File "/usr/local/anaconda2/lib/python2.7/site-packages/gdal.py", line 2, in
>
> from osgeo.gdal import deprecation_warn
> File "/usr/local/anaconda2/lib/python2.7/site-packages/osgeo/__init__.py",
> line 21, in
> _gdal = swig_import_helper()
> File "/usr/local/anaconda2/lib/python2.7/site-packages/osgeo/__init__.py",
> line 17, in swig_import_helper
> _mod = imp.load_module('_gdal', fp, pathname, description)
> ImportError: libpoppler.so.71: cannot open shared object file: No such file
> or directory
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
[jira] [Work logged] (SDAP-203) Update docker build files
[ https://issues.apache.org/jira/browse/SDAP-203?focusedWorklogId=298984&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-298984 ] ASF GitHub Bot logged work on SDAP-203: --- Author: ASF GitHub Bot Created on: 21/Aug/19 20:24 Start Date: 21/Aug/19 20:24 Worklog Time Spent: 10m Work Description: fgreg commented on pull request #80: SDAP-203 Update docker build files URL: https://github.com/apache/incubator-sdap-nexus/pull/80 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 298984) Time Spent: 20m (was: 10m) > Update docker build files > - > > Key: SDAP-203 > URL: https://issues.apache.org/jira/browse/SDAP-203 > Project: Apache Science Data Analytics Platform > Issue Type: Bug > Components: nexus >Reporter: Frank Greguska >Assignee: Frank Greguska >Priority: Major > Time Spent: 20m > Remaining Estimate: 0h > > Docker build should accept Java RPM URL as a build time argument. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (SDAP-203) Update docker build files
[ https://issues.apache.org/jira/browse/SDAP-203?focusedWorklogId=298983&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-298983 ] ASF GitHub Bot logged work on SDAP-203: --- Author: ASF GitHub Bot Created on: 21/Aug/19 20:23 Start Date: 21/Aug/19 20:23 Worklog Time Spent: 10m Work Description: fgreg commented on pull request #80: SDAP-203 Update docker build files URL: https://github.com/apache/incubator-sdap-nexus/pull/80 Oracle JDK was no longer available publicly so switched to OpenJDK 8 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 298983) Remaining Estimate: 0h Time Spent: 10m > Update docker build files > - > > Key: SDAP-203 > URL: https://issues.apache.org/jira/browse/SDAP-203 > Project: Apache Science Data Analytics Platform > Issue Type: Bug > Components: nexus >Reporter: Frank Greguska >Assignee: Frank Greguska >Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > > Docker build should accept Java RPM URL as a build time argument. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (SDAP-206) remove pegged numpy version in nexuscli requirements.txt
[
https://issues.apache.org/jira/browse/SDAP-206?focusedWorklogId=298458&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-298458
]
ASF GitHub Bot logged work on SDAP-206:
---
Author: ASF GitHub Bot
Created on: 21/Aug/19 05:19
Start Date: 21/Aug/19 05:19
Worklog Time Spent: 10m
Work Description: lewismc commented on pull request #78: SDAP-206 remove
pegged numpy version in nexuscli requirements.txt
URL: https://github.com/apache/incubator-sdap-nexus/pull/78
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 298458)
Remaining Estimate: 0h
Time Spent: 10m
> remove pegged numpy version in nexuscli requirements.txt
>
>
> Key: SDAP-206
> URL: https://issues.apache.org/jira/browse/SDAP-206
> Project: Apache Science Data Analytics Platform
> Issue Type: Bug
> Components: nexus
>Affects Versions: 0.1
>Reporter: Lewis John McGibbney
>Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Building nexuscli fails as follows
> {code}
> pip3 install -r requirements.txt
> ...
>
> /usr/local/Cellar/python/3.7.4/Frameworks/Python.framework/Versions/3.7/include/python3.7m/pystate.h:241:15:
> note: 'curexc_traceback' declared here
> PyObject *curexc_traceback;
> ^
> 16 errors generated.
> error: Command "clang -Wno-unused-result -Wsign-compare
> -Wunreachable-code -fno-common -dynamic -DNDEBUG -g -fwrapv -O3 -Wall
> -isysroot
> /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk
>
> -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk/usr/include
>
> -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk/System/Library/Frameworks/Tk.framework/Versions/8.5/Headers
> -D_FILE_OFFSET_BITS=64 -D_LARGEFILE_SOURCE=1 -D_LARGEFILE64_SOURCE=1
> -Inumpy/core/include
> -Ibuild/src.macosx-10.14-x86_64-3.7/numpy/core/include/numpy
> -Inumpy/core/src/private -Inumpy/core/src -Inumpy/core
> -Inumpy/core/src/npymath -Inumpy/core/src/multiarray -Inumpy/core/src/umath
> -Inumpy/core/src/npysort -I/usr/local/include
> -I/usr/local/opt/openssl/include -I/usr/local/opt/sqlite/include
> -I/usr/local/Cellar/python/3.7.4/Frameworks/Python.framework/Versions/3.7/include/python3.7m
> -Ibuild/src.macosx-10.14-x86_64-3.7/numpy/core/src/private
> -Ibuild/src.macosx-10.14-x86_64-3.7/numpy/core/src/npymath
> -Ibuild/src.macosx-10.14-x86_64-3.7/numpy/core/src/private
> -Ibuild/src.macosx-10.14-x86_64-3.7/numpy/core/src/npymath
> -Ibuild/src.macosx-10.14-x86_64-3.7/numpy/core/src/private
> -Ibuild/src.macosx-10.14-x86_64-3.7/numpy/core/src/npymath -c
> numpy/random/mtrand/mtrand.c -o
> build/temp.macosx-10.14-x86_64-3.7/numpy/random/mtrand/mtrand.o -MMD -MF
> build/temp.macosx-10.14-x86_64-3.7/numpy/random/mtrand/mtrand.o.d" failed
> with exit status 1
>
> Rolling back uninstall of numpy
> Moving to /usr/local/lib/python3.7/site-packages/numpy
>from /usr/local/lib/python3.7/site-packages/~umpy
> Moving to /usr/local/lib/python3.7/site-packages/numpy-1.16.4-py3.7.egg-info
>from /usr/local/lib/python3.7/site-packages/~umpy-1.16.4-py3.7.egg-info
> ERROR: Command "/usr/local/opt/python/bin/python3.7 -u -c 'import setuptools,
> tokenize;__file__='"'"'/private/var/folders/3p/t0shq8j10q56q45ntm0skn00fv8362/T/pip-install-7md1x8s_/numpy/setup.py'"'"';f=getattr(tokenize,
> '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"',
> '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))'
> install --record
> /private/var/folders/3p/t0shq8j10q56q45ntm0skn00fv8362/T/pip-record-weq7k5md/install-record.txt
> --single-version-externally-managed --compile" failed with error code 1 in
> /private/var/folders/3p/t0shq8j10q56q45ntm0skn00fv8362/T/pip-install-7md1x8s_/numpy/
> {code}
> Essentially it relates to the [pegged version of numpy in
> requirements.txt|https://github.com/apache/incubator-sdap-nexus/blob/master/client/requirements.txt#L7]
>
> When the version is removed, nexuscli builds just fine. I'll submit a PR for
> this.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
[jira] [Work logged] (SDAP-205) Lat/lon netcdf not writing as float
[ https://issues.apache.org/jira/browse/SDAP-205?focusedWorklogId=298265&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-298265 ] ASF GitHub Bot logged work on SDAP-205: --- Author: ASF GitHub Bot Created on: 20/Aug/19 22:26 Start Date: 20/Aug/19 22:26 Worklog Time Spent: 10m Work Description: fgreg commented on pull request #77: SDAP-205: Lat/lon netcdf not writing as float URL: https://github.com/apache/incubator-sdap-nexus/pull/77 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 298265) Time Spent: 20m (was: 10m) > Lat/lon netcdf not writing as float > --- > > Key: SDAP-205 > URL: https://issues.apache.org/jira/browse/SDAP-205 > Project: Apache Science Data Analytics Platform > Issue Type: Bug >Reporter: Maya DeBellis >Assignee: Maya DeBellis >Priority: Major > Time Spent: 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (SDAP-205) Lat/lon netcdf not writing as float
[ https://issues.apache.org/jira/browse/SDAP-205?focusedWorklogId=298224&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-298224 ] ASF GitHub Bot logged work on SDAP-205: --- Author: ASF GitHub Bot Created on: 20/Aug/19 22:03 Start Date: 20/Aug/19 22:03 Worklog Time Spent: 10m Work Description: mayadebellis commented on pull request #77: SDAP-205: Lat/lon netcdf not writing as float URL: https://github.com/apache/incubator-sdap-nexus/pull/77 The min and max attributes for lat and lon variables in the netcdf were not writing as floats. This was causing errors in the calculation and errors for the readers. This has been fixed https://issues.apache.org/jira/browse/SDAP-205 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 298224) Remaining Estimate: 0h Time Spent: 10m > Lat/lon netcdf not writing as float > --- > > Key: SDAP-205 > URL: https://issues.apache.org/jira/browse/SDAP-205 > Project: Apache Science Data Analytics Platform > Issue Type: Bug >Reporter: Maya DeBellis >Assignee: Maya DeBellis >Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (SDAP-204) Fix quality flag bugs
[ https://issues.apache.org/jira/browse/SDAP-204?focusedWorklogId=298202&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-298202 ] ASF GitHub Bot logged work on SDAP-204: --- Author: ASF GitHub Bot Created on: 20/Aug/19 21:11 Start Date: 20/Aug/19 21:11 Worklog Time Spent: 10m Work Description: fgreg commented on pull request #76: SDAP-204: Fix quality flag bugs URL: https://github.com/apache/incubator-sdap-nexus/pull/76 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 298202) Time Spent: 20m (was: 10m) > Fix quality flag bugs > - > > Key: SDAP-204 > URL: https://issues.apache.org/jira/browse/SDAP-204 > Project: Apache Science Data Analytics Platform > Issue Type: Bug >Reporter: Maya DeBellis >Assignee: Maya DeBellis >Priority: Major > Time Spent: 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (SDAP-197) Add quality flags to DOMS matchup output
[ https://issues.apache.org/jira/browse/SDAP-197?focusedWorklogId=298194&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-298194 ] ASF GitHub Bot logged work on SDAP-197: --- Author: ASF GitHub Bot Created on: 20/Aug/19 21:09 Start Date: 20/Aug/19 21:09 Worklog Time Spent: 10m Work Description: fgreg commented on pull request #75: SDAP-197 URL: https://github.com/apache/incubator-sdap-nexus/pull/75 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 298194) Time Spent: 40m (was: 0.5h) > Add quality flags to DOMS matchup output > > > Key: SDAP-197 > URL: https://issues.apache.org/jira/browse/SDAP-197 > Project: Apache Science Data Analytics Platform > Issue Type: New Feature >Reporter: Maya DeBellis >Assignee: Eamon Ford >Priority: Major > Time Spent: 40m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (SDAP-204) Fix quality flag bugs
[ https://issues.apache.org/jira/browse/SDAP-204?focusedWorklogId=298190&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-298190 ] ASF GitHub Bot logged work on SDAP-204: --- Author: ASF GitHub Bot Created on: 20/Aug/19 21:08 Start Date: 20/Aug/19 21:08 Worklog Time Spent: 10m Work Description: mayadebellis commented on pull request #76: SDAP-204: Fix quality flag bugs URL: https://github.com/apache/incubator-sdap-nexus/pull/76 Fixed the following issues/bugs: 1 - Removed quality information from satellite variables in the csv output 2 - Add comment attribute to WindComponent to explain it's relation to windU and windV 3 - Add api query to DOMS headers (netcdf and csv) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 298190) Remaining Estimate: 0h Time Spent: 10m > Fix quality flag bugs > - > > Key: SDAP-204 > URL: https://issues.apache.org/jira/browse/SDAP-204 > Project: Apache Science Data Analytics Platform > Issue Type: Bug >Reporter: Maya DeBellis >Assignee: Maya DeBellis >Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (SDAP-197) Add quality flags to DOMS matchup output
[ https://issues.apache.org/jira/browse/SDAP-197?focusedWorklogId=298173&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-298173 ] ASF GitHub Bot logged work on SDAP-197: --- Author: ASF GitHub Bot Created on: 20/Aug/19 20:49 Start Date: 20/Aug/19 20:49 Worklog Time Spent: 10m Work Description: mayadebellis commented on pull request #75: SDAP-197 URL: https://github.com/apache/incubator-sdap-nexus/pull/75 Fixed the following issues/bugs: 1 - Removed quality information from satellite variables in the csv output 2 - Add comment attribute to WindComponent to explain it's relation to windU and windV 3 - Add api query to DOMS headers (netcdf and csv) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 298173) Time Spent: 0.5h (was: 20m) > Add quality flags to DOMS matchup output > > > Key: SDAP-197 > URL: https://issues.apache.org/jira/browse/SDAP-197 > Project: Apache Science Data Analytics Platform > Issue Type: New Feature >Reporter: Maya DeBellis >Assignee: Eamon Ford >Priority: Major > Time Spent: 0.5h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (SDAP-202) Edge Doesn't filter based on qualitFlag parameter
[ https://issues.apache.org/jira/browse/SDAP-202?focusedWorklogId=298110&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-298110 ] ASF GitHub Bot logged work on SDAP-202: --- Author: ASF GitHub Bot Created on: 20/Aug/19 18:52 Start Date: 20/Aug/19 18:52 Worklog Time Spent: 10m Work Description: ntquach commented on pull request #5: SDAP-202 Edge Doesn't filter based on qualitFlag parameter URL: https://github.com/apache/incubator-sdap-edge/pull/5 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 298110) Time Spent: 20m (was: 10m) > Edge Doesn't filter based on qualitFlag parameter > - > > Key: SDAP-202 > URL: https://issues.apache.org/jira/browse/SDAP-202 > Project: Apache Science Data Analytics Platform > Issue Type: Bug > Components: edge >Reporter: Frank Greguska >Assignee: Elizabeth Yam >Priority: Major > Time Spent: 20m > Remaining Estimate: 0h > > EDGE does not seem to be filtering results according to the qualityFlag query > parameter: > [http://doms.coaps.fsu.edu:8890/ws/search/samos?qualityFlag=1&variable=sst] > Returns the same results as > [http://doms.coaps.fsu.edu:8890/ws/search/samos|http://doms.coaps.fsu.edu:8890/ws/search/samos?qualityFlag=1&variable=sst] > > I think it is because qualityFlag is not configured as a parameter for the > plugin: > [https://github.com/apache/incubator-sdap-edge/blob/master/src/main/python/plugins/samos/json/plugin.conf#L6] > Same for icoads: > [https://github.com/apache/incubator-sdap-edge/blob/master/src/main/python/plugins/icoads/json/plugin.conf#L6] -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (SDAP-202) Edge Doesn't filter based on qualitFlag parameter
[ https://issues.apache.org/jira/browse/SDAP-202?focusedWorklogId=298105&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-298105 ] ASF GitHub Bot logged work on SDAP-202: --- Author: ASF GitHub Bot Created on: 20/Aug/19 18:50 Start Date: 20/Aug/19 18:50 Worklog Time Spent: 10m Work Description: echyam commented on pull request #5: SDAP-202 Edge Doesn't filter based on qualitFlag parameter URL: https://github.com/apache/incubator-sdap-edge/pull/5 Add `qualityFlag` parameter for icoads and samos configs This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 298105) Remaining Estimate: 0h Time Spent: 10m > Edge Doesn't filter based on qualitFlag parameter > - > > Key: SDAP-202 > URL: https://issues.apache.org/jira/browse/SDAP-202 > Project: Apache Science Data Analytics Platform > Issue Type: Bug > Components: edge >Reporter: Frank Greguska >Assignee: Elizabeth Yam >Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > > EDGE does not seem to be filtering results according to the qualityFlag query > parameter: > [http://doms.coaps.fsu.edu:8890/ws/search/samos?qualityFlag=1&variable=sst] > Returns the same results as > [http://doms.coaps.fsu.edu:8890/ws/search/samos|http://doms.coaps.fsu.edu:8890/ws/search/samos?qualityFlag=1&variable=sst] > > I think it is because qualityFlag is not configured as a parameter for the > plugin: > [https://github.com/apache/incubator-sdap-edge/blob/master/src/main/python/plugins/samos/json/plugin.conf#L6] > Same for icoads: > [https://github.com/apache/incubator-sdap-edge/blob/master/src/main/python/plugins/icoads/json/plugin.conf#L6] -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (SDAP-144) DOMS API to support filtering by quality
[ https://issues.apache.org/jira/browse/SDAP-144?focusedWorklogId=298091&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-298091 ] ASF GitHub Bot logged work on SDAP-144: --- Author: ASF GitHub Bot Created on: 20/Aug/19 18:18 Start Date: 20/Aug/19 18:18 Worklog Time Spent: 10m Work Description: fgreg commented on pull request #74: SDAP-144 add quality flag support for DOMS URL: https://github.com/apache/incubator-sdap-nexus/pull/74 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 298091) Time Spent: 20m (was: 10m) > DOMS API to support filtering by quality > > > Key: SDAP-144 > URL: https://issues.apache.org/jira/browse/SDAP-144 > Project: Apache Science Data Analytics Platform > Issue Type: New Feature > Components: doms, nexus >Reporter: Frank Greguska >Assignee: Elizabeth Yam >Priority: Major > Time Spent: 20m > Remaining Estimate: 0h > > The matchup algorithm can be modified to utilize quality filtering of in situ > data. > > This method is a good place to start because it is used to query for insitu > data using EDGE. > https://github.com/apache/incubator-sdap-nexus/blob/725ed5a7bb7db96662e5351f8cd373f4c54862d6/analysis/webservice/algorithms_spark/Matchup.py#L650 -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (SDAP-197) Add quality flags to DOMS matchup output
[ https://issues.apache.org/jira/browse/SDAP-197?focusedWorklogId=298089&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-298089 ] ASF GitHub Bot logged work on SDAP-197: --- Author: ASF GitHub Bot Created on: 20/Aug/19 18:18 Start Date: 20/Aug/19 18:18 Worklog Time Spent: 10m Work Description: fgreg commented on pull request #73: SDAP-197: Add quality flags to DOMS matchup output URL: https://github.com/apache/incubator-sdap-nexus/pull/73 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 298089) Time Spent: 20m (was: 10m) > Add quality flags to DOMS matchup output > > > Key: SDAP-197 > URL: https://issues.apache.org/jira/browse/SDAP-197 > Project: Apache Science Data Analytics Platform > Issue Type: New Feature >Reporter: Maya DeBellis >Assignee: Eamon Ford >Priority: Major > Time Spent: 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (SDAP-194) Implement new depth construction for DOMS matchup
[ https://issues.apache.org/jira/browse/SDAP-194?focusedWorklogId=298087&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-298087 ] ASF GitHub Bot logged work on SDAP-194: --- Author: ASF GitHub Bot Created on: 20/Aug/19 18:14 Start Date: 20/Aug/19 18:14 Worklog Time Spent: 10m Work Description: fgreg commented on pull request #72: SDAP-194: Implement new depth construction for DOMS matchup URL: https://github.com/apache/incubator-sdap-nexus/pull/72 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 298087) Time Spent: 20m (was: 10m) > Implement new depth construction for DOMS matchup > - > > Key: SDAP-194 > URL: https://issues.apache.org/jira/browse/SDAP-194 > Project: Apache Science Data Analytics Platform > Issue Type: Bug >Reporter: Maya DeBellis >Assignee: Maya DeBellis >Priority: Major > Time Spent: 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (SDAP-144) DOMS API to support filtering by quality
[ https://issues.apache.org/jira/browse/SDAP-144?focusedWorklogId=297485&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-297485 ] ASF GitHub Bot logged work on SDAP-144: --- Author: ASF GitHub Bot Created on: 19/Aug/19 23:12 Start Date: 19/Aug/19 23:12 Worklog Time Spent: 10m Work Description: echyam commented on pull request #74: SDAP-144 add quality flag support for DOMS URL: https://github.com/apache/incubator-sdap-nexus/pull/74 support querying with quality flags in DOMS This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 297485) Remaining Estimate: 0h Time Spent: 10m > DOMS API to support filtering by quality > > > Key: SDAP-144 > URL: https://issues.apache.org/jira/browse/SDAP-144 > Project: Apache Science Data Analytics Platform > Issue Type: New Feature > Components: doms, nexus >Reporter: Frank Greguska >Assignee: Elizabeth Yam >Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > > The matchup algorithm can be modified to utilize quality filtering of in situ > data. > > This method is a good place to start because it is used to query for insitu > data using EDGE. > https://github.com/apache/incubator-sdap-nexus/blob/725ed5a7bb7db96662e5351f8cd373f4c54862d6/analysis/webservice/algorithms_spark/Matchup.py#L650 -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (SDAP-201) Empty CSV Data Results With NullPointerException
[ https://issues.apache.org/jira/browse/SDAP-201?focusedWorklogId=290591&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-290591 ] ASF GitHub Bot logged work on SDAP-201: --- Author: ASF GitHub Bot Created on: 07/Aug/19 16:41 Start Date: 07/Aug/19 16:41 Worklog Time Spent: 10m Work Description: lewismc commented on pull request #49: SDAP-201 Empty CSV data results with NullPointerException. URL: https://github.com/apache/incubator-sdap-mudrod/pull/49 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 290591) Time Spent: 10m Remaining Estimate: 0h > Empty CSV Data Results With NullPointerException > > > Key: SDAP-201 > URL: https://issues.apache.org/jira/browse/SDAP-201 > Project: Apache Science Data Analytics Platform > Issue Type: Bug > Components: mudrod >Reporter: Furkan KAMACI >Priority: Major > Fix For: 0.1 > > Time Spent: 10m > Remaining Estimate: 0h > > Empty CSV Data case should be handled in order to avoid NullPointerException > when creating header data. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Work logged] (SDAP-199) Boxed Types Should Be Compared Using equals()
[ https://issues.apache.org/jira/browse/SDAP-199?focusedWorklogId=290592&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-290592 ] ASF GitHub Bot logged work on SDAP-199: --- Author: ASF GitHub Bot Created on: 07/Aug/19 16:41 Start Date: 07/Aug/19 16:41 Worklog Time Spent: 10m Work Description: lewismc commented on pull request #50: SDAP-199 equals() is used for String comparison. URL: https://github.com/apache/incubator-sdap-mudrod/pull/50 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 290592) Time Spent: 40m (was: 0.5h) > Boxed Types Should Be Compared Using equals() > - > > Key: SDAP-199 > URL: https://issues.apache.org/jira/browse/SDAP-199 > Project: Apache Science Data Analytics Platform > Issue Type: Bug > Components: mudrod >Reporter: Furkan KAMACI >Priority: Major > Fix For: 0.1 > > Time Spent: 40m > Remaining Estimate: 0h > > It's a mistake to compare two instances of boxed types like java.lang.Integer > using reference equality == or !=, because it is not comparing actual value > but locations in memory. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Work logged] (SDAP-200) Use Loggers Instead of Printing Throwable
[ https://issues.apache.org/jira/browse/SDAP-200?focusedWorklogId=290590&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-290590 ] ASF GitHub Bot logged work on SDAP-200: --- Author: ASF GitHub Bot Created on: 07/Aug/19 16:39 Start Date: 07/Aug/19 16:39 Worklog Time Spent: 10m Work Description: lewismc commented on pull request #48: SDAP-200 Loggers used instead to print Throwable. URL: https://github.com/apache/incubator-sdap-mudrod/pull/48 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 290590) Time Spent: 10m Remaining Estimate: 0h > Use Loggers Instead of Printing Throwable > - > > Key: SDAP-200 > URL: https://issues.apache.org/jira/browse/SDAP-200 > Project: Apache Science Data Analytics Platform > Issue Type: Improvement > Components: mudrod >Reporter: Furkan KAMACI >Priority: Minor > Fix For: 0.1 > > Time Spent: 10m > Remaining Estimate: 0h > > Loggers should be used instead to print Throwable. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Work logged] (SDAP-199) Boxed Types Should Be Compared Using equals()
[ https://issues.apache.org/jira/browse/SDAP-199?focusedWorklogId=290324&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-290324 ] ASF GitHub Bot logged work on SDAP-199: --- Author: ASF GitHub Bot Created on: 07/Aug/19 09:17 Start Date: 07/Aug/19 09:17 Worklog Time Spent: 10m Work Description: kamaci commented on pull request #50: SDAP-199 equals() is used for String comparison. URL: https://github.com/apache/incubator-sdap-mudrod/pull/50 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 290324) Time Spent: 0.5h (was: 20m) > Boxed Types Should Be Compared Using equals() > - > > Key: SDAP-199 > URL: https://issues.apache.org/jira/browse/SDAP-199 > Project: Apache Science Data Analytics Platform > Issue Type: Bug > Components: mudrod >Reporter: Furkan KAMACI >Priority: Major > Fix For: 0.1 > > Time Spent: 0.5h > Remaining Estimate: 0h > > It's a mistake to compare two instances of boxed types like java.lang.Integer > using reference equality == or !=, because it is not comparing actual value > but locations in memory. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Work logged] (SDAP-198) InterruptedExceptions Should Never Be Ignored In the Code
[ https://issues.apache.org/jira/browse/SDAP-198?focusedWorklogId=290051&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-290051 ] ASF GitHub Bot logged work on SDAP-198: --- Author: ASF GitHub Bot Created on: 06/Aug/19 23:06 Start Date: 06/Aug/19 23:06 Worklog Time Spent: 10m Work Description: lewismc commented on pull request #46: SDAP-198 InterruptedExceptions are handled. URL: https://github.com/apache/incubator-sdap-mudrod/pull/46 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 290051) Time Spent: 20m (was: 10m) > InterruptedExceptions Should Never Be Ignored In the Code > - > > Key: SDAP-198 > URL: https://issues.apache.org/jira/browse/SDAP-198 > Project: Apache Science Data Analytics Platform > Issue Type: Bug > Components: mudrod >Reporter: Furkan KAMACI >Priority: Major > Fix For: 0.1 > > Time Spent: 20m > Remaining Estimate: 0h > > *InterruptedExceptions* should never be ignored in the code. Just logging the > exception or throwing another one clears the interrupted state of the Thread. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Work logged] (SDAP-199) Boxed Types Should Be Compared Using equals()
[ https://issues.apache.org/jira/browse/SDAP-199?focusedWorklogId=290050&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-290050 ] ASF GitHub Bot logged work on SDAP-199: --- Author: ASF GitHub Bot Created on: 06/Aug/19 23:05 Start Date: 06/Aug/19 23:05 Worklog Time Spent: 10m Work Description: lewismc commented on pull request #47: SDAP-199 equals() is used for java.lang.Integer instead of == or !=, because it is not comparing actual value but locations in memory. URL: https://github.com/apache/incubator-sdap-mudrod/pull/47 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 290050) Time Spent: 20m (was: 10m) > Boxed Types Should Be Compared Using equals() > - > > Key: SDAP-199 > URL: https://issues.apache.org/jira/browse/SDAP-199 > Project: Apache Science Data Analytics Platform > Issue Type: Bug > Components: mudrod >Reporter: Furkan KAMACI >Priority: Major > Fix For: 0.1 > > Time Spent: 20m > Remaining Estimate: 0h > > It's a mistake to compare two instances of boxed types like java.lang.Integer > using reference equality == or !=, because it is not comparing actual value > but locations in memory. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Work logged] (SDAP-199) Boxed Types Should Be Compared Using equals()
[ https://issues.apache.org/jira/browse/SDAP-199?focusedWorklogId=290041&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-290041 ] ASF GitHub Bot logged work on SDAP-199: --- Author: ASF GitHub Bot Created on: 06/Aug/19 22:52 Start Date: 06/Aug/19 22:52 Worklog Time Spent: 10m Work Description: kamaci commented on pull request #47: SDAP-199 equals() is used for java.lang.Integer instead of == or !=, because it is not comparing actual value but locations in memory. URL: https://github.com/apache/incubator-sdap-mudrod/pull/47 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 290041) Time Spent: 10m Remaining Estimate: 0h > Boxed Types Should Be Compared Using equals() > - > > Key: SDAP-199 > URL: https://issues.apache.org/jira/browse/SDAP-199 > Project: Apache Science Data Analytics Platform > Issue Type: Bug > Components: mudrod >Reporter: Furkan KAMACI >Priority: Major > Fix For: 0.1 > > Time Spent: 10m > Remaining Estimate: 0h > > It's a mistake to compare two instances of boxed types like java.lang.Integer > using reference equality == or !=, because it is not comparing actual value > but locations in memory. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Work logged] (SDAP-198) InterruptedExceptions Should Never Be Ignored In the Code
[ https://issues.apache.org/jira/browse/SDAP-198?focusedWorklogId=290039&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-290039 ] ASF GitHub Bot logged work on SDAP-198: --- Author: ASF GitHub Bot Created on: 06/Aug/19 22:44 Start Date: 06/Aug/19 22:44 Worklog Time Spent: 10m Work Description: kamaci commented on pull request #46: SDAP-198 InterruptedExceptions are handled. URL: https://github.com/apache/incubator-sdap-mudrod/pull/46 InterruptedExceptions should never be ignored in the code. Just logging the exception or throwing it clears the interrupted state of the Thread. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 290039) Time Spent: 10m Remaining Estimate: 0h > InterruptedExceptions Should Never Be Ignored In the Code > - > > Key: SDAP-198 > URL: https://issues.apache.org/jira/browse/SDAP-198 > Project: Apache Science Data Analytics Platform > Issue Type: Bug > Components: mudrod >Reporter: Furkan KAMACI >Priority: Major > Fix For: 0.1 > > Time Spent: 10m > Remaining Estimate: 0h > > *InterruptedExceptions* should never be ignored in the code. Just logging the > exception or throwing it clears the interrupted state of the Thread. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Work logged] (SDAP-182) Localization and Charset Definitions Should be Done
[ https://issues.apache.org/jira/browse/SDAP-182?focusedWorklogId=289990&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-289990 ] ASF GitHub Bot logged work on SDAP-182: --- Author: ASF GitHub Bot Created on: 06/Aug/19 21:02 Start Date: 06/Aug/19 21:02 Worklog Time Spent: 10m Work Description: lewismc commented on pull request #45: SDAP-182 Localization and charset definitions are done URL: https://github.com/apache/incubator-sdap-mudrod/pull/45 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 289990) Time Spent: 40m (was: 0.5h) > Localization and Charset Definitions Should be Done > --- > > Key: SDAP-182 > URL: https://issues.apache.org/jira/browse/SDAP-182 > Project: Apache Science Data Analytics Platform > Issue Type: Bug > Components: mudrod >Reporter: Furkan KAMACI >Priority: Major > Fix For: 0.1 > > Time Spent: 40m > Remaining Estimate: 0h > > We should apply localization and charset definition throughout the code base. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Work logged] (SDAP-182) Localization and Charset Definitions Should be Done
[ https://issues.apache.org/jira/browse/SDAP-182?focusedWorklogId=289989&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-289989 ] ASF GitHub Bot logged work on SDAP-182: --- Author: ASF GitHub Bot Created on: 06/Aug/19 21:02 Start Date: 06/Aug/19 21:02 Worklog Time Spent: 10m Work Description: lewismc commented on pull request #45: SDAP-182 Localization and charset definitions are done URL: https://github.com/apache/incubator-sdap-mudrod/pull/45 This issue fixes the missing Javadoc which was causing a build failure. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 289989) Time Spent: 0.5h (was: 20m) > Localization and Charset Definitions Should be Done > --- > > Key: SDAP-182 > URL: https://issues.apache.org/jira/browse/SDAP-182 > Project: Apache Science Data Analytics Platform > Issue Type: Bug > Components: mudrod >Reporter: Furkan KAMACI >Priority: Major > Fix For: 0.1 > > Time Spent: 0.5h > Remaining Estimate: 0h > > We should apply localization and charset definition throughout the code base. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Work logged] (SDAP-182) Localization and Charset Definitions Should be Done
[ https://issues.apache.org/jira/browse/SDAP-182?focusedWorklogId=289814&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-289814 ] ASF GitHub Bot logged work on SDAP-182: --- Author: ASF GitHub Bot Created on: 06/Aug/19 16:06 Start Date: 06/Aug/19 16:06 Worklog Time Spent: 10m Work Description: lewismc commented on pull request #42: SDAP-182 Localization and charset definitions are done. URL: https://github.com/apache/incubator-sdap-mudrod/pull/42 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 289814) Time Spent: 20m (was: 10m) > Localization and Charset Definitions Should be Done > --- > > Key: SDAP-182 > URL: https://issues.apache.org/jira/browse/SDAP-182 > Project: Apache Science Data Analytics Platform > Issue Type: Bug > Components: mudrod >Reporter: Furkan KAMACI >Priority: Major > Fix For: 0.1 > > Time Spent: 20m > Remaining Estimate: 0h > > We should apply localization and charset definition throughout the code base. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Work logged] (SDAP-197) Add quality flags to DOMS matchup output
[ https://issues.apache.org/jira/browse/SDAP-197?focusedWorklogId=283697&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-283697 ] ASF GitHub Bot logged work on SDAP-197: --- Author: ASF GitHub Bot Created on: 27/Jul/19 00:01 Start Date: 27/Jul/19 00:01 Worklog Time Spent: 10m Work Description: mayadebellis commented on pull request #73: SDAP-197 Add quality flags to DOMS matchup output URL: https://github.com/apache/incubator-sdap-nexus/pull/73 Implementation for quality flags in csv and netcdf output. (Still one known bug - these are floats in the netcdf instead of ints. For some reason causes a type error and breaks it. Looking into this but wanted to put in the PR for review.) This branch also includes all of the changes made in SDAP-194 (the depth implementation) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 283697) Time Spent: 10m Remaining Estimate: 0h > Add quality flags to DOMS matchup output > > > Key: SDAP-197 > URL: https://issues.apache.org/jira/browse/SDAP-197 > Project: Apache Science Data Analytics Platform > Issue Type: New Feature >Reporter: Maya DeBellis >Assignee: Maya DeBellis >Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Work logged] (SDAP-194) Implement new depth construction for DOMS matchup
[ https://issues.apache.org/jira/browse/SDAP-194?focusedWorklogId=277822&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-277822 ] ASF GitHub Bot logged work on SDAP-194: --- Author: ASF GitHub Bot Created on: 16/Jul/19 22:52 Start Date: 16/Jul/19 22:52 Worklog Time Spent: 10m Work Description: mayadebellis commented on pull request #72: SDAP-194: Implement new depth construction for DOMS matchup URL: https://github.com/apache/incubator-sdap-nexus/pull/72 https://issues.apache.org/jira/projects/SDAP/issues/SDAP-194 Depth implementation updated to follow agreed upon structure. This PR also includes some other bug fixes including https://issues.apache.org/jira/projects/SDAP/issues/SDAP-188 - the time was being generated incorrectly in the netCDF implementation and resulted in being off by 8hrs in all cases. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 277822) Time Spent: 10m Remaining Estimate: 0h > Implement new depth construction for DOMS matchup > - > > Key: SDAP-194 > URL: https://issues.apache.org/jira/browse/SDAP-194 > Project: Apache Science Data Analytics Platform > Issue Type: Bug >Reporter: Maya DeBellis >Assignee: Maya DeBellis >Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Work logged] (SDAP-196) Account for time when finding closest match
[ https://issues.apache.org/jira/browse/SDAP-196?focusedWorklogId=276483&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-276483 ] ASF GitHub Bot logged work on SDAP-196: --- Author: ASF GitHub Bot Created on: 15/Jul/19 05:19 Start Date: 15/Jul/19 05:19 Worklog Time Spent: 10m Work Description: fgreg commented on pull request #71: SDAP-196: take time into account when finding closest match URL: https://github.com/apache/incubator-sdap-nexus/pull/71 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 276483) Time Spent: 40m (was: 0.5h) > Account for time when finding closest match > --- > > Key: SDAP-196 > URL: https://issues.apache.org/jira/browse/SDAP-196 > Project: Apache Science Data Analytics Platform > Issue Type: Improvement > Components: nexus >Reporter: Frank Greguska >Assignee: Frank Greguska >Priority: Major > Time Spent: 40m > Remaining Estimate: 0h > > [https://github.com/apache/incubator-sdap-nexus/blob/584b2f5b91300fd0952cb4de32068a008c551936/analysis/webservice/algorithms_spark/Matchup.py#L467-L484] > > As you can see, we do only take into account spatial distance, not time > distance. This would be where we need to modify the code to also take into > account time distance when trying to find the closest match. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Work logged] (SDAP-196) Account for time when finding closest match
[ https://issues.apache.org/jira/browse/SDAP-196?focusedWorklogId=276482&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-276482 ] ASF GitHub Bot logged work on SDAP-196: --- Author: ASF GitHub Bot Created on: 15/Jul/19 05:19 Start Date: 15/Jul/19 05:19 Worklog Time Spent: 10m Work Description: fgreg commented on pull request #71: SDAP-196: take time into account when finding closest match URL: https://github.com/apache/incubator-sdap-nexus/pull/71 Use time to determine closest point if two points are same distance from primary. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 276482) Time Spent: 0.5h (was: 20m) > Account for time when finding closest match > --- > > Key: SDAP-196 > URL: https://issues.apache.org/jira/browse/SDAP-196 > Project: Apache Science Data Analytics Platform > Issue Type: Improvement > Components: nexus >Reporter: Frank Greguska >Assignee: Frank Greguska >Priority: Major > Time Spent: 0.5h > Remaining Estimate: 0h > > [https://github.com/apache/incubator-sdap-nexus/blob/584b2f5b91300fd0952cb4de32068a008c551936/analysis/webservice/algorithms_spark/Matchup.py#L467-L484] > > As you can see, we do only take into account spatial distance, not time > distance. This would be where we need to modify the code to also take into > account time distance when trying to find the closest match. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Work logged] (SDAP-196) Account for time when finding closest match
[ https://issues.apache.org/jira/browse/SDAP-196?focusedWorklogId=276481&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-276481 ] ASF GitHub Bot logged work on SDAP-196: --- Author: ASF GitHub Bot Created on: 15/Jul/19 05:18 Start Date: 15/Jul/19 05:18 Worklog Time Spent: 10m Work Description: fgreg commented on pull request #70: SDAP-196: Account for time when finding closest match URL: https://github.com/apache/incubator-sdap-nexus/pull/70 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 276481) Time Spent: 20m (was: 10m) > Account for time when finding closest match > --- > > Key: SDAP-196 > URL: https://issues.apache.org/jira/browse/SDAP-196 > Project: Apache Science Data Analytics Platform > Issue Type: Improvement > Components: nexus >Reporter: Frank Greguska >Assignee: Frank Greguska >Priority: Major > Time Spent: 20m > Remaining Estimate: 0h > > [https://github.com/apache/incubator-sdap-nexus/blob/584b2f5b91300fd0952cb4de32068a008c551936/analysis/webservice/algorithms_spark/Matchup.py#L467-L484] > > As you can see, we do only take into account spatial distance, not time > distance. This would be where we need to modify the code to also take into > account time distance when trying to find the closest match. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Work logged] (SDAP-196) Account for time when finding closest match
[ https://issues.apache.org/jira/browse/SDAP-196?focusedWorklogId=276480&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-276480 ] ASF GitHub Bot logged work on SDAP-196: --- Author: ASF GitHub Bot Created on: 15/Jul/19 05:18 Start Date: 15/Jul/19 05:18 Worklog Time Spent: 10m Work Description: fgreg commented on pull request #70: SDAP-196: Account for time when finding closest match URL: https://github.com/apache/incubator-sdap-nexus/pull/70 Use time to determine closest point if two points are same distance from primary. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 276480) Time Spent: 10m Remaining Estimate: 0h > Account for time when finding closest match > --- > > Key: SDAP-196 > URL: https://issues.apache.org/jira/browse/SDAP-196 > Project: Apache Science Data Analytics Platform > Issue Type: Improvement > Components: nexus >Reporter: Frank Greguska >Assignee: Frank Greguska >Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > > [https://github.com/apache/incubator-sdap-nexus/blob/584b2f5b91300fd0952cb4de32068a008c551936/analysis/webservice/algorithms_spark/Matchup.py#L467-L484] > > As you can see, we do only take into account spatial distance, not time > distance. This would be where we need to modify the code to also take into > account time distance when trying to find the closest match. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Work logged] (SDAP-192) Create DOMS netCDF reader tool
[ https://issues.apache.org/jira/browse/SDAP-192?focusedWorklogId=276476&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-276476 ] ASF GitHub Bot logged work on SDAP-192: --- Author: ASF GitHub Bot Created on: 15/Jul/19 05:11 Start Date: 15/Jul/19 05:11 Worklog Time Spent: 10m Work Description: fgreg commented on pull request #69: SDAP-192 Created DOMS netCDF reader tool. (#68) URL: https://github.com/apache/incubator-sdap-nexus/pull/69 * SDAP-192 Created DOMS netCDF reader tool. * SDAP-192 DOMS netCDF reader updated to use num2date function to get datetime object from timestamp. * SDAP-192 Added logging to DOMS netCDF reader tool. * SDAP-192 Miscellaneous variable updates with DOMS netCDF reader. * SDAP-192 'try/except' blocks around 'with' statements for netCDF and CSV file handling. Changed name of CSV file output from main. Moved print statement. * SDAP-192 Changed print to LOGGER.info in DOMS netCDF reader. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 276476) Time Spent: 20m (was: 10m) > Create DOMS netCDF reader tool > -- > > Key: SDAP-192 > URL: https://issues.apache.org/jira/browse/SDAP-192 > Project: Apache Science Data Analytics Platform > Issue Type: New Feature > Components: doms >Reporter: Jocelyn Elya >Priority: Major > Time Spent: 20m > Remaining Estimate: 0h > > Create a reader tool for the DOMS netCDF output files to load data into > memory and assemble satellite-to-in situ matched data pairs from separate > groups. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Work logged] (SDAP-192) Create DOMS netCDF reader tool
[ https://issues.apache.org/jira/browse/SDAP-192?focusedWorklogId=276477&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-276477 ] ASF GitHub Bot logged work on SDAP-192: --- Author: ASF GitHub Bot Created on: 15/Jul/19 05:11 Start Date: 15/Jul/19 05:11 Worklog Time Spent: 10m Work Description: fgreg commented on pull request #69: SDAP-192 Created DOMS netCDF reader tool. (#68) URL: https://github.com/apache/incubator-sdap-nexus/pull/69 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 276477) Time Spent: 0.5h (was: 20m) > Create DOMS netCDF reader tool > -- > > Key: SDAP-192 > URL: https://issues.apache.org/jira/browse/SDAP-192 > Project: Apache Science Data Analytics Platform > Issue Type: New Feature > Components: doms >Reporter: Jocelyn Elya >Priority: Major > Time Spent: 0.5h > Remaining Estimate: 0h > > Create a reader tool for the DOMS netCDF output files to load data into > memory and assemble satellite-to-in situ matched data pairs from separate > groups. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Work logged] (SDAP-195) EDGE updates to support SAMOS quality control flags
[ https://issues.apache.org/jira/browse/SDAP-195?focusedWorklogId=262538&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-262538 ] ASF GitHub Bot logged work on SDAP-195: --- Author: ASF GitHub Bot Created on: 18/Jun/19 18:04 Start Date: 18/Jun/19 18:04 Worklog Time Spent: 10m Work Description: ntquach commented on pull request #4: SDAP-195: Updates to quality control flagging fields for winds in plugins for the SAMOS node URL: https://github.com/apache/incubator-sdap-edge/pull/4 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 262538) Time Spent: 20m (was: 10m) > EDGE updates to support SAMOS quality control flags > --- > > Key: SDAP-195 > URL: https://issues.apache.org/jira/browse/SDAP-195 > Project: Apache Science Data Analytics Platform > Issue Type: Bug >Reporter: Jocelyn Elya >Priority: Major > Time Spent: 20m > Remaining Estimate: 0h > > Updates to the SAMOS plugins to support new fields for IODE quality control > flags on wind. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (SDAP-195) EDGE updates to support SAMOS quality control flags
[ https://issues.apache.org/jira/browse/SDAP-195?focusedWorklogId=261666&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-261666 ] ASF GitHub Bot logged work on SDAP-195: --- Author: ASF GitHub Bot Created on: 17/Jun/19 18:51 Start Date: 17/Jun/19 18:51 Worklog Time Spent: 10m Work Description: jelya commented on pull request #4: SDAP-195: Updates to quality control flagging fields for winds in plugins for the SAMOS node URL: https://github.com/apache/incubator-sdap-edge/pull/4 To align with the updates to the SAMOS Solr index to support QC fields, the wind_quality field name was corrected to wind_speed_quality, and wind_direction_quality was corrected to wind_component_quality. And the mapping from logical to numeric values for these fields is no longer necessary after the updates to our Solr index. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 261666) Time Spent: 10m Remaining Estimate: 0h > EDGE updates to support SAMOS quality control flags > --- > > Key: SDAP-195 > URL: https://issues.apache.org/jira/browse/SDAP-195 > Project: Apache Science Data Analytics Platform > Issue Type: Bug >Reporter: Jocelyn Elya >Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > > Updates to the SAMOS plugins to support new fields for IODE quality control > flags on wind. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (SDAP-192) Create DOMS netCDF reader tool
[ https://issues.apache.org/jira/browse/SDAP-192?focusedWorklogId=222456&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-222456 ] ASF GitHub Bot logged work on SDAP-192: --- Author: ASF GitHub Bot Created on: 03/Apr/19 17:55 Start Date: 03/Apr/19 17:55 Worklog Time Spent: 10m Work Description: fgreg commented on pull request #68: SDAP-192 Created DOMS netCDF reader tool. URL: https://github.com/apache/incubator-sdap-nexus/pull/68 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 222456) Time Spent: 10m Remaining Estimate: 0h > Create DOMS netCDF reader tool > -- > > Key: SDAP-192 > URL: https://issues.apache.org/jira/browse/SDAP-192 > Project: Apache Science Data Analytics Platform > Issue Type: New Feature > Components: doms >Reporter: Jocelyn Elya >Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > > Create a reader tool for the DOMS netCDF output files to load data into > memory and assemble satellite-to-in situ matched data pairs from separate > groups. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (SDAP-176) Modify Solr Queries to include quality flags and new IODE flags
[ https://issues.apache.org/jira/browse/SDAP-176?focusedWorklogId=218169&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-218169 ] ASF GitHub Bot logged work on SDAP-176: --- Author: ASF GitHub Bot Created on: 25/Mar/19 17:32 Start Date: 25/Mar/19 17:32 Worklog Time Spent: 10m Work Description: fgreg commented on pull request #3: SDAP-176 Quality flag filtering on Solr search URL: https://github.com/apache/incubator-sdap-edge/pull/3 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 218169) Time Spent: 10m Remaining Estimate: 0h > Modify Solr Queries to include quality flags and new IODE flags > --- > > Key: SDAP-176 > URL: https://issues.apache.org/jira/browse/SDAP-176 > Project: Apache Science Data Analytics Platform > Issue Type: Task >Reporter: Elizabeth Yam >Assignee: Elizabeth Yam >Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (SDAP-169) Update passthrough plugin to use defaults for some HTTP headers
[ https://issues.apache.org/jira/browse/SDAP-169?focusedWorklogId=218166&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-218166 ] ASF GitHub Bot logged work on SDAP-169: --- Author: ASF GitHub Bot Created on: 25/Mar/19 17:30 Start Date: 25/Mar/19 17:30 Worklog Time Spent: 10m Work Description: fgreg commented on pull request #2: SDAP-169 Update passthrough plugin headers URL: https://github.com/apache/incubator-sdap-edge/pull/2 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 218166) Time Spent: 20m (was: 10m) > Update passthrough plugin to use defaults for some HTTP headers > --- > > Key: SDAP-169 > URL: https://issues.apache.org/jira/browse/SDAP-169 > Project: Apache Science Data Analytics Platform > Issue Type: Bug > Components: edge >Reporter: Frank Greguska >Assignee: Maya DeBellis >Priority: Minor > Time Spent: 20m > Remaining Estimate: 0h > > The passthrough EDGE plugin should set a default for some HTTP headers: > "User-Agent": "Tornado" > "Accept": "*" > > Changes should be implemented here: > [https://github.com/apache/incubator-sdap-edge/blob/master/src/main/python/libraries/edge/httputility.py] > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (SDAP-187) webapp : Impossible to change Cassandra cluster CQL port
[ https://issues.apache.org/jira/browse/SDAP-187?focusedWorklogId=216519&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-216519 ] ASF GitHub Bot logged work on SDAP-187: --- Author: ASF GitHub Bot Created on: 20/Mar/19 22:55 Start Date: 20/Mar/19 22:55 Worklog Time Spent: 10m Work Description: fgreg commented on pull request #66: SDAP-187 Unable to change cassandra port URL: https://github.com/apache/incubator-sdap-nexus/pull/66 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 216519) Time Spent: 10m Remaining Estimate: 0h > webapp : Impossible to change Cassandra cluster CQL port > > > Key: SDAP-187 > URL: https://issues.apache.org/jira/browse/SDAP-187 > Project: Apache Science Data Analytics Platform > Issue Type: Improvement > Components: nexus >Reporter: Antoine Queric >Priority: Minor > Time Spent: 10m > Remaining Estimate: 0h > > It is not possible to change the Cassandra CQL port (9042). > Tried following configuration values for host : > * "host:port,host:port" > * "host port,host port" > It would be convenient to specify the port directly in the configuration file > and/or via docker ENV variables. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (SDAP-191) Remove Access-Control-Allow-Origin :*
[ https://issues.apache.org/jira/browse/SDAP-191?focusedWorklogId=216518&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-216518 ] ASF GitHub Bot logged work on SDAP-191: --- Author: ASF GitHub Bot Created on: 20/Mar/19 22:54 Start Date: 20/Mar/19 22:54 Worklog Time Spent: 10m Work Description: fgreg commented on pull request #67: SDAP-191 Remove Access-Control-Allow-Origin :* URL: https://github.com/apache/incubator-sdap-nexus/pull/67 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 216518) Time Spent: 20m (was: 10m) > Remove Access-Control-Allow-Origin :* > - > > Key: SDAP-191 > URL: https://issues.apache.org/jira/browse/SDAP-191 > Project: Apache Science Data Analytics Platform > Issue Type: Bug > Components: nexus >Reporter: Frank Greguska >Assignee: Frank Greguska >Priority: Critical > Time Spent: 20m > Remaining Estimate: 0h > > The web server should not be setting Access-Control-Allow-Origin: * > > https://github.com/apache/incubator-sdap-nexus/blob/be19c1d567301b09269e851cc5b5af55fea02c5d/analysis/webservice/webapp.py#L59 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (SDAP-191) Remove Access-Control-Allow-Origin :*
[ https://issues.apache.org/jira/browse/SDAP-191?focusedWorklogId=216517&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-216517 ] ASF GitHub Bot logged work on SDAP-191: --- Author: ASF GitHub Bot Created on: 20/Mar/19 22:54 Start Date: 20/Mar/19 22:54 Worklog Time Spent: 10m Work Description: fgreg commented on pull request #67: SDAP-191 Remove Access-Control-Allow-Origin :* URL: https://github.com/apache/incubator-sdap-nexus/pull/67 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 216517) Time Spent: 10m Remaining Estimate: 0h > Remove Access-Control-Allow-Origin :* > - > > Key: SDAP-191 > URL: https://issues.apache.org/jira/browse/SDAP-191 > Project: Apache Science Data Analytics Platform > Issue Type: Bug > Components: nexus >Reporter: Frank Greguska >Assignee: Frank Greguska >Priority: Critical > Time Spent: 10m > Remaining Estimate: 0h > > The web server should not be setting Access-Control-Allow-Origin: * > > https://github.com/apache/incubator-sdap-nexus/blob/be19c1d567301b09269e851cc5b5af55fea02c5d/analysis/webservice/webapp.py#L59 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (SDAP-185) Clean Up code base
[ https://issues.apache.org/jira/browse/SDAP-185?focusedWorklogId=208951&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-208951 ] ASF GitHub Bot logged work on SDAP-185: --- Author: ASF GitHub Bot Created on: 06/Mar/19 16:41 Start Date: 06/Mar/19 16:41 Worklog Time Spent: 10m Work Description: lewismc commented on pull request #43: SDAP-185: Clean up code base URL: https://github.com/apache/incubator-sdap-mudrod/pull/43 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 208951) Time Spent: 20m (was: 10m) > Clean Up code base > -- > > Key: SDAP-185 > URL: https://issues.apache.org/jira/browse/SDAP-185 > Project: Apache Science Data Analytics Platform > Issue Type: Task > Components: mudrod >Reporter: Kevin Ratnasekera >Priority: Minor > Time Spent: 20m > Remaining Estimate: 0h > > Remove wild card imports, add missing license headers, improve custom error > logs, improve access modifiers and fix formatting issues. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (SDAP-186) Add Cosine distance as vector similarity measure
[ https://issues.apache.org/jira/browse/SDAP-186?focusedWorklogId=208948&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-208948 ] ASF GitHub Bot logged work on SDAP-186: --- Author: ASF GitHub Bot Created on: 06/Mar/19 16:40 Start Date: 06/Mar/19 16:40 Worklog Time Spent: 10m Work Description: lewismc commented on pull request #44: SDAP-186 : Add Cosine distance as vector similarity measure URL: https://github.com/apache/incubator-sdap-mudrod/pull/44 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 208948) Time Spent: 20m (was: 10m) > Add Cosine distance as vector similarity measure > > > Key: SDAP-186 > URL: https://issues.apache.org/jira/browse/SDAP-186 > Project: Apache Science Data Analytics Platform > Issue Type: Improvement > Components: mudrod >Reporter: Kevin Ratnasekera >Priority: Major > Time Spent: 20m > Remaining Estimate: 0h > > Current cosine distance calculation is incomplete. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (SDAP-186) Add Cosine distance as vector similarity measure
[ https://issues.apache.org/jira/browse/SDAP-186?focusedWorklogId=203492&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-203492 ] ASF GitHub Bot logged work on SDAP-186: --- Author: ASF GitHub Bot Created on: 25/Feb/19 08:39 Start Date: 25/Feb/19 08:39 Worklog Time Spent: 10m Work Description: djkevincr commented on pull request #44: SDAP-186 : Add Cosine distance as vector similarity measure URL: https://github.com/apache/incubator-sdap-mudrod/pull/44 Add Cosine distance as vector similarity measure. This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 203492) Time Spent: 10m Remaining Estimate: 0h > Add Cosine distance as vector similarity measure > > > Key: SDAP-186 > URL: https://issues.apache.org/jira/browse/SDAP-186 > Project: Apache Science Data Analytics Platform > Issue Type: Improvement > Components: mudrod >Reporter: Kevin Ratnasekera >Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > > Current cosine distance calculation is incomplete. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (SDAP-185) Clean Up code base
[ https://issues.apache.org/jira/browse/SDAP-185?focusedWorklogId=201489&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-201489 ] ASF GitHub Bot logged work on SDAP-185: --- Author: ASF GitHub Bot Created on: 20/Feb/19 18:04 Start Date: 20/Feb/19 18:04 Worklog Time Spent: 10m Work Description: djkevincr commented on pull request #43: SDAP-185: Clean up code base URL: https://github.com/apache/incubator-sdap-mudrod/pull/43 Removed wild card imports, added missing license headers, improved custom error logs, improved access modifiers and some formatting. This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 201489) Time Spent: 10m Remaining Estimate: 0h > Clean Up code base > -- > > Key: SDAP-185 > URL: https://issues.apache.org/jira/browse/SDAP-185 > Project: Apache Science Data Analytics Platform > Issue Type: Task > Components: mudrod >Reporter: Kevin Ratnasekera >Priority: Minor > Time Spent: 10m > Remaining Estimate: 0h > > Removed wild card imports, added missing license headers, improved custom > error logs, improved access modifiers and some formatting. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (SDAP-181) REST Methods Should be Public
[ https://issues.apache.org/jira/browse/SDAP-181?focusedWorklogId=198285&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-198285 ] ASF GitHub Bot logged work on SDAP-181: --- Author: ASF GitHub Bot Created on: 13/Feb/19 19:35 Start Date: 13/Feb/19 19:35 Worklog Time Spent: 10m Work Description: lewismc commented on pull request #41: SDAP-181 Method visibility is fixed. URL: https://github.com/apache/incubator-sdap-mudrod/pull/41 This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 198285) Time Spent: 20m (was: 10m) > REST Methods Should be Public > - > > Key: SDAP-181 > URL: https://issues.apache.org/jira/browse/SDAP-181 > Project: Apache Science Data Analytics Platform > Issue Type: Bug > Components: mudrod >Reporter: Furkan KAMACI >Priority: Major > Fix For: 0.1 > > Time Spent: 20m > Remaining Estimate: 0h > > searchSessionDetail() method in SessionDetailResource.java is not public and > should be fixed. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (SDAP-180) Fix Broken Tests
[ https://issues.apache.org/jira/browse/SDAP-180?focusedWorklogId=198284&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-198284 ] ASF GitHub Bot logged work on SDAP-180: --- Author: ASF GitHub Bot Created on: 13/Feb/19 19:32 Start Date: 13/Feb/19 19:32 Worklog Time Spent: 10m Work Description: lewismc commented on pull request #40: SDAP-180 fixes failed test for Apache access logs. URL: https://github.com/apache/incubator-sdap-mudrod/pull/40 This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 198284) Time Spent: 20m (was: 10m) > Fix Broken Tests > > > Key: SDAP-180 > URL: https://issues.apache.org/jira/browse/SDAP-180 > Project: Apache Science Data Analytics Platform > Issue Type: Bug > Components: mudrod >Reporter: Furkan KAMACI >Priority: Critical > Fix For: 0.1 > > Time Spent: 20m > Remaining Estimate: 0h > > Tests are broken since ApacheAccessLog.java is updated to handle referrer and > browser but related test access log line at TestApacheAccessLog.java is not > updated. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (SDAP-182) Localization and Charset Definitions Should be Done
[ https://issues.apache.org/jira/browse/SDAP-182?focusedWorklogId=198166&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-198166 ] ASF GitHub Bot logged work on SDAP-182: --- Author: ASF GitHub Bot Created on: 13/Feb/19 15:45 Start Date: 13/Feb/19 15:45 Worklog Time Spent: 10m Work Description: kamaci commented on pull request #42: SDAP-182 Localization and charset definitions are done. URL: https://github.com/apache/incubator-sdap-mudrod/pull/42 This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 198166) Time Spent: 10m Remaining Estimate: 0h > Localization and Charset Definitions Should be Done > --- > > Key: SDAP-182 > URL: https://issues.apache.org/jira/browse/SDAP-182 > Project: Apache Science Data Analytics Platform > Issue Type: Bug > Components: mudrod >Reporter: Furkan KAMACI >Priority: Major > Fix For: 0.1 > > Time Spent: 10m > Remaining Estimate: 0h > > We should apply localization and charset definition throughout the code base. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (SDAP-181) REST Methods Should be Public
[ https://issues.apache.org/jira/browse/SDAP-181?focusedWorklogId=198038&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-198038 ] ASF GitHub Bot logged work on SDAP-181: --- Author: ASF GitHub Bot Created on: 13/Feb/19 11:51 Start Date: 13/Feb/19 11:51 Worklog Time Spent: 10m Work Description: kamaci commented on pull request #41: SDAP-181 Method visibility is fixed. URL: https://github.com/apache/incubator-sdap-mudrod/pull/41 This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 198038) Time Spent: 10m Remaining Estimate: 0h > REST Methods Should be Public > - > > Key: SDAP-181 > URL: https://issues.apache.org/jira/browse/SDAP-181 > Project: Apache Science Data Analytics Platform > Issue Type: Bug > Components: mudrod >Reporter: Furkan KAMACI >Priority: Major > Fix For: 0.1 > > Time Spent: 10m > Remaining Estimate: 0h > > searchSessionDetail() method in SessionDetailResource.java is not public and > should be fixed. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (SDAP-180) Fix Broken Tests
[ https://issues.apache.org/jira/browse/SDAP-180?focusedWorklogId=197981&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-197981 ] ASF GitHub Bot logged work on SDAP-180: --- Author: ASF GitHub Bot Created on: 13/Feb/19 08:06 Start Date: 13/Feb/19 08:06 Worklog Time Spent: 10m Work Description: kamaci commented on pull request #40: SDAP-180 fixes failed test for Apache access logs. URL: https://github.com/apache/incubator-sdap-mudrod/pull/40 This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 197981) Time Spent: 10m Remaining Estimate: 0h > Fix Broken Tests > > > Key: SDAP-180 > URL: https://issues.apache.org/jira/browse/SDAP-180 > Project: Apache Science Data Analytics Platform > Issue Type: Bug > Components: mudrod >Reporter: Furkan KAMACI >Priority: Critical > Fix For: 0.1 > > Time Spent: 10m > Remaining Estimate: 0h > > Tests are broken since ApacheAccessLog.java is updated to handle referrer and > browser but related test access log line at TestApacheAccessLog.java is not > updated. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (SDAP-166) Update SolrCloud Docker Image
[ https://issues.apache.org/jira/browse/SDAP-166?focusedWorklogId=189079&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-189079 ] ASF GitHub Bot logged work on SDAP-166: --- Author: ASF GitHub Bot Created on: 23/Jan/19 17:27 Start Date: 23/Jan/19 17:27 Worklog Time Spent: 10m Work Description: fgreg commented on pull request #63: SDAP-166 SolrCloud Docker Image URL: https://github.com/apache/incubator-sdap-nexus/pull/63 This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 189079) Time Spent: 20m (was: 10m) > Update SolrCloud Docker Image > - > > Key: SDAP-166 > URL: https://issues.apache.org/jira/browse/SDAP-166 > Project: Apache Science Data Analytics Platform > Issue Type: Improvement > Components: nexus >Reporter: Frank Greguska >Assignee: Frank Greguska >Priority: Major > Fix For: 1.0 > > Time Spent: 20m > Remaining Estimate: 0h > > We need an updated SolrCloud image that will allow us to launch an instance > of SolrCloud. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (SDAP-173) Fix Hovmoller code reporting missing get_spark_cfg attribute
[
https://issues.apache.org/jira/browse/SDAP-173?focusedWorklogId=185365&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-185365
]
ASF GitHub Bot logged work on SDAP-173:
---
Author: ASF GitHub Bot
Created on: 15/Jan/19 18:07
Start Date: 15/Jan/19 18:07
Worklog Time Spent: 10m
Work Description: fgreg commented on pull request #65: SDAP-173 Fix
Hovmoller code reporting missing get_spark_cfg attribute
URL: https://github.com/apache/incubator-sdap-nexus/pull/65
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 185365)
Time Spent: 40m (was: 0.5h)
> Fix Hovmoller code reporting missing get_spark_cfg attribute
>
>
> Key: SDAP-173
> URL: https://issues.apache.org/jira/browse/SDAP-173
> Project: Apache Science Data Analytics Platform
> Issue Type: Bug
> Components: nexus
>Reporter: Frank Greguska
>Assignee: Joseph Jacob
>Priority: Major
> Time Spent: 40m
> Remaining Estimate: 0h
>
> Changes introduced in
> [https://github.com/apache/incubator-sdap-nexus/pull/50]
> broke Hovmoller implementation. Need to update. Error is:
>
> { "code": 500, "error": "'NexusRequestObject' object has no attribute
> 'get_spark_cfg'" }
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Work logged] (SDAP-173) Fix Hovmoller code reporting missing get_spark_cfg attribute
[
https://issues.apache.org/jira/browse/SDAP-173?focusedWorklogId=185073&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-185073
]
ASF GitHub Bot logged work on SDAP-173:
---
Author: ASF GitHub Bot
Created on: 15/Jan/19 01:40
Start Date: 15/Jan/19 01:40
Worklog Time Spent: 10m
Work Description: jjacob7734 commented on pull request #65: SDAP-173 Fix
Hovmoller code reporting missing get_spark_cfg attribute
URL: https://github.com/apache/incubator-sdap-nexus/pull/65
I removed the obsolete get_spark_cfg call from the Hovmoller code since none
of those spark attributes are used.
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 185073)
Time Spent: 0.5h (was: 20m)
> Fix Hovmoller code reporting missing get_spark_cfg attribute
>
>
> Key: SDAP-173
> URL: https://issues.apache.org/jira/browse/SDAP-173
> Project: Apache Science Data Analytics Platform
> Issue Type: Bug
> Components: nexus
>Reporter: Frank Greguska
>Assignee: Joseph Jacob
>Priority: Major
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> Changes introduced in
> [https://github.com/apache/incubator-sdap-nexus/pull/50]
> broke Hovmoller implementation. Need to update. Error is:
>
> { "code": 500, "error": "'NexusRequestObject' object has no attribute
> 'get_spark_cfg'" }
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Work logged] (SDAP-173) Fix Hovmoller code reporting missing get_spark_cfg attribute
[
https://issues.apache.org/jira/browse/SDAP-173?focusedWorklogId=185068&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-185068
]
ASF GitHub Bot logged work on SDAP-173:
---
Author: ASF GitHub Bot
Created on: 15/Jan/19 01:27
Start Date: 15/Jan/19 01:27
Worklog Time Spent: 10m
Work Description: jjacob7734 commented on pull request #64: SDAP-173 Fix
Hovmoller code reporting missing get_spark_cfg attribute
URL: https://github.com/apache/incubator-sdap-nexus/pull/64
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 185068)
Time Spent: 20m (was: 10m)
> Fix Hovmoller code reporting missing get_spark_cfg attribute
>
>
> Key: SDAP-173
> URL: https://issues.apache.org/jira/browse/SDAP-173
> Project: Apache Science Data Analytics Platform
> Issue Type: Bug
> Components: nexus
>Reporter: Frank Greguska
>Assignee: Joseph Jacob
>Priority: Major
> Time Spent: 20m
> Remaining Estimate: 0h
>
> Changes introduced in
> [https://github.com/apache/incubator-sdap-nexus/pull/50]
> broke Hovmoller implementation. Need to update. Error is:
>
> { "code": 500, "error": "'NexusRequestObject' object has no attribute
> 'get_spark_cfg'" }
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Work logged] (SDAP-173) Fix Hovmoller code reporting missing get_spark_cfg attribute
[
https://issues.apache.org/jira/browse/SDAP-173?focusedWorklogId=185065&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-185065
]
ASF GitHub Bot logged work on SDAP-173:
---
Author: ASF GitHub Bot
Created on: 15/Jan/19 01:19
Start Date: 15/Jan/19 01:19
Worklog Time Spent: 10m
Work Description: jjacob7734 commented on pull request #64: SDAP-173 Fix
Hovmoller code reporting missing get_spark_cfg attribute
URL: https://github.com/apache/incubator-sdap-nexus/pull/64
The spark configuration is no longer used and isn't needed in Hovmoller, so
I simply removed it.
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 185065)
Time Spent: 10m
Remaining Estimate: 0h
> Fix Hovmoller code reporting missing get_spark_cfg attribute
>
>
> Key: SDAP-173
> URL: https://issues.apache.org/jira/browse/SDAP-173
> Project: Apache Science Data Analytics Platform
> Issue Type: Bug
> Components: nexus
>Reporter: Frank Greguska
>Assignee: Joseph Jacob
>Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Changes introduced in
> [https://github.com/apache/incubator-sdap-nexus/pull/50]
> broke Hovmoller implementation. Need to update. Error is:
>
> { "code": 500, "error": "'NexusRequestObject' object has no attribute
> 'get_spark_cfg'" }
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Work logged] (SDAP-166) Update SolrCloud Docker Image
[ https://issues.apache.org/jira/browse/SDAP-166?focusedWorklogId=184455&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-184455 ] ASF GitHub Bot logged work on SDAP-166: --- Author: ASF GitHub Bot Created on: 12/Jan/19 01:31 Start Date: 12/Jan/19 01:31 Worklog Time Spent: 10m Work Description: fgreg commented on pull request #63: SDAP-166 SolrCloud Docker Image URL: https://github.com/apache/incubator-sdap-nexus/pull/63 This PR encapsulates all of the work done to create a working SolrCloud image that is able to initialize a nexustiles collection. This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 184455) Time Spent: 10m Remaining Estimate: 0h > Update SolrCloud Docker Image > - > > Key: SDAP-166 > URL: https://issues.apache.org/jira/browse/SDAP-166 > Project: Apache Science Data Analytics Platform > Issue Type: Improvement > Components: nexus >Reporter: Frank Greguska >Assignee: Frank Greguska >Priority: Major > Fix For: 1.0 > > Time Spent: 10m > Remaining Estimate: 0h > > We need an updated SolrCloud image that will allow us to launch an instance > of SolrCloud. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (SDAP-105) Implement netCDF output for matchup
[ https://issues.apache.org/jira/browse/SDAP-105?focusedWorklogId=184422&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-184422 ] ASF GitHub Bot logged work on SDAP-105: --- Author: ASF GitHub Bot Created on: 11/Jan/19 23:44 Start Date: 11/Jan/19 23:44 Worklog Time Spent: 10m Work Description: fgreg commented on pull request #61: SDAP-105 DOMS matchup netcdf and csv generation URL: https://github.com/apache/incubator-sdap-nexus/pull/61 This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 184422) Time Spent: 20m (was: 10m) > Implement netCDF output for matchup > --- > > Key: SDAP-105 > URL: https://issues.apache.org/jira/browse/SDAP-105 > Project: Apache Science Data Analytics Platform > Issue Type: New Feature > Components: doms >Reporter: Frank Greguska >Assignee: Maya DeBellis >Priority: Major > Time Spent: 20m > Remaining Estimate: 0h > > Need to implement netcdf output for the matchup algorithm. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (SDAP-169) Update passthrough plugin to use defaults for some HTTP headers
[ https://issues.apache.org/jira/browse/SDAP-169?focusedWorklogId=177812&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-177812 ] ASF GitHub Bot logged work on SDAP-169: --- Author: ASF GitHub Bot Created on: 21/Dec/18 00:07 Start Date: 21/Dec/18 00:07 Worklog Time Spent: 10m Work Description: mayadebellis opened a new pull request #2: SDAP-169 Update passthrough plugin headers URL: https://github.com/apache/incubator-sdap-edge/pull/2 Update passthrough plugin to use defaults for some HTTP headers This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 177812) Time Spent: 10m Remaining Estimate: 0h > Update passthrough plugin to use defaults for some HTTP headers > --- > > Key: SDAP-169 > URL: https://issues.apache.org/jira/browse/SDAP-169 > Project: Apache Science Data Analytics Platform > Issue Type: Bug > Components: edge >Reporter: Frank Greguska >Assignee: Maya DeBellis >Priority: Minor > Time Spent: 10m > Remaining Estimate: 0h > > The passthrough EDGE plugin should set a default for some HTTP headers: > "User-Agent": "Tornado" > "Accept": "*" > > Changes should be implemented here: > [https://github.com/apache/incubator-sdap-edge/blob/master/src/main/python/libraries/edge/httputility.py] > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (SDAP-105) Implement netCDF output for matchup
[ https://issues.apache.org/jira/browse/SDAP-105?focusedWorklogId=176167&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-176167 ] ASF GitHub Bot logged work on SDAP-105: --- Author: ASF GitHub Bot Created on: 17/Dec/18 18:13 Start Date: 17/Dec/18 18:13 Worklog Time Spent: 10m Work Description: mayadebellis opened a new pull request #61: SDAP-105 DOMS matchup netcdf and csv generation URL: https://github.com/apache/incubator-sdap-nexus/pull/61 Still need to go over a few things with Vardis on fine tuning some variables, but put in a PR so everyone can see it and make comments. This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 176167) Time Spent: 10m Remaining Estimate: 0h > Implement netCDF output for matchup > --- > > Key: SDAP-105 > URL: https://issues.apache.org/jira/browse/SDAP-105 > Project: Apache Science Data Analytics Platform > Issue Type: New Feature > Components: doms >Reporter: Frank Greguska >Assignee: Maya DeBellis >Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > > Need to implement netcdf output for the matchup algorithm. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (SDAP-161) MUDROD embedded unit test
[ https://issues.apache.org/jira/browse/SDAP-161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16715103#comment-16715103 ] ASF GitHub Bot commented on SDAP-161: - quintinali commented on issue #35: SDAP-161 MUDROD embedded unit test URL: https://github.com/apache/incubator-sdap-mudrod/pull/35#issuecomment-445891269 @lewismc I revised code based on your comments. Please take a look at the embedded elasticsearch engine when you have time. Thanks. For the compressed logs, MUDROD has the capability to decompress them. Please check the attached figure.  This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > MUDROD embedded unit test > - > > Key: SDAP-161 > URL: https://issues.apache.org/jira/browse/SDAP-161 > Project: Apache Science Data Analytics Platform > Issue Type: Improvement > Components: mudrod >Affects Versions: 1.0 >Reporter: Yun Li >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (SDAP-161) MUDROD embedded unit test
[
https://issues.apache.org/jira/browse/SDAP-161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16714993#comment-16714993
]
ASF GitHub Bot commented on SDAP-161:
-
quintinali commented on a change in pull request #35: SDAP-161 MUDROD embedded
unit test
URL:
https://github.com/apache/incubator-sdap-mudrod/pull/35#discussion_r240271668
##
File path:
core/src/test/java/org/apache/sdap/mudrod/weblog/structure/log/GeoIpTest.java
##
@@ -0,0 +1,18 @@
+package org.apache.sdap.mudrod.weblog.structure.log;
+
+import static org.junit.Assert.*;
+
+import org.junit.Assert;
+import org.junit.Test;
+
+public class GeoIpTest {
+
+ @Test
+ public void testToLocation() {
+ GeoIp ip = new GeoIp();
+ String iptest = "185.10.104.194";
+ Coordinates result = ip.toLocation(iptest);
+ Assert.assertEquals("failed in geoip function!",
"22.283001,114.150002", result.latlon);
+ }
+
+}
Review comment:
I remembered that @fgreg has added a function of decompressing zip log file
for MUDROD. And the test code can parse the two gz. file. If you need, I can
depress them for you. Is it necessary?
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> MUDROD embedded unit test
> -
>
> Key: SDAP-161
> URL: https://issues.apache.org/jira/browse/SDAP-161
> Project: Apache Science Data Analytics Platform
> Issue Type: Improvement
> Components: mudrod
>Affects Versions: 1.0
>Reporter: Yun Li
>Priority: Major
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (SDAP-161) MUDROD embedded unit test
[
https://issues.apache.org/jira/browse/SDAP-161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16713769#comment-16713769
]
ASF GitHub Bot commented on SDAP-161:
-
lewismc commented on a change in pull request #35: SDAP-161 MUDROD embedded
unit test
URL:
https://github.com/apache/incubator-sdap-mudrod/pull/35#discussion_r240015520
##
File path: core/src/test/java/org/apache/sdap/mudrod/main/ESDriverTest.java
##
@@ -0,0 +1,265 @@
+/*
+ * Licensed under the Apache License, Version 2.0 (the "License"); you
+ * may not use this file except in compliance with the License.
+ * You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+package org.apache.sdap.mudrod.main;
+
+import org.apache.commons.io.IOUtils;
+import org.apache.sdap.mudrod.main.MudrodConstants;
+import org.apache.sdap.mudrod.main.MudrodEngine;
+import org.apache.sdap.mudrod.driver.ESDriver;
+import org.apache.sdap.mudrod.driver.EmbeddedElasticsearchServer;
+import org.elasticsearch.client.Client;
+import org.codehaus.jettison.json.JSONException;
+import org.codehaus.jettison.json.JSONObject;
+import org.elasticsearch.index.query.MatchAllQueryBuilder;
+import org.elasticsearch.index.query.QueryBuilders;
+import org.elasticsearch.action.bulk.BulkProcessor;
+import org.elasticsearch.action.update.UpdateRequest;
+import org.junit.After;
+import org.junit.AfterClass;
+import org.junit.Before;
+import org.junit.BeforeClass;
+import org.junit.Test;
+import org.slf4j.Logger;
+import org.slf4j.LoggerFactory;
+import java.io.IOException;
+import java.io.InputStream;
+import java.util.ArrayList;
+import java.util.List;
+import java.util.HashMap;
+import java.util.Map;
+import java.util.Properties;
+import java.util.concurrent.ExecutionException;
+
+public class ESDriverTest extends AbstractElasticsearchIntegrationTest {
+
+ private static final Logger LOG = LoggerFactory.getLogger(ESDriver.class);
+ protected static final String ES_SETTINGS = "elastic_settings.json";
+ protected static final String ES_MAPPINGS = "elastic_mappings.json";
+
+ static ESDriver es = null;
+ static MudrodEngine mudrodEngine = null;
+
+ @BeforeClass
+ public static void setUp() {
+mudrodEngine = new MudrodEngine();
+es = new ESDriver(mudrodEngine.loadConfig());
+ }
+
+ @AfterClass
+ public static void tearDown() {
+es.destroyBulkProcessor();
+es.close();
+ }
+
+ @Test
+ public void testESDriverProperties() {
+
+Client client = es.getClient();
+assert client != null;
+ }
+
+ @Test
+ public void testCreateBulkProcessor() {
+es.createBulkProcessor();
+BulkProcessor processor = es.getBulkProcessor();
+assert processor != null;
+ }
+
+ @Test
+ public void testDestroyBulkProcessor() {
+es.createBulkProcessor();
+es.destroyBulkProcessor();
+
+BulkProcessor processor = es.getBulkProcessor();
+assert processor == null;
+ }
+
+ @Test
+ public void testPutMapping() {
+
+InputStream settingsStream =
getClass().getClassLoader().getResourceAsStream(ES_SETTINGS);
+InputStream mappingsStream =
getClass().getClassLoader().getResourceAsStream(ES_MAPPINGS);
+
+JSONObject settingsJSON = null;
+JSONObject mappingJSON = null;
+
+Properties props = mudrodEngine.loadConfig();
+try {
+ settingsJSON = new JSONObject(IOUtils.toString(settingsStream));
+} catch (JSONException | IOException e1) {
+ LOG.error("Error reading Elasticsearch settings!", e1);
+}
+
+try {
+ mappingJSON = new JSONObject(IOUtils.toString(mappingsStream));
+} catch (JSONException | IOException e1) {
+ LOG.error("Error reading Elasticsearch mappings!", e1);
+}
+
+try {
+ if (settingsJSON != null && mappingJSON != null) {
+es.putMapping(props.getProperty(MudrodConstants.ES_INDEX_NAME),
settingsJSON.toString(), mappingJSON.toString());
+ }
+} catch (IOException e) {
+ LOG.error("Error entering Elasticsearch Mappings!", e);
+}
+ }
+
+ @Test
+ public void testCustomAnalyzingStringString() {
+
+String str = "temp";
+try {
+ String res = es.customAnalyzing("mudrod", str);
+ assert res != "";
+ assert res != null;
+} catch (InterruptedException | ExecutionException e) {
+ LOG.error("Error!", e);
+}
+ }
+
+ @Test
+ public void testCustomAnalyzingStringStringString() {
+String str = "temp";
+
Review comment:
Remove whitespace
This is an automated message from the Apache Git Serv
[jira] [Commented] (SDAP-161) MUDROD embedded unit test
[
https://issues.apache.org/jira/browse/SDAP-161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16713764#comment-16713764
]
ASF GitHub Bot commented on SDAP-161:
-
lewismc commented on a change in pull request #35: SDAP-161 MUDROD embedded
unit test
URL:
https://github.com/apache/incubator-sdap-mudrod/pull/35#discussion_r240015405
##
File path: core/src/main/java/org/apache/sdap/mudrod/main/MudrodEngine.java
##
@@ -391,12 +391,12 @@ public static void main(String[] args) {
me.end();
} catch (Exception e) {
HelpFormatter formatter = new HelpFormatter();
- formatter.printHelp("MudrodEngine: 'dataDir' argument is mandatory. " +
"User must also provide an ingest method.", true);
+ formatter.printHelp("MudrodEngine: 'dataDir' argument is mandatory. " +
"User must also provide an ingest method.", options, true);
Review comment:
OK what I am saying is that this code should be changed to the following
```
} catch (Exception e) {
throw new RuntimeException(e)
}
```
...or something similar.
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> MUDROD embedded unit test
> -
>
> Key: SDAP-161
> URL: https://issues.apache.org/jira/browse/SDAP-161
> Project: Apache Science Data Analytics Platform
> Issue Type: Improvement
> Components: mudrod
>Affects Versions: 1.0
>Reporter: Yun Li
>Priority: Major
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (SDAP-161) MUDROD embedded unit test
[
https://issues.apache.org/jira/browse/SDAP-161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16713779#comment-16713779
]
ASF GitHub Bot commented on SDAP-161:
-
lewismc commented on a change in pull request #35: SDAP-161 MUDROD embedded
unit test
URL:
https://github.com/apache/incubator-sdap-mudrod/pull/35#discussion_r240015553
##
File path: core/src/test/java/org/apache/sdap/mudrod/main/ESDriverTest.java
##
@@ -0,0 +1,265 @@
+/*
+ * Licensed under the Apache License, Version 2.0 (the "License"); you
+ * may not use this file except in compliance with the License.
+ * You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+package org.apache.sdap.mudrod.main;
+
+import org.apache.commons.io.IOUtils;
+import org.apache.sdap.mudrod.main.MudrodConstants;
+import org.apache.sdap.mudrod.main.MudrodEngine;
+import org.apache.sdap.mudrod.driver.ESDriver;
+import org.apache.sdap.mudrod.driver.EmbeddedElasticsearchServer;
+import org.elasticsearch.client.Client;
+import org.codehaus.jettison.json.JSONException;
+import org.codehaus.jettison.json.JSONObject;
+import org.elasticsearch.index.query.MatchAllQueryBuilder;
+import org.elasticsearch.index.query.QueryBuilders;
+import org.elasticsearch.action.bulk.BulkProcessor;
+import org.elasticsearch.action.update.UpdateRequest;
+import org.junit.After;
+import org.junit.AfterClass;
+import org.junit.Before;
+import org.junit.BeforeClass;
+import org.junit.Test;
+import org.slf4j.Logger;
+import org.slf4j.LoggerFactory;
+import java.io.IOException;
+import java.io.InputStream;
+import java.util.ArrayList;
+import java.util.List;
+import java.util.HashMap;
+import java.util.Map;
+import java.util.Properties;
+import java.util.concurrent.ExecutionException;
+
+public class ESDriverTest extends AbstractElasticsearchIntegrationTest {
+
+ private static final Logger LOG = LoggerFactory.getLogger(ESDriver.class);
+ protected static final String ES_SETTINGS = "elastic_settings.json";
+ protected static final String ES_MAPPINGS = "elastic_mappings.json";
+
+ static ESDriver es = null;
+ static MudrodEngine mudrodEngine = null;
+
+ @BeforeClass
+ public static void setUp() {
+mudrodEngine = new MudrodEngine();
+es = new ESDriver(mudrodEngine.loadConfig());
+ }
+
+ @AfterClass
+ public static void tearDown() {
+es.destroyBulkProcessor();
+es.close();
+ }
+
+ @Test
+ public void testESDriverProperties() {
+
+Client client = es.getClient();
+assert client != null;
+ }
+
+ @Test
+ public void testCreateBulkProcessor() {
+es.createBulkProcessor();
+BulkProcessor processor = es.getBulkProcessor();
+assert processor != null;
+ }
+
+ @Test
+ public void testDestroyBulkProcessor() {
+es.createBulkProcessor();
+es.destroyBulkProcessor();
+
+BulkProcessor processor = es.getBulkProcessor();
+assert processor == null;
+ }
+
+ @Test
+ public void testPutMapping() {
+
+InputStream settingsStream =
getClass().getClassLoader().getResourceAsStream(ES_SETTINGS);
+InputStream mappingsStream =
getClass().getClassLoader().getResourceAsStream(ES_MAPPINGS);
+
+JSONObject settingsJSON = null;
+JSONObject mappingJSON = null;
+
+Properties props = mudrodEngine.loadConfig();
+try {
+ settingsJSON = new JSONObject(IOUtils.toString(settingsStream));
+} catch (JSONException | IOException e1) {
+ LOG.error("Error reading Elasticsearch settings!", e1);
+}
+
+try {
+ mappingJSON = new JSONObject(IOUtils.toString(mappingsStream));
+} catch (JSONException | IOException e1) {
+ LOG.error("Error reading Elasticsearch mappings!", e1);
+}
+
+try {
+ if (settingsJSON != null && mappingJSON != null) {
+es.putMapping(props.getProperty(MudrodConstants.ES_INDEX_NAME),
settingsJSON.toString(), mappingJSON.toString());
+ }
+} catch (IOException e) {
+ LOG.error("Error entering Elasticsearch Mappings!", e);
+}
+ }
+
+ @Test
+ public void testCustomAnalyzingStringString() {
+
+String str = "temp";
+try {
+ String res = es.customAnalyzing("mudrod", str);
+ assert res != "";
+ assert res != null;
+} catch (InterruptedException | ExecutionException e) {
+ LOG.error("Error!", e);
+}
+ }
+
+ @Test
+ public void testCustomAnalyzingStringStringString() {
+String str = "temp";
+
+try {
+ String res = es.customAnalyzing("mudrod", "cody", str);
+ assert res != "";
+ assert res != null;
+} catch (InterruptedExceptio
[jira] [Commented] (SDAP-161) MUDROD embedded unit test
[
https://issues.apache.org/jira/browse/SDAP-161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16713780#comment-16713780
]
ASF GitHub Bot commented on SDAP-161:
-
lewismc commented on a change in pull request #35: SDAP-161 MUDROD embedded
unit test
URL:
https://github.com/apache/incubator-sdap-mudrod/pull/35#discussion_r240015530
##
File path: core/src/test/java/org/apache/sdap/mudrod/main/ESDriverTest.java
##
@@ -0,0 +1,265 @@
+/*
+ * Licensed under the Apache License, Version 2.0 (the "License"); you
+ * may not use this file except in compliance with the License.
+ * You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+package org.apache.sdap.mudrod.main;
+
+import org.apache.commons.io.IOUtils;
+import org.apache.sdap.mudrod.main.MudrodConstants;
+import org.apache.sdap.mudrod.main.MudrodEngine;
+import org.apache.sdap.mudrod.driver.ESDriver;
+import org.apache.sdap.mudrod.driver.EmbeddedElasticsearchServer;
+import org.elasticsearch.client.Client;
+import org.codehaus.jettison.json.JSONException;
+import org.codehaus.jettison.json.JSONObject;
+import org.elasticsearch.index.query.MatchAllQueryBuilder;
+import org.elasticsearch.index.query.QueryBuilders;
+import org.elasticsearch.action.bulk.BulkProcessor;
+import org.elasticsearch.action.update.UpdateRequest;
+import org.junit.After;
+import org.junit.AfterClass;
+import org.junit.Before;
+import org.junit.BeforeClass;
+import org.junit.Test;
+import org.slf4j.Logger;
+import org.slf4j.LoggerFactory;
+import java.io.IOException;
+import java.io.InputStream;
+import java.util.ArrayList;
+import java.util.List;
+import java.util.HashMap;
+import java.util.Map;
+import java.util.Properties;
+import java.util.concurrent.ExecutionException;
+
+public class ESDriverTest extends AbstractElasticsearchIntegrationTest {
+
+ private static final Logger LOG = LoggerFactory.getLogger(ESDriver.class);
+ protected static final String ES_SETTINGS = "elastic_settings.json";
+ protected static final String ES_MAPPINGS = "elastic_mappings.json";
+
+ static ESDriver es = null;
+ static MudrodEngine mudrodEngine = null;
+
+ @BeforeClass
+ public static void setUp() {
+mudrodEngine = new MudrodEngine();
+es = new ESDriver(mudrodEngine.loadConfig());
+ }
+
+ @AfterClass
+ public static void tearDown() {
+es.destroyBulkProcessor();
+es.close();
+ }
+
+ @Test
+ public void testESDriverProperties() {
+
+Client client = es.getClient();
+assert client != null;
+ }
+
+ @Test
+ public void testCreateBulkProcessor() {
+es.createBulkProcessor();
+BulkProcessor processor = es.getBulkProcessor();
+assert processor != null;
+ }
+
+ @Test
+ public void testDestroyBulkProcessor() {
+es.createBulkProcessor();
+es.destroyBulkProcessor();
+
+BulkProcessor processor = es.getBulkProcessor();
+assert processor == null;
+ }
+
+ @Test
+ public void testPutMapping() {
+
+InputStream settingsStream =
getClass().getClassLoader().getResourceAsStream(ES_SETTINGS);
+InputStream mappingsStream =
getClass().getClassLoader().getResourceAsStream(ES_MAPPINGS);
+
+JSONObject settingsJSON = null;
+JSONObject mappingJSON = null;
+
+Properties props = mudrodEngine.loadConfig();
+try {
+ settingsJSON = new JSONObject(IOUtils.toString(settingsStream));
+} catch (JSONException | IOException e1) {
+ LOG.error("Error reading Elasticsearch settings!", e1);
+}
+
+try {
+ mappingJSON = new JSONObject(IOUtils.toString(mappingsStream));
+} catch (JSONException | IOException e1) {
+ LOG.error("Error reading Elasticsearch mappings!", e1);
+}
+
+try {
+ if (settingsJSON != null && mappingJSON != null) {
+es.putMapping(props.getProperty(MudrodConstants.ES_INDEX_NAME),
settingsJSON.toString(), mappingJSON.toString());
+ }
+} catch (IOException e) {
+ LOG.error("Error entering Elasticsearch Mappings!", e);
+}
+ }
+
+ @Test
+ public void testCustomAnalyzingStringString() {
+
+String str = "temp";
+try {
+ String res = es.customAnalyzing("mudrod", str);
+ assert res != "";
+ assert res != null;
+} catch (InterruptedException | ExecutionException e) {
+ LOG.error("Error!", e);
+}
+ }
+
+ @Test
+ public void testCustomAnalyzingStringStringString() {
+String str = "temp";
+
+try {
+ String res = es.customAnalyzing("mudrod", "cody", str);
+ assert res != "";
+ assert res != null;
+} catch (InterruptedExceptio
[jira] [Commented] (SDAP-161) MUDROD embedded unit test
[
https://issues.apache.org/jira/browse/SDAP-161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16713778#comment-16713778
]
ASF GitHub Bot commented on SDAP-161:
-
lewismc commented on a change in pull request #35: SDAP-161 MUDROD embedded
unit test
URL:
https://github.com/apache/incubator-sdap-mudrod/pull/35#discussion_r240015540
##
File path: core/src/test/java/org/apache/sdap/mudrod/main/ESDriverTest.java
##
@@ -0,0 +1,265 @@
+/*
+ * Licensed under the Apache License, Version 2.0 (the "License"); you
+ * may not use this file except in compliance with the License.
+ * You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+package org.apache.sdap.mudrod.main;
+
+import org.apache.commons.io.IOUtils;
+import org.apache.sdap.mudrod.main.MudrodConstants;
+import org.apache.sdap.mudrod.main.MudrodEngine;
+import org.apache.sdap.mudrod.driver.ESDriver;
+import org.apache.sdap.mudrod.driver.EmbeddedElasticsearchServer;
+import org.elasticsearch.client.Client;
+import org.codehaus.jettison.json.JSONException;
+import org.codehaus.jettison.json.JSONObject;
+import org.elasticsearch.index.query.MatchAllQueryBuilder;
+import org.elasticsearch.index.query.QueryBuilders;
+import org.elasticsearch.action.bulk.BulkProcessor;
+import org.elasticsearch.action.update.UpdateRequest;
+import org.junit.After;
+import org.junit.AfterClass;
+import org.junit.Before;
+import org.junit.BeforeClass;
+import org.junit.Test;
+import org.slf4j.Logger;
+import org.slf4j.LoggerFactory;
+import java.io.IOException;
+import java.io.InputStream;
+import java.util.ArrayList;
+import java.util.List;
+import java.util.HashMap;
+import java.util.Map;
+import java.util.Properties;
+import java.util.concurrent.ExecutionException;
+
+public class ESDriverTest extends AbstractElasticsearchIntegrationTest {
+
+ private static final Logger LOG = LoggerFactory.getLogger(ESDriver.class);
+ protected static final String ES_SETTINGS = "elastic_settings.json";
+ protected static final String ES_MAPPINGS = "elastic_mappings.json";
+
+ static ESDriver es = null;
+ static MudrodEngine mudrodEngine = null;
+
+ @BeforeClass
+ public static void setUp() {
+mudrodEngine = new MudrodEngine();
+es = new ESDriver(mudrodEngine.loadConfig());
+ }
+
+ @AfterClass
+ public static void tearDown() {
+es.destroyBulkProcessor();
+es.close();
+ }
+
+ @Test
+ public void testESDriverProperties() {
+
+Client client = es.getClient();
+assert client != null;
+ }
+
+ @Test
+ public void testCreateBulkProcessor() {
+es.createBulkProcessor();
+BulkProcessor processor = es.getBulkProcessor();
+assert processor != null;
+ }
+
+ @Test
+ public void testDestroyBulkProcessor() {
+es.createBulkProcessor();
+es.destroyBulkProcessor();
+
+BulkProcessor processor = es.getBulkProcessor();
+assert processor == null;
+ }
+
+ @Test
+ public void testPutMapping() {
+
+InputStream settingsStream =
getClass().getClassLoader().getResourceAsStream(ES_SETTINGS);
+InputStream mappingsStream =
getClass().getClassLoader().getResourceAsStream(ES_MAPPINGS);
+
+JSONObject settingsJSON = null;
+JSONObject mappingJSON = null;
+
+Properties props = mudrodEngine.loadConfig();
+try {
+ settingsJSON = new JSONObject(IOUtils.toString(settingsStream));
+} catch (JSONException | IOException e1) {
+ LOG.error("Error reading Elasticsearch settings!", e1);
+}
+
+try {
+ mappingJSON = new JSONObject(IOUtils.toString(mappingsStream));
+} catch (JSONException | IOException e1) {
+ LOG.error("Error reading Elasticsearch mappings!", e1);
+}
+
+try {
+ if (settingsJSON != null && mappingJSON != null) {
+es.putMapping(props.getProperty(MudrodConstants.ES_INDEX_NAME),
settingsJSON.toString(), mappingJSON.toString());
+ }
+} catch (IOException e) {
+ LOG.error("Error entering Elasticsearch Mappings!", e);
+}
+ }
+
+ @Test
+ public void testCustomAnalyzingStringString() {
+
+String str = "temp";
+try {
+ String res = es.customAnalyzing("mudrod", str);
+ assert res != "";
+ assert res != null;
+} catch (InterruptedException | ExecutionException e) {
+ LOG.error("Error!", e);
+}
+ }
+
+ @Test
+ public void testCustomAnalyzingStringStringString() {
+String str = "temp";
+
+try {
+ String res = es.customAnalyzing("mudrod", "cody", str);
+ assert res != "";
+ assert res != null;
+} catch (InterruptedExceptio
[jira] [Commented] (SDAP-161) MUDROD embedded unit test
[
https://issues.apache.org/jira/browse/SDAP-161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16713772#comment-16713772
]
ASF GitHub Bot commented on SDAP-161:
-
lewismc commented on a change in pull request #35: SDAP-161 MUDROD embedded
unit test
URL:
https://github.com/apache/incubator-sdap-mudrod/pull/35#discussion_r240015527
##
File path: core/src/test/java/org/apache/sdap/mudrod/main/ESDriverTest.java
##
@@ -0,0 +1,265 @@
+/*
+ * Licensed under the Apache License, Version 2.0 (the "License"); you
+ * may not use this file except in compliance with the License.
+ * You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+package org.apache.sdap.mudrod.main;
+
+import org.apache.commons.io.IOUtils;
+import org.apache.sdap.mudrod.main.MudrodConstants;
+import org.apache.sdap.mudrod.main.MudrodEngine;
+import org.apache.sdap.mudrod.driver.ESDriver;
+import org.apache.sdap.mudrod.driver.EmbeddedElasticsearchServer;
+import org.elasticsearch.client.Client;
+import org.codehaus.jettison.json.JSONException;
+import org.codehaus.jettison.json.JSONObject;
+import org.elasticsearch.index.query.MatchAllQueryBuilder;
+import org.elasticsearch.index.query.QueryBuilders;
+import org.elasticsearch.action.bulk.BulkProcessor;
+import org.elasticsearch.action.update.UpdateRequest;
+import org.junit.After;
+import org.junit.AfterClass;
+import org.junit.Before;
+import org.junit.BeforeClass;
+import org.junit.Test;
+import org.slf4j.Logger;
+import org.slf4j.LoggerFactory;
+import java.io.IOException;
+import java.io.InputStream;
+import java.util.ArrayList;
+import java.util.List;
+import java.util.HashMap;
+import java.util.Map;
+import java.util.Properties;
+import java.util.concurrent.ExecutionException;
+
+public class ESDriverTest extends AbstractElasticsearchIntegrationTest {
+
+ private static final Logger LOG = LoggerFactory.getLogger(ESDriver.class);
+ protected static final String ES_SETTINGS = "elastic_settings.json";
+ protected static final String ES_MAPPINGS = "elastic_mappings.json";
+
+ static ESDriver es = null;
+ static MudrodEngine mudrodEngine = null;
+
+ @BeforeClass
+ public static void setUp() {
+mudrodEngine = new MudrodEngine();
+es = new ESDriver(mudrodEngine.loadConfig());
+ }
+
+ @AfterClass
+ public static void tearDown() {
+es.destroyBulkProcessor();
+es.close();
+ }
+
+ @Test
+ public void testESDriverProperties() {
+
+Client client = es.getClient();
+assert client != null;
+ }
+
+ @Test
+ public void testCreateBulkProcessor() {
+es.createBulkProcessor();
+BulkProcessor processor = es.getBulkProcessor();
+assert processor != null;
+ }
+
+ @Test
+ public void testDestroyBulkProcessor() {
+es.createBulkProcessor();
+es.destroyBulkProcessor();
+
+BulkProcessor processor = es.getBulkProcessor();
+assert processor == null;
+ }
+
+ @Test
+ public void testPutMapping() {
+
+InputStream settingsStream =
getClass().getClassLoader().getResourceAsStream(ES_SETTINGS);
+InputStream mappingsStream =
getClass().getClassLoader().getResourceAsStream(ES_MAPPINGS);
+
+JSONObject settingsJSON = null;
+JSONObject mappingJSON = null;
+
+Properties props = mudrodEngine.loadConfig();
+try {
+ settingsJSON = new JSONObject(IOUtils.toString(settingsStream));
+} catch (JSONException | IOException e1) {
+ LOG.error("Error reading Elasticsearch settings!", e1);
+}
+
+try {
+ mappingJSON = new JSONObject(IOUtils.toString(mappingsStream));
+} catch (JSONException | IOException e1) {
+ LOG.error("Error reading Elasticsearch mappings!", e1);
+}
+
+try {
+ if (settingsJSON != null && mappingJSON != null) {
+es.putMapping(props.getProperty(MudrodConstants.ES_INDEX_NAME),
settingsJSON.toString(), mappingJSON.toString());
+ }
+} catch (IOException e) {
+ LOG.error("Error entering Elasticsearch Mappings!", e);
+}
+ }
+
+ @Test
+ public void testCustomAnalyzingStringString() {
+
+String str = "temp";
+try {
+ String res = es.customAnalyzing("mudrod", str);
+ assert res != "";
+ assert res != null;
+} catch (InterruptedException | ExecutionException e) {
+ LOG.error("Error!", e);
+}
+ }
+
+ @Test
+ public void testCustomAnalyzingStringStringString() {
+String str = "temp";
+
+try {
+ String res = es.customAnalyzing("mudrod", "cody", str);
+ assert res != "";
+ assert res != null;
+} catch (InterruptedExceptio
[jira] [Commented] (SDAP-161) MUDROD embedded unit test
[
https://issues.apache.org/jira/browse/SDAP-161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16713776#comment-16713776
]
ASF GitHub Bot commented on SDAP-161:
-
lewismc commented on a change in pull request #35: SDAP-161 MUDROD embedded
unit test
URL:
https://github.com/apache/incubator-sdap-mudrod/pull/35#discussion_r240015576
##
File path:
core/src/test/java/org/apache/sdap/mudrod/weblog/structure/log/GeoIpTest.java
##
@@ -0,0 +1,18 @@
+package org.apache.sdap.mudrod.weblog.structure.log;
+
+import static org.junit.Assert.*;
+
+import org.junit.Assert;
+import org.junit.Test;
+
+public class GeoIpTest {
+
+ @Test
+ public void testToLocation() {
+ GeoIp ip = new GeoIp();
+ String iptest = "185.10.104.194";
+ Coordinates result = ip.toLocation(iptest);
+ Assert.assertEquals("failed in geoip function!",
"22.283001,114.150002", result.latlon);
+ }
+
+}
Review comment:
You have not addressed this issue. The files should not be in the compressed
form... you need to decompress them.
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> MUDROD embedded unit test
> -
>
> Key: SDAP-161
> URL: https://issues.apache.org/jira/browse/SDAP-161
> Project: Apache Science Data Analytics Platform
> Issue Type: Improvement
> Components: mudrod
>Affects Versions: 1.0
>Reporter: Yun Li
>Priority: Major
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (SDAP-161) MUDROD embedded unit test
[
https://issues.apache.org/jira/browse/SDAP-161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16713768#comment-16713768
]
ASF GitHub Bot commented on SDAP-161:
-
lewismc commented on a change in pull request #35: SDAP-161 MUDROD embedded
unit test
URL:
https://github.com/apache/incubator-sdap-mudrod/pull/35#discussion_r240015519
##
File path: core/src/test/java/org/apache/sdap/mudrod/main/ESDriverTest.java
##
@@ -0,0 +1,265 @@
+/*
+ * Licensed under the Apache License, Version 2.0 (the "License"); you
+ * may not use this file except in compliance with the License.
+ * You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+package org.apache.sdap.mudrod.main;
+
+import org.apache.commons.io.IOUtils;
+import org.apache.sdap.mudrod.main.MudrodConstants;
+import org.apache.sdap.mudrod.main.MudrodEngine;
+import org.apache.sdap.mudrod.driver.ESDriver;
+import org.apache.sdap.mudrod.driver.EmbeddedElasticsearchServer;
+import org.elasticsearch.client.Client;
+import org.codehaus.jettison.json.JSONException;
+import org.codehaus.jettison.json.JSONObject;
+import org.elasticsearch.index.query.MatchAllQueryBuilder;
+import org.elasticsearch.index.query.QueryBuilders;
+import org.elasticsearch.action.bulk.BulkProcessor;
+import org.elasticsearch.action.update.UpdateRequest;
+import org.junit.After;
+import org.junit.AfterClass;
+import org.junit.Before;
+import org.junit.BeforeClass;
+import org.junit.Test;
+import org.slf4j.Logger;
+import org.slf4j.LoggerFactory;
+import java.io.IOException;
+import java.io.InputStream;
+import java.util.ArrayList;
+import java.util.List;
+import java.util.HashMap;
+import java.util.Map;
+import java.util.Properties;
+import java.util.concurrent.ExecutionException;
+
+public class ESDriverTest extends AbstractElasticsearchIntegrationTest {
+
+ private static final Logger LOG = LoggerFactory.getLogger(ESDriver.class);
+ protected static final String ES_SETTINGS = "elastic_settings.json";
+ protected static final String ES_MAPPINGS = "elastic_mappings.json";
+
+ static ESDriver es = null;
+ static MudrodEngine mudrodEngine = null;
+
+ @BeforeClass
+ public static void setUp() {
+mudrodEngine = new MudrodEngine();
+es = new ESDriver(mudrodEngine.loadConfig());
+ }
+
+ @AfterClass
+ public static void tearDown() {
+es.destroyBulkProcessor();
+es.close();
+ }
+
+ @Test
+ public void testESDriverProperties() {
+
+Client client = es.getClient();
+assert client != null;
+ }
+
+ @Test
+ public void testCreateBulkProcessor() {
+es.createBulkProcessor();
+BulkProcessor processor = es.getBulkProcessor();
+assert processor != null;
+ }
+
+ @Test
+ public void testDestroyBulkProcessor() {
+es.createBulkProcessor();
+es.destroyBulkProcessor();
+
+BulkProcessor processor = es.getBulkProcessor();
+assert processor == null;
+ }
+
+ @Test
+ public void testPutMapping() {
+
+InputStream settingsStream =
getClass().getClassLoader().getResourceAsStream(ES_SETTINGS);
+InputStream mappingsStream =
getClass().getClassLoader().getResourceAsStream(ES_MAPPINGS);
+
+JSONObject settingsJSON = null;
+JSONObject mappingJSON = null;
+
+Properties props = mudrodEngine.loadConfig();
+try {
+ settingsJSON = new JSONObject(IOUtils.toString(settingsStream));
+} catch (JSONException | IOException e1) {
+ LOG.error("Error reading Elasticsearch settings!", e1);
+}
+
+try {
+ mappingJSON = new JSONObject(IOUtils.toString(mappingsStream));
+} catch (JSONException | IOException e1) {
+ LOG.error("Error reading Elasticsearch mappings!", e1);
+}
+
+try {
+ if (settingsJSON != null && mappingJSON != null) {
+es.putMapping(props.getProperty(MudrodConstants.ES_INDEX_NAME),
settingsJSON.toString(), mappingJSON.toString());
+ }
+} catch (IOException e) {
+ LOG.error("Error entering Elasticsearch Mappings!", e);
+}
+ }
+
+ @Test
+ public void testCustomAnalyzingStringString() {
+
Review comment:
Remove whitespace
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> MUDROD embedded unit test
> -
>
> Key: SDAP-161
> URL: https://issues.apache.org/jira/b
[jira] [Commented] (SDAP-161) MUDROD embedded unit test
[
https://issues.apache.org/jira/browse/SDAP-161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16713782#comment-16713782
]
ASF GitHub Bot commented on SDAP-161:
-
lewismc commented on a change in pull request #35: SDAP-161 MUDROD embedded
unit test
URL:
https://github.com/apache/incubator-sdap-mudrod/pull/35#discussion_r240015543
##
File path: core/src/test/java/org/apache/sdap/mudrod/main/ESDriverTest.java
##
@@ -0,0 +1,265 @@
+/*
+ * Licensed under the Apache License, Version 2.0 (the "License"); you
+ * may not use this file except in compliance with the License.
+ * You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+package org.apache.sdap.mudrod.main;
+
+import org.apache.commons.io.IOUtils;
+import org.apache.sdap.mudrod.main.MudrodConstants;
+import org.apache.sdap.mudrod.main.MudrodEngine;
+import org.apache.sdap.mudrod.driver.ESDriver;
+import org.apache.sdap.mudrod.driver.EmbeddedElasticsearchServer;
+import org.elasticsearch.client.Client;
+import org.codehaus.jettison.json.JSONException;
+import org.codehaus.jettison.json.JSONObject;
+import org.elasticsearch.index.query.MatchAllQueryBuilder;
+import org.elasticsearch.index.query.QueryBuilders;
+import org.elasticsearch.action.bulk.BulkProcessor;
+import org.elasticsearch.action.update.UpdateRequest;
+import org.junit.After;
+import org.junit.AfterClass;
+import org.junit.Before;
+import org.junit.BeforeClass;
+import org.junit.Test;
+import org.slf4j.Logger;
+import org.slf4j.LoggerFactory;
+import java.io.IOException;
+import java.io.InputStream;
+import java.util.ArrayList;
+import java.util.List;
+import java.util.HashMap;
+import java.util.Map;
+import java.util.Properties;
+import java.util.concurrent.ExecutionException;
+
+public class ESDriverTest extends AbstractElasticsearchIntegrationTest {
+
+ private static final Logger LOG = LoggerFactory.getLogger(ESDriver.class);
+ protected static final String ES_SETTINGS = "elastic_settings.json";
+ protected static final String ES_MAPPINGS = "elastic_mappings.json";
+
+ static ESDriver es = null;
+ static MudrodEngine mudrodEngine = null;
+
+ @BeforeClass
+ public static void setUp() {
+mudrodEngine = new MudrodEngine();
+es = new ESDriver(mudrodEngine.loadConfig());
+ }
+
+ @AfterClass
+ public static void tearDown() {
+es.destroyBulkProcessor();
+es.close();
+ }
+
+ @Test
+ public void testESDriverProperties() {
+
+Client client = es.getClient();
+assert client != null;
+ }
+
+ @Test
+ public void testCreateBulkProcessor() {
+es.createBulkProcessor();
+BulkProcessor processor = es.getBulkProcessor();
+assert processor != null;
+ }
+
+ @Test
+ public void testDestroyBulkProcessor() {
+es.createBulkProcessor();
+es.destroyBulkProcessor();
+
+BulkProcessor processor = es.getBulkProcessor();
+assert processor == null;
+ }
+
+ @Test
+ public void testPutMapping() {
+
+InputStream settingsStream =
getClass().getClassLoader().getResourceAsStream(ES_SETTINGS);
+InputStream mappingsStream =
getClass().getClassLoader().getResourceAsStream(ES_MAPPINGS);
+
+JSONObject settingsJSON = null;
+JSONObject mappingJSON = null;
+
+Properties props = mudrodEngine.loadConfig();
+try {
+ settingsJSON = new JSONObject(IOUtils.toString(settingsStream));
+} catch (JSONException | IOException e1) {
+ LOG.error("Error reading Elasticsearch settings!", e1);
+}
+
+try {
+ mappingJSON = new JSONObject(IOUtils.toString(mappingsStream));
+} catch (JSONException | IOException e1) {
+ LOG.error("Error reading Elasticsearch mappings!", e1);
+}
+
+try {
+ if (settingsJSON != null && mappingJSON != null) {
+es.putMapping(props.getProperty(MudrodConstants.ES_INDEX_NAME),
settingsJSON.toString(), mappingJSON.toString());
+ }
+} catch (IOException e) {
+ LOG.error("Error entering Elasticsearch Mappings!", e);
+}
+ }
+
+ @Test
+ public void testCustomAnalyzingStringString() {
+
+String str = "temp";
+try {
+ String res = es.customAnalyzing("mudrod", str);
+ assert res != "";
+ assert res != null;
+} catch (InterruptedException | ExecutionException e) {
+ LOG.error("Error!", e);
+}
+ }
+
+ @Test
+ public void testCustomAnalyzingStringStringString() {
+String str = "temp";
+
+try {
+ String res = es.customAnalyzing("mudrod", "cody", str);
+ assert res != "";
+ assert res != null;
+} catch (InterruptedExceptio
