eamonford opened a new pull request #26:
URL: https://github.com/apache/incubator-sdap-ingester/pull/26
https://issues.apache.org/jira/browse/SDAP-297
This is an automated message from the Apache Git Service.
To respond to
eamonford merged pull request #112:
URL: https://github.com/apache/incubator-sdap-nexus/pull/112
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
eamonford opened a new pull request #112:
URL: https://github.com/apache/incubator-sdap-nexus/pull/112
https://issues.apache.org/jira/browse/SDAP-296
This is an automated message from the Apache Git Service.
To respond to
eamonford merged pull request #25:
URL: https://github.com/apache/incubator-sdap-ingester/pull/25
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
eamonford opened a new pull request #25:
URL: https://github.com/apache/incubator-sdap-ingester/pull/25
https://issues.apache.org/jira/browse/SDAP-295
This is an automated message from the Apache Git Service.
To respond to
eamonford merged pull request #22:
URL: https://github.com/apache/incubator-sdap-ingester/pull/22
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
eamonford merged pull request #24:
URL: https://github.com/apache/incubator-sdap-ingester/pull/24
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
eamonford opened a new pull request #24:
URL: https://github.com/apache/incubator-sdap-ingester/pull/24
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use
eamonford merged pull request #23:
URL: https://github.com/apache/incubator-sdap-ingester/pull/23
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
eamonford opened a new pull request #23:
URL: https://github.com/apache/incubator-sdap-ingester/pull/23
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use
echyam opened a new pull request #22:
URL: https://github.com/apache/incubator-sdap-ingester/pull/22
- add ingestion side support for Kelvin to Celsius conversion
- also lays groundwork for allowing an operator-customized plugin processor
to further transform data if necessary
echyam opened a new pull request #110:
URL: https://github.com/apache/incubator-sdap-nexus/pull/110
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
eamonford merged pull request #21:
URL: https://github.com/apache/incubator-sdap-ingester/pull/21
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
eamonford opened a new pull request #21:
URL: https://github.com/apache/incubator-sdap-ingester/pull/21
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use
eamonford merged pull request #20:
URL: https://github.com/apache/incubator-sdap-ingester/pull/20
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
eamonford opened a new pull request #20:
URL: https://github.com/apache/incubator-sdap-ingester/pull/20
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use
ngachung merged pull request #109:
URL: https://github.com/apache/incubator-sdap-nexus/pull/109
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
eamonford opened a new pull request #109:
URL: https://github.com/apache/incubator-sdap-nexus/pull/109
https://issues.apache.org/jira/browse/SDAP-258
This is an automated message from the Apache Git Service.
To respond to
ngachung merged pull request #4:
URL: https://github.com/apache/incubator-sdap-website/pull/4
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
ngachung opened a new pull request #4:
URL: https://github.com/apache/incubator-sdap-website/pull/4
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
eamonford merged pull request #108:
URL: https://github.com/apache/incubator-sdap-nexus/pull/108
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
eamonford opened a new pull request #108:
URL: https://github.com/apache/incubator-sdap-nexus/pull/108
This updates the custom Solr image to include the JTS jar to (re)enable
polygon intersection queries. Also updates the solr-create-collection image to
create a "geo" fieldtype and field,
eamonford merged pull request #19:
URL: https://github.com/apache/incubator-sdap-ingester/pull/19
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
eamonford opened a new pull request #19:
URL: https://github.com/apache/incubator-sdap-ingester/pull/19
https://issues.apache.org/jira/browse/SDAP-282
This is an automated message from the Apache Git Service.
To respond to
tloubrieu-jpl opened a new pull request #107:
URL: https://github.com/apache/incubator-sdap-nexus/pull/107
So far:
- added the fair scheduling option in spark (no tested with big jobs yet)
- added NexusHandlerManager to manage different end-points for a single
algorthim. The
eamonford merged pull request #16:
URL: https://github.com/apache/incubator-sdap-ingester/pull/16
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
eamonford merged pull request #17:
URL: https://github.com/apache/incubator-sdap-ingester/pull/17
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
eamonford commented on a change in pull request #16:
URL:
https://github.com/apache/incubator-sdap-ingester/pull/16#discussion_r468750245
##
File path: collection_manager/collection_manager/services/CollectionProcessor.py
##
@@ -59,13 +59,13 @@ async def process_granule(self,
tloubrieu-jpl commented on a change in pull request #17:
URL:
https://github.com/apache/incubator-sdap-ingester/pull/17#discussion_r468617699
##
File path: collection_manager/collection_manager/services/CollectionWatcher.py
##
@@ -1,12 +1,12 @@
import asyncio
+import time
tloubrieu-jpl commented on a change in pull request #16:
URL:
https://github.com/apache/incubator-sdap-ingester/pull/16#discussion_r468608811
##
File path: collection_manager/collection_manager/services/CollectionProcessor.py
##
@@ -59,13 +59,13 @@ async def
eamonford opened a new pull request #18:
URL: https://github.com/apache/incubator-sdap-ingester/pull/18
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use
eamonford commented on a change in pull request #17:
URL:
https://github.com/apache/incubator-sdap-ingester/pull/17#discussion_r468314366
##
File path: collection_manager/collection_manager/services/CollectionWatcher.py
##
@@ -1,12 +1,12 @@
import asyncio
+import time
eamonford opened a new pull request #17:
URL: https://github.com/apache/incubator-sdap-ingester/pull/17
https://issues.apache.org/jira/browse/SDAP-279
This is an automated message from the Apache Git Service.
To respond to
eamonford opened a new pull request #16:
URL: https://github.com/apache/incubator-sdap-ingester/pull/16
https://issues.apache.org/jira/browse/SDAP-280
This is an automated message from the Apache Git Service.
To respond to
eamonford merged pull request #106:
URL: https://github.com/apache/incubator-sdap-nexus/pull/106
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
eamonford commented on a change in pull request #106:
URL:
https://github.com/apache/incubator-sdap-nexus/pull/106#discussion_r467335787
##
File path: analysis/webservice/algorithms_spark/DailyDifferenceAverageSpark.py
##
@@ -264,7 +267,7 @@ def
tloubrieu-jpl commented on a change in pull request #106:
URL:
https://github.com/apache/incubator-sdap-nexus/pull/106#discussion_r467321628
##
File path: analysis/webservice/algorithms/HofMoeller.py
##
@@ -168,7 +168,7 @@ def calc(self, computeOptions, **args):
eamonford merged pull request #15:
URL: https://github.com/apache/incubator-sdap-ingester/pull/15
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
eamonford opened a new pull request #106:
URL: https://github.com/apache/incubator-sdap-nexus/pull/106
https://issues.apache.org/jira/browse/SDAP-278
This is an automated message from the Apache Git Service.
To respond to
eamonford commented on a change in pull request #15:
URL:
https://github.com/apache/incubator-sdap-ingester/pull/15#discussion_r466073626
##
File path: granule_ingester/granule_ingester/pipeline/Pipeline.py
##
@@ -91,43 +101,61 @@ def __init__(self,
tloubrieu-jpl commented on a change in pull request #15:
URL:
https://github.com/apache/incubator-sdap-ingester/pull/15#discussion_r466009301
##
File path: granule_ingester/granule_ingester/pipeline/Pipeline.py
##
@@ -91,43 +101,61 @@ def __init__(self,
eamonford opened a new pull request #15:
URL: https://github.com/apache/incubator-sdap-ingester/pull/15
https://issues.apache.org/jira/browse/SDAP-277
This PR accomplishes 3 things:
1) Any dropped network connections will attempt to reconnect
2) Any unrecoverable errors
eamonford merged pull request #12:
URL: https://github.com/apache/incubator-sdap-ingester/pull/12
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
eamonford commented on pull request #12:
URL:
https://github.com/apache/incubator-sdap-ingester/pull/12#issuecomment-669474653
> A general comment, initially I found the usage of async functions pretty
smart but the more I see them the more I am afraid the code will be difficult
to
eamonford merged pull request #14:
URL: https://github.com/apache/incubator-sdap-ingester/pull/14
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
eamonford merged pull request #13:
URL: https://github.com/apache/incubator-sdap-ingester/pull/13
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
tloubrieu-jpl opened a new pull request #14:
URL: https://github.com/apache/incubator-sdap-ingester/pull/14
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and
eamonford opened a new pull request #13:
URL: https://github.com/apache/incubator-sdap-ingester/pull/13
https://issues.apache.org/jira/browse/SDAP-273
This is an automated message from the Apache Git Service.
To respond to
eamonford opened a new pull request #12:
URL: https://github.com/apache/incubator-sdap-ingester/pull/12
https://issues.apache.org/jira/browse/SDAP-272
This is an automated message from the Apache Git Service.
To respond to
eamonford merged pull request #11:
URL: https://github.com/apache/incubator-sdap-ingester/pull/11
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
eamonford opened a new pull request #11:
URL: https://github.com/apache/incubator-sdap-ingester/pull/11
Support connecting to cassandra with username and password.
https://issues.apache.org/jira/browse/SDAP-271
This
tloubrieu-jpl merged pull request #10:
URL: https://github.com/apache/incubator-sdap-ingester/pull/10
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
tloubrieu-jpl opened a new pull request #10:
URL: https://github.com/apache/incubator-sdap-ingester/pull/10
add a on.update kopf event for crd updates
This is an automated message from the Apache Git Service.
To respond to
eamonford merged pull request #9:
URL: https://github.com/apache/incubator-sdap-ingester/pull/9
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
eamonford opened a new pull request #9:
URL: https://github.com/apache/incubator-sdap-ingester/pull/9
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
eamonford merged pull request #8:
URL: https://github.com/apache/incubator-sdap-ingester/pull/8
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
eamonford commented on a change in pull request #8:
URL:
https://github.com/apache/incubator-sdap-ingester/pull/8#discussion_r464745892
##
File path:
collection_manager/collection_manager/services/history_manager/SolrIngestionHistory.py
##
@@ -100,12 +99,11 @@ def
tloubrieu-jpl commented on a change in pull request #8:
URL:
https://github.com/apache/incubator-sdap-ingester/pull/8#discussion_r464661619
##
File path:
collection_manager/collection_manager/services/history_manager/SolrIngestionHistory.py
##
@@ -100,12 +99,11 @@ def
eamonford merged pull request #7:
URL: https://github.com/apache/incubator-sdap-ingester/pull/7
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
eamonford commented on pull request #7:
URL:
https://github.com/apache/incubator-sdap-ingester/pull/7#issuecomment-668205691
> Ok, Eamon.
> I run the unit tests. I notice that we now have a dependency on the common
package.
> I think you could add that in the README file. Like for
eamonford commented on a change in pull request #6:
URL:
https://github.com/apache/incubator-sdap-ingester/pull/6#discussion_r458995312
##
File path: config_operator/README.md
##
@@ -25,7 +25,7 @@ The component runs as a kubernetes operator (see
containerization section)
To
eamonford merged pull request #6:
URL: https://github.com/apache/incubator-sdap-ingester/pull/6
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
eamonford opened a new pull request #7:
URL: https://github.com/apache/incubator-sdap-ingester/pull/7
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
eamonford opened a new pull request #8:
URL: https://github.com/apache/incubator-sdap-ingester/pull/8
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
tloubrieu-jpl opened a new pull request #6:
URL: https://github.com/apache/incubator-sdap-ingester/pull/6
add login for kopf operator (helps for integration in k8s different versions)
add unit tests for config_source
support username/token
add unit test for K8sConfigMap
eamonford merged pull request #103:
URL: https://github.com/apache/incubator-sdap-nexus/pull/103
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
tloubrieu-jpl merged pull request #104:
URL: https://github.com/apache/incubator-sdap-nexus/pull/104
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
echyam commented on a change in pull request #104:
URL:
https://github.com/apache/incubator-sdap-nexus/pull/104#discussion_r452462570
##
File path: analysis/webservice/webmodel/NexusRequestObject.py
##
@@ -0,0 +1,227 @@
+import logging
+import re
+from datetime import
eamonford merged pull request #5:
URL: https://github.com/apache/incubator-sdap-ingester/pull/5
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
tloubrieu-jpl merged pull request #101:
URL: https://github.com/apache/incubator-sdap-nexus/pull/101
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
tloubrieu-jpl commented on a change in pull request #101:
URL:
https://github.com/apache/incubator-sdap-nexus/pull/101#discussion_r451910342
##
File path: analysis/webservice/webapp.py
##
@@ -25,10 +25,16 @@
import pkg_resources
import tornado.web
from tornado.options
tloubrieu-jpl commented on pull request #104:
URL:
https://github.com/apache/incubator-sdap-nexus/pull/104#issuecomment-655800182
I also compared performances on podaac dev of the new docker image for this
pull request vs nexus-webapp:distributed.0.1.3
They are similar. A bit
eamonford merged pull request #105:
URL: https://github.com/apache/incubator-sdap-nexus/pull/105
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
tloubrieu-jpl commented on pull request #104:
URL:
https://github.com/apache/incubator-sdap-nexus/pull/104#issuecomment-655798699
I have created a follow on ticket SDAP-260 for the re-engineering for the
NexusRequestObject which is linked to the tornado request object which is not
thread
tloubrieu-jpl commented on a change in pull request #104:
URL:
https://github.com/apache/incubator-sdap-nexus/pull/104#discussion_r451859321
##
File path: analysis/webservice/webmodel/NexusRequestObject.py
##
@@ -0,0 +1,227 @@
+import logging
+import re
+from datetime import
tloubrieu-jpl commented on a change in pull request #104:
URL:
https://github.com/apache/incubator-sdap-nexus/pull/104#discussion_r451858049
##
File path: analysis/webservice/webmodel/CustomEncoder.py
##
@@ -0,0 +1,49 @@
+import json
+from datetime import datetime
+from
tloubrieu-jpl commented on a change in pull request #104:
URL:
https://github.com/apache/incubator-sdap-nexus/pull/104#discussion_r451855059
##
File path: analysis/webservice/algorithms/NexusCalcHandler.py
##
@@ -0,0 +1,70 @@
+import time
+import types
+
+from
tloubrieu-jpl commented on a change in pull request #104:
URL:
https://github.com/apache/incubator-sdap-nexus/pull/104#discussion_r451854205
##
File path: analysis/webservice/webmodel/NexusRequestObjectTornadoFree.py
##
@@ -0,0 +1,108 @@
+import logging
+import re
+from
tloubrieu-jpl commented on a change in pull request #104:
URL:
https://github.com/apache/incubator-sdap-nexus/pull/104#discussion_r451853844
##
File path: analysis/webservice/algorithms_spark/NexusCalcSparkHandler.py
##
@@ -0,0 +1,359 @@
+import logging
+
+import numpy as np
tloubrieu-jpl commented on a change in pull request #104:
URL:
https://github.com/apache/incubator-sdap-nexus/pull/104#discussion_r451853758
##
File path: analysis/webservice/algorithms_spark/HofMoellerSpark.py
##
@@ -100,7 +101,7 @@ def hofmoeller_stats(metrics_callback,
tloubrieu-jpl commented on a change in pull request #104:
URL:
https://github.com/apache/incubator-sdap-nexus/pull/104#discussion_r451850842
##
File path: analysis/webservice/algorithms_spark/ClimMapSpark.py
##
@@ -22,22 +22,17 @@
import numpy as np
from
tloubrieu-jpl commented on a change in pull request #105:
URL:
https://github.com/apache/incubator-sdap-nexus/pull/105#discussion_r451849444
##
File path: helm/values.yaml
##
@@ -1,24 +1,104 @@
-# Duplicate this file and put your customization here
-
+## This is the
eamonford opened a new pull request #105:
URL: https://github.com/apache/incubator-sdap-nexus/pull/105
This addresses the following Jira issues to add the Collection Manager,
Granule Ingester, and Config Operator to the SDAP Helm chart.
https://issues.apache.org/jira/browse/SDAP-238
echyam commented on pull request #104:
URL:
https://github.com/apache/incubator-sdap-nexus/pull/104#issuecomment-650433143
Sorry my review took so long. Looks like all the typos got fixed, but I
think we should still generalize from SLCP env URLs if possible.
echyam commented on a change in pull request #104:
URL:
https://github.com/apache/incubator-sdap-nexus/pull/104#discussion_r446427377
##
File path: analysis/webservice/algorithms_spark/VarianceSpark.py
##
@@ -23,15 +23,16 @@
from nexustiles.nexustiles import NexusTileService
eamonford commented on a change in pull request #104:
URL:
https://github.com/apache/incubator-sdap-nexus/pull/104#discussion_r446363886
##
File path: analysis/webservice/algorithms_spark/ClimMapSpark.py
##
@@ -22,22 +22,17 @@
import numpy as np
from nexustiles.nexustiles
eamonford commented on a change in pull request #104:
URL:
https://github.com/apache/incubator-sdap-nexus/pull/104#discussion_r446363886
##
File path: analysis/webservice/algorithms_spark/ClimMapSpark.py
##
@@ -22,22 +22,17 @@
import numpy as np
from nexustiles.nexustiles
tloubrieu-jpl opened a new pull request #104:
URL: https://github.com/apache/incubator-sdap-nexus/pull/104
This pull request removes the singleton pattern for Nexus Calc Handers.
This also simplifies the hierarchy of handlers and distribute objects in
their own file (for code
eamonford merged pull request #4:
URL: https://github.com/apache/incubator-sdap-ingester/pull/4
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
tloubrieu-jpl commented on a change in pull request #4:
URL:
https://github.com/apache/incubator-sdap-ingester/pull/4#discussion_r445885787
##
File path: collection_manager/containers/docker/entrypoint.sh
##
@@ -0,0 +1,10 @@
+#!/bin/bash
+
+python
eamonford opened a new pull request #103:
URL: https://github.com/apache/incubator-sdap-nexus/pull/103
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
eamonford commented on a change in pull request #4:
URL:
https://github.com/apache/incubator-sdap-ingester/pull/4#discussion_r445821134
##
File path: collection_manager/containers/docker/entrypoint.sh
##
@@ -0,0 +1,10 @@
+#!/bin/bash
+
+python
eamonford commented on a change in pull request #4:
URL:
https://github.com/apache/incubator-sdap-ingester/pull/4#discussion_r445817278
##
File path: collection_manager/containers/docker/entrypoint.sh
##
@@ -0,0 +1,10 @@
+#!/bin/bash
+
+python
eamonford commented on a change in pull request #4:
URL:
https://github.com/apache/incubator-sdap-ingester/pull/4#discussion_r445811851
##
File path: collection_manager/README.md
##
@@ -1,103 +1,75 @@
-# SDAP manager for ingestion of datasets
+# SDAP Collection Manager
-##
eamonford commented on a change in pull request #4:
URL:
https://github.com/apache/incubator-sdap-ingester/pull/4#discussion_r445809290
##
File path: collection_manager/collection_manager/main.py
##
@@ -8,7 +8,7 @@
logging.basicConfig(level=logging.INFO)
tloubrieu-jpl commented on a change in pull request #4:
URL:
https://github.com/apache/incubator-sdap-ingester/pull/4#discussion_r445769115
##
File path: collection_manager/containers/docker/entrypoint.sh
##
@@ -0,0 +1,10 @@
+#!/bin/bash
+
+python
fgreg commented on a change in pull request #101:
URL:
https://github.com/apache/incubator-sdap-nexus/pull/101#discussion_r444360805
##
File path: analysis/webservice/webapp.py
##
@@ -25,10 +25,16 @@
import pkg_resources
import tornado.web
from tornado.options import
tloubrieu-jpl commented on a change in pull request #101:
URL:
https://github.com/apache/incubator-sdap-nexus/pull/101#discussion_r443932972
##
File path: data-access/nexustiles/dao/CassandraProxy.py
##
@@ -168,6 +168,7 @@ def __init__(self, config):
def __open(self):
tloubrieu-jpl commented on a change in pull request #101:
URL:
https://github.com/apache/incubator-sdap-nexus/pull/101#discussion_r443932994
##
File path: data-access/nexustiles/dao/SolrProxy.py
##
@@ -36,12 +36,18 @@ class SolrProxy(object):
def __init__(self, config):
tloubrieu-jpl commented on a change in pull request #101:
URL:
https://github.com/apache/incubator-sdap-nexus/pull/101#discussion_r443931960
##
File path: analysis/webservice/webapp.py
##
@@ -156,6 +155,23 @@ def async_callback(self, result):
if hasattr(result,
501 - 600 of 1280 matches
Mail list logo
