[jira] [Commented] (SDAP-276) weird values in timeAvgMap

2020-08-11 Thread Thomas G Loubrieu (Jira)
[ https://issues.apache.org/jira/browse/SDAP-276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175863#comment-17175863 ] Thomas G Loubrieu commented on SDAP-276: A possibility is that some tiles are not i

[jira] [Updated] (SDAP-281) bigdata ingestion feedback

2020-08-11 Thread Thomas G Loubrieu (Jira)
[ https://issues.apache.org/jira/browse/SDAP-281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas G Loubrieu updated SDAP-281: --- Description: While doing the ingestion on bigdata wth configuration file https://github.com/tl

[jira] [Updated] (SDAP-281) bigdata ingestion feedback

2020-08-11 Thread Thomas G Loubrieu (Jira)
[ https://issues.apache.org/jira/browse/SDAP-281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas G Loubrieu updated SDAP-281: --- Description: While doing the ingestion on bigdata wth configuration file https://github.com/tl

[jira] [Created] (SDAP-281) bigdata ingestion feedback

2020-08-11 Thread Thomas G Loubrieu (Jira)
Thomas G Loubrieu created SDAP-281: -- Summary: bigdata ingestion feedback Key: SDAP-281 URL: https://issues.apache.org/jira/browse/SDAP-281 Project: Apache Science Data Analytics Platform Iss

[GitHub] [incubator-sdap-nexus] tloubrieu-jpl opened a new pull request #107: Sdap 268: asynchronous request management

2020-08-11 Thread GitBox
tloubrieu-jpl opened a new pull request #107: URL: https://github.com/apache/incubator-sdap-nexus/pull/107 So far: - added the fair scheduling option in spark (no tested with big jobs yet) - added NexusHandlerManager to manage different end-points for a single algorthim. The demonstra

[jira] [Updated] (SDAP-280) Collection Manager should not block when checking ingestion history

2020-08-11 Thread Eamon Ford (Jira)
[ https://issues.apache.org/jira/browse/SDAP-280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eamon Ford updated SDAP-280: Resolution: Done Status: Done (was: In Progress) > Collection Manager should not block when checking

[GitHub] [incubator-sdap-ingester] eamonford merged pull request #16: SDAP-280: Collection Manager to talk to Ingestion History asynchronously

2020-08-11 Thread GitBox
eamonford merged pull request #16: URL: https://github.com/apache/incubator-sdap-ingester/pull/16 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

[jira] [Updated] (SDAP-279) Collection Manager does not pick up fs events with NAS mount

2020-08-11 Thread Eamon Ford (Jira)
[ https://issues.apache.org/jira/browse/SDAP-279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eamon Ford updated SDAP-279: Resolution: Fixed Status: Done (was: In Progress) > Collection Manager does not pick up fs events wi

[GitHub] [incubator-sdap-ingester] eamonford merged pull request #17: SDAP-279: Poll filesystem for file updates

2020-08-11 Thread GitBox
eamonford merged pull request #17: URL: https://github.com/apache/incubator-sdap-ingester/pull/17 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

[GitHub] [incubator-sdap-ingester] eamonford commented on a change in pull request #16: SDAP-280: Collection Manager to talk to Ingestion History asynchronously

2020-08-11 Thread GitBox
eamonford commented on a change in pull request #16: URL: https://github.com/apache/incubator-sdap-ingester/pull/16#discussion_r468750245 ## File path: collection_manager/collection_manager/services/CollectionProcessor.py ## @@ -59,13 +59,13 @@ async def process_granule(self,

[GitHub] [incubator-sdap-ingester] tloubrieu-jpl commented on a change in pull request #17: SDAP-279: Poll filesystem for file updates

2020-08-11 Thread GitBox
tloubrieu-jpl commented on a change in pull request #17: URL: https://github.com/apache/incubator-sdap-ingester/pull/17#discussion_r468617699 ## File path: collection_manager/collection_manager/services/CollectionWatcher.py ## @@ -1,12 +1,12 @@ import asyncio +import time im

[GitHub] [incubator-sdap-ingester] tloubrieu-jpl commented on a change in pull request #16: SDAP-280: Collection Manager to talk to Ingestion History asynchronously

2020-08-11 Thread GitBox
tloubrieu-jpl commented on a change in pull request #16: URL: https://github.com/apache/incubator-sdap-ingester/pull/16#discussion_r468608811 ## File path: collection_manager/collection_manager/services/CollectionProcessor.py ## @@ -59,13 +59,13 @@ async def process_granule(se