[
https://issues.apache.org/jira/browse/BEAM-4666?focusedWorklogId=117056&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-117056
]
ASF GitHub Bot logged work on BEAM-4666:
----------------------------------------
Author: ASF GitHub Bot
Created on: 28/Jun/18 21:41
Start Date: 28/Jun/18 21:41
Worklog Time Spent: 10m
Work Description: herohde commented on a change in pull request #5810:
[BEAM-4666] Make Go run on Flink again
URL: https://github.com/apache/beam/pull/5810#discussion_r198995514
##########
File path:
runners/java-fn-execution/src/main/java/org/apache/beam/runners/fnexecution/environment/DockerEnvironmentFactory.java
##########
@@ -114,20 +112,16 @@ public RemoteEnvironment createEnvironment(Environment
environment) throws Excep
String workerId = idGenerator.getId();
// Prepare docker invocation.
- Path workerPersistentDirectory =
Files.createTempDirectory("worker_persistent_directory");
- Path semiPersistentDirectory =
Files.createTempDirectory("semi_persistent_dir");
Review comment:
I think we should omit this till if/when we decide to do it right. The
current code was a bit confused (the path inside the container shouldn't be
created on the host) and if we use kubernetes, say, then it would be done in a
different way. For local runs, having no mounts is not unreasonable.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 117056)
Time Spent: 2h 10m (was: 2h)
> Go SDK fails to stage artifacts on Flink
> ----------------------------------------
>
> Key: BEAM-4666
> URL: https://issues.apache.org/jira/browse/BEAM-4666
> Project: Beam
> Issue Type: Bug
> Components: sdk-go
> Reporter: Henning Rohde
> Assignee: Henning Rohde
> Priority: Major
> Time Spent: 2h 10m
> Remaining Estimate: 0h
>
> $ go run examples/wordcount/wordcount.go --runner=flink
> --endpoint=localhost:8099 --output=/tmp/asd
> 2018/06/27 17:17:02 No container image specified. Using dev image:
> 'herohde-docker-apache.bintray.io/beam/go:latest'
> 2018/06/27 17:17:02 Prepared job with id:
> go-job-1-1530145022009357193_b49f59e5-4dfc-4b82-aa67-cad62a3f7d6a and staging
> token:
> {"sessionId":"go-job-1-1530145022009357193_b49f59e5-4dfc-4b82-aa67-cad62a3f7d6a","basePath":"/tmp/flink-artifacts"}
> 2018/06/27 17:17:02 Cross-compiling
> /Users/herohde/go/src/github.com/apache/beam/sdks/go/examples/wordcount/wordcount.go
> as
> /var/folders/s2/97strbs55_353t_t7r24yf94009w4s/T/beam-go-1530145022019779968
> 2018/06/27 17:17:12 Failed to execute job: failed to stage artifacts: failed
> to stage
> {"sessionId":"go-job-1-1530145022009357193_b49f59e5-4dfc-4b82-aa67-cad62a3f7d6a","basePath":"/tmp/flink-artifacts"}
> in 3 attempts: stat
> {"sessionId":"go-job-1-1530145022009357193_b49f59e5-4dfc-4b82-aa67-cad62a3f7d6a","basePath":"/tmp/flink-artifacts"}:
> no such file or directory; stat
> {"sessionId":"go-job-1-1530145022009357193_b49f59e5-4dfc-4b82-aa67-cad62a3f7d6a","basePath":"/tmp/flink-artifacts"}:
> no such file or directory; stat
> {"sessionId":"go-job-1-1530145022009357193_b49f59e5-4dfc-4b82-aa67-cad62a3f7d6a","basePath":"/tmp/flink-artifacts"}:
> no such file or directory; stat
> {"sessionId":"go-job-1-1530145022009357193_b49f59e5-4dfc-4b82-aa67-cad62a3f7d6a","basePath":"/tmp/flink-artifacts"}:
> no such file or directory
> exit status 1
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
