[ 
https://issues.apache.org/jira/browse/BEAM-9383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17112678#comment-17112678
 ] 

Chamikara Madhusanka Jayalath commented on BEAM-9383:
-----------------------------------------------------

Seems like it's picking up jars from the Java runtime.

nashorn.jar
ldrdata.jar
jfxrt.jar
dnsns.jar
localedata.jar
MRJToolkit.jar
beam-sdks-java-io-expansion-service-2.22.0-SNAPSHOT.jar

 

Also part of the problem is that 
beam-sdks-java-io-expansion-service-2.22.0-SNAPSHOT.jar is 51MB and takes a 
long time to stage.

 

We stage two of each of the above since we have both Kafka read and write 
transforms in the pipeline.

 

Can we somehow exclude jars from the Java runtime here ?

[https://github.com/apache/beam/blob/master/sdks/java/expansion-service/src/main/java/org/apache/beam/sdk/expansion/service/ExpansionService.java#L324]

> Staging Dataflow artifacts from environment
> -------------------------------------------
>
>                 Key: BEAM-9383
>                 URL: https://issues.apache.org/jira/browse/BEAM-9383
>             Project: Beam
>          Issue Type: Sub-task
>          Components: java-fn-execution
>            Reporter: Heejong Lee
>            Assignee: Heejong Lee
>            Priority: P0
>             Fix For: 2.22.0
>
>          Time Spent: 12h
>  Remaining Estimate: 0h
>
> Staging Dataflow artifacts from environment



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to