[ 
https://issues.apache.org/jira/browse/FLINK-7951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16235598#comment-16235598
 ] 

ASF GitHub Bot commented on FLINK-7951:
---------------------------------------

Github user steveloughran commented on the issue:

    https://github.com/apache/flink/pull/4926
  
    creating YarnConfiguration & HdfsConfiguration through some dynamic 
classloading is enough to force in these files & configs underneath your own 
Configurations. You shouldn't be reading in all their values and sending them 
over the wire with your job, just the direct values off your config, which you 
can just enum directly off the Configuration (which is Writeable, BTW),  I have 
some scala code to send it around [using Java 
serialization](https://github.com/hortonworks-spark/cloud-integration/blob/master/spark-cloud-integration/src/main/scala/com/hortonworks/spark/cloud/utils/ConfigSerDeser.scala)
 if that helps


> YarnApplicationMaster does not load HDFSConfiguration
> -----------------------------------------------------
>
>                 Key: FLINK-7951
>                 URL: https://issues.apache.org/jira/browse/FLINK-7951
>             Project: Flink
>          Issue Type: Bug
>          Components: YARN
>    Affects Versions: 1.4.0
>            Reporter: Till Rohrmann
>            Assignee: Till Rohrmann
>            Priority: Critical
>             Fix For: 1.4.0
>
>
> When instantiating the {{YarnConfiguration}} we do not load the corresponding 
> {{HDFSConfiguration}}. This causes that we do not read the {{hdfs-site.xml}}.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to