[ https://issues.apache.org/jira/browse/SPARK-4534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Lianhui Wang updated SPARK-4534: -------------------------------- Description: example: SparkConf sparkConf=new SparkConf(); Configuration conf = new Configuration(); List inputFormatInfoList =new ArrayList<InputFormatInfo>(); inputFormatInfoList.add(new InputFormatInfo(conf, org.apache.hadoop.mapred.TextInputFormat.class, path)); JavaSparkContext ctx=new JavaSparkContext(sparkConf,inputFormatInfoList); we can use above code to let preferredNodeLocalityData be work in Java program. was: example: SparkConf sparkConf=new SparkConf(); Configuration conf = new Configuration(); List inputFormatInfoList =new ArrayList<InputFormatInfo>(); inputFormatInfoList.add(new InputFormatInfo(conf, org.apache.hadoop.mapred.TextInputFormat.class, path)); JavaSparkContext ctx=new JavaSparkContext(sparkConf,inputFormatInfoList); we can use above code to let preferredNodeLocalityData be work in Java programme. > With YARN, JavaSparkContext provide to add preferredNodeLocalityData to > SparkContext > ------------------------------------------------------------------------------------ > > Key: SPARK-4534 > URL: https://issues.apache.org/jira/browse/SPARK-4534 > Project: Spark > Issue Type: Improvement > Components: Java API > Reporter: Lianhui Wang > > example: > SparkConf sparkConf=new SparkConf(); > Configuration conf = new Configuration(); > List inputFormatInfoList =new ArrayList<InputFormatInfo>(); > inputFormatInfoList.add(new InputFormatInfo(conf, > org.apache.hadoop.mapred.TextInputFormat.class, path)); > JavaSparkContext ctx=new JavaSparkContext(sparkConf,inputFormatInfoList); > we can use above code to let preferredNodeLocalityData be work in Java > program. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org