[
https://issues.apache.org/jira/browse/SPARK-22601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16265264#comment-16265264
]
Sujith edited comment on SPARK-22601 at 11/24/17 1:32 PM:
----------------------------------------------------------
I think in this scenario we should validate the hdfs path to check whether
its existing , as i noticed we are validating and throwing exception in case of
local non existing file path. if we wont validate then then this can mislead
the user and also this creates an inconsistency in the load command behaviour
with local and hdfs path. i am working on this issue, will raise PR asap.
was (Author: s71955):
I think in this scenario we should validate the hdfs path to check whether
its existing , as i noticed we are validating and throwing exception in case of
local non existing file path. i am working on this issue, will raise PR asap.
> Data load is getting displayed successful on providing non existing hdfs file
> path
> ----------------------------------------------------------------------------------
>
> Key: SPARK-22601
> URL: https://issues.apache.org/jira/browse/SPARK-22601
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 2.2.0
> Reporter: Sujith
> Priority: Minor
>
> Data load is getting displayed successful on providing non existing hdfs file
> path where as in local path proper error message is getting displayed
> create table tb2 (a string, b int);
> load data inpath 'hdfs://hacluster/data1.csv' into table tb2
> Note: data1.csv does not exist in HDFS
> when local non existing file path is given below error message will be
> displayed
> "LOAD DATA input path does not exist". attached snapshots of behaviour in
> spark 2.1 and spark 2.2 version
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
