RE: Spark 2.0 error: Wrong FS: file://spark-warehouse, expected: file:///

[Ulanov, Alexander]

Hi Sean,

I updated the issue, could you check the changes?

Best regards, Alexander

-Original Message-
From: Sean Owen [mailto:so...@cloudera.com] 
Sent: Wednesday, August 03, 2016 2:49 AM
To: Utkarsh Sengar <utkarsh2...@gmail.com>
Cc: User <user@spark.apache.org>
Subject: Re: Spark 2.0 error: Wrong FS: file://spark-warehouse, expected: 
file:///

This is https://issues.apache.org/jira/browse/SPARK-15899  -- anyone seeing 
this please review the proposed change. I think it's stalled and needs an 
update.

On Tue, Aug 2, 2016 at 4:47 PM, Utkarsh Sengar <utkarsh2...@gmail.com> wrote:
> Upgraded to spark2.0 and tried to load a model:
> LogisticRegressionModel model = LogisticRegressionModel.load(sc.sc(),
> "s3a://cruncher/c/models/lr/");
>
> Getting this error: Exception in thread "main"
> java.lang.IllegalArgumentException: Wrong FS: file://spark-warehouse,
> expected: file:///
> Full stacktrace:
> https://gist.githubusercontent.com/utkarsh2012/7c4c8e0f408e36a8fb6d9c9
> d3bd6b301/raw/2621ed3ceffb63d72ecdce169193dfabe4d41b40/spark2.0%2520LR
> %2520load
>
>
> This was working fine in Spark 1.5.1. I don't have "spark-warehouse"
> anywhere in my code, so its somehow defaulting to that.
>
> --
> Thanks,
> -Utkarsh

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Re: Spark 2.0 error: Wrong FS: file://spark-warehouse, expected: file:///

[Utkarsh Sengar]

I don't think its a related problem, although by setting
"spark.sql.warehouse.dir"=/tmp in spark config fixed it.

On Tue, Aug 2, 2016 at 5:02 PM, Utkarsh Sengar 
wrote:

> Do we have a workaround for this problem?
> Can I overwrite that using some config?
>
> On Tue, Aug 2, 2016 at 4:48 PM, Sean Owen  wrote:
>
>> This is https://issues.apache.org/jira/browse/SPARK-15899  -- anyone
>> seeing this please review the proposed change. I think it's stalled
>> and needs an update.
>>
>> On Tue, Aug 2, 2016 at 4:47 PM, Utkarsh Sengar 
>> wrote:
>> > Upgraded to spark2.0 and tried to load a model:
>> > LogisticRegressionModel model = LogisticRegressionModel.load(sc.sc(),
>> > "s3a://cruncher/c/models/lr/");
>> >
>> > Getting this error: Exception in thread "main"
>> > java.lang.IllegalArgumentException: Wrong FS: file://spark-warehouse,
>> > expected: file:///
>> > Full stacktrace:
>> >
>> https://gist.githubusercontent.com/utkarsh2012/7c4c8e0f408e36a8fb6d9c9d3bd6b301/raw/2621ed3ceffb63d72ecdce169193dfabe4d41b40/spark2.0%2520LR%2520load
>> >
>> >
>> > This was working fine in Spark 1.5.1. I don't have "spark-warehouse"
>> > anywhere in my code, so its somehow defaulting to that.
>> >
>> > --
>> > Thanks,
>> > -Utkarsh
>>
>
>
>
> --
> Thanks,
> -Utkarsh
>



-- 
Thanks,
-Utkarsh

Re: Spark 2.0 error: Wrong FS: file://spark-warehouse, expected: file:///

[Utkarsh Sengar]

Do we have a workaround for this problem?
Can I overwrite that using some config?

On Tue, Aug 2, 2016 at 4:48 PM, Sean Owen  wrote:

> This is https://issues.apache.org/jira/browse/SPARK-15899  -- anyone
> seeing this please review the proposed change. I think it's stalled
> and needs an update.
>
> On Tue, Aug 2, 2016 at 4:47 PM, Utkarsh Sengar 
> wrote:
> > Upgraded to spark2.0 and tried to load a model:
> > LogisticRegressionModel model = LogisticRegressionModel.load(sc.sc(),
> > "s3a://cruncher/c/models/lr/");
> >
> > Getting this error: Exception in thread "main"
> > java.lang.IllegalArgumentException: Wrong FS: file://spark-warehouse,
> > expected: file:///
> > Full stacktrace:
> >
> https://gist.githubusercontent.com/utkarsh2012/7c4c8e0f408e36a8fb6d9c9d3bd6b301/raw/2621ed3ceffb63d72ecdce169193dfabe4d41b40/spark2.0%2520LR%2520load
> >
> >
> > This was working fine in Spark 1.5.1. I don't have "spark-warehouse"
> > anywhere in my code, so its somehow defaulting to that.
> >
> > --
> > Thanks,
> > -Utkarsh
>



-- 
Thanks,
-Utkarsh

Re: Spark 2.0 error: Wrong FS: file://spark-warehouse, expected: file:///

[Sean Owen]

This is https://issues.apache.org/jira/browse/SPARK-15899  -- anyone
seeing this please review the proposed change. I think it's stalled
and needs an update.

On Tue, Aug 2, 2016 at 4:47 PM, Utkarsh Sengar  wrote:
> Upgraded to spark2.0 and tried to load a model:
> LogisticRegressionModel model = LogisticRegressionModel.load(sc.sc(),
> "s3a://cruncher/c/models/lr/");
>
> Getting this error: Exception in thread "main"
> java.lang.IllegalArgumentException: Wrong FS: file://spark-warehouse,
> expected: file:///
> Full stacktrace:
> https://gist.githubusercontent.com/utkarsh2012/7c4c8e0f408e36a8fb6d9c9d3bd6b301/raw/2621ed3ceffb63d72ecdce169193dfabe4d41b40/spark2.0%2520LR%2520load
>
>
> This was working fine in Spark 1.5.1. I don't have "spark-warehouse"
> anywhere in my code, so its somehow defaulting to that.
>
> --
> Thanks,
> -Utkarsh

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org