Re: Return binary mode in ThriftServer

[lalit sharma]

+1 for bringing this back.

 Binary mode needs to be present for working with data visualization tools.

--Regards,
Lalit

On Tue, Jun 14, 2016 at 7:07 PM, Raymond Honderdors <
raymond.honderd...@sizmek.com> wrote:

> I experienced something similar using Sprak+Microstretegy
>
> I reformatted the commands file locally and recompiled spark 2.0, for the
> issue was resolved, but I am not sure I made the change in the correct
> direction
>
> 1.SPARK-14947 <https://issues.apache.org/jira/browse/SPARK-14947>
>
>
>
>
>
>
>
>
>
> *Raymond Honderdors *
>
> *Team Lead Analytics BI*
>
> *Business Intelligence Developer *
>
> *raymond.honderd...@sizmek.com <raymond.honderd...@sizmek.com> *
>
> *T +972.7325.3569*
>
> *Herzliya*
>
>
>
> *From:* Chris Fregly [mailto:ch...@fregly.com]
> *Sent:* Tuesday, June 14, 2016 4:06 PM
> *To:* Reynold Xin <r...@databricks.com>
> *Cc:* Egor Pahomov <pahomov.e...@gmail.com>; dav...@databricks.com;
> dev@spark.apache.org
> *Subject:* Re: Return binary mode in ThriftServer
>
>
>
> +1 on bringing it back.  causing all sorts of problems on my end that was
> not obvious without digging in
>
>
>
> I was having problems building spark, as well, with the
> --hive-thriftserver flag.  also thought I was doing something wrong on my
> end.
>
>
> On Jun 13, 2016, at 9:11 PM, Reynold Xin <r...@databricks.com> wrote:
>
> Thanks for the email. Things like this (and bugs) are exactly the reason
> the preview releases exist. It seems like enough people have run into
> problem with this one that maybe we should just bring it back for backward
> compatibility.
>
> On Monday, June 13, 2016, Egor Pahomov <pahomov.e...@gmail.com> wrote:
>
> In May due to the SPARK-15095 binary mode was "removed" (code is there,
> but you can not turn it on) from Spark-2.0. In 1.6.1 binary was default and
> in 2.0.0-preview it was removed. It's really annoying:
>
>- I can not use Tableau+Spark anymore
>- I need to change connection URL in SQL client for every analyst in
>my organization. And with Squirrel I experiencing problems with that.
>- We have parts of infrastructure, which connected to data
>infrastructure though ThriftServer. And of course format was binary.
>
> I've created a ticket to get binary back(
> https://issues.apache.org/jira/browse/SPARK-15934), but that's not the
> point. I've experienced this problem a month ago, but haven't done anything
> about it, because I believed, that I'm stupid and doing something wrong.
> But documentation was release recently and it contained no information
> about this new thing and it made me digging.
>
>
>
> Most of what I describe is just annoying, but Tableau+Spark new
> incompatibility I believe is big deal. Maybe I'm wrong and there are ways
> to make things work, it's just I wouldn't expect move to 2.0.0 to be so
> time consuming.
>
>
>
> My point: Do we have any guidelines regarding doing such radical things?
>
>
>
> --
>
>
>
>
> *Sincerely yours Egor Pakhomov *
>
>

RE: Return binary mode in ThriftServer

[Raymond Honderdors]

I experienced something similar using Sprak+Microstretegy
I reformatted the commands file locally and recompiled spark 2.0, for the issue 
was resolved, but I am not sure I made the change in the correct direction
1.SPARK-14947<https://issues.apache.org/jira/browse/SPARK-14947>




Raymond Honderdors
Team Lead Analytics BI
Business Intelligence Developer
raymond.honderd...@sizmek.com<mailto:raymond.honderd...@sizmek.com>
T +972.7325.3569
Herzliya

From: Chris Fregly [mailto:ch...@fregly.com]
Sent: Tuesday, June 14, 2016 4:06 PM
To: Reynold Xin <r...@databricks.com>
Cc: Egor Pahomov <pahomov.e...@gmail.com>; dav...@databricks.com; 
dev@spark.apache.org
Subject: Re: Return binary mode in ThriftServer

+1 on bringing it back.  causing all sorts of problems on my end that was not 
obvious without digging in

I was having problems building spark, as well, with the --hive-thriftserver 
flag.  also thought I was doing something wrong on my end.

On Jun 13, 2016, at 9:11 PM, Reynold Xin 
<r...@databricks.com<mailto:r...@databricks.com>> wrote:
Thanks for the email. Things like this (and bugs) are exactly the reason the 
preview releases exist. It seems like enough people have run into problem with 
this one that maybe we should just bring it back for backward compatibility.

On Monday, June 13, 2016, Egor Pahomov 
<pahomov.e...@gmail.com<mailto:pahomov.e...@gmail.com>> wrote:
In May due to the SPARK-15095 binary mode was "removed" (code is there, but you 
can not turn it on) from Spark-2.0. In 1.6.1 binary was default and in 
2.0.0-preview it was removed. It's really annoying:

  *   I can not use Tableau+Spark anymore
  *   I need to change connection URL in SQL client for every analyst in my 
organization. And with Squirrel I experiencing problems with that.
  *   We have parts of infrastructure, which connected to data infrastructure 
though ThriftServer. And of course format was binary.
I've created a ticket to get binary 
back(https://issues.apache.org/jira/browse/SPARK-15934), but that's not the 
point. I've experienced this problem a month ago, but haven't done anything 
about it, because I believed, that I'm stupid and doing something wrong. But 
documentation was release recently and it contained no information about this 
new thing and it made me digging.

Most of what I describe is just annoying, but Tableau+Spark new incompatibility 
I believe is big deal. Maybe I'm wrong and there are ways to make things work, 
it's just I wouldn't expect move to 2.0.0 to be so time consuming.

My point: Do we have any guidelines regarding doing such radical things?

--
Sincerely yours
Egor Pakhomov

Re: Return binary mode in ThriftServer

[Chris Fregly]

+1 on bringing it back.  causing all sorts of problems on my end that was not 
obvious without digging in

I was having problems building spark, as well, with the --hive-thriftserver 
flag.  also thought I was doing something wrong on my end.

> On Jun 13, 2016, at 9:11 PM, Reynold Xin  wrote:
> 
> Thanks for the email. Things like this (and bugs) are exactly the reason the 
> preview releases exist. It seems like enough people have run into problem 
> with this one that maybe we should just bring it back for backward 
> compatibility. 
> 
>> On Monday, June 13, 2016, Egor Pahomov  wrote:
>> In May due to the SPARK-15095 binary mode was "removed" (code is there, but 
>> you can not turn it on) from Spark-2.0. In 1.6.1 binary was default and in 
>> 2.0.0-preview it was removed. It's really annoying: 
>> I can not use Tableau+Spark anymore
>> I need to change connection URL in SQL client for every analyst in my 
>> organization. And with Squirrel I experiencing problems with that.
>> We have parts of infrastructure, which connected to data infrastructure 
>> though ThriftServer. And of course format was binary.
>> I've created a ticket to get binary 
>> back(https://issues.apache.org/jira/browse/SPARK-15934), but that's not the 
>> point. I've experienced this problem a month ago, but haven't done anything 
>> about it, because I believed, that I'm stupid and doing something wrong. But 
>> documentation was release recently and it contained no information about 
>> this new thing and it made me digging. 
>> 
>> Most of what I describe is just annoying, but Tableau+Spark new 
>> incompatibility I believe is big deal. Maybe I'm wrong and there are ways to 
>> make things work, it's just I wouldn't expect move to 2.0.0 to be so time 
>> consuming. 
>> 
>> My point: Do we have any guidelines regarding doing such radical things?
>> 
>> -- 
>> Sincerely yours
>> Egor Pakhomov

Re: Return binary mode in ThriftServer

[Reynold Xin]

Thanks for the email. Things like this (and bugs) are exactly the reason
the preview releases exist. It seems like enough people have run into
problem with this one that maybe we should just bring it back for backward
compatibility.

On Monday, June 13, 2016, Egor Pahomov  wrote:

> In May due to the SPARK-15095 binary mode was "removed" (code is there,
> but you can not turn it on) from Spark-2.0. In 1.6.1 binary was default and
> in 2.0.0-preview it was removed. It's really annoying:
>
>- I can not use Tableau+Spark anymore
>- I need to change connection URL in SQL client for every analyst in
>my organization. And with Squirrel I experiencing problems with that.
>- We have parts of infrastructure, which connected to data
>infrastructure though ThriftServer. And of course format was binary.
>
> I've created a ticket to get binary back(
> https://issues.apache.org/jira/browse/SPARK-15934), but that's not the
> point. I've experienced this problem a month ago, but haven't done anything
> about it, because I believed, that I'm stupid and doing something wrong.
> But documentation was release recently and it contained no information
> about this new thing and it made me digging.
>
> Most of what I describe is just annoying, but Tableau+Spark new
> incompatibility I believe is big deal. Maybe I'm wrong and there are ways
> to make things work, it's just I wouldn't expect move to 2.0.0 to be so
> time consuming.
>
> My point: Do we have any guidelines regarding doing such radical things?
>
> --
>
>
> *Sincerely yoursEgor Pakhomov*
>

Return binary mode in ThriftServer

[Egor Pahomov]

In May due to the SPARK-15095 binary mode was "removed" (code is there, but
you can not turn it on) from Spark-2.0. In 1.6.1 binary was default and in
2.0.0-preview it was removed. It's really annoying:

   - I can not use Tableau+Spark anymore
   - I need to change connection URL in SQL client for every analyst in my
   organization. And with Squirrel I experiencing problems with that.
   - We have parts of infrastructure, which connected to data
   infrastructure though ThriftServer. And of course format was binary.

I've created a ticket to get binary back(
https://issues.apache.org/jira/browse/SPARK-15934), but that's not the
point. I've experienced this problem a month ago, but haven't done anything
about it, because I believed, that I'm stupid and doing something wrong.
But documentation was release recently and it contained no information
about this new thing and it made me digging.

Most of what I describe is just annoying, but Tableau+Spark new
incompatibility I believe is big deal. Maybe I'm wrong and there are ways
to make things work, it's just I wouldn't expect move to 2.0.0 to be so
time consuming.

My point: Do we have any guidelines regarding doing such radical things?

-- 


*Sincerely yoursEgor Pakhomov*