Re: Adding Kubernetes support to Livy

2024-07-08 Thread Marco Gaido
Hi, I do not have objections. Thanks, Marco Il giorno lun 8 lug 2024 alle ore 15:36 György Gál ha scritto: > Hi all, > > There is an updated version of the PR adding Livy Kubernetes support ( > LIVY-702 ) at > https://github.com/apache/incubator-

[jira] [Resolved] (LIVY-987) NPE when waiting for thrift session to start timeout.

2023-09-05 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/LIVY-987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido resolved LIVY-987. -- Resolution: Fixed Issue resolved by https://github.com/apache/incubator-livy/pull/416. > NPE w

[jira] [Updated] (LIVY-987) NPE when waiting for thrift session to start timeout.

2023-09-05 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/LIVY-987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido updated LIVY-987: - Fix Version/s: 0.9.0 > NPE when waiting for thrift session to start time

[jira] [Updated] (LIVY-987) NPE when waiting for thrift session to start timeout.

2023-09-05 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/LIVY-987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido updated LIVY-987: - Component/s: Thriftserver > NPE when waiting for thrift session to start time

Re: API rate limit

2023-08-11 Thread Marco Gaido
Hi, please check https://issues.apache.org/jira/browse/LIVY-412. Thanks, Marco Il giorno mer 9 ago 2023 alle ore 16:51 Sadha Chilukoori < sage.quoti...@gmail.com> ha scritto: > Hi folks, > > Hope you are all doing well. > > My company is using Livy to submit spark jobs on AWS. On one project wh

Re: API rate limit

2023-08-11 Thread Marco Gaido
Hi, please check https://issues.apache.org/jira/browse/LIVY-412. Thanks, Marco Il giorno mer 9 ago 2023 alle ore 16:51 Sadha Chilukoori < sage.quoti...@gmail.com> ha scritto: > Hi folks, > > Hope you are all doing well. > > My company is using Livy to submit spark jobs on AWS. On one project wh

[jira] [Comment Edited] (SPARK-14516) Clustering evaluator

2023-03-27 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/SPARK-14516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16069815#comment-16069815 ] Marco Gaido edited comment on SPARK-14516 at 3/27/23 9:4

[jira] [Commented] (SPARK-14516) Clustering evaluator

2023-03-27 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/SPARK-14516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17705265#comment-17705265 ] Marco Gaido commented on SPARK-14516: - As there are some issues with the Google

[jira] [Commented] (LIVY-899) The state of interactive session is always idle when using thrift protocol.

2022-11-15 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/LIVY-899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17634337#comment-17634337 ] Marco Gaido commented on LIVY-899: -- Can you reproduce the issue with a UT? If so, pl

[jira] [Assigned] (LIVY-899) The state of interactive session is always idle when using thrift protocol.

2022-11-15 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/LIVY-899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido reassigned LIVY-899: Assignee: (was: Marco Gaido) > The state of interactive session is always idle when us

Re: [NOTICE] Adding new PPMC and Committers to Apache Livy

2022-10-31 Thread Marco Gaido
lready been added. > The invitations are only for the brand new committers. > > You are already on the PPMC list. > > Thank you for following up those, just in case! > > thanks, > > --larry > > On Mon, Oct 31, 2022 at 4:49 AM Marco Gaido > wrote: > >> Hi La

Re: [NOTICE] Adding new PPMC and Committers to Apache Livy

2022-10-31 Thread Marco Gaido
Hi Larry, I also expressed my interest in still being part of the community. At least for the thriftserver part, which I contributed and maintained. Thanks, Marco Il giorno lun 31 ott 2022 alle ore 02:08 larry mccay ha scritto: > All - > > I have sent a single invitation to all those on the to

Re: Proposal to Revive Apache Livy Community

2022-10-24 Thread Marco Gaido
Hi all, I am also busy with different projects at the moment, as such I am more than happy if ai can help somehow, e.g. reviewing code in parts that I know, but I cannot allocate much bandwidth to it. Thanks, Marco Il lun 24 ott 2022, 22:07 larry mccay ha scritto: > Personally, I would welcome

[jira] [Commented] (SPARK-36673) Incorrect Unions of struct with mismatched field name case

2021-09-06 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17410488#comment-17410488 ] Marco Gaido commented on SPARK-36673: - AFAIK, in SQL the names in the struct

[jira] [Commented] (LIVY-489) Expose a JDBC endpoint for Livy

2021-03-29 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/LIVY-489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17310849#comment-17310849 ] Marco Gaido commented on LIVY-489: -- [~akshay.kotechajain] you can find an example in

Re: [VOTE] Release Livy 0.7.1 based on RC1

2021-02-05 Thread Marco Gaido
+1 for me. Thanks, Marco On Thu, 4 Feb 2021, 06:44 Saisai Shao, wrote: > This vote is for releasing Livy 0.7.1 based on RC1. > > The vote will be open until Feb 10 23:59 UTC and > will pass with a minimum of 3 +1 binding votes and a majority of positive > votes. > > [+1] This release is ready t

[jira] [Resolved] (LIVY-754) precision and scale are not encoded in decimal type

2020-05-20 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/LIVY-754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido resolved LIVY-754. -- Fix Version/s: 0.8.0 Assignee: Wing Yew Poon Resolution: Fixed Issue resolved by PR

[jira] [Resolved] (LIVY-752) Livy TS does not accept any connections when limits are set on connections

2020-03-16 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/LIVY-752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido resolved LIVY-752. -- Fix Version/s: 0.8.0 Assignee: Wing Yew Poon Resolution: Fixed Issue resolved by PR

[jira] [Resolved] (LIVY-745) more than 11 concurrent clients lead to java.io.IOException: Unable to connect to provided ports 10000~10010

2020-02-15 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/LIVY-745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido resolved LIVY-745. -- Fix Version/s: 0.7.0 Assignee: Wing Yew Poon Resolution: Fixed Issue resolved by pull

Re: Livy on Kubernetes support

2020-01-14 Thread Marco Gaido
Hi Aliaksandr, thanks for your email and you work on this feature. As I mentioned to you in the PR, I agree with you on the usefulness of this feature and you have a big +1 from me having it in Livy. Unfortunately, it is not my area of expertise, so I don't feel confident merging it without other

Re: Livy metrics

2020-01-10 Thread Marco Gaido
I think the best approach would be first preparing a design doc with your proposal so we can discuss on it and decide how to go about it. You can go ahead with this if you want to contribute. Thanks, Marco . Il giorno ven 10 gen 2020 alle ore 03:00 安辉 ha scritto: > In my company, We are maintai

[jira] [Comment Edited] (LIVY-718) Support multi-active high availability in Livy

2019-12-30 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/LIVY-718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17005512#comment-17005512 ] Marco Gaido edited comment on LIVY-718 at 12/30/19 6:29 PM:

[jira] [Commented] (LIVY-718) Support multi-active high availability in Livy

2019-12-30 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/LIVY-718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17005512#comment-17005512 ] Marco Gaido commented on LIVY-718: -- > IIRC JDBC had a REST and an RPC mode. The R

[jira] [Commented] (LIVY-718) Support multi-active high availability in Livy

2019-12-29 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/LIVY-718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17005063#comment-17005063 ] Marco Gaido commented on LIVY-718: -- Thanks for your comments [~bikassaha]. I am not

Re: [RESULT][Vote][LIVY-718] Support multi-active high availability in Livy

2019-12-18 Thread Marco Gaido
Thank you for this proposal and your work. Looking forward to it. Thanks, Marco On Thu, 19 Dec 2019, 07:27 Yiheng Wang, wrote: > Hi All > > Thanks for participating in the vote. Here's the result: > +1 (binding) > ajbozarth > zjffdu > mgaido91 > jerryshao > > +1 (no-binding) > 5 > > The vote pas

Re: Unable to retrieve livy statement status

2019-12-14 Thread Marco Gaido
I think this question is better to be submitted to the user list: you're more likely to get answers. Thanks, Marco Il giorno gio 12 dic 2019 alle ore 07:53 venkatesh sami < venkateshsa...@gmail.com> ha scritto: > Team, > > I have a problem in getting statement status in another livy statement, >

Re: [Vote][LIVY-718] Support multi-active high availability in Livy

2019-12-12 Thread Marco Gaido
+1 Il giorno gio 12 dic 2019 alle ore 14:22 Jeff Zhang ha scritto: > +1 > > > Aliaksandr Sasnouskikh 于2019年12月12日周四 下午6:14写道: > > > +1 > > Best regards, > > Aliaksandr Sasnouskikh > > https://github.com/jahstreet/ > > https://www.linkedin.com/in/jahstreet/ > > +31 (0) 6 51 29 58 39 > > > > > >

Re: Support multi-active high availability in Livy

2019-12-11 Thread Marco Gaido
Shall we start an official vote before creating the subtasks? Thanks, Marco Il giorno mer 11 dic 2019 alle ore 14:50 Saisai Shao ha scritto: > I think it is feasible to move to next step. Let's create subtasks to track > all the works. > > Thanks > Saisai > > Yiheng Wang 于2019年12月10日周二 下午3:18写

ASF Diversity & Inclusion Survey

2019-12-05 Thread Marco Gaido
Hello everyone, If you have an apache.org email, you should have received an email with an invitation to take the 2020 ASF Community Survey. Please take 15 minutes to complete it. If you do not have an apache.org email address or you didn’t receive a link, please follow this link to the survey: h

[jira] [Commented] (SPARK-29667) implicitly convert mismatched datatypes on right side of "IN" operator

2019-12-04 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16987712#comment-16987712 ] Marco Gaido commented on SPARK-29667: - I can agree more with you [~hyukjin.kwon

[jira] [Resolved] (LIVY-699) [LIVY-699][THRIFT] Fix resultSet.getBigDecimal throw java.sql.SQLException: Illegal conversion

2019-11-12 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/LIVY-699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido resolved LIVY-699. -- Fix Version/s: 0.7.0 Assignee: runzhiwang Resolution: Fixed Issue resolved by PR https

[jira] [Assigned] (LIVY-705) Support getting keystore password from Hadoop credential provider for Thrift server

2019-11-06 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/LIVY-705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido reassigned LIVY-705: Assignee: Wing Yew Poon > Support getting keystore password from Hadoop credential provider

[jira] [Resolved] (LIVY-705) Support getting keystore password from Hadoop credential provider for Thrift server

2019-11-06 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/LIVY-705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido resolved LIVY-705. -- Fix Version/s: 0.7.0 Resolution: Fixed Issue resolved by PR https://github.com/apache/incubator

[jira] [Resolved] (LIVY-356) Add support for LDAP authentication in Livy Server

2019-10-13 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/LIVY-356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido resolved LIVY-356. -- Fix Version/s: 0.7.0 Assignee: mingchao zhao Resolution: Fixed Issue resolved by https

Re: Plan to cut new branch and prepare to release 0.7

2019-10-10 Thread Marco Gaido
gest to have a whole HA design, then > splitting into small pieces, rather than opposite. So currently I'm not > confident if the JIRAs are good enough to merge. Thanks Saisai Marco Gaido < > marcogaid...@gmail.com> 于2019年10月10日周四 下午4:19写道: > Hi Saisai, > > thanks > for sta

Re: Plan to cut new branch and prepare to release 0.7

2019-10-10 Thread Marco Gaido
Hi Saisai, thanks for starting this discussion. I agree starting talking about a 0.7.0 release. Just a couple of notes: [LIVY-692][THRIFT] Use configured principal for Kerberos authentication: as I mentioned in the PR, I don't think this is an actual problem. What about including in the scope of

Re: Podling Report Reminder - October 2019

2019-10-01 Thread Marco Gaido
Thanks Bikas, I checked and everything sounds fine to me. I just edited the wiki in order to fix some typos and other small edits. Thanks, Marco Il giorno mar 1 ott 2019 alle ore 05:18 Bikas Saha ha scritto: > Hi, > > The issue seems to have resolved itself. Coming to why I started the edit. >

[jira] [Commented] (LIVY-667) Support query a lot of data.

2019-09-23 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/LIVY-667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16935852#comment-16935852 ] Marco Gaido commented on LIVY-667: -- [~yihengw] yes, that's true. The point is

Re: Podling Report Reminder - October 2019

2019-09-23 Thread Marco Gaido
Hi, I don't have access either. May it be I wasn't granted access? Thanks, Marco Il giorno lun 23 set 2019 alle ore 07:31 Jean-Baptiste Onofré < j...@nanthrax.net> ha scritto: > Hi, > > it works fine for me. > > Regards > JB > > On 22/09/2019 18:47, Bikas Saha wrote: > > Hi, > > > > I noticed t

[jira] [Commented] (LIVY-667) Support query a lot of data.

2019-09-23 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/LIVY-667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16935616#comment-16935616 ] Marco Gaido commented on LIVY-667: -- [~runzhiwang] let me cite you in the JIRA

Re: [DISCUSS] Spark 2.5 release

2019-09-21 Thread Marco Gaido
I agree with Matei too. Thanks, Marco Il giorno dom 22 set 2019 alle ore 03:44 Dongjoon Hyun < dongjoon.h...@gmail.com> ha scritto: > +1 for Matei's suggestion! > > Bests, > Dongjoon. > > On Sat, Sep 21, 2019 at 5:44 PM Matei Zaharia > wrote: > >> If the goal is to get people to try the DSv2 AP

[jira] [Resolved] (LIVY-683) Livy SQLInterpreter get empty array when extract date format rows to json

2019-09-21 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/LIVY-683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido resolved LIVY-683. -- Resolution: Duplicate > Livy SQLInterpreter get empty array when extract date format rows to j

[jira] [Assigned] (LIVY-683) Livy SQLInterpreter get empty array when extract date format rows to json

2019-09-21 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/LIVY-683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido reassigned LIVY-683: Assignee: (was: Zhefeng Wang) > Livy SQLInterpreter get empty array when extract date for

[jira] [Commented] (LIVY-667) Support query a lot of data.

2019-09-20 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/LIVY-667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934489#comment-16934489 ] Marco Gaido commented on LIVY-667: -- [~runzhiwang] I'd argue that if the data

[jira] [Commented] (SPARK-29123) DecimalType multiplication precision loss

2019-09-19 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16933560#comment-16933560 ] Marco Gaido commented on SPARK-29123: - [~benny] the point here is: Spark

[jira] [Commented] (SPARK-29123) DecimalType multiplication precision loss

2019-09-19 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16933128#comment-16933128 ] Marco Gaido commented on SPARK-29123: - You can

Re: Documentation on org.apache.spark.sql.functions backend.

2019-09-16 Thread Marco Gaido
nullSafeEval, > doGenCode. Aren't there any architectural docs that could help with what is > exactly happening? Reverse engineering seems a bit daunting. > > Regards > > On Mon, Sep 16, 2019 at 1:36 PM Marco Gaido > wrote: > >> Hi Vipul, >> >> a function i

Re: Documentation on org.apache.spark.sql.functions backend.

2019-09-16 Thread Marco Gaido
Hi Vipul, a function is never turned in a logical plan. A function is turned into an Expression. And an Expression can be part of many Logical or Physical Plans. Hope this helps. Thanks, Marco Il giorno lun 16 set 2019 alle ore 08:27 Vipul Rajan ha scritto: > I am trying to create a function t

[jira] [Commented] (SPARK-29038) SPIP: Support Spark Materialized View

2019-09-10 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16926650#comment-16926650 ] Marco Gaido commented on SPARK-29038: - [~cltlfcjin] currently spark has a somet

[jira] [Comment Edited] (SPARK-29038) SPIP: Support Spark Materialized View

2019-09-10 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16926650#comment-16926650 ] Marco Gaido edited comment on SPARK-29038 at 9/10/19 1:4

[jira] [Commented] (LIVY-489) Expose a JDBC endpoint for Livy

2019-09-07 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/LIVY-489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924894#comment-16924894 ] Marco Gaido commented on LIVY-489: -- The right place is the user mailing list, please

[jira] [Commented] (LIVY-489) Expose a JDBC endpoint for Livy

2019-09-07 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/LIVY-489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924817#comment-16924817 ] Marco Gaido commented on LIVY-489: -- Yes, sure. The point is: that template in

[jira] [Commented] (LIVY-489) Expose a JDBC endpoint for Livy

2019-09-07 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/LIVY-489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924812#comment-16924812 ] Marco Gaido commented on LIVY-489: -- [~vonatzki] nothing to be sorry about. Please

[jira] [Commented] (SPARK-29009) Returning pojo from udf not working

2019-09-07 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924774#comment-16924774 ] Marco Gaido commented on SPARK-29009: - Why do you think this is a bug? If you

[jira] [Resolved] (LIVY-640) Add tests for ThriftServer

2019-09-05 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/LIVY-640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido resolved LIVY-640. -- Fix Version/s: 0.7.0 Assignee: mingchao zhao Resolution: Fixed Issue resolved by https

[jira] [Commented] (LIVY-489) Expose a JDBC endpoint for Livy

2019-09-04 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/LIVY-489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16922363#comment-16922363 ] Marco Gaido commented on LIVY-489: -- Hi [~vonatzki]. Please check the design doc atta

[jira] [Commented] (SPARK-28610) Support larger buffer for sum of long

2019-09-03 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16921471#comment-16921471 ] Marco Gaido commented on SPARK-28610: - Hi [~Gengliang.Wang]. That's a

Re: Possible missing mentor(s)

2019-09-02 Thread Marco Gaido
Sid, answering to the PRs you pointed out, I think open meisam's PRs are: - 1 WIP; - 1 changes were requested and he has not done them; - 1 I commented on it and it was stated that the feature could have been merged if the PR is brought up to date, which hasn't so far by the contributor. Moreov

[jira] [Updated] (SPARK-28939) SQL configuration are not always propagated

2019-09-01 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido updated SPARK-28939: Description: The SQL configurations are propagated to executors in order to be effective

[jira] [Created] (SPARK-28939) SQL configuration are not always propagated

2019-09-01 Thread Marco Gaido (Jira)
Marco Gaido created SPARK-28939: --- Summary: SQL configuration are not always propagated Key: SPARK-28939 URL: https://issues.apache.org/jira/browse/SPARK-28939 Project: Spark Issue Type: Bug

Re: Possible missing mentor(s)

2019-08-31 Thread Marco Gaido
Hi Sid, what you are stating is pretty serious. I am not sure whether you have specific examples you're referring to. Since I've been asked to join the PMC, I regularly check open PRs and I try and review/check all those on the part I have more confidence with, ie. the thriftserver. Honestly, I do

[jira] [Commented] (SPARK-28916) Generated SpecificSafeProjection.apply method grows beyond 64 KB when use SparkSQL

2019-08-31 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920153#comment-16920153 ] Marco Gaido commented on SPARK-28916: - I think the problem is relate

[jira] [Commented] (SPARK-28916) Generated SpecificSafeProjection.apply method grows beyond 64 KB when use SparkSQL

2019-08-31 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920074#comment-16920074 ] Marco Gaido commented on SPARK-28916: - Thanks for reporting this. I am checkin

[jira] [Commented] (SPARK-28934) Add `spark.sql.compatiblity.mode`

2019-08-31 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920072#comment-16920072 ] Marco Gaido commented on SPARK-28934: - Hi [~smilegator]! Thanks for opening thi

[jira] [Resolved] (LIVY-650) Remove schema from ResultSet

2019-08-29 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/LIVY-650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido resolved LIVY-650. -- Fix Version/s: 0.7.0 Resolution: Fixed Issue resolved by https://github.com/apache/incubator-livy

[jira] [Resolved] (SPARK-28610) Support larger buffer for sum of long

2019-08-28 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido resolved SPARK-28610. - Resolution: Won't Fix Since the perf regression introduced by the change would be very

Re: [VOTE] Release Apache Spark 2.3.4 (RC1)

2019-08-28 Thread Marco Gaido
+1 Il giorno mer 28 ago 2019 alle ore 06:31 Wenchen Fan ha scritto: > +1 > > On Wed, Aug 28, 2019 at 2:43 AM DB Tsai wrote: > >> +1 >> >> Sincerely, >> >> DB Tsai >> -- >> Web: https://www.dbtsai.com >> PGP Key ID: 42E5B25A8F7A82C1 >> >> O

[jira] [Created] (LIVY-650) Remove schema from ResultSet

2019-08-25 Thread Marco Gaido (Jira)
Marco Gaido created LIVY-650: Summary: Remove schema from ResultSet Key: LIVY-650 URL: https://issues.apache.org/jira/browse/LIVY-650 Project: Livy Issue Type: Improvement Components

[jira] [Resolved] (LIVY-574) Add tests for metadata operations

2019-08-25 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/LIVY-574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido resolved LIVY-574. -- Fix Version/s: 0.7.0 Assignee: Yiheng Wang Resolution: Fixed Issue resolved by PR https

Re: Unmarking most things as experimental, evolving for 3.0?

2019-08-22 Thread Marco Gaido
Thanks for bringing this out Sean. +1 from me as well! Thanks, Marco Il giorno gio 22 ago 2019 alle ore 08:21 Dongjoon Hyun < dongjoon.h...@gmail.com> ha scritto: > +1 for unmarking old ones (made in `2.3.x` and before). > Thank you, Sean. > > Bests, > Dongjoon. > > On Wed, Aug 21, 2019 at 6:46

[jira] [Resolved] (LIVY-573) Add tests for operation logs retrieval

2019-08-19 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/LIVY-573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido resolved LIVY-573. -- Fix Version/s: 0.7.0 Resolution: Fixed Issue resolved by PR https://github.com/apache/incubator

[jira] [Assigned] (LIVY-573) Add tests for operation logs retrieval

2019-08-19 Thread Marco Gaido (Jira)
[ https://issues.apache.org/jira/browse/LIVY-573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido reassigned LIVY-573: Assignee: Yiheng Wang > Add tests for operation logs retrie

[jira] [Commented] (LIVY-627) Implement GetCrossReference metadata operation

2019-08-07 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16902733#comment-16902733 ] Marco Gaido commented on LIVY-627: -- Hi [~micahzhao]. Actually in Spark there i

[jira] [Commented] (LIVY-575) Implement missing metadata operations

2019-08-06 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16900970#comment-16900970 ] Marco Gaido commented on LIVY-575: -- No problem, thank you. :) > Implement

[jira] [Assigned] (LIVY-627) Implement GetCrossReference metadata operation

2019-08-06 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido reassigned LIVY-627: Assignee: (was: Yiheng Wang) > Implement GetCrossReference metadata operat

[jira] [Comment Edited] (LIVY-575) Implement missing metadata operations

2019-08-06 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16900956#comment-16900956 ] Marco Gaido edited comment on LIVY-575 at 8/6/19 12:1

[jira] [Assigned] (LIVY-629) Implement CancelDelegationToken metadata operation

2019-08-06 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido reassigned LIVY-629: Assignee: (was: Yiheng Wang) > Implement CancelDelegationToken metadata operat

[jira] [Assigned] (LIVY-628) Implement GetDelegationToken metadata operation

2019-08-06 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido reassigned LIVY-628: Assignee: (was: Yiheng Wang) > Implement GetDelegationToken metadata operat

[jira] [Assigned] (LIVY-626) Implement GetPrimaryKeys metadata operation

2019-08-06 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido reassigned LIVY-626: Assignee: (was: Yiheng Wang) > Implement GetPrimaryKeys metadata operat

[jira] [Assigned] (LIVY-623) Implement GetTables metadata operation

2019-08-06 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido reassigned LIVY-623: Assignee: (was: Yiheng Wang) > Implement GetTables metadata operat

[jira] [Assigned] (LIVY-624) Implement GetColumns metadata operation

2019-08-06 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido reassigned LIVY-624: Assignee: (was: Yiheng Wang) > Implement GetColumns metadata operat

[jira] [Assigned] (LIVY-622) Implement GetSchemas metadata operation

2019-08-06 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido reassigned LIVY-622: Assignee: (was: Yiheng Wang) > Implement GetSchemas metadata operat

[jira] [Assigned] (LIVY-625) Implement GetFunctions metadata operation

2019-08-06 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido reassigned LIVY-625: Assignee: (was: Yiheng Wang) > Implement GetFunctions metadata operat

[jira] [Assigned] (LIVY-575) Implement missing metadata operations

2019-08-06 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido reassigned LIVY-575: Assignee: (was: Yiheng Wang) > Implement missing metadata operati

[jira] [Commented] (LIVY-575) Implement missing metadata operations

2019-08-06 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16900956#comment-16900956 ] Marco Gaido commented on LIVY-575: -- [~yihengw] we assign JIRAs when the related PRs

[jira] [Commented] (SPARK-28611) Histogram's height is diffrent

2019-08-04 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16899585#comment-16899585 ] Marco Gaido commented on SPARK-28611: - Mmmhthat's weird! How can

[jira] [Created] (SPARK-28610) Support larger buffer for sum of long

2019-08-03 Thread Marco Gaido (JIRA)
Marco Gaido created SPARK-28610: --- Summary: Support larger buffer for sum of long Key: SPARK-28610 URL: https://issues.apache.org/jira/browse/SPARK-28610 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-28512) New optional mode: throw runtime exceptions on casting failures

2019-07-25 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16892692#comment-16892692 ] Marco Gaido commented on SPARK-28512: - Thanks for pinging me [~maropu]. It is

[jira] [Commented] (LIVY-571) When an exception happens running a query, we should report it to end user

2019-07-23 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16890785#comment-16890785 ] Marco Gaido commented on LIVY-571: -- Issue resolved by PR https://github.com/ap

[jira] [Commented] (LIVY-575) Implement missing metadata operations

2019-07-23 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16890784#comment-16890784 ] Marco Gaido commented on LIVY-575: -- Oh, you're right. Sorry for the mistake. &g

[jira] [Issue Comment Deleted] (LIVY-575) Implement missing metadata operations

2019-07-23 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido updated LIVY-575: - Comment: was deleted (was: Issue resolved by PR https://github.com/apache/incubator-livy/pull/182

[jira] [Assigned] (LIVY-571) When an exception happens running a query, we should report it to end user

2019-07-22 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido reassigned LIVY-571: Assignee: Jeffrey(Xilang) Yan > When an exception happens running a query, we should report it

[jira] [Resolved] (LIVY-575) Implement missing metadata operations

2019-07-22 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido resolved LIVY-575. -- Resolution: Fixed Fix Version/s: 0.7.0 Issue resolved by PR https://github.com/apache/incubator

[jira] [Commented] (SPARK-28470) Honor spark.sql.decimalOperations.nullOnOverflow in Cast

2019-07-22 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16889979#comment-16889979 ] Marco Gaido commented on SPARK-28470: - Thanks for checking this Wenchen! I

[jira] [Resolved] (LIVY-598) Upgrade Livy jackson dependency to 2.9.9

2019-07-21 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido resolved LIVY-598. -- Resolution: Fixed Fix Version/s: 0.7.0 Issue resolved by https://github.com/apache/incubator-livy

[jira] [Assigned] (LIVY-598) Upgrade Livy jackson dependency to 2.9.9

2019-07-21 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido reassigned LIVY-598: Assignee: Arun Mahadevan > Upgrade Livy jackson dependency to 2.

[jira] [Comment Edited] (SPARK-28225) Unexpected behavior for Window functions

2019-07-20 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16889518#comment-16889518 ] Marco Gaido edited comment on SPARK-28225 at 7/20/19 2:4

[jira] [Commented] (SPARK-28225) Unexpected behavior for Window functions

2019-07-20 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16889518#comment-16889518 ] Marco Gaido commented on SPARK-28225: - Let me cite PostgreSQL documentatio

[jira] [Commented] (SPARK-28386) Cannot resolve ORDER BY columns with GROUP BY and HAVING

2019-07-20 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16889422#comment-16889422 ] Marco Gaido commented on SPARK-28386: - I think this is a duplicate of SPARK-2

[jira] [Commented] (LIVY-575) Implement missing metadata operations

2019-07-18 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/LIVY-575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16887778#comment-16887778 ] Marco Gaido commented on LIVY-575: -- Sure, sounds fine. Yes then we can create subt

  1   2   3   4   5   6   7   8   9   10   >