[GitHub] [incubator-livy] jerryshao commented on pull request #289: [LIVY-756] Add Support Spark 3

2020-07-29 Thread GitBox
jerryshao commented on pull request #289: URL: https://github.com/apache/incubator-livy/pull/289#issuecomment-664907671 There still have some minor issues in JDBC side, we prepare a release when all the issues are done.

[GitHub] [incubator-livy] jerryshao commented on pull request #300: [LIVY-756] Add Spark 3.0 and Scala 2.12 support

2020-07-29 Thread GitBox
jerryshao commented on pull request #300: URL: https://github.com/apache/incubator-livy/pull/300#issuecomment-664909277 There still have some minor issues in JDBC side related to Scala versions. Will prepare a new release when everything is done.

[GitHub] [incubator-livy] giftkugel commented on pull request #289: [LIVY-756] Add Support Spark 3

2020-07-29 Thread GitBox
giftkugel commented on pull request #289: URL: https://github.com/apache/incubator-livy/pull/289#issuecomment-664894916 Is there any timeline to add this patch into a release? Maybe Livy 0.8? This is an automated message

[GitHub] [incubator-livy] jerryshao edited a comment on pull request #289: [LIVY-756] Add Support Spark 3

2020-07-29 Thread GitBox
jerryshao edited a comment on pull request #289: URL: https://github.com/apache/incubator-livy/pull/289#issuecomment-664907671 There still have some minor issues in JDBC side, will prepare a release when all the issues are done.

[GitHub] [incubator-livy] pdambrauskas commented on pull request #300: [LIVY-756] Add Spark 3.0 and Scala 2.12 support

2020-07-24 Thread GitBox
pdambrauskas commented on pull request #300: URL: https://github.com/apache/incubator-livy/pull/300#issuecomment-663497351 Hey, are there any plans to release this feature :) ? This is an automated message from the Apache

[GitHub] [incubator-livy] jameschen1519 commented on pull request #212: [LIVY-11] Enable HA support

2020-07-23 Thread GitBox
jameschen1519 commented on pull request #212: URL: https://github.com/apache/incubator-livy/pull/212#issuecomment-662927113 Taking over the pull request with @RogPodge 's permission. A bug involving query omission on failover was fixed, along with a bit of minor refactoring and renaming.

[GitHub] [incubator-livy] gmcoringa commented on pull request #249: [LIVY-702]: Submit Spark apps to Kubernetes

2020-07-14 Thread GitBox
gmcoringa commented on pull request #249: URL: https://github.com/apache/incubator-livy/pull/249#issuecomment-658342256 Thanks @jahstreet for your effort. Tested with: * kubernetes 1.15.11 * Spark 2.4.5 What is holding this pr and

[GitHub] [incubator-livy] stczwd commented on pull request #289: [LIVY-756] Add Support Spark 3

2020-07-12 Thread GitBox
stczwd commented on pull request #289: URL: https://github.com/apache/incubator-livy/pull/289#issuecomment-657356354 Glad to see this patch merged. I have test this path, it works well with spark3.0. This is an automated

[GitHub] [incubator-livy] jahstreet commented on pull request #167: [LIVY-588]: Full support for Spark on Kubernetes

2020-07-09 Thread GitBox
jahstreet commented on pull request #167: URL: https://github.com/apache/incubator-livy/pull/167#issuecomment-656291933 Thanks @groodt , I really appreciate your feedback. > Hopefully someday we can have a the ability to run interactive Spark jobs that autoscale on a Kubernetes

[GitHub] [incubator-livy] wypoon commented on a change in pull request #296: [LIVY-771][THRIFT] Do not remove trailing zeros from decimal values.

2020-07-09 Thread GitBox
wypoon commented on a change in pull request #296: URL: https://github.com/apache/incubator-livy/pull/296#discussion_r452339853 ## File path: thriftserver/session/src/main/java/org/apache/livy/thriftserver/session/ResultSet.java ## @@ -88,7 +88,7 @@ private String

[GitHub] [incubator-livy] wypoon commented on a change in pull request #296: [LIVY-771][THRIFT] Do not remove trailing zeros from decimal values.

2020-07-09 Thread GitBox
wypoon commented on a change in pull request #296: URL: https://github.com/apache/incubator-livy/pull/296#discussion_r452339853 ## File path: thriftserver/session/src/main/java/org/apache/livy/thriftserver/session/ResultSet.java ## @@ -88,7 +88,7 @@ private String

[GitHub] [incubator-livy] groodt commented on pull request #167: [LIVY-588]: Full support for Spark on Kubernetes

2020-07-09 Thread GitBox
groodt commented on pull request #167: URL: https://github.com/apache/incubator-livy/pull/167#issuecomment-655930417 Thanks for your determination and efforts @jahstreet Hopefully someday we can have a the ability to run interactive Spark jobs that autoscale on a Kubernetes

[GitHub] [incubator-livy] wypoon commented on a change in pull request #296: [LIVY-771][THRIFT] Do not remove trailing zeros from decimal values.

2020-07-08 Thread GitBox
wypoon commented on a change in pull request #296: URL: https://github.com/apache/incubator-livy/pull/296#discussion_r451965507 ## File path: thriftserver/session/src/main/java/org/apache/livy/thriftserver/session/ResultSet.java ## @@ -88,7 +88,7 @@ private String

[GitHub] [incubator-livy] wypoon commented on a change in pull request #296: [LIVY-771][THRIFT] Do not remove trailing zeros from decimal values.

2020-07-08 Thread GitBox
wypoon commented on a change in pull request #296: URL: https://github.com/apache/incubator-livy/pull/296#discussion_r451832688 ## File path: thriftserver/session/src/main/java/org/apache/livy/thriftserver/session/ResultSet.java ## @@ -88,7 +88,7 @@ private String

[GitHub] [incubator-livy] mgaido91 commented on a change in pull request #296: [LIVY-771][THRIFT] Do not remove trailing zeros from decimal values.

2020-07-08 Thread GitBox
mgaido91 commented on a change in pull request #296: URL: https://github.com/apache/incubator-livy/pull/296#discussion_r451698726 ## File path: thriftserver/session/src/main/java/org/apache/livy/thriftserver/session/ResultSet.java ## @@ -88,7 +88,7 @@ private String

[GitHub] [incubator-livy] liubarnabas commented on pull request #167: [LIVY-588]: Full support for Spark on Kubernetes

2020-07-07 Thread GitBox
liubarnabas commented on pull request #167: URL: https://github.com/apache/incubator-livy/pull/167#issuecomment-654880389 This is a great feature! Hope the owner could merge it into master. This is an automated message from

[GitHub] [incubator-livy] jahstreet opened a new pull request #167: [LIVY-588]: Full support for Spark on Kubernetes

2020-07-05 Thread GitBox
jahstreet opened a new pull request #167: URL: https://github.com/apache/incubator-livy/pull/167 ## What changes were proposed in this pull request? This PR is a new feature proposal: full support for Spark on Kubernetes (inspired by SparkYarnApp implementation). Since Spark

[GitHub] [incubator-livy] jahstreet commented on pull request #167: [LIVY-588]: Full support for Spark on Kubernetes

2020-07-05 Thread GitBox
jahstreet commented on pull request #167: URL: https://github.com/apache/incubator-livy/pull/167#issuecomment-653879398 Squashed and rebased to master. This is an automated message from the Apache Git Service. To respond to

[GitHub] [incubator-livy] jahstreet closed pull request #167: [LIVY-588]: Full support for Spark on Kubernetes

2020-07-05 Thread GitBox
jahstreet closed pull request #167: URL: https://github.com/apache/incubator-livy/pull/167 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [incubator-livy] jahstreet commented on pull request #167: [LIVY-588]: Full support for Spark on Kubernetes

2020-07-05 Thread GitBox
jahstreet commented on pull request #167: URL: https://github.com/apache/incubator-livy/pull/167#issuecomment-653860581 Hi @JagadeeshNagella , the issue you've describe is cause by the incompatibility of Jackson libs.Fabric8 Java Kubernetes client `v4.9.2` is compiled with

[GitHub] [incubator-livy] jerryshao closed pull request #258: Bump jackson.version from 2.9.9 to 2.10.1

2020-07-02 Thread GitBox
jerryshao closed pull request #258: URL: https://github.com/apache/incubator-livy/pull/258 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [incubator-livy] jerryshao closed pull request #243: [LIVY-693] Upgrade jackson to 2.9.10

2020-07-02 Thread GitBox
jerryshao closed pull request #243: URL: https://github.com/apache/incubator-livy/pull/243 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [incubator-livy] jerryshao commented on pull request #243: [LIVY-693] Upgrade jackson to 2.9.10

2020-07-02 Thread GitBox
jerryshao commented on pull request #243: URL: https://github.com/apache/incubator-livy/pull/243#issuecomment-652849861 Upgraded to 2.10.1, thanks a lot for the contribution. This is an automated message from the Apache Git

[GitHub] [incubator-livy] jerryshao commented on pull request #258: Bump jackson.version from 2.9.9 to 2.10.1

2020-07-02 Thread GitBox
jerryshao commented on pull request #258: URL: https://github.com/apache/incubator-livy/pull/258#issuecomment-652849346 Fixed in #300 . This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [incubator-livy] dependabot[bot] commented on pull request #258: Bump jackson.version from 2.9.9 to 2.10.1

2020-07-02 Thread GitBox
dependabot[bot] commented on pull request #258: URL: https://github.com/apache/incubator-livy/pull/258#issuecomment-652849356 OK, I won't notify you again about this release, but will get in touch when a new version is available. If you change your mind, just re-open this PR and

[GitHub] [incubator-livy] jerryshao edited a comment on pull request #299: LIVY-776 - Update Maven Shade Plugin to 3.2.1

2020-07-02 Thread GitBox
jerryshao edited a comment on pull request #299: URL: https://github.com/apache/incubator-livy/pull/299#issuecomment-652848737 Fixed in #300 , thanks a lot for the contribution. This is an automated message from the Apache

[GitHub] [incubator-livy] jerryshao closed pull request #299: LIVY-776 - Update Maven Shade Plugin to 3.2.1

2020-07-02 Thread GitBox
jerryshao closed pull request #299: URL: https://github.com/apache/incubator-livy/pull/299 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [incubator-livy] jerryshao commented on pull request #299: LIVY-776 - Update Maven Shade Plugin to 3.2.1

2020-07-02 Thread GitBox
jerryshao commented on pull request #299: URL: https://github.com/apache/incubator-livy/pull/299#issuecomment-652848737 Fixed in #300 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [incubator-livy] jerryshao commented on pull request #289: [LIVY-756] Add Support Spark 3

2020-07-02 Thread GitBox
jerryshao commented on pull request #289: URL: https://github.com/apache/incubator-livy/pull/289#issuecomment-652848316 Thanks @tprelle for your work, I've already merged this PR, all credits to you. This is an automated

[GitHub] [incubator-livy] jerryshao closed pull request #289: [LIVY-756] Add Support Spark 3

2020-07-02 Thread GitBox
jerryshao closed pull request #289: URL: https://github.com/apache/incubator-livy/pull/289 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [incubator-livy] dependabot[bot] commented on pull request #263: Bump jetty.version from 9.3.24.v20180605 to 9.4.24.v20191120

2020-07-02 Thread GitBox
dependabot[bot] commented on pull request #263: URL: https://github.com/apache/incubator-livy/pull/263#issuecomment-652844566 Superseded by #301. This is an automated message from the Apache Git Service. To respond to the

[GitHub] [incubator-livy] dependabot[bot] opened a new pull request #301: Bump jetty.version from 9.3.24.v20180605 to 9.4.30.v20200611

2020-07-02 Thread GitBox
dependabot[bot] opened a new pull request #301: URL: https://github.com/apache/incubator-livy/pull/301 Bumps `jetty.version` from 9.3.24.v20180605 to 9.4.30.v20200611. Updates `jetty-http` from 9.3.24.v20180605 to 9.4.30.v20200611 Commits

[GitHub] [incubator-livy] dependabot[bot] closed pull request #263: Bump jetty.version from 9.3.24.v20180605 to 9.4.24.v20191120

2020-07-02 Thread GitBox
dependabot[bot] closed pull request #263: URL: https://github.com/apache/incubator-livy/pull/263 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [incubator-livy] jerryshao closed pull request #300: [LIVY-756] Add Spark 3.0 and Scala 2.12 support

2020-07-02 Thread GitBox
jerryshao closed pull request #300: URL: https://github.com/apache/incubator-livy/pull/300 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [incubator-livy] jerryshao commented on pull request #300: [LIVY-756] Add Spark 3.0 and Scala 2.12 support

2020-07-02 Thread GitBox
jerryshao commented on pull request #300: URL: https://github.com/apache/incubator-livy/pull/300#issuecomment-652839568 I've triggered the travis test several times, seems everything is fine. I'm going to merge this, thanks @tprelle for the contribution.

[GitHub] [incubator-livy] jerryshao commented on pull request #300: [LIVY-756] Add Spark 3.0 and Scala 2.12 support

2020-07-01 Thread GitBox
jerryshao commented on pull request #300: URL: https://github.com/apache/incubator-livy/pull/300#issuecomment-652320407 @tprelle @andrasbeni would you please help to review, thanks! This is an automated message from the

[GitHub] [incubator-livy] jerryshao closed pull request #300: [LIVY-756] Add Spark 3.0 and Scala 2.12 support

2020-06-30 Thread GitBox
jerryshao closed pull request #300: URL: https://github.com/apache/incubator-livy/pull/300 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [incubator-livy] jerryshao commented on pull request #300: [LIVY-756] Add Spark 3.0 and Scala 2.12 support

2020-06-30 Thread GitBox
jerryshao commented on pull request #300: URL: https://github.com/apache/incubator-livy/pull/300#issuecomment-652203533 reopen to trigger the test again. This is an automated message from the Apache Git Service. To respond

[GitHub] [incubator-livy] jerryshao commented on pull request #300: [LIVY-756] Add Spark 3.0 and Scala 2.12 support

2020-06-29 Thread GitBox
jerryshao commented on pull request #300: URL: https://github.com/apache/incubator-livy/pull/300#issuecomment-651474672 Travis image seems too old to support Spark 3.0 R version, we should also upgrade Travis script.

[GitHub] [incubator-livy] andrasbeni commented on pull request #274: [LIVY-721][SERVER] Distributed session id generation

2020-06-29 Thread GitBox
andrasbeni commented on pull request #274: URL: https://github.com/apache/incubator-livy/pull/274#issuecomment-651220914 @runzhiwang do you plan to continue working on this? If not, I am happy to address present concerns and move forward the feature.

[GitHub] [incubator-livy] jerryshao commented on a change in pull request #300: [LIVY-756] Add Spark 3.0 and Scala 2.12 support

2020-06-29 Thread GitBox
jerryshao commented on a change in pull request #300: URL: https://github.com/apache/incubator-livy/pull/300#discussion_r447039881 ## File path: repl/src/main/scala/org/apache/livy/repl/Session.scala ## @@ -348,8 +348,10 @@ class Session( case "1" =>

[GitHub] [incubator-livy] tprelle commented on pull request #300: [LIVY-756] Add Spark 3.0 and Scala 2.12 support

2020-06-29 Thread GitBox
tprelle commented on pull request #300: URL: https://github.com/apache/incubator-livy/pull/300#issuecomment-651137090 @jerryshao How you manage to make sparkR work ? This is an automated message from the Apache Git Service.

[GitHub] [incubator-livy] jerryshao opened a new pull request #300: [LIVY-756] Add Spark 3.0 and Scala 2.12 support

2020-06-29 Thread GitBox
jerryshao opened a new pull request #300: URL: https://github.com/apache/incubator-livy/pull/300 ## What changes were proposed in this pull request? This PR is based @tprelle 's PR #289 , and address all the left issues in that PR: 1. multi-scala version support in one build

[GitHub] [incubator-livy] jerryshao commented on a change in pull request #289: [LIVY-756] Add Support Spark 3

2020-06-29 Thread GitBox
jerryshao commented on a change in pull request #289: URL: https://github.com/apache/incubator-livy/pull/289#discussion_r446820287 ## File path: scala-api/src/main/scala/org/apache/livy/scalaapi/ScalaJobHandle.scala ## @@ -190,6 +190,19 @@ class ScalaJobHandle[T]

[GitHub] [incubator-livy] andrasbeni commented on a change in pull request #289: [LIVY-756] Add Support Spark 3

2020-06-28 Thread GitBox
andrasbeni commented on a change in pull request #289: URL: https://github.com/apache/incubator-livy/pull/289#discussion_r446670999 ## File path: scala-api/src/main/scala/org/apache/livy/scalaapi/ScalaJobHandle.scala ## @@ -190,6 +190,19 @@ class ScalaJobHandle[T]

[GitHub] [incubator-livy] jerryshao commented on a change in pull request #289: [LIVY-756] Add Support Spark 3

2020-06-27 Thread GitBox
jerryshao commented on a change in pull request #289: URL: https://github.com/apache/incubator-livy/pull/289#discussion_r446593365 ## File path: scala-api/src/main/scala/org/apache/livy/scalaapi/ScalaJobHandle.scala ## @@ -190,6 +190,19 @@ class ScalaJobHandle[T]

[GitHub] [incubator-livy] wypoon commented on a change in pull request #296: [LIVY-771][THRIFT] Do not remove trailing zeros from decimal values.

2020-06-26 Thread GitBox
wypoon commented on a change in pull request #296: URL: https://github.com/apache/incubator-livy/pull/296#discussion_r446464042 ## File path: thriftserver/session/src/main/java/org/apache/livy/thriftserver/session/ResultSet.java ## @@ -88,7 +88,7 @@ private String

[GitHub] [incubator-livy] wypoon commented on a change in pull request #296: [LIVY-771][THRIFT] Do not remove trailing zeros from decimal values.

2020-06-26 Thread GitBox
wypoon commented on a change in pull request #296: URL: https://github.com/apache/incubator-livy/pull/296#discussion_r44643 ## File path: thriftserver/session/src/main/java/org/apache/livy/thriftserver/session/ResultSet.java ## @@ -88,7 +88,7 @@ private String

[GitHub] [incubator-livy] mgaido91 commented on a change in pull request #296: [LIVY-771][THRIFT] Do not remove trailing zeros from decimal values.

2020-06-26 Thread GitBox
mgaido91 commented on a change in pull request #296: URL: https://github.com/apache/incubator-livy/pull/296#discussion_r446423157 ## File path: thriftserver/session/src/main/java/org/apache/livy/thriftserver/session/ResultSet.java ## @@ -88,7 +88,7 @@ private String

[GitHub] [incubator-livy] mmigdiso commented on pull request #289: [LIVY-756] Add Support Spark 3

2020-06-26 Thread GitBox
mmigdiso commented on pull request #289: URL: https://github.com/apache/incubator-livy/pull/289#issuecomment-650323339 Hey @tprelle , will @jerryshao comments be a blocker for that PR? This is an automated message from the

[GitHub] [incubator-livy] coheigea commented on pull request #299: LIVY-776 - Update Maven Shade Plugin to 3.2.1

2020-06-24 Thread GitBox
coheigea commented on pull request #299: URL: https://github.com/apache/incubator-livy/pull/299#issuecomment-648887533 @tprelle It's up to the maintainers of the project, either it could all be done in one go (as in your PR), or maybe they might prefer to just update Jackson separately.

[GitHub] [incubator-livy] tprelle commented on pull request #299: LIVY-776 - Update Maven Shade Plugin to 3.2.1

2020-06-24 Thread GitBox
tprelle commented on pull request #299: URL: https://github.com/apache/incubator-livy/pull/299#issuecomment-648874686 Hi @coheigea I faced the same issue (shaded plugin and jackson version) on https://github.com/apache/incubator-livy/pull/289 for scala 2.12 and spark 3 support. I need

[GitHub] [incubator-livy] tprelle commented on a change in pull request #289: [LIVY-756] Add Support Spark 3

2020-06-24 Thread GitBox
tprelle commented on a change in pull request #289: URL: https://github.com/apache/incubator-livy/pull/289#discussion_r444891736 ## File path: pom.xml ## @@ -86,24 +87,25 @@ 1.9 4.5.3 4.4.4 -2.9.9 +2.10.1 3.1.0 9.3.24.v20180605 3.2.11

[GitHub] [incubator-livy] tprelle commented on pull request #289: [LIVY-756] Add Support Spark 3

2020-06-24 Thread GitBox
tprelle commented on pull request #289: URL: https://github.com/apache/incubator-livy/pull/289#issuecomment-648813898 > I just did a quick review about the overall implementation. Seems like we can only support one Scala version for one build here in this PR. But Livy could actually

[GitHub] [incubator-livy] tprelle commented on a change in pull request #289: [LIVY-756] Add Support Spark 3

2020-06-24 Thread GitBox
tprelle commented on a change in pull request #289: URL: https://github.com/apache/incubator-livy/pull/289#discussion_r444880828 ## File path: client-http/pom.xml ## @@ -109,58 +109,6 @@ - Review comment: It was a mistake, i will put it back

[GitHub] [incubator-livy] tprelle commented on a change in pull request #289: [LIVY-756] Add Support Spark 3

2020-06-24 Thread GitBox
tprelle commented on a change in pull request #289: URL: https://github.com/apache/incubator-livy/pull/289#discussion_r444876495 ## File path: api/src/main/java/org/apache/livy/JobContext.java ## @@ -41,12 +41,12 @@ /** * @return The shared SQLContext instance. */ -

[GitHub] [incubator-livy] jerryshao commented on pull request #289: [WIP] [LIVY-756] Add Support Spark 3

2020-06-24 Thread GitBox
jerryshao commented on pull request #289: URL: https://github.com/apache/incubator-livy/pull/289#issuecomment-648718274 I'm doing some local improvements based on @tprelle 's current PR, I can submit a PR when everything is ready.

[GitHub] [incubator-livy] jerryshao commented on a change in pull request #289: [WIP] [LIVY-756] Add Support Spark 3

2020-06-24 Thread GitBox
jerryshao commented on a change in pull request #289: URL: https://github.com/apache/incubator-livy/pull/289#discussion_r444774680 ## File path: api/src/main/java/org/apache/livy/JobContext.java ## @@ -41,12 +41,12 @@ /** * @return The shared SQLContext instance. */

[GitHub] [incubator-livy] jerryshao commented on a change in pull request #289: [WIP] [LIVY-756] Add Support Spark 3

2020-06-24 Thread GitBox
jerryshao commented on a change in pull request #289: URL: https://github.com/apache/incubator-livy/pull/289#discussion_r444770427 ## File path: pom.xml ## @@ -86,24 +87,25 @@ 1.9 4.5.3 4.4.4 -2.9.9 +2.10.1 3.1.0 9.3.24.v20180605 3.2.11

[GitHub] [incubator-livy] jerryshao commented on a change in pull request #289: [WIP] [LIVY-756] Add Support Spark 3

2020-06-24 Thread GitBox
jerryshao commented on a change in pull request #289: URL: https://github.com/apache/incubator-livy/pull/289#discussion_r444770427 ## File path: pom.xml ## @@ -86,24 +87,25 @@ 1.9 4.5.3 4.4.4 -2.9.9 +2.10.1 3.1.0 9.3.24.v20180605 3.2.11

[GitHub] [incubator-livy] andrasbeni commented on a change in pull request #289: [WIP] [LIVY-756] Add Support Spark 3

2020-06-24 Thread GitBox
andrasbeni commented on a change in pull request #289: URL: https://github.com/apache/incubator-livy/pull/289#discussion_r444717000 ## File path: pom.xml ## @@ -86,24 +87,25 @@ 1.9 4.5.3 4.4.4 -2.9.9 +2.10.1 3.1.0 9.3.24.v20180605 3.2.11

[GitHub] [incubator-livy] andrasbeni commented on a change in pull request #289: [WIP] [LIVY-756] Add Support Spark 3

2020-06-24 Thread GitBox
andrasbeni commented on a change in pull request #289: URL: https://github.com/apache/incubator-livy/pull/289#discussion_r444719602 ## File path: api/src/main/java/org/apache/livy/JobContext.java ## @@ -41,12 +41,12 @@ /** * @return The shared SQLContext instance.

[GitHub] [incubator-livy] jerryshao commented on a change in pull request #289: [WIP] [LIVY-756] Add Support Spark 3

2020-06-23 Thread GitBox
jerryshao commented on a change in pull request #289: URL: https://github.com/apache/incubator-livy/pull/289#discussion_r444628517 ## File path: pom.xml ## @@ -86,24 +87,25 @@ 1.9 4.5.3 4.4.4 -2.9.9 +2.10.1 3.1.0 9.3.24.v20180605 3.2.11

[GitHub] [incubator-livy] jerryshao commented on a change in pull request #289: [WIP] [LIVY-756] Add Support Spark 3

2020-06-23 Thread GitBox
jerryshao commented on a change in pull request #289: URL: https://github.com/apache/incubator-livy/pull/289#discussion_r444614548 ## File path: .travis.yml ## @@ -34,6 +34,12 @@ matrix: env: MVN_FLAG='-Pspark-2.4 -Pthriftserver -DskipITs' - name: "Spark 2.4 ITs"

[GitHub] [incubator-livy] jerryshao commented on a change in pull request #289: [WIP] [LIVY-756] Add Support Spark 3

2020-06-23 Thread GitBox
jerryshao commented on a change in pull request #289: URL: https://github.com/apache/incubator-livy/pull/289#discussion_r444613917 ## File path: client-http/pom.xml ## @@ -109,58 +109,6 @@ - Review comment: What's the reason to remove this?

[GitHub] [incubator-livy] jerryshao commented on pull request #289: [WIP] [LIVY-756] Add Support Spark 3

2020-06-23 Thread GitBox
jerryshao commented on pull request #289: URL: https://github.com/apache/incubator-livy/pull/289#issuecomment-648547180 I just did a quick review about the overall implementation. Seems like we can only support one Scala version for one build here in this PR. But Livy could actually

[GitHub] [incubator-livy] tprelle commented on pull request #289: [WIP] [LIVY-756] Add Support Spark 3

2020-06-23 Thread GitBox
tprelle commented on pull request #289: URL: https://github.com/apache/incubator-livy/pull/289#issuecomment-648289289 All unit and intregration scala and Python test are working. I'm currently redeploy it to make more integration test because of

[GitHub] [incubator-livy] coheigea opened a new pull request #299: LIVY-776 - Update Maven Shade Plugin to 3.2.1

2020-06-23 Thread GitBox
coheigea opened a new pull request #299: URL: https://github.com/apache/incubator-livy/pull/299 In order to apply the PR to update Jackson to 2.10.1 (https://github.com/apache/incubator-livy/pull/258/files), it is also necessary to update the Maven Shade Plugin to avoid an ASM

[GitHub] [incubator-livy] coheigea commented on pull request #243: [LIVY-693] Upgrade jackson to 2.9.10

2020-06-23 Thread GitBox
coheigea commented on pull request #243: URL: https://github.com/apache/incubator-livy/pull/243#issuecomment-648264364 @peter-toth I think this PR and associated JIRA should be closed, as it is superceded by the upgrade to 2.10.1 (https://github.com/apache/incubator-livy/pull/258/files)

[GitHub] [incubator-livy] peter-toth commented on pull request #244: [LIVY-694] Upgrade Jetty to 9.4.18.v20190429

2020-06-23 Thread GitBox
peter-toth commented on pull request #244: URL: https://github.com/apache/incubator-livy/pull/244#issuecomment-648245292 @coheigea , unfortunately I didn't have time to check http mode, but we are using version 9.4.26.v20200117 now.

[GitHub] [incubator-livy] coheigea commented on pull request #244: [LIVY-694] Upgrade Jetty to 9.4.18.v20190429

2020-06-23 Thread GitBox
coheigea commented on pull request #244: URL: https://github.com/apache/incubator-livy/pull/244#issuecomment-648213951 This PR duplicates an existing PR: https://github.com/apache/incubator-livy/pull/175/files @peter-toth is there any status on the Jetty check? It would be good to

[GitHub] [incubator-livy] jerryshao commented on pull request #289: [WIP] [LIVY-756] Add Support Spark 3

2020-06-23 Thread GitBox
jerryshao commented on pull request #289: URL: https://github.com/apache/incubator-livy/pull/289#issuecomment-648103728 Yes, I think it is fine to leave R support to another PR. Please make sure this PR is OK for Scala and Python part.

[GitHub] [incubator-livy] tprelle commented on pull request #289: [WIP] [LIVY-756] Add Support Spark 3

2020-06-23 Thread GitBox
tprelle commented on pull request #289: URL: https://github.com/apache/incubator-livy/pull/289#issuecomment-648102517 @jerryshao the code it's working for spark scala and python but I do not managed to make it work for sparkR. I can submit the PR and open a ticket for sparkR support

[GitHub] [incubator-livy] jerryshao commented on pull request #289: [WIP] [LIVY-756] Add Support Spark 3

2020-06-23 Thread GitBox
jerryshao commented on pull request #289: URL: https://github.com/apache/incubator-livy/pull/289#issuecomment-648101189 I'm going to try this PR locally to see if the current code is complete or not. This is an automated

[GitHub] [incubator-livy] JagadeeshNagella edited a comment on pull request #167: [LIVY-588]: Full support for Spark on Kubernetes

2020-06-22 Thread GitBox
JagadeeshNagella edited a comment on pull request #167: URL: https://github.com/apache/incubator-livy/pull/167#issuecomment-647843917 > > @JagadeeshNagella , I still need to have the Livy/Spark/Docker changes you introduced to have the same build: it can be diff patch, forked branch or

[GitHub] [incubator-livy] JagadeeshNagella commented on pull request #167: [LIVY-588]: Full support for Spark on Kubernetes

2020-06-22 Thread GitBox
JagadeeshNagella commented on pull request #167: URL: https://github.com/apache/incubator-livy/pull/167#issuecomment-647843917 > > @JagadeeshNagella , I still need to have the Livy/Spark/Docker changes you introduced to have the same build: it can be diff patch, forked branch or whatever

[GitHub] [incubator-livy] wypoon commented on a change in pull request #296: [LIVY-771][THRIFT] Do not remove trailing zeros from decimal values.

2020-06-22 Thread GitBox
wypoon commented on a change in pull request #296: URL: https://github.com/apache/incubator-livy/pull/296#discussion_r443859934 ## File path: thriftserver/session/src/main/java/org/apache/livy/thriftserver/session/ResultSet.java ## @@ -88,7 +88,7 @@ private String

[GitHub] [incubator-livy] wypoon commented on a change in pull request #296: [LIVY-771][THRIFT] Do not remove trailing zeros from decimal values.

2020-06-22 Thread GitBox
wypoon commented on a change in pull request #296: URL: https://github.com/apache/incubator-livy/pull/296#discussion_r443858197 ## File path: thriftserver/session/src/main/java/org/apache/livy/thriftserver/session/ResultSet.java ## @@ -88,7 +88,7 @@ private String

[GitHub] [incubator-livy] wypoon commented on a change in pull request #296: [LIVY-771][THRIFT] Do not remove trailing zeros from decimal values.

2020-06-22 Thread GitBox
wypoon commented on a change in pull request #296: URL: https://github.com/apache/incubator-livy/pull/296#discussion_r443858197 ## File path: thriftserver/session/src/main/java/org/apache/livy/thriftserver/session/ResultSet.java ## @@ -88,7 +88,7 @@ private String

[GitHub] [incubator-livy] jerryshao commented on pull request #289: [WIP] [LIVY-756] Add Support Spark 3

2020-06-21 Thread GitBox
jerryshao commented on pull request #289: URL: https://github.com/apache/incubator-livy/pull/289#issuecomment-647246039 @tprelle is this PR ready for review? This is an automated message from the Apache Git Service. To

[GitHub] [incubator-livy] mgaido91 commented on a change in pull request #296: [LIVY-771][THRIFT] Do not remove trailing zeros from decimal values.

2020-06-21 Thread GitBox
mgaido91 commented on a change in pull request #296: URL: https://github.com/apache/incubator-livy/pull/296#discussion_r443259717 ## File path: thriftserver/session/src/main/java/org/apache/livy/thriftserver/session/ResultSet.java ## @@ -88,7 +88,7 @@ private String

[GitHub] [incubator-livy] wypoon commented on a change in pull request #296: [LIVY-771][THRIFT] Do not remove trailing zeros from decimal values.

2020-06-19 Thread GitBox
wypoon commented on a change in pull request #296: URL: https://github.com/apache/incubator-livy/pull/296#discussion_r443087452 ## File path: thriftserver/session/src/main/java/org/apache/livy/thriftserver/session/ResultSet.java ## @@ -88,7 +88,7 @@ private String

[GitHub] [incubator-livy] tprelle commented on pull request #289: [WIP] [LIVY-756] Add Support Spark 3

2020-06-19 Thread GitBox
tprelle commented on pull request #289: URL: https://github.com/apache/incubator-livy/pull/289#issuecomment-646867581 > Spark 3 was released. https://spark.apache.org/downloads.html, please, continue  Move to spark 3.0.0. Do not have time yet to test spark R

[GitHub] [incubator-livy] JagadeeshNagella commented on pull request #167: [LIVY-588]: Full support for Spark on Kubernetes

2020-06-19 Thread GitBox
JagadeeshNagella commented on pull request #167: URL: https://github.com/apache/incubator-livy/pull/167#issuecomment-646792497 > @JagadeeshNagella , I still need to have the Livy/Spark/Docker changes you introduced to have the same build: it can be diff patch, forked branch or whatever

[GitHub] [incubator-livy] zjffdu commented on a change in pull request #289: [WIP] [LIVY-756] Add Support Spark 3

2020-06-19 Thread GitBox
zjffdu commented on a change in pull request #289: URL: https://github.com/apache/incubator-livy/pull/289#discussion_r442677351 ## File path: assembly/pom.xml ## @@ -29,7 +29,7 @@ pom -apache-livy-${project.version}-bin +

[GitHub] [incubator-livy] zjffdu commented on a change in pull request #289: [WIP] [LIVY-756] Add Support Spark 3

2020-06-19 Thread GitBox
zjffdu commented on a change in pull request #289: URL: https://github.com/apache/incubator-livy/pull/289#discussion_r442677351 ## File path: assembly/pom.xml ## @@ -29,7 +29,7 @@ pom -apache-livy-${project.version}-bin +

[GitHub] [incubator-livy] Minutis commented on pull request #289: [WIP] [LIVY-756] Add Support Spark 3

2020-06-19 Thread GitBox
Minutis commented on pull request #289: URL: https://github.com/apache/incubator-livy/pull/289#issuecomment-646481118 Spark 3 was released. https://spark.apache.org/downloads.html, please, continue :+1: This is an

[GitHub] [incubator-livy] fifthpostulate commented on pull request #95: [LIVY-471][Server] Adding new API set to support resource uploading

2020-06-18 Thread GitBox
fifthpostulate commented on pull request #95: URL: https://github.com/apache/incubator-livy/pull/95#issuecomment-646190343 This functionality would be extremely useful. This is an automated message from the Apache Git

[GitHub] [incubator-livy] jahstreet commented on pull request #167: [LIVY-588]: Full support for Spark on Kubernetes

2020-06-17 Thread GitBox
jahstreet commented on pull request #167: URL: https://github.com/apache/incubator-livy/pull/167#issuecomment-645570904 @JagadeeshNagella , I still need to have the Livy/Spark/Docker changes you introduced to have the same build. Could you please share that? Otherwise it'll be hard to

[GitHub] [incubator-livy] JagadeeshNagella commented on pull request #167: [LIVY-588]: Full support for Spark on Kubernetes

2020-06-17 Thread GitBox
JagadeeshNagella commented on pull request #167: URL: https://github.com/apache/incubator-livy/pull/167#issuecomment-645550398 > > could you please share with me the diff so that I could patch this PR branch and try it out? > > @JagadeeshNagella , then the only I can do for you is

[GitHub] [incubator-livy] jahstreet edited a comment on pull request #167: [LIVY-588]: Full support for Spark on Kubernetes

2020-06-17 Thread GitBox
jahstreet edited a comment on pull request #167: URL: https://github.com/apache/incubator-livy/pull/167#issuecomment-645532672 Hi @PedroRossi , please check the PR #249 , specifically to `livy.server.kubernetes.allowedNamespaces` and `livy.server.kubernetes.defaultNamespace` config

[GitHub] [incubator-livy] jahstreet commented on pull request #167: [LIVY-588]: Full support for Spark on Kubernetes

2020-06-17 Thread GitBox
jahstreet commented on pull request #167: URL: https://github.com/apache/incubator-livy/pull/167#issuecomment-645532672 Hi @PedroRossi , please check the PR #249 , specifically to `livy.server.kubernetes.allowedNamespaces` and `livy.server.kubernetes.defaultNamespace` config options.

[GitHub] [incubator-livy] PedroRossi commented on pull request #167: [LIVY-588]: Full support for Spark on Kubernetes

2020-06-17 Thread GitBox
PedroRossi commented on pull request #167: URL: https://github.com/apache/incubator-livy/pull/167#issuecomment-645529277 Hi @jahstreet, are there any plans to support setting the namespace in which Livy is going to search for the pods? I would like to be able to set K8s Roles instead of

[GitHub] [incubator-livy] codecov-commenter commented on pull request #298: [LIVY-775] Upgrade jQuery

2020-06-17 Thread GitBox
codecov-commenter commented on pull request #298: URL: https://github.com/apache/incubator-livy/pull/298#issuecomment-645504498 # [Codecov](https://codecov.io/gh/apache/incubator-livy/pull/298?src=pr=h1) Report > Merging

[GitHub] [incubator-livy] jahstreet commented on pull request #167: [LIVY-588]: Full support for Spark on Kubernetes

2020-06-17 Thread GitBox
jahstreet commented on pull request #167: URL: https://github.com/apache/incubator-livy/pull/167#issuecomment-645473735 > could you please share with me the diff so that I could patch this PR branch and try it out? @JagadeeshNagella , then the only I can do for you is to try it out

[GitHub] [incubator-livy] andrasbeni opened a new pull request #298: [LIVY-775] Upgrade jQuery

2020-06-17 Thread GitBox
andrasbeni opened a new pull request #298: URL: https://github.com/apache/incubator-livy/pull/298 ## What changes were proposed in this pull request? The jquery version currently used by Livy is vulnerable (see [CVE](https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2020-11022))

[GitHub] [incubator-livy] JagadeeshNagella edited a comment on pull request #167: [LIVY-588]: Full support for Spark on Kubernetes

2020-06-17 Thread GitBox
JagadeeshNagella edited a comment on pull request #167: URL: https://github.com/apache/incubator-livy/pull/167#issuecomment-645463429 > @JagadeeshNagella , could you please share with me the diff so that I could patch this PR branch and try it out? Also you might be interested in [this

[GitHub] [incubator-livy] JagadeeshNagella commented on pull request #167: [LIVY-588]: Full support for Spark on Kubernetes

2020-06-17 Thread GitBox
JagadeeshNagella commented on pull request #167: URL: https://github.com/apache/incubator-livy/pull/167#issuecomment-645463429 > @JagadeeshNagella , could you please share with me the diff so that I could patch this PR branch and try it out? Also you might be interested in [this

[GitHub] [incubator-livy] jahstreet commented on pull request #167: [LIVY-588]: Full support for Spark on Kubernetes

2020-06-16 Thread GitBox
jahstreet commented on pull request #167: URL: https://github.com/apache/incubator-livy/pull/167#issuecomment-644922185 @JagadeeshNagella , could you please share with me the diff so that I could patch this PR branch and try it out? Also you might be interested in [this

[GitHub] [incubator-livy] jahstreet commented on pull request #249: [LIVY-702]: Submit Spark apps to Kubernetes

2020-06-16 Thread GitBox
jahstreet commented on pull request #249: URL: https://github.com/apache/incubator-livy/pull/249#issuecomment-644914983 @lukatera , you can check that PR: https://github.com/apache/incubator-livy/pull/167 . Basically this PR is the clean backport from the former one.

  1   2   3   4   5   6   7   8   9   10   >