Re: Should we consider Spark3 support for Hive on Spark
Yes exactly. This is what is recommended, cause hive on Spark has little interest. However there is nothing enforcing not todo it. Important to me cause i sit here and work on grassroots marrieng hive on kafka-streams. Owen O'Malley schrieb am Mi., 24. Aug. 2022, 18:51: > Hive on Spark is not recommended. The recommended path is to use either > Tez or LLAP. If you already are using Spark 3, it would be far easier to > use Spark SQL. > > .. Owen > > On Wed, Aug 24, 2022 at 3:46 AM Fred Bai > wrote: > >> Hi everyone: >> >> Do we have any support for Hive on Spark? I need Hive on Spark, but my >> Spark version is 3.X. >> >> I found Hive incompatible with Spark3, I modify a lot of code to be >> compatible. >> >> Hive on Spark has deprecated? >> >> And. Hive on Spark is very slow when the job executes. >> >
Re: Should we consider Spark3 support for Hive on Spark
Hive on Spark is not recommended. The recommended path is to use either Tez or LLAP. If you already are using Spark 3, it would be far easier to use Spark SQL. .. Owen On Wed, Aug 24, 2022 at 3:46 AM Fred Bai wrote: > Hi everyone: > > Do we have any support for Hive on Spark? I need Hive on Spark, but my > Spark version is 3.X. > > I found Hive incompatible with Spark3, I modify a lot of code to be > compatible. > > Hive on Spark has deprecated? > > And. Hive on Spark is very slow when the job executes. >
Re: Should we consider Spark3 support for Hive on Spark
Do you honestly believe that a non apache community dev can just fork hive, modify the code and make it work with any version of spark? Is that what you are suggesting? Please, let us know if this is the case. Sent from Yahoo Mail for iPad On Wednesday, August 24, 2022, 6:13 AM, Jan Fili wrote: Can always fork to get things going ;) *sorry for spam* Am Mi., 24. Aug. 2022 um 06:34 Uhr schrieb hernan saab via user : > > > Hey Fred, > > Contrary to what you may perceive from the hive docs, what you are trying to > do is not plug and play. > Only apache committers can do what you are trying to do. > Use canned solutions such as confluence or AWS EMR and save yourself weeks of > wasted effort. > > Hernán > On Tuesday, August 23, 2022 at 08:46:30 PM PDT, Fred Bai > wrote: > > > Hi everyone: > > Do we have any support for Hive on Spark? I need Hive on Spark, but my Spark > version is 3.X. > > I found Hive incompatible with Spark3, I modify a lot of code to be > compatible. > > Hive on Spark has deprecated? > > And. Hive on Spark is very slow when the job executes.
Re: Should we consider Spark3 support for Hive on Spark
Can always fork to get things going ;) *sorry for spam* Am Mi., 24. Aug. 2022 um 06:34 Uhr schrieb hernan saab via user : > > > Hey Fred, > > Contrary to what you may perceive from the hive docs, what you are trying to > do is not plug and play. > Only apache committers can do what you are trying to do. > Use canned solutions such as confluence or AWS EMR and save yourself weeks of > wasted effort. > > Hernán > On Tuesday, August 23, 2022 at 08:46:30 PM PDT, Fred Bai > wrote: > > > Hi everyone: > > Do we have any support for Hive on Spark? I need Hive on Spark, but my Spark > version is 3.X. > > I found Hive incompatible with Spark3, I modify a lot of code to be > compatible. > > Hive on Spark has deprecated? > > And. Hive on Spark is very slow when the job executes.
Re: Should we consider Spark3 support for Hive on Spark
Hey Fred, Contrary to what you may perceive from the hive docs, what you are trying to do is not plug and play.Only apache committers can do what you are trying to do.Use canned solutions such as confluence or AWS EMR and save yourself weeks of wasted effort. HernánOn Tuesday, August 23, 2022 at 08:46:30 PM PDT, Fred Bai wrote: Hi everyone: Do we have any support for Hive on Spark? I need Hive on Spark, but my Spark version is 3.X. I found Hive incompatible with Spark3, I modify a lot of code to be compatible. Hive on Spark has deprecated? And. Hive on Spark is very slow when the job executes.
Should we consider Spark3 support for Hive on Spark
Hi everyone: Do we have any support for Hive on Spark? I need Hive on Spark, but my Spark version is 3.X. I found Hive incompatible with Spark3, I modify a lot of code to be compatible. Hive on Spark has deprecated? And. Hive on Spark is very slow when the job executes.
