[ 
https://issues.apache.org/jira/browse/HUDI-254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vinoth Chandar updated HUDI-254:
--------------------------------
    Description: 
A lot of discussions around this kicked off from 
[https://github.com/apache/incubator-hudi/issues/869] 

Breaking down into phases, when we drop the hudi-spark-bundle*.jar onto the 
`jars` folder 

 

a) Writing data via Hudi datasource should work 

b) Spark datasource reads should work

 

c)  a + Hive Sync should work

d) SparkSQL on Hive synced table works 

 

Start with Spark 2.3 (current demo setup) and then proceed to 2.4 and iron out 
issues.

 

  was:
A lot of discussions around this kicked off from 
[https://github.com/apache/incubator-hudi/issues/869] 

Breaking down into phases, when we drop the hudi-spark-bundle*.jar onto the 
`jars` folder 

 

a) Writing data via Hudi datasource should work 

b)  a + Hive Sync should work

c) Spark datasource reads should work

d) SparkSQL on Hive synced table works 

 

Start with Spark 2.3 (current demo setup) and then proceed to 2.4 and iron out 
issues.

 


> Provide mechanism for installing hudi-spark-bundle onto an existing spark 
> installation
> --------------------------------------------------------------------------------------
>
>                 Key: HUDI-254
>                 URL: https://issues.apache.org/jira/browse/HUDI-254
>             Project: Apache Hudi (incubating)
>          Issue Type: Improvement
>          Components: Spark datasource, SparkSQL Support
>            Reporter: Vinoth Chandar
>            Assignee: Vinoth Chandar
>            Priority: Major
>
> A lot of discussions around this kicked off from 
> [https://github.com/apache/incubator-hudi/issues/869] 
> Breaking down into phases, when we drop the hudi-spark-bundle*.jar onto the 
> `jars` folder 
>  
> a) Writing data via Hudi datasource should work 
> b) Spark datasource reads should work
>  
> c)  a + Hive Sync should work
> d) SparkSQL on Hive synced table works 
>  
> Start with Spark 2.3 (current demo setup) and then proceed to 2.4 and iron 
> out issues.
>  



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

Reply via email to