Re: New Spark Datasource for Hive ACID tables

2019-07-27 Thread Abhishek Somani
I realised that the build instructions in the README.md were not very clear due to some recent changes. I have updated those now. Thanks, Abhishek Somani On Sun, Jul 28, 2019 at 7:53 AM naresh Goud wrote: > Thanks Abhishek. > I will check it out. > > Thank you, > Naresh > > On Sat, Jul 27,

Re: New Spark Datasource for Hive ACID tables

2019-07-27 Thread naresh Goud
Thanks Abhishek. I will check it out. Thank you, Naresh On Sat, Jul 27, 2019 at 9:21 PM Abhishek Somani wrote: > Hey Naresh, > > There is a `shaded-dependecies` project inside the root directory. You > need to go into that and build and publish that to local first. > > cd shaded-dependencies

Re: New Spark Datasource for Hive ACID tables

2019-07-27 Thread Abhishek Somani
Hey Naresh, There is a `shaded-dependecies` project inside the root directory. You need to go into that and build and publish that to local first. cd shaded-dependencies > sbt clean publishLocal > After that, come back out to the root directory and build that project. The

Re: New Spark Datasource for Hive ACID tables

2019-07-27 Thread naresh Goud
It looks there is some internal dependency missing. libraryDependencies ++= Seq( "com.qubole" %% "spark-acid-shaded-dependencies" % "0.1" ) How do we get it? Thank you, Naresh Thanks, Naresh www.linkedin.com/in/naresh-dulam http://hadoopandspark.blogspot.com/ On Sat, Jul 27, 2019 at

Re: New Spark Datasource for Hive ACID tables

2019-07-27 Thread naresh Goud
Hi Abhishek, We are not able to build jar using git hub code with below error? Any others able to build jars? Is there anything else missing? Note: Unresolved dependencies path: [warn] com.qubole:spark-acid-shaded-dependencies_2.11:0.1

Re: New Spark Datasource for Hive ACID tables

2019-07-27 Thread Nicolas Paris
Congrats The read/write feature with hive3 is highly interesting On Fri, Jul 26, 2019 at 06:07:55PM +0530, Abhishek Somani wrote: > Hi All, > > We at Qubole have open sourced a datasource that will enable users to work on > their Hive ACID Transactional Tables using Spark.  > > Github: