Re: Injection of custom rules in session

2019-03-07 Thread David CaiQiang
>From spark 2.2, Spark can inject extensions.  
for example:
val spark = SparkSession
  .builder()
  ...
  .withExtensions(...)
  ...

CarbonSession.CarbonBuilder uses default extensions to create CarbonSession. 
It doesn't inject parser, analyzer and so on.

And the extensions variable is private in the apache.spark.sql package.
 Maybe We can't get the extensions directly to inject some rules by self.

So in my opinion, we should modify CarbonBuilder to support it. 




-
Best Regards
David Cai
--
Sent from: 
http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/


[Collection] Collect the requirement of hive + CarbonData

2019-03-07 Thread xubo245
Dear all,
 Hive is a popular data warehouse software in big data domain. It's
better for enhance Hive + CarbonData, which will convenient for hive user to
read CarbonData. CarbonData supported hive before, and the hive test case
can run in CarbonData-1.5.2, but hive module is very old and not easy to be
used. SO we want to collect the requirement of hive + CarbonData and then
enhance the hive module in CarbonData.
 If you have any requirements or good suggestions for Hive+CarbonData,
Please reply this mail. I will check it.
 Thanks.
Best wishes!
   Xubo
 




--
Sent from: 
http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/