Hello,
I am trying to write a basic analyzer, by extending the catalyst analyzer
with a few extra rules.
I am getting the following error:
""" *trait CatalystConf in package catalyst cannot be accessed in package
org.apache.spark.sql.catalyst* """
In my attempt I am doing the following:
class CustomSQLContext(sc: SparkContext) extends SQLContext(sc) {
val an = new CustomAnalyzer(Map("testRule" ->
testRule),catalog,functionRegistry,conf)
override lazy val analyzer: Analyzer = an
}
class CustomAnalyzer(rules: Map[String, Rule[LogicalPlan]], catalog:
Catalog, registery: FunctionRegistry, conf: CatalystConf )
extends Analyzer( catalog, registery, conf) {
......
override lazy val batches = my_batch.toSeq ++ default_batches ++ Nil
}
Any ideas how I can pass the conf to the customAnalyzer without this error?
I tried passing it as SQLConf but get a not found error and importing
doesn't seem to work.
Thanks!
