hi dev.
carbon version :1.3.1
spark version:2.2.1
1) First I create a carbon table through beeline.
2) Then I use spark-submit and dataframe load data to carbon. Query is OK??
3) Then I use spark-submit and dataframe load data to carbon again, but query
through thriftserver return all NULL field.
4) I restart thriftserver, and query through thriftserver return correct result.
This problem happens everytime. I think this problem may is about
CarbonThriftServer.
is there anybody encountered this problem? can anybody give some advice,thanks.
you can use this code to reproduce problem.
===================
val carbonTableName = args(1)
val warehouse = new File("./warehouse").getCanonicalPath
val metastore = new File("./metastore").getCanonicalPath
val spark = SparkSession
.builder()
.appName("StreamExample")
.config("spark.sql.warehouse.dir", warehouse)
.getOrCreateCarbonSession(warehouse, metastore)
val df2 = spark.read.parquet(path)
df2.write
.format("carbondata")
.option("tableName", carbonTableName)
.option("compress", "true")
.option("tempCSV", "false")
.mode(SaveMode.Overwrite)
.save()=============