[
https://issues.apache.org/jira/browse/CARBONDATA-4326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Indhumathi resolved CARBONDATA-4326.
------------------------------------
Fix Version/s: 2.3.0
Resolution: Fixed
> mv created in beeline not hitting in sql/shell and vice versa if both beeline
> and sql/shell are running in parellel
> -------------------------------------------------------------------------------------------------------------------
>
> Key: CARBONDATA-4326
> URL: https://issues.apache.org/jira/browse/CARBONDATA-4326
> Project: CarbonData
> Issue Type: Bug
> Reporter: SHREELEKHYA GAMPA
> Priority: Major
> Fix For: 2.3.0
>
> Time Spent: 1h 40m
> Remaining Estimate: 0h
>
> [Steps] :-
> When MV is created in spark-shell/spark-sql on table created using Spark
> Dataframe, Explain query hits MV in spark-shell/spark-sql, but doesnt hit MV
> in spark-beeline, Same is the case when MV is created in spark-beeline on
> table created using Spark Dataframe, query hits MV in spark-beeline, but
> doesnt hit MV in spark-shell/spark-sql. This issue is faced when both
> sessions are running in parallel during MV Creation. On restarting the
> sessions of Spark-shell/ Spark-beeline, query hits the MV in both sessions.
> Queries Table created using Spark Dataframe:
> val geoSchema = StructType(Seq(StructField("timevalue", LongType, nullable =
> true), StructField("longitude", LongType, nullable = false),
> StructField("latitude", LongType, nullable = false))) val geoDf =
> sqlContext.read.option("delimiter", ",").option("header",
> "true").schema(geoSchema).csv("hdfs://hacluster/geodata/geodata.csv")
> sql("drop table if exists source_index_df").show() geoDf.write
> .format("carbondata") .option("tableName", "source_index_df")
> .mode(SaveMode.Overwrite) .save()
> Queries for MV created in spark-shell: sql("CREATE MATERIALIZED VIEW
> datamap_mv1 as select latitude,longitude from source_index_df group by
> latitude,longitude").show() sql("explain select latitude,longitude from
> source_index_df group by latitude,longitude").show(100,false)
> Queries for MV created in spark-beeline/spark-sql: CREATE MATERIALIZED VIEW
> datamap_mv1 as select latitude,longitude from source_index_df group by
> latitude,longitude; explain select latitude,longitude from source_index_df
> group by latitude,longitude;
> [Expected Result] :- mv created in beeline should hit the sql/shell and vice
> versa if both beeline and sql/shell are running in parellel
> [Actual Issue]:- mv created in beeline not hitting in sql/shell and vice
> versa if both beeline and sql/shell are running in parellel
>
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
