PRIYESH RANJAN created CARBONDATA-4281:
------------------------------------------
Summary: document update for range column and COLUMN_META_CACHE
for complex column
Key: CARBONDATA-4281
URL: https://issues.apache.org/jira/browse/CARBONDATA-4281
Project: CarbonData
Issue Type: Bug
Components: docs
Affects Versions: 2.3.0
Environment: Contents verified on Spark 2.4.5 and Spark 3.1.1
Reporter: PRIYESH RANJAN
+Modification 1 :+
[https://github.com/apache/carbondata/blob/master/docs/ddl-of-carbondata.md]
Range column and COLUMN_META_CACHE does not support complex columns .This
details need to be updated in doc.
*+Query:+*
CREATE TABLE alter_com(intField INT,EDUCATED string ,rankk string) STORED AS
carbondata
TBLPROPERTIES('inverted_index'='intField','sort_columns'='intField','COLUMN_META_CACHE'='rankk','range_column'='EDUCATED');
insert into alter_com values(1,'pti','tanj');
ALTER TABLE alter_com ADD COLUMNS(arr1 array<array<int>>, arr2
array<struct<a1:string, map1:Map<string, string>>>) ;
*+For Range column :+*
0: jdbc:hive2://linux-29:22550/> ALTER TABLE alter_com SET
TBLPROPERTIES('COLUMN_META_CACHE'='arr2');
Error: org.apache.hive.service.cli.HiveSQLException: Error running query:
java.lang.RuntimeException: Alter table newProperties operation failed: arr2 is
a complex type column and *complex type is not allowed for the option(s):
column_meta_cach*e
at
org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation.org$apache$spark$sql$hive$thriftserver$SparkExecuteStatementOperation$$execute(SparkExecuteStatementOperation.scala:387)
at
org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$anon$2$$anon$3.$anonfun$run$3(SparkExecuteStatementOperation.scala:276)
at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
at
org.apache.spark.sql.hive.thriftserver.SparkOperation.withLocalProperties(SparkOperation.scala:78)
at
org.apache.spark.sql.hive.thriftserver.SparkOperation.withLocalProperties$(SparkOperation.scala:62)
at
org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation.withLocalProperties(SparkExecuteStatementOperation.scala:46)
at
org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$anon$2$$anon$3.run(SparkExecuteStatementOperation.scala:276)
at
org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$anon$2$$anon$3.run(SparkExecuteStatementOperation.scala:263)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1761)
at
org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$anon$2.run(SparkExecuteStatementOperation.scala:290)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
+*For COLUMN_META_CACHE* :+
0: jdbc:hive2://linux-29:22550/> ALTER TABLE alter_com SET
TBLPROPERTIES('range_column'='arr2');
Error: org.apache.hive.service.cli.HiveSQLException: Error running query:
java.lang.RuntimeException: Alter table newProperties operation failed:
*RANGE_COLUMN doesn't support ARRAY data type: arr2*
at
org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation.org$apache$spark$sql$hive$thriftserver$SparkExecuteStatementOperation$$execute(SparkExecuteStatementOperation.scala:387)
at
org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$anon$2$$anon$3.$anonfun$run$3(SparkExecuteStatementOperation.scala:276)
at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
at
org.apache.spark.sql.hive.thriftserver.SparkOperation.withLocalProperties(SparkOperation.scala:78)
at
org.apache.spark.sql.hive.thriftserver.SparkOperation.withLocalProperties$(SparkOperation.scala:62)
at
org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation.withLocalProperties(SparkExecuteStatementOperation.scala:46)
at
org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$anon$2$$anon$3.run(SparkExecuteStatementOperation.scala:276)
at
org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$anon$2$$anon$3.run(SparkExecuteStatementOperation.scala:263)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1761)
at
org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$anon$2.run(SparkExecuteStatementOperation.scala:290)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
