Github user ravipesala commented on the issue:
https://github.com/apache/carbondata/pull/2628
SDV Build Fail , Please check CI
http://144.76.159.231:8080/job/ApacheSDVTests/6371/
---
Github user ravipesala commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2623#discussion_r212535141
--- Diff:
core/src/main/java/org/apache/carbondata/core/util/CarbonConfiguration.java ---
@@ -0,0 +1,61 @@
+/*
+ * Licensed to the Apache Sof
Github user ravipesala commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2623#discussion_r212534871
--- Diff:
core/src/main/java/org/apache/carbondata/core/datastore/impl/FileFactory.java
---
@@ -43,12 +46,6 @@
*/
private static fina
Github user ravipesala commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2653#discussion_r212534244
--- Diff:
store/sdk/src/main/java/org/apache/carbondata/sdk/file/CarbonWriterBuilder.java
---
@@ -360,6 +382,33 @@ public CarbonWriter
buildWriterF
Github user ravipesala commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2653#discussion_r212534215
--- Diff:
store/sdk/src/main/java/org/apache/carbondata/sdk/file/CarbonWriterBuilder.java
---
@@ -339,6 +339,28 @@ public CarbonWriter buildWriterFo
Github user ravipesala commented on the issue:
https://github.com/apache/carbondata/pull/2647
SDV Build Fail , Please check CI
http://144.76.159.231:8080/job/ApacheSDVTests/6370/
---
Github user xuchuanyin commented on the issue:
https://github.com/apache/carbondata/pull/2628
@QiangCai Fixed.
We will get and validate the compressor before loading and will use that
compressor during that loading procedure.
Tests are added to verify this: during data loading,
Github user ravipesala commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2653#discussion_r212533573
--- Diff:
processing/src/main/java/org/apache/carbondata/processing/util/CarbonDataProcessorUtil.java
---
@@ -659,9 +659,14 @@ public static boolean
Github user xuchuanyin commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2628#discussion_r212533250
--- Diff:
integration/spark-common-test/src/test/scala/org/apache/carbondata/integration/spark/testsuite/dataload/TestLoadDataWithCompressor.scala
---
Github user xuchuanyin commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2628#discussion_r212533227
--- Diff:
integration/spark-common-test/src/test/scala/org/apache/carbondata/integration/spark/testsuite/dataload/TestLoadDataWithCompressor.scala
---
Github user ravipesala commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2653#discussion_r212533163
--- Diff:
hadoop/src/main/java/org/apache/carbondata/hadoop/api/CarbonTableOutputFormat.java
---
@@ -268,6 +268,49 @@ public synchronized OutputComm
Github user ravipesala commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2653#discussion_r212532764
--- Diff:
hadoop/src/main/java/org/apache/carbondata/hadoop/api/CarbonTableOutputFormat.java
---
@@ -434,4 +477,61 @@ public CarbonLoadModel getLoad
Github user ravipesala commented on the issue:
https://github.com/apache/carbondata/pull/2623
SDV Build Fail , Please check CI
http://144.76.159.231:8080/job/ApacheSDVTests/6369/
---
Github user ravipesala commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2653#discussion_r212531510
--- Diff:
hadoop/src/main/java/org/apache/carbondata/hadoop/api/CarbonTableOutputFormat.java
---
@@ -434,4 +477,61 @@ public CarbonLoadModel getLoad
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/2653
Build Success with Spark 2.2.1, Please check CI
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/6743/
---
Github user QiangCai commented on the issue:
https://github.com/apache/carbondata/pull/2657
retest this please
---
Github user ravipesala commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2653#discussion_r212531097
--- Diff:
hadoop/src/main/java/org/apache/carbondata/hadoop/api/CarbonTableOutputFormat.java
---
@@ -268,6 +268,49 @@ public synchronized OutputComm
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/2653
Build Success with Spark 2.1.0, Please check CI
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/8020/
---
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/2657
Build Success with Spark 2.2.1, Please check CI
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/6742/
---
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/2657
Build Failed with Spark 2.1.0, Please check CI
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/8019/
---
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/2647
Build Failed with Spark 2.2.1, Please check CI
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/6740/
---
Github user ravipesala commented on the issue:
https://github.com/apache/carbondata/pull/2653
SDV Build Fail , Please check CI
http://144.76.159.231:8080/job/ApacheSDVTests/6368/
---
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/2647
Build Failed with Spark 2.1.0, Please check CI
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/8017/
---
Github user ravipesala commented on the issue:
https://github.com/apache/carbondata/pull/2657
SDV Build Fail , Please check CI
http://144.76.159.231:8080/job/ApacheSDVTests/6367/
---
Github user ravipesala commented on the issue:
https://github.com/apache/carbondata/pull/2647
SDV Build Fail , Please check CI
http://144.76.159.231:8080/job/ApacheSDVTests/6366/
---
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/2656
Build Failed with Spark 2.1.0, Please check CI
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/8018/
---
GitHub user QiangCai opened a pull request:
https://github.com/apache/carbondata/pull/2657
[CARBONDATA-2884] Rename the methods of ByteUtil class to avoid the misuse
The method toBytes will execute XOR operation on data.
So the result is not the byte array of the real value.
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/2656
Build Failed with Spark 2.2.1, Please check CI
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/6741/
---
QiangCai created CARBONDATA-2884:
Summary: Should rename the methods of ByteUtil class to avoid the
misuse
Key: CARBONDATA-2884
URL: https://issues.apache.org/jira/browse/CARBONDATA-2884
Project: Carb
[
https://issues.apache.org/jira/browse/CARBONDATA-2884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
QiangCai reassigned CARBONDATA-2884:
Assignee: QiangCai
> Should rename the methods of ByteUtil class to avoid the misuse
Github user Sssan520 commented on the issue:
https://github.com/apache/carbondata/pull/2656
retest this please
---
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/2653
Build Success with Spark 2.2.1, Please check CI
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/6738/
---
[
https://issues.apache.org/jira/browse/CARBONDATA-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
lianganping updated CARBONDATA-2883:
Description:
Now some operatons are not supported for external format table, so those
[
https://issues.apache.org/jira/browse/CARBONDATA-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
lianganping reassigned CARBONDATA-2883:
---
Assignee: lianganping
> block some operations on external format table
> --
lianganping created CARBONDATA-2883:
---
Summary: block some operations on external format table
Key: CARBONDATA-2883
URL: https://issues.apache.org/jira/browse/CARBONDATA-2883
Project: CarbonData
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/2653
Build Failed with Spark 2.1.0, Please check CI
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/8015/
---
Github user ravipesala commented on the issue:
https://github.com/apache/carbondata/pull/2656
SDV Build Fail , Please check CI
http://144.76.159.231:8080/job/ApacheSDVTests/6365/
---
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/2656
Build Failed with Spark 2.1.0, Please check CI
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/8016/
---
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/2656
Build Failed with Spark 2.2.1, Please check CI
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/6739/
---
GitHub user Sssan520 opened a pull request:
https://github.com/apache/carbondata/pull/2656
[ExternalFormat] block some operations on external format table
These operations will be blocked:
1. update data on external format table
2. delete data on external format table
3.
xuchuanyin created CARBONDATA-2882:
--
Summary: Support longstring for streaming table
Key: CARBONDATA-2882
URL: https://issues.apache.org/jira/browse/CARBONDATA-2882
Project: CarbonData
Issue
[
https://issues.apache.org/jira/browse/CARBONDATA-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
xuchuanyin reopened CARBONDATA-2420:
Assignee: (was: xuchuanyin)
> Support string longer than 32000 characters
>
Github user ajantha-bhat commented on the issue:
https://github.com/apache/carbondata/pull/2653
retest this please
---
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/2654
Build Failed with Spark 2.2.1, Please check CI
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/6737/
---
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/2654
Build Failed with Spark 2.1.0, Please check CI
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/8014/
---
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/2623
Build Failed with Spark 2.2.1, Please check CI
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/6736/
---
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/2623
Build Failed with Spark 2.1.0, Please check CI
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/8013/
---
Github user ravipesala commented on the issue:
https://github.com/apache/carbondata/pull/2654
SDV Build Fail , Please check CI
http://144.76.159.231:8080/job/ApacheSDVTests/6364/
---
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/2653
Build Success with Spark 2.2.1, Please check CI
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/6734/
---
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/2653
Build Failed with Spark 2.1.0, Please check CI
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/8011/
---
Github user ravipesala commented on the issue:
https://github.com/apache/carbondata/pull/2623
SDV Build Fail , Please check CI
http://144.76.159.231:8080/job/ApacheSDVTests/6363/
---
Github user ravipesala commented on the issue:
https://github.com/apache/carbondata/pull/2654
SDV Build Fail , Please check CI
http://144.76.159.231:8080/job/ApacheSDVTests/6362/
---
Github user kunal642 closed the pull request at:
https://github.com/apache/carbondata/pull/2655
---
Github user ravipesala commented on the issue:
https://github.com/apache/carbondata/pull/2654
SDV Build Fail , Please check CI
http://144.76.159.231:8080/job/ApacheSDVTests/6361/
---
Github user ravipesala commented on the issue:
https://github.com/apache/carbondata/pull/2655
SDV Build Fail , Please check CI
http://144.76.159.231:8080/job/ApacheSDVTests/6360/
---
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/2655
Build Failed with Spark 2.2.1, Please check CI
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/6732/
---
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/2654
Build Failed with Spark 2.2.1, Please check CI
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/6733/
---
Github user ajantha-bhat commented on the issue:
https://github.com/apache/carbondata/pull/2653
retest this please
---
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/2655
Build Failed with Spark 2.1.0, Please check CI
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/8009/
---
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/2654
Build Failed with Spark 2.1.0, Please check CI
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/8010/
---
GitHub user kunal642 opened a pull request:
https://github.com/apache/carbondata/pull/2655
[WIP][TEST] sk ak test
Be sure to do all of the following checklist to help us incorporate
your contribution quickly and easily:
- [ ] Any interfaces changed?
- [ ] An
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/2623
Build Failed with Spark 2.2.1, Please check CI
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/6730/
---
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/2623
Build Failed with Spark 2.1.0, Please check CI
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/8007/
---
Github user ravipesala commented on the issue:
https://github.com/apache/carbondata/pull/2654
SDV Build Fail , Please check CI
http://144.76.159.231:8080/job/ApacheSDVTests/6359/
---
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/2653
Build Success with Spark 2.2.1, Please check CI
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/6729/
---
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/2654
Build Failed with Spark 2.1.0, Please check CI
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/8008/
---
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/2654
Build Failed with Spark 2.2.1, Please check CI
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/6731/
---
GitHub user dhatchayani opened a pull request:
https://github.com/apache/carbondata/pull/2654
[WIP] Adaptive Encoding for Primitive data types
Be sure to do all of the following checklist to help us incorporate
your contribution quickly and easily:
- [ ] Any interfaces
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/2653
Build Failed with Spark 2.1.0, Please check CI
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/8006/
---
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/2649
Build Success with Spark 2.2.1, Please check CI
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/6727/
---
Github user ravipesala commented on the issue:
https://github.com/apache/carbondata/pull/2623
SDV Build Fail , Please check CI
http://144.76.159.231:8080/job/ApacheSDVTests/6358/
---
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/2649
Build Failed with Spark 2.1.0, Please check CI
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/8004/
---
Github user ravipesala commented on the issue:
https://github.com/apache/carbondata/pull/2653
SDV Build Fail , Please check CI
http://144.76.159.231:8080/job/ApacheSDVTests/6357/
---
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/2614
Build Success with Spark 2.2.1, Please check CI
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/6726/
---
GitHub user ajantha-bhat opened a pull request:
https://github.com/apache/carbondata/pull/2653
[CARBONDATA-2874] Support SDK writer as thread safe api
Problem: Currently CarbonWriter.write() not a thread safe. if multiple
threads calls .write() for one writer.
Data count incon
Github user ravipesala commented on the issue:
https://github.com/apache/carbondata/pull/2623
SDV Build Fail , Please check CI
http://144.76.159.231:8080/job/ApacheSDVTests/6356/
---
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/2614
Build Failed with Spark 2.1.0, Please check CI
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/8003/
---
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/2623
Build Failed with Spark 2.2.1, Please check CI
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/6728/
---
Github user ravipesala commented on the issue:
https://github.com/apache/carbondata/pull/2649
SDV Build Fail , Please check CI
http://144.76.159.231:8080/job/ApacheSDVTests/6355/
---
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/2647
Build Success with Spark 2.2.1, Please check CI
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/6725/
---
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/2623
Build Failed with Spark 2.1.0, Please check CI
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/8005/
---
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/2647
Build Failed with Spark 2.1.0, Please check CI
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/8002/
---
Github user manishgupta88 commented on the issue:
https://github.com/apache/carbondata/pull/2649
@jackylk
1. This PR is only for SDK support
2. Yes map is implemented as an array of struct. For more
details you can check the design document
https://docs.google.com/documen
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/2623
Build Failed with Spark 2.2.1, Please check CI
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/6724/
---
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/2623
Build Failed with Spark 2.1.0, Please check CI
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/8001/
---
Github user ravipesala commented on the issue:
https://github.com/apache/carbondata/pull/2647
SDV Build Fail , Please check CI
http://144.76.159.231:8080/job/ApacheSDVTests/6354/
---
Github user jackylk commented on the issue:
https://github.com/apache/carbondata/pull/2614
retest this please
---
Github user jackylk commented on the issue:
https://github.com/apache/carbondata/pull/2649
Is map implemented as an array of struct?
---
Github user jackylk commented on the issue:
https://github.com/apache/carbondata/pull/2649
Is this only for SDK or can be support in SQL also?
---
Github user jackylk commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2646#discussion_r212353990
--- Diff:
processing/src/main/java/org/apache/carbondata/processing/loading/iterator/CarbonOutputIteratorWrapper.java
---
@@ -45,17 +45,21 @@
Github user ravipesala commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2647#discussion_r212350692
--- Diff:
integration/spark-datasource/src/main/scala/org/apache/spark/sql/carbondata/execution/datasources/readsupport/SparkUnsafeRowReadSuport.scala
-
Github user jackylk commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2646#discussion_r212350574
--- Diff:
store/sdk/src/test/java/org/apache/carbondata/sdk/file/ConcurrentSdkWriterTest.java
---
@@ -0,0 +1,102 @@
+/*
+ * Licensed to the Apa
Github user jackylk commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2646#discussion_r212350482
--- Diff:
store/sdk/src/test/java/org/apache/carbondata/sdk/file/ConcurrentSdkWriterTest.java
---
@@ -0,0 +1,102 @@
+/*
+ * Licensed to the Apa
Github user jackylk commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2646#discussion_r212350373
--- Diff:
store/sdk/src/test/java/org/apache/carbondata/sdk/file/ConcurrentSdkWriterTest.java
---
@@ -0,0 +1,102 @@
+/*
+ * Licensed to the Apa
Github user ravipesala commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2647#discussion_r212350177
--- Diff:
integration/spark-datasource/src/main/scala/org/apache/spark/sql/carbondata/execution/datasources/SparkCarbonFileFormat.scala
---
@@ -0,0
Github user ravipesala commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2647#discussion_r212348045
--- Diff:
integration/spark-datasource/src/main/scala/org/apache/spark/sql/carbondata/execution/datasources/CarbonSparkDataSourceUtil.scala
---
@@ -
Github user ravipesala commented on the issue:
https://github.com/apache/carbondata/pull/2623
SDV Build Fail , Please check CI
http://144.76.159.231:8080/job/ApacheSDVTests/6353/
---
Github user ravipesala commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2647#discussion_r212340928
--- Diff:
integration/spark-datasource/src/main/scala/org/apache/spark/sql/carbondata/execution/datasources/CarbonSparkDataSourceUtil.scala
---
@@ -
Github user ravipesala commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2647#discussion_r212336190
--- Diff: integration/spark-datasource/pom.xml ---
@@ -0,0 +1,279 @@
+
+
+http://maven.apache.org/POM/4.0.0";
xmlns:xsi="http://www.w3.or
Github user KanakaKumar commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2647#discussion_r212333785
--- Diff:
integration/spark-datasource/src/main/scala/org/apache/spark/sql/carbondata/execution/datasources/readsupport/SparkUnsafeRowReadSuport.scala
1 - 100 of 171 matches
Mail list logo
