QiangCai created CARBONDATA-3524:
Summary: support compaction by GLOBAL_SORT
Key: CARBONDATA-3524
URL: https://issues.apache.org/jira/browse/CARBONDATA-3524
Project: CarbonData
Issue Type
QiangCai created CARBONDATA-3523:
Summary: Should store file size into index file
Key: CARBONDATA-3523
URL: https://issues.apache.org/jira/browse/CARBONDATA-3523
Project: CarbonData
Issue
[
https://issues.apache.org/jira/browse/CARBONDATA-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
QiangCai resolved CARBONDATA-3348.
--
Resolution: Fixed
> support alter table property SORT_COLU
[
https://issues.apache.org/jira/browse/CARBONDATA-3371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
QiangCai reassigned CARBONDATA-3371:
Assignee: QiangCai
> Compaction show ArrayIndexOutOfBoundsException af
QiangCai created CARBONDATA-3371:
Summary: Compaction show ArrayIndexOutOfBoundsException after
sort_columns modification
Key: CARBONDATA-3371
URL: https://issues.apache.org/jira/browse/CARBONDATA-3371
[
https://issues.apache.org/jira/browse/CARBONDATA-3347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
QiangCai updated CARBONDATA-3347:
-
Description:
*Background*
Now SORT_COLUMNS can’t be modified after the table is created
[
https://issues.apache.org/jira/browse/CARBONDATA-3347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
QiangCai updated CARBONDATA-3347:
-
Description:
*Background*
Now SORT_COLUMNS can’t be modified after the table is created
[
https://issues.apache.org/jira/browse/CARBONDATA-3347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
QiangCai updated CARBONDATA-3347:
-
Attachment: sort_columns modification_v2.pdf
> support SORT_COLUMNS modificat
[
https://issues.apache.org/jira/browse/CARBONDATA-3347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
QiangCai reassigned CARBONDATA-3347:
Assignee: QiangCai
> support SORT_COLUMNS modificat
[
https://issues.apache.org/jira/browse/CARBONDATA-3350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
QiangCai updated CARBONDATA-3350:
-
Parent Issue: CARBONDATA-3347 (was: CARBONDATA-3343)
> enhance custom compaction
[
https://issues.apache.org/jira/browse/CARBONDATA-3343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
QiangCai reassigned CARBONDATA-3343:
Assignee: (was: QiangCai)
> Support Compaction for Range S
[
https://issues.apache.org/jira/browse/CARBONDATA-3349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
QiangCai updated CARBONDATA-3349:
-
Parent Issue: CARBONDATA-3347 (was: CARBONDATA-3343)
> add is_sorted and sort_colu
[
https://issues.apache.org/jira/browse/CARBONDATA-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
QiangCai updated CARBONDATA-3348:
-
Parent Issue: CARBONDATA-3347 (was: CARBONDATA-3343)
> support alter table prope
[
https://issues.apache.org/jira/browse/CARBONDATA-3343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
QiangCai reassigned CARBONDATA-3343:
Assignee: QiangCai
> Support Compaction for Range S
QiangCai created CARBONDATA-3350:
Summary: enhance custom compaction to support resort single segment
Key: CARBONDATA-3350
URL: https://issues.apache.org/jira/browse/CARBONDATA-3350
Project
[
https://issues.apache.org/jira/browse/CARBONDATA-3349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
QiangCai updated CARBONDATA-3349:
-
Summary: add is_sorted and sort_columns information into show segments
(was: Show Segments
QiangCai created CARBONDATA-3349:
Summary: Show Segments add is_sorted and sort_columns information
Key: CARBONDATA-3349
URL: https://issues.apache.org/jira/browse/CARBONDATA-3349
Project: CarbonData
QiangCai created CARBONDATA-3348:
Summary: support alter table property SORT_COLUMNS
Key: CARBONDATA-3348
URL: https://issues.apache.org/jira/browse/CARBONDATA-3348
Project: CarbonData
Issue
QiangCai created CARBONDATA-3347:
Summary: support SORT_COLUMNS modification
Key: CARBONDATA-3347
URL: https://issues.apache.org/jira/browse/CARBONDATA-3347
Project: CarbonData
Issue Type
[
https://issues.apache.org/jira/browse/CARBONDATA-3317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
QiangCai resolved CARBONDATA-3317.
--
Resolution: Fixed
> Executing 'show segments' command throws NPE when spark
[
https://issues.apache.org/jira/browse/CARBONDATA-3299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
QiangCai resolved CARBONDATA-3299.
--
Resolution: Fixed
> Updated value is not being reflected in the Desc formatted Comm
[
https://issues.apache.org/jira/browse/CARBONDATA-3276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
QiangCai resolved CARBONDATA-3276.
--
Resolution: Fixed
> Compacting table that do not exist should throw NoSuchTableExcept
[
https://issues.apache.org/jira/browse/CARBONDATA-841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
QiangCai closed CARBONDATA-841.
---
Resolution: Fixed
> improve the compress encoding for numeric type column to give g
[
https://issues.apache.org/jira/browse/CARBONDATA-436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
QiangCai closed CARBONDATA-436.
---
Resolution: Fixed
> Make blocklet size configuration respect to the actual size (in terms
[
https://issues.apache.org/jira/browse/CARBONDATA-1136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
QiangCai closed CARBONDATA-1136.
Resolution: Fixed
> After compaction, the select query is not showing d
[
https://issues.apache.org/jira/browse/CARBONDATA-1572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
QiangCai closed CARBONDATA-1572.
Resolution: Fixed
> Support Streaming Ing
[
https://issues.apache.org/jira/browse/CARBONDATA-3263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
QiangCai resolved CARBONDATA-3263.
--
Resolution: Fixed
> Should update doc for RANGE_COLUMN feat
[
https://issues.apache.org/jira/browse/CARBONDATA-3269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
QiangCai updated CARBONDATA-3269:
-
Description:
Reproduce:
For range_column feature,When we set "spark.serialize
QiangCai created CARBONDATA-3269:
Summary: Range_column throwing ArrayIndexOutOfBoundsException when
using KryoSerializer
Key: CARBONDATA-3269
URL: https://issues.apache.org/jira/browse/CARBONDATA-3269
[
https://issues.apache.org/jira/browse/CARBONDATA-3269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
QiangCai reassigned CARBONDATA-3269:
Assignee: QiangCai
> Range_column throwing ArrayIndexOutOfBoundsException when us
[
https://issues.apache.org/jira/browse/CARBONDATA-3263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
QiangCai reassigned CARBONDATA-3263:
Assignee: QiangCai
> Should update doc for RANGE_COLUMN feat
QiangCai created CARBONDATA-3263:
Summary: Should update doc for RANGE_COLUMN feature
Key: CARBONDATA-3263
URL: https://issues.apache.org/jira/browse/CARBONDATA-3263
Project: CarbonData
Github user QiangCai commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/3063#discussion_r246979073
--- Diff:
core/src/main/java/org/apache/carbondata/core/util/CarbonProperties.java ---
@@ -1364,6 +1365,29 @@ public int
Github user QiangCai commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/3063#discussion_r246978328
--- Diff:
core/src/main/java/org/apache/carbondata/core/metadata/schema/table/CarbonTable.java
---
@@ -947,6 +947,16 @@ public int
GitHub user QiangCai opened a pull request:
https://github.com/apache/carbondata/pull/3063
[CARBONDATA-3242] Move Range_Column into the table level properties
Move Range_Column into the table level properties
Be sure to do all of the following checklist to help us
QiangCai created CARBONDATA-3242:
Summary: Range_Column should be table level property
Key: CARBONDATA-3242
URL: https://issues.apache.org/jira/browse/CARBONDATA-3242
Project: CarbonData
GitHub user QiangCai opened a pull request:
https://github.com/apache/carbondata/pull/3061
[CARBONDATA-3239] Fix ArrayIndexOutOfBoundsException in
DataSkewRangePartitioner
Fix ArrayIndexOutOfBoundsException in DataSkewRangePartitioner and add test
case
Be sure to do all
QiangCai created CARBONDATA-3239:
Summary: Throwing ArrayIndexOutOfBoundsException in
DataSkewRangePartitioner
Key: CARBONDATA-3239
URL: https://issues.apache.org/jira/browse/CARBONDATA-3239
Project
Github user QiangCai commented on the issue:
https://github.com/apache/carbondata/pull/3001
@ravipesala reverted
---
Github user QiangCai commented on the issue:
https://github.com/apache/carbondata/pull/3001
@ravipesala
added test case for reading stream table
---
Github user QiangCai commented on the issue:
https://github.com/apache/carbondata/pull/3001
Is that ok?
---
Github user QiangCai commented on the issue:
https://github.com/apache/carbondata/pull/3001
@ravipesala
because we use spark to generate streaming segment and presto can't
dependency spark, So I want to use StructuredStreamingExample to create stream
table and commit the
Github user QiangCai commented on the issue:
https://github.com/apache/carbondata/pull/3001
@ravipesala please review again
---
Github user QiangCai commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/3001#discussion_r245916195
--- Diff:
integration/presto/src/test/scala/org/apache/carbondata/presto/integrationtest/PrestoAllDataTypeLocalDictTest.scala
---
@@ -38,48 +38,16
Github user QiangCai commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/3001#discussion_r245916085
--- Diff:
integration/presto/src/main/java/org/apache/carbondata/presto/stream/CarbondataStreamPageSource.java
---
@@ -0,0 +1,243
Github user QiangCai commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/3001#discussion_r245916004
--- Diff:
integration/presto/src/main/java/org/apache/carbondata/presto/readers/BooleanStreamReader.java
---
@@ -86,4 +86,15 @@ public
Github user QiangCai commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/3001#discussion_r245915288
--- Diff:
integration/presto/src/main/java/org/apache/carbondata/presto/CarbondataPageSourceProvider.java
---
@@ -79,13 +80,31 @@
@Override
Github user QiangCai commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/3001#discussion_r245912249
--- Diff:
integration/presto/src/main/java/org/apache/carbondata/presto/CarbonVectorBatch.java
---
@@ -95,6 +95,9 @@ private CarbonColumnVectorImpl
Github user QiangCai commented on the issue:
https://github.com/apache/carbondata/pull/3001
> @QiangCai Can you explain the dependency of readers after this PR?
Ideally, presto module should depends on streaming reader in core or hadoop
modules.
yes, I removed the rea
Github user QiangCai commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/3001#discussion_r245903277
--- Diff:
integration/presto/src/main/java/org/apache/carbondata/presto/CarbonVectorBatch.java
---
@@ -95,6 +95,9 @@ private CarbonColumnVectorImpl
Github user QiangCai commented on the issue:
https://github.com/apache/carbondata/pull/2971
@ravipesala
In my opinion, it is unnecessary to restrict changing.
The users will keep the range_column as unchanged as possible.
So I only add this option into loading command.
---
Github user QiangCai commented on the issue:
https://github.com/apache/carbondata/pull/2971
@ravipesala
I agree with you to add it to the table properties.
Even if it becomes the table property, maybe the user also can change it.
right?
Range_column is different from the
Github user QiangCai commented on the issue:
https://github.com/apache/carbondata/pull/2971
@ravipesala @kumarvishal09
please review again.
---
Github user QiangCai commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2971#discussion_r245260405
--- Diff:
integration/spark-common/src/main/scala/org/apache/carbondata/spark/load/DataLoadProcessBuilderOnSpark.scala
---
@@ -156,4 +161,206
Github user QiangCai commented on the issue:
https://github.com/apache/carbondata/pull/2971
@ravipesala
After the compaction, it will become local_sort.
In my opinion, we can use Range_column to partition the input data.
So it can reduce the scope of sorting during data
Github user QiangCai commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2971#discussion_r245237625
--- Diff:
integration/spark-common/src/main/scala/org/apache/carbondata/spark/load/DataLoadProcessBuilderOnSpark.scala
---
@@ -156,4 +161,206
Github user QiangCai commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2971#discussion_r245224484
--- Diff:
integration/spark-common/src/main/scala/org/apache/carbondata/spark/load/DataLoadProcessBuilderOnSpark.scala
---
@@ -156,4 +161,206
Github user QiangCai commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2971#discussion_r245224217
--- Diff:
integration/spark-common/src/main/scala/org/apache/carbondata/spark/load/DataLoadProcessBuilderOnSpark.scala
---
@@ -156,4 +161,206
Github user QiangCai commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2971#discussion_r245223174
--- Diff:
integration/spark-common/src/main/scala/org/apache/carbondata/spark/load/DataLoadProcessorStepOnSpark.scala
---
@@ -95,6 +96,67 @@ object
Github user QiangCai commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2971#discussion_r24542
--- Diff:
integration/spark-common/src/main/scala/org/apache/carbondata/spark/load/DataLoadProcessorStepOnSpark.scala
---
@@ -95,6 +96,67 @@ object
Github user QiangCai commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2971#discussion_r245198317
--- Diff:
integration/spark-common-test/src/test/scala/org/apache/carbondata/spark/testsuite/dataload/TestGlobalSortDataLoad.scala
---
@@ -106,6
Github user QiangCai commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2971#discussion_r245198367
--- Diff:
integration/spark-common/src/main/scala/org/apache/spark/DataSkewRangePartitioner.scala
---
@@ -0,0 +1,319 @@
+/*
+ * Licensed to
[
https://issues.apache.org/jira/browse/CARBONDATA-3219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
QiangCai reassigned CARBONDATA-3219:
Assignee: QiangCai
> support range partition the input data for local_sort/glo
[
https://issues.apache.org/jira/browse/CARBONDATA-3220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
QiangCai reassigned CARBONDATA-3220:
Assignee: QiangCai
> Should support presto to read stream segment d
QiangCai created CARBONDATA-3220:
Summary: Should support presto to read stream segment data
Key: CARBONDATA-3220
URL: https://issues.apache.org/jira/browse/CARBONDATA-3220
Project: CarbonData
QiangCai created CARBONDATA-3219:
Summary: support range partition the input data for
local_sort/global sort data loading
Key: CARBONDATA-3219
URL: https://issues.apache.org/jira/browse/CARBONDATA-3219
Github user QiangCai commented on the issue:
https://github.com/apache/carbondata/pull/2997
LGTM
---
Github user QiangCai commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/3001#discussion_r243176905
--- Diff:
integration/presto/src/main/java/org/apache/carbondata/presto/streaming/PrestoCarbonStreamRecordReader.java
---
@@ -0,0 +1,617
Github user QiangCai commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/3001#discussion_r243176527
--- Diff:
integration/presto/src/main/java/org/apache/carbondata/presto/streaming/CarbondataStreamPageSource.java
---
@@ -0,0 +1,243
Github user QiangCai commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/3001#discussion_r243164638
--- Diff:
integration/presto/src/main/java/org/apache/carbondata/presto/streaming/CarbondataStreamPageSource.java
---
@@ -0,0 +1,243
GitHub user QiangCai opened a pull request:
https://github.com/apache/carbondata/pull/3001
[Presto][Streaming] support presto read streaming table
Be sure to do all of the following checklist to help us incorporate
your contribution quickly and easily:
- [ ] Any
Github user QiangCai commented on the issue:
https://github.com/apache/carbondata/pull/2931
LGTM
---
Github user QiangCai commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2931#discussion_r242428274
--- Diff: store/CSDK/test/main.cpp ---
@@ -822,16 +831,17 @@ int main(int argc, char *argv[]) {
// init jvm
JNIEnv *env;
env
Github user QiangCai commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2984#discussion_r241265601
--- Diff:
datamap/bloom/src/main/java/org/apache/carbondata/datamap/bloom/BloomCoarseGrainDataMap.java
---
@@ -227,6 +231,12 @@ private String
Github user QiangCai commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2971#discussion_r238507037
--- Diff:
integration/spark-common/src/main/scala/org/apache/carbondata/spark/load/DataLoadProcessBuilderOnSpark.scala
---
@@ -156,4 +158,132
Github user QiangCai commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2971#discussion_r238505807
--- Diff:
integration/spark-common/src/main/scala/org/apache/carbondata/spark/load/DataLoadProcessBuilderOnSpark.scala
---
@@ -156,4 +158,132
Github user QiangCai commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2971#discussion_r238505859
--- Diff:
processing/src/main/java/org/apache/carbondata/processing/loading/model/LoadOption.java
---
@@ -188,6 +188,8 @@
optionsFinal.put
GitHub user QiangCai opened a pull request:
https://github.com/apache/carbondata/pull/2971
[TEST] Test loading performance of range_sort
For global_sort, add a option 'range_column':
LOAD DATA LOCAL INPATH 'xxx' INTO TABLE xxx OPTIONS('rang
Github user QiangCai commented on the issue:
https://github.com/apache/carbondata/pull/2954
LGTM
---
Github user QiangCai commented on the issue:
https://github.com/apache/carbondata/pull/2884
ok, merge to master
---
Github user QiangCai commented on the issue:
https://github.com/apache/carbondata/pull/2807
ok, merge into master
---
QiangCai created CARBONDATA-3059:
Summary: the size of carbondata file is much smaller than
table_blocksize
Key: CARBONDATA-3059
URL: https://issues.apache.org/jira/browse/CARBONDATA-3059
Project
Github user QiangCai commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2824#discussion_r227289015
--- Diff:
integration/spark2/src/main/scala/org/apache/spark/sql/execution/datasources/SparkCarbonTableFormat.scala
---
@@ -172,33 +172,8 @@ with
Github user QiangCai commented on the issue:
https://github.com/apache/carbondata/pull/2834
LGTM
---
Github user QiangCai commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2840#discussion_r227199190
--- Diff:
core/src/main/java/org/apache/carbondata/core/constants/CarbonCommonConstants.java
---
@@ -361,7 +361,7
GitHub user QiangCai opened a pull request:
https://github.com/apache/carbondata/pull/2832
[CARBONDATA-3021][Streaming] Fix unsupported data type exception for
streaming
Background:
when spark uses Kryo serialization, streaming app throws the exception
"Unsupported data
QiangCai created CARBONDATA-3021:
Summary: Streaming throw Unsupported data type exception
Key: CARBONDATA-3021
URL: https://issues.apache.org/jira/browse/CARBONDATA-3021
Project: CarbonData
Github user QiangCai commented on the issue:
https://github.com/apache/carbondata/pull/2730
@ravipesala
can you describe the modification?
---
Github user QiangCai commented on the issue:
https://github.com/apache/carbondata/pull/2729
@kumarvishal09
can you describe the modification?
---
Github user QiangCai commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2782#discussion_r221444696
--- Diff:
integration/spark2/src/test/scala/org/apache/spark/carbondata/TestStreamingTableOperation.scala
---
@@ -2327,7 +2371,7 @@ class
Github user QiangCai commented on the issue:
https://github.com/apache/carbondata/pull/2782
@xuchuanyin different test cases use different tables, they are independent.
---
GitHub user QiangCai opened a pull request:
https://github.com/apache/carbondata/pull/2782
[CARBONDATA-2984][Streaming] Fix NPE when there is no data in the task of a
batch
Fix NPE when there is no data in the task of a batch
- [x] Any interfaces changed?
no
QiangCai created CARBONDATA-2984:
Summary: streaming throw NPE when there is no data in the task of
a batch
Key: CARBONDATA-2984
URL: https://issues.apache.org/jira/browse/CARBONDATA-2984
Project
Github user QiangCai closed the pull request at:
https://github.com/apache/carbondata/pull/2670
---
Github user QiangCai commented on the issue:
https://github.com/apache/carbondata/pull/2769
LGTM
---
GitHub user QiangCai opened a pull request:
https://github.com/apache/carbondata/pull/2775
[HOTFIX][Streaming] Avoid throwing NPE during deleting the streaming lock
file
Be sure to do all of the following checklist to help us incorporate
your contribution quickly and easily
Github user QiangCai commented on the issue:
https://github.com/apache/carbondata/pull/2712
The failed test cases are success in my local machine
---
GitHub user QiangCai opened a pull request:
https://github.com/apache/carbondata/pull/2712
[HOTFIX] Fix streaming CI issue
fix streaming ci issue
- [x] Any interfaces changed?
no
- [x] Any backward compatibility impacted?
no
- [x] Document update
Github user QiangCai commented on the issue:
https://github.com/apache/carbondata/pull/2665
retest this please
---
Github user QiangCai commented on the issue:
https://github.com/apache/carbondata/pull/2598
retest this please
---
1 - 100 of 918 matches
Mail list logo
