Github user ajantha-bhat commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2384#discussion_r197638055
--- Diff:
processing/src/main/java/org/apache/carbondata/processing/loading/jsoninput/JsonInputFormat.java
---
@@ -0,0 +1,285
Github user ajantha-bhat commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2384#discussion_r197638059
--- Diff:
store/sdk/src/main/java/org/apache/carbondata/sdk/file/JsonCarbonWriter.java ---
@@ -0,0 +1,146 @@
+/*
+ * Licensed
Github user ajantha-bhat commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2384#discussion_r197638048
--- Diff:
processing/src/main/java/org/apache/carbondata/processing/loading/jsoninput/JsonInputFormat.java
---
@@ -0,0 +1,285
Github user ajantha-bhat commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2384#discussion_r197638028
--- Diff:
core/src/main/java/org/apache/carbondata/core/util/CarbonUtil.java ---
@@ -3116,5 +3117,48 @@ public static void
Github user ajantha-bhat commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2384#discussion_r197638029
--- Diff:
processing/src/main/java/org/apache/carbondata/processing/loading/jsoninput/JsonInputFormat.java
---
@@ -0,0 +1,285
Github user ajantha-bhat commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2384#discussion_r197638025
--- Diff:
core/src/main/java/org/apache/carbondata/core/util/CarbonUtil.java ---
@@ -3116,5 +3117,48 @@ public static void
Github user ajantha-bhat commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2384#discussion_r197372247
--- Diff:
store/sdk/src/main/java/org/apache/carbondata/sdk/file/JsonReader.java ---
@@ -0,0 +1,130 @@
+/*
+ * Licensed to the Apache
Github user ajantha-bhat commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2384#discussion_r197367547
--- Diff:
processing/src/main/java/org/apache/carbondata/processing/loading/jsoninput/JsonInputFormat.java
---
@@ -0,0 +1,285
Github user ajantha-bhat commented on the issue:
https://github.com/apache/carbondata/pull/2384
retest this please
---
[
https://issues.apache.org/jira/browse/CARBONDATA-2608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ajantha Bhat reassigned CARBONDATA-2608:
Assignee: Ajantha Bhat
> SDK Support JSON data loading directly without A
GitHub user ajantha-bhat opened a pull request:
https://github.com/apache/carbondata/pull/2384
[CARBONDATA-2608] SDK Support JSON data loading directly (without AVRO
conversion)
What changes were proposed in this pull request?
Currently SDK Support JSON data loading only
[
https://issues.apache.org/jira/browse/CARBONDATA-2608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ajantha Bhat updated CARBONDATA-2608:
-
Summary: SDK Support JSON data loading directly without AVRO conversion
GitHub user ajantha-bhat opened a pull request:
https://github.com/apache/carbondata/pull/2368
[CARBONDATA-2603] Fix: error handling during reader build failure
problem : When the CarbonReaderBuilder.build() is failed due to some
problems like invalid projection that leads to query
Github user ajantha-bhat commented on the issue:
https://github.com/apache/carbondata/pull/2363
@ravipesala : please merge this fix to 1.4.0 branch also
---
Github user ajantha-bhat commented on the issue:
https://github.com/apache/carbondata/pull/2363
LGTM.
This fix need to merge to both master and 1.4 branch
---
Github user ajantha-bhat commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2363#discussion_r194323660
--- Diff:
store/sdk/src/test/java/org/apache/carbondata/sdk/file/CarbonReaderTest.java ---
@@ -105,6 +115,243 @@ public void testWriteAndReadFiles
Github user ajantha-bhat commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2363#discussion_r194323041
--- Diff:
store/sdk/src/main/java/org/apache/carbondata/sdk/file/CarbonReaderBuilder.java
---
@@ -179,7 +179,11 @@ public CarbonReaderBuilder
Ajantha Bhat created CARBONDATA-2577:
Summary: Nested Array logical type of date, timestamp-millis,
timestamp-micros is not working.
Key: CARBONDATA-2577
URL: https://issues.apache.org/jira/browse/CARBONDATA
GitHub user ajantha-bhat opened a pull request:
https://github.com/apache/carbondata/pull/2361
[WIP] Avro logical type issue fixes
**This PR is dependent on #2347**
Be sure to do all of the following checklist to help us incorporate
your contribution quickly
Github user ajantha-bhat commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2345#discussion_r192658697
--- Diff:
core/src/main/java/org/apache/carbondata/core/metadata/schema/table/CarbonTable.java
---
@@ -226,7 +226,7 @@ public static CarbonTable
Github user ajantha-bhat commented on the issue:
https://github.com/apache/carbondata/pull/2345
retest this please
---
Github user ajantha-bhat commented on the issue:
https://github.com/apache/carbondata/pull/2345
retest this please
---
[
https://issues.apache.org/jira/browse/CARBONDATA-2570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16497763#comment-16497763
]
Ajantha Bhat commented on CARBONDATA-2570:
--
Steps:
# Take sdk jars and dependent jars
Github user ajantha-bhat commented on the issue:
https://github.com/apache/carbondata/pull/2345
@xubo245 : Yes, It is there in PR, refer the CarbonRecordReader.java
---
Github user ajantha-bhat commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2345#discussion_r192333461
--- Diff:
core/src/main/java/org/apache/carbondata/core/metadata/schema/table/CarbonTable.java
---
@@ -996,4 +979,30 @@ public boolean canAllow
Ajantha Bhat created CARBONDATA-2570:
Summary: Carbon SDK Reader, second time reader instance have an
issue in cluster test
Key: CARBONDATA-2570
URL: https://issues.apache.org/jira/browse/CARBONDATA-2570
Github user ajantha-bhat commented on the issue:
https://github.com/apache/carbondata/pull/2345
@ravipesala : please review the PR.
With these change CarbonReaderBuilder.build() performance has improved by
50% on S3.
---
Github user ajantha-bhat commented on the issue:
https://github.com/apache/carbondata/pull/2322
Hanldled in #2435
---
Github user ajantha-bhat closed the pull request at:
https://github.com/apache/carbondata/pull/2322
---
Github user ajantha-bhat commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2352#discussion_r191691253
--- Diff:
store/sdk/src/test/java/org/apache/carbondata/sdk/file/CarbonReaderTest.java ---
@@ -305,7 +309,7 @@ public void
Github user ajantha-bhat commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2352#discussion_r191690950
--- Diff:
store/sdk/src/test/java/org/apache/carbondata/sdk/file/CarbonReaderTest.java ---
@@ -305,7 +309,7 @@ public void
[
https://issues.apache.org/jira/browse/CARBONDATA-2313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ajantha Bhat updated CARBONDATA-2313:
-
Attachment: carbon NonTranscational Table_v1.0.pdf
> Support Non Transactio
[
https://issues.apache.org/jira/browse/CARBONDATA-2313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ajantha Bhat updated CARBONDATA-2313:
-
Attachment: (was: carbon unamanged table_V1.0.pdf)
> Support Non Transactio
[
https://issues.apache.org/jira/browse/CARBONDATA-2557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ajantha Bhat updated CARBONDATA-2557:
-
Summary: Improve Carbon Reader Schema reading performance on S3 (was: SDK
Reader
Ajantha Bhat created CARBONDATA-2557:
Summary: SDK Reader performance is very slow in S3
Key: CARBONDATA-2557
URL: https://issues.apache.org/jira/browse/CARBONDATA-2557
Project: CarbonData
[
https://issues.apache.org/jira/browse/CARBONDATA-2555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ajantha Bhat updated CARBONDATA-2555:
-
Summary: SDK Reader should have isTransactionalTable = false by default
GitHub user ajantha-bhat opened a pull request:
https://github.com/apache/carbondata/pull/2352
[CARBONDATA-2555]Fixed SDK reader set default isTransactional as false
[CARBONDATA-2555]Fixed SDK reader set default isTransactional as false .
SDK writer is having default value
[
https://issues.apache.org/jira/browse/CARBONDATA-2555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ajantha Bhat reassigned CARBONDATA-2555:
Assignee: Ajantha Bhat
> SDK Reader should have isTransactionalTable = fa
Ajantha Bhat created CARBONDATA-2555:
Summary: SDK Reader should have isTransactionalTable = false by
default to be inline with SDK writer
Key: CARBONDATA-2555
URL: https://issues.apache.org/jira/browse
Github user ajantha-bhat commented on the issue:
https://github.com/apache/carbondata/pull/2345
@xuchuanyin : This is one of the exposed method in SDK reader now. External
client can make use of it to get schema by passing index file path.
You can refer the other methods
[
https://issues.apache.org/jira/browse/CARBONDATA-2548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16492594#comment-16492594
]
Ajantha Bhat commented on CARBONDATA-2548:
--
[~kevintop]: Can you please give/attach a create
Github user ajantha-bhat commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2345#discussion_r191110226
--- Diff:
store/sdk/src/main/java/org/apache/carbondata/sdk/file/CarbonReader.java ---
@@ -101,6 +108,43 @@ public static CarbonReaderBuilder
Github user ajantha-bhat commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2345#discussion_r191110214
--- Diff:
store/sdk/src/main/java/org/apache/carbondata/sdk/file/CarbonReader.java ---
@@ -101,6 +108,43 @@ public static CarbonReaderBuilder
Github user ajantha-bhat commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2345#discussion_r191110093
--- Diff:
store/sdk/src/main/java/org/apache/carbondata/sdk/file/CarbonReader.java ---
@@ -101,6 +108,43 @@ public static CarbonReaderBuilder
Github user ajantha-bhat commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2345#discussion_r191110113
--- Diff:
store/sdk/src/main/java/org/apache/carbondata/sdk/file/CarbonReader.java ---
@@ -101,6 +108,43 @@ public static CarbonReaderBuilder
GitHub user ajantha-bhat opened a pull request:
https://github.com/apache/carbondata/pull/2345
[wip] Improve Carbon Reader Schema reading performance on S3
Problem : Currently carbon reader is reading schema from carbondata file.
On s3 multiple IO happens as buffer size is small
Github user ajantha-bhat commented on the issue:
https://github.com/apache/carbondata/pull/2337
LGTM
---
Github user ajantha-bhat commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2337#discussion_r190850065
--- Diff:
store/sdk/src/main/java/org/apache/carbondata/sdk/file/CarbonReaderBuilder.java
---
@@ -50,26 +50,50 @@
private String tableName
Github user ajantha-bhat commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2337#discussion_r190819817
--- Diff: docs/sdk-guide.md ---
@@ -398,3 +399,160 @@ Reference : [list of carbon
properties](http://carbondata.apache.org/configurati
Github user ajantha-bhat commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2337#discussion_r190819502
--- Diff: docs/sdk-guide.md ---
@@ -398,3 +399,160 @@ Reference : [list of carbon
properties](http://carbondata.apache.org/configurati
Github user ajantha-bhat commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2337#discussion_r190819633
--- Diff: docs/sdk-guide.md ---
@@ -398,3 +399,160 @@ Reference : [list of carbon
properties](http://carbondata.apache.org/configurati
Github user ajantha-bhat commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2337#discussion_r190818765
--- Diff:
store/sdk/src/main/java/org/apache/carbondata/sdk/file/CarbonReaderBuilder.java
---
@@ -136,10 +160,17 @@ public CarbonReaderBuilder
[
https://issues.apache.org/jira/browse/CARBONDATA-2313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ajantha Bhat updated CARBONDATA-2313:
-
Attachment: carbon unamanged table_V1.0.pdf
> Support Non Transactional carbon ta
Github user ajantha-bhat commented on the issue:
https://github.com/apache/carbondata/pull/2319
retest this please
---
Github user ajantha-bhat commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2319#discussion_r189558009
--- Diff:
core/src/main/java/org/apache/carbondata/core/metadata/datatype/ArrayType.java
---
@@ -52,11 +56,12 @@ public boolean equals(Object obj
Github user ajantha-bhat commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2319#discussion_r189557906
--- Diff:
core/src/main/java/org/apache/carbondata/core/metadata/datatype/StructField.java
---
@@ -54,4 +54,41 @@ public String getFieldName
Github user ajantha-bhat commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2322#discussion_r189509573
--- Diff:
core/src/main/java/org/apache/carbondata/core/indexstore/blockletindex/BlockletDataMapFactory.java
---
@@ -191,7 +143,7 @@ private
Github user ajantha-bhat commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2322#discussion_r189502471
--- Diff:
core/src/main/java/org/apache/carbondata/core/util/BlockletDataMapUtil.java ---
@@ -67,7 +76,22 @@
List indexInfo
Github user ajantha-bhat commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2316#discussion_r189499110
--- Diff: docs/sdk-writer-guide.md ---
@@ -93,9 +93,8 @@ public class TestSdkAvro {
try {
CarbonWriter writer
Github user ajantha-bhat commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2316#discussion_r189496847
--- Diff: docs/sdk-writer-guide.md ---
@@ -33,9 +33,9 @@ These SDK writer output contains just a carbondata and
carbonindex files. No met
Github user ajantha-bhat commented on the issue:
https://github.com/apache/carbondata/pull/2322
retest this please
---
Github user ajantha-bhat commented on the issue:
https://github.com/apache/carbondata/pull/2322
@gvramana : please review.
---
GitHub user ajantha-bhat opened a pull request:
https://github.com/apache/carbondata/pull/2322
[CARBONDATA-2472] Fixed:Refactor NonTransactional table code for Index file
IO performance
[CARBONDATA-2472] Fixed:Refactor NonTransactional table code for Index file
IO performance
Github user ajantha-bhat commented on the issue:
https://github.com/apache/carbondata/pull/2319
retest this please
---
GitHub user ajantha-bhat opened a pull request:
https://github.com/apache/carbondata/pull/2319
[CARBONDATA-2493] DataType.equals() failes for complex types
This PR is dependent on #2313
problem :
[CARBONDATA-2493] DataType.equals() failes for complex types
Ajantha Bhat created CARBONDATA-2493:
Summary: DataType.equals() failes for complex types
Key: CARBONDATA-2493
URL: https://issues.apache.org/jira/browse/CARBONDATA-2493
Project: CarbonData
Github user ajantha-bhat commented on the issue:
https://github.com/apache/carbondata/pull/2299
@ravipesala : please review
---
[
https://issues.apache.org/jira/browse/CARBONDATA-2479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ajantha Bhat updated CARBONDATA-2479:
-
Description:
Multiple issues:
fixed external table path display
fixed
Github user ajantha-bhat commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2306#discussion_r188838995
--- Diff:
store/sdk/src/main/java/org/apache/carbondata/sdk/file/CarbonWriterBuilder.java
---
@@ -540,4 +543,19 @@ private CarbonLoadModel
Github user ajantha-bhat commented on the issue:
https://github.com/apache/carbondata/pull/2306
@ravipesala : PR is ready
---
Github user ajantha-bhat commented on the issue:
https://github.com/apache/carbondata/pull/2306
retest this please
---
Github user ajantha-bhat commented on the issue:
https://github.com/apache/carbondata/pull/2306
@ravipesala : please review
---
Github user ajantha-bhat commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2299#discussion_r188627098
--- Diff:
core/src/main/java/org/apache/carbondata/core/util/DataTypeUtil.java ---
@@ -401,6 +401,11 @@ public static Object
Github user ajantha-bhat commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2299#discussion_r188626030
--- Diff:
core/src/main/java/org/apache/carbondata/core/indexstore/blockletindex/BlockletDataMapFactory.java
---
@@ -115,13 +123,55 @@ public
Github user ajantha-bhat commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2299#discussion_r188625272
--- Diff:
core/src/main/java/org/apache/carbondata/core/indexstore/blockletindex/BlockletDataMapFactory.java
---
@@ -115,13 +123,55 @@ public
Github user ajantha-bhat commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2299#discussion_r188625173
--- Diff:
core/src/main/java/org/apache/carbondata/core/datamap/DataMapStoreManager.java
---
@@ -297,7 +297,7 @@ public TableDataMap
Github user ajantha-bhat commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2299#discussion_r188624043
--- Diff:
core/src/main/java/org/apache/carbondata/core/indexstore/blockletindex/BlockletDataMapFactory.java
---
@@ -115,13 +123,55 @@ public
[
https://issues.apache.org/jira/browse/CARBONDATA-2479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ajantha Bhat updated CARBONDATA-2479:
-
Description:
Multiple issues:
fixed external table path display
fixed
Github user ajantha-bhat commented on the issue:
https://github.com/apache/carbondata/pull/2306
retest this please
---
[
https://issues.apache.org/jira/browse/CARBONDATA-2472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ajantha Bhat updated CARBONDATA-2472:
-
Summary: Refactor NonTransactional table code for Index file IO performance
GitHub user ajantha-bhat opened a pull request:
https://github.com/apache/carbondata/pull/2306
[CARBONDATA-2479] Multiple issue fixes in SDK writer and external table flow
[CARBONDATA-2479] Multiple issues:
fixed external table path display
fixed default value
Ajantha Bhat created CARBONDATA-2479:
Summary: Multiple issue in sdk writer and external table flow
Key: CARBONDATA-2479
URL: https://issues.apache.org/jira/browse/CARBONDATA-2479
Project
Github user ajantha-bhat commented on the issue:
https://github.com/apache/carbondata/pull/2299
retest this please
---
Github user ajantha-bhat commented on the issue:
https://github.com/apache/carbondata/pull/2299
retest this please
---
GitHub user ajantha-bhat opened a pull request:
https://github.com/apache/carbondata/pull/2299
[CARBONDATA-2472] Fixed:NonTransactional table performance degarde issue
induced by PR #2273
Be sure to do all of the following checklist to help us incorporate
your
Github user ajantha-bhat commented on the issue:
https://github.com/apache/carbondata/pull/2291
LGTM
---
[
https://issues.apache.org/jira/browse/CARBONDATA-2472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ajantha Bhat updated CARBONDATA-2472:
-
Summary: NonTransactional table performance degarde issue induced by PR
#2273
Ajantha Bhat created CARBONDATA-2472:
Summary: NonTransactional table performance degarde issue induced
by #2273
Key: CARBONDATA-2472
URL: https://issues.apache.org/jira/browse/CARBONDATA-2472
[
https://issues.apache.org/jira/browse/CARBONDATA-2472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ajantha Bhat reassigned CARBONDATA-2472:
Assignee: Ajantha Bhat
> NonTransactional table performance degarde is
GitHub user ajantha-bhat opened a pull request:
https://github.com/apache/carbondata/pull/2296
[CARBONDATA-2369] updated the document about AVRO to carbon schema converter
[CARBONDATA-2369] updated the document about AVRO to carbon schema converter
Be sure to do all
Github user ajantha-bhat commented on the issue:
https://github.com/apache/carbondata/pull/2273
retest this please
---
Github user ajantha-bhat commented on the issue:
https://github.com/apache/carbondata/pull/2273
retest this please
---
Github user ajantha-bhat commented on the issue:
https://github.com/apache/carbondata/pull/2289
@jackylk : ObjectSizeCalculator is called during ReverseDictonaryCache init
time [please refer the issue callstack in jira] but reverse dictionary cache no
need to initialize for sdk flows
Github user ajantha-bhat commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2273#discussion_r187136017
--- Diff:
hadoop/src/main/java/org/apache/carbondata/hadoop/api/CarbonTableInputFormat.java
---
@@ -151,6 +154,33 @@ public CarbonTable
Github user ajantha-bhat commented on the issue:
https://github.com/apache/carbondata/pull/2273
retest this please
---
Github user ajantha-bhat commented on the issue:
https://github.com/apache/carbondata/pull/2289
@ravipesala : please review the PR
---
GitHub user ajantha-bhat opened a pull request:
https://github.com/apache/carbondata/pull/2289
[CARBONDATA-2435] Remove SDK dependency on spark jars.
[CARBONDATA-2435] Remove SDK dependency on spark jars.
Problem and cause : when sdk writer is used in standalone cluster
Github user ajantha-bhat commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2273#discussion_r187007180
--- Diff:
hadoop/src/main/java/org/apache/carbondata/hadoop/api/CarbonTableInputFormat.java
---
@@ -151,6 +154,33 @@ public CarbonTable
Github user ajantha-bhat commented on the issue:
https://github.com/apache/carbondata/pull/2283
@ravipesala : PR is ready
---
Github user ajantha-bhat commented on the issue:
https://github.com/apache/carbondata/pull/2283
retest this please
---
801 - 900 of 1029 matches
Mail list logo
