[jira] [Created] (CARBONDATA-231) Rename repeared table names in same test file and add drop tables.
zhangshunyu created CARBONDATA-231: -- Summary: Rename repeared table names in same test file and add drop tables. Key: CARBONDATA-231 URL: https://issues.apache.org/jira/browse/CARBONDATA-231 Project: CarbonData Issue Type: Improvement Reporter: zhangshunyu -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[GitHub] incubator-carbondata pull request #145: [CARBONDATA-230]Decoding for alias i...
GitHub user ashokblend opened a pull request: https://github.com/apache/incubator-carbondata/pull/145 [CARBONDATA-230]Decoding for alias in case of join and subquery Problem: When query has alias and subquery with join, decoder is not able to decode Analysis: In case of mentioned problem scenario, aliasMap is not getting populated with its correct origin value. Solution: Need to populate aliasmap with correct attribute You can merge this pull request into a Git repository by running: $ git pull https://github.com/ashokblend/incubator-carbondata dictdecoder Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-carbondata/pull/145.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #145 commit 7b281f7ae811dbd1c7392a4c99f3435e97dff3f9 Author: ashok.blendDate: 2016-09-02T07:08:32Z Pushing down below functions to carbon 1.Filter pushdown 2.EquiJoin 3.COUNT(*) commit 91eef1e45713a91eaee8a233e6f45dc50a8bca58 Author: ashok.blend Date: 2016-09-08T17:04:28Z 1.Changed alias decoder to get correct value 2.Changed logger to log datatype. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #144: [CARBONDATA-220] TimeStampDirectDict...
GitHub user mohammadshahidkhan opened a pull request: https://github.com/apache/incubator-carbondata/pull/144 [CARBONDATA-220] TimeStampDirectDictionaryGenerator_UT.java is not running in the build # **Why raise this pr?** Our build script does not execute the test case if the class name does not have Test or TestCase There was no boundary value test case for the timestamp datatype. # **How to resolve?** We have to refactor the class and have to add the boundary test cases. You can merge this pull request into a Git repository by running: $ git pull https://github.com/mohammadshahidkhan/incubator-carbondata test_case_fix Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-carbondata/pull/144.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #144 commit aa945684cfeb9639248481bce25872f00824cc2b Author: mohammadshahidkhanDate: 2016-09-08T10:06:11Z [CARBONDATA-220] TimeStampDirectDictionaryGenerator_UT.java is not running in the build --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #143: [CARBONDATA-229] Array Index of boun...
Github user asfgit closed the pull request at: https://github.com/apache/incubator-carbondata/pull/143 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #141: [CARBONDATA-228] Removed Unsupported...
Github user asfgit closed the pull request at: https://github.com/apache/incubator-carbondata/pull/141 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #140: [CARBONDATA-227] In block distributi...
Github user asfgit closed the pull request at: https://github.com/apache/incubator-carbondata/pull/140 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #137: [CARBONDATA-222] Handled query issue...
Github user asfgit closed the pull request at: https://github.com/apache/incubator-carbondata/pull/137 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Created] (CARBONDATA-229) Array Index of bound exception thrown from dictionary look up while writing sort index file
Manish Gupta created CARBONDATA-229: --- Summary: Array Index of bound exception thrown from dictionary look up while writing sort index file Key: CARBONDATA-229 URL: https://issues.apache.org/jira/browse/CARBONDATA-229 Project: CarbonData Issue Type: Bug Reporter: Manish Gupta Assignee: Manish Gupta Whenever we load dictionary data into memory, then in case of populating reverse dictionary object sometimes a chunk which has no value is also getting added to the dictionary chunk list. This is happening because the logic for dictionary chunk distribution in case of forward dictionary is not implemented for reverse dictionary and 0 size dictionary chunks are not getting removed while adding to the list of dictionary chunks. java.lang.IndexOutOfBoundsException: Index: 0, Size: 0 at java.util.ArrayList.rangeCheck(ArrayList.java:653) at java.util.ArrayList.get(ArrayList.java:429) at org.apache.carbondata.core.cache.dictionary.DictionaryChunksWrapper.next(DictionaryChunksWrapper.java:92) at org.apache.carbondata.core.writer.sortindex.CarbonDictionarySortInfoPreparator.prepareDictionarySortModels(CarbonDictionarySortInfoPreparator.java:120) at org.apache.carbondata.core.writer.sortindex.CarbonDictionarySortInfoPreparator.getDictionarySortInfo(CarbonDictionarySortInfoPreparator.java:51) at org.apache.carbondata.spark.tasks.SortIndexWriterTask.execute(SortIndexWriterTask.scala:44) at org.apache.carbondata.spark.rdd.CarbonGlobalDictionaryGenerateRDD$$anon$1.(CarbonGlobalDictionaryRDD.scala:387) at org.apache.carbondata.spark.rdd.CarbonGlobalDictionaryGenerateRDD.compute(CarbonGlobalDictionaryRDD.scala:294) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[GitHub] incubator-carbondata pull request #134: [CARBONDATA-220] TimeStampDirectDict...
Github user asfgit closed the pull request at: https://github.com/apache/incubator-carbondata/pull/134 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #135: [CARBONDATA-226]changing the error m...
Github user asfgit closed the pull request at: https://github.com/apache/incubator-carbondata/pull/135 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #142: [WIP][CARBONDATA-221] Fix the bug of...
GitHub user Zhangshunyu opened a pull request: https://github.com/apache/incubator-carbondata/pull/142 [WIP][CARBONDATA-221] Fix the bug of inverted index that store inverted index in metadata. ## Why raise this pr? Inverted index in ddl info was not stored into store, and when we restart the culster, query might mismatch. ## How to solve? Using the Encoding as the indentifier to check whether using inverted index. You can merge this pull request into a Git repository by running: $ git pull https://github.com/Zhangshunyu/incubator-carbondata index Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-carbondata/pull/142.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #142 commit f76908319c8eae0b65ea2cd9d0f5899225c95667 Author: ZhangshunyuDate: 2016-09-08T07:48:03Z Save useInvertedIndex info into thrift store commit ecd5403105fd37da239db66bd313cf548a532eef Author: Zhangshunyu Date: 2016-09-08T07:48:15Z Save useInvertedIndex info into thrift store --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #90: [CARBONDATA-175]Fix Bug: Load Decimal...
Github user lion-x closed the pull request at: https://github.com/apache/incubator-carbondata/pull/90 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #140: [CARBONDATA-227] In block distributi...
Github user gvramana commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/140#discussion_r77950753 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/rdd/CarbonScanRDD.scala --- @@ -73,7 +73,7 @@ class CarbonScanRDD[V: ClassTag]( baseStoreLocation: String) extends RDD[V](sc, Nil) with Logging { - val defaultParallelism = sc.defaultParallelism + var defaultParallelism = sc.defaultParallelism --- End diff -- now member is not required, make it a private val. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-carbondata pull request #137: [CARBONDATA-222] Handled query issue...
Github user gvramana commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/137#discussion_r77950155 --- Diff: core/src/main/java/org/apache/carbondata/core/carbon/datastore/impl/btree/BTreeDataRefNodeFinder.java --- @@ -240,9 +240,16 @@ private int compareIndexes(IndexKey first, IndexKey second) { firstNoDictionaryKeyBuffer.getShort(nonDictionaryKeyOffset + SHORT_SIZE_IN_BYTES); secondNodeDictionaryLength = secondNoDictionaryKeyBuffer.getShort(nonDictionaryKeyOffset + SHORT_SIZE_IN_BYTES); - compareResult = ByteUtil.UnsafeComparer.INSTANCE - .compareTo(first.getNoDictionaryKeys(), actualOffset, firstNoDcitionaryLength, - second.getNoDictionaryKeys(), actualOffset, secondNodeDictionaryLength); + int minLength = Math.min(firstNoDcitionaryLength, secondNodeDictionaryLength); --- End diff -- @kumarvishal09 please comment on this. I am not getting how actualOffset is same for both keybuffers. Also as I know length can be calculated by nextOffset-currentOffset. Please give the structure of data stored and how this function works --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---