[jira] [Created] (CARBONDATA-231) Rename repeared table names in same test file and add drop tables.

2016-09-08 Thread zhangshunyu (JIRA)
zhangshunyu created CARBONDATA-231:
--

 Summary: Rename repeared table names in same test file and add 
drop tables.
 Key: CARBONDATA-231
 URL: https://issues.apache.org/jira/browse/CARBONDATA-231
 Project: CarbonData
  Issue Type: Improvement
Reporter: zhangshunyu






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] incubator-carbondata pull request #145: [CARBONDATA-230]Decoding for alias i...

2016-09-08 Thread ashokblend
GitHub user ashokblend opened a pull request:

https://github.com/apache/incubator-carbondata/pull/145

[CARBONDATA-230]Decoding for alias in case of join and subquery 

Problem: When query has alias and subquery with join, decoder is not able 
to decode
Analysis: In case of mentioned problem scenario, aliasMap is not getting 
populated with its correct origin value.
Solution: Need to populate aliasmap with correct attribute

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/ashokblend/incubator-carbondata dictdecoder

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-carbondata/pull/145.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #145


commit 7b281f7ae811dbd1c7392a4c99f3435e97dff3f9
Author: ashok.blend 
Date:   2016-09-02T07:08:32Z

Pushing down below functions to carbon
1.Filter pushdown
2.EquiJoin
3.COUNT(*)

commit 91eef1e45713a91eaee8a233e6f45dc50a8bca58
Author: ashok.blend 
Date:   2016-09-08T17:04:28Z

1.Changed alias decoder to get correct value
2.Changed logger to log datatype.




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata pull request #144: [CARBONDATA-220] TimeStampDirectDict...

2016-09-08 Thread mohammadshahidkhan
GitHub user mohammadshahidkhan opened a pull request:

https://github.com/apache/incubator-carbondata/pull/144

[CARBONDATA-220] TimeStampDirectDictionaryGenerator_UT.java is not running 
in the build

# **Why raise this pr?**

Our build script does not execute the test case if the class name does not 
have Test or TestCase 
There was no boundary value test case for the timestamp datatype.

# **How to resolve?**

We have to refactor the class and have to add the boundary test cases.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/mohammadshahidkhan/incubator-carbondata 
test_case_fix

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-carbondata/pull/144.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #144


commit aa945684cfeb9639248481bce25872f00824cc2b
Author: mohammadshahidkhan 
Date:   2016-09-08T10:06:11Z

[CARBONDATA-220] TimeStampDirectDictionaryGenerator_UT.java is not running 
in the build




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata pull request #143: [CARBONDATA-229] Array Index of boun...

2016-09-08 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/incubator-carbondata/pull/143


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata pull request #141: [CARBONDATA-228] Removed Unsupported...

2016-09-08 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/incubator-carbondata/pull/141


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata pull request #140: [CARBONDATA-227] In block distributi...

2016-09-08 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/incubator-carbondata/pull/140


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata pull request #137: [CARBONDATA-222] Handled query issue...

2016-09-08 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/incubator-carbondata/pull/137


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Created] (CARBONDATA-229) Array Index of bound exception thrown from dictionary look up while writing sort index file

2016-09-08 Thread Manish Gupta (JIRA)
Manish Gupta created CARBONDATA-229:
---

 Summary: Array Index of bound exception thrown from dictionary 
look up while writing sort index file
 Key: CARBONDATA-229
 URL: https://issues.apache.org/jira/browse/CARBONDATA-229
 Project: CarbonData
  Issue Type: Bug
Reporter: Manish Gupta
Assignee: Manish Gupta


Whenever we load dictionary data into memory, then in case of populating 
reverse dictionary object sometimes a chunk which has no value is also getting 
added to the dictionary chunk list. This is happening because the logic for 
dictionary chunk distribution in case of forward dictionary is not implemented 
for reverse dictionary and 0 size dictionary chunks are not getting removed 
while adding to the list of dictionary chunks.
java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
at java.util.ArrayList.rangeCheck(ArrayList.java:653)
at java.util.ArrayList.get(ArrayList.java:429)
at 
org.apache.carbondata.core.cache.dictionary.DictionaryChunksWrapper.next(DictionaryChunksWrapper.java:92)
at 
org.apache.carbondata.core.writer.sortindex.CarbonDictionarySortInfoPreparator.prepareDictionarySortModels(CarbonDictionarySortInfoPreparator.java:120)
at 
org.apache.carbondata.core.writer.sortindex.CarbonDictionarySortInfoPreparator.getDictionarySortInfo(CarbonDictionarySortInfoPreparator.java:51)
at 
org.apache.carbondata.spark.tasks.SortIndexWriterTask.execute(SortIndexWriterTask.scala:44)
at 
org.apache.carbondata.spark.rdd.CarbonGlobalDictionaryGenerateRDD$$anon$1.(CarbonGlobalDictionaryRDD.scala:387)
at 
org.apache.carbondata.spark.rdd.CarbonGlobalDictionaryGenerateRDD.compute(CarbonGlobalDictionaryRDD.scala:294)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] incubator-carbondata pull request #134: [CARBONDATA-220] TimeStampDirectDict...

2016-09-08 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/incubator-carbondata/pull/134


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata pull request #135: [CARBONDATA-226]changing the error m...

2016-09-08 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/incubator-carbondata/pull/135


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata pull request #142: [WIP][CARBONDATA-221] Fix the bug of...

2016-09-08 Thread Zhangshunyu
GitHub user Zhangshunyu opened a pull request:

https://github.com/apache/incubator-carbondata/pull/142

[WIP][CARBONDATA-221] Fix the bug of inverted index that store inverted 
index in metadata.

## Why raise this pr?
Inverted index in ddl info was not stored into store, and when we restart 
the culster, query might mismatch.
## How to solve?
Using the Encoding as the indentifier to check whether using inverted index.


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/Zhangshunyu/incubator-carbondata index

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-carbondata/pull/142.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #142


commit f76908319c8eae0b65ea2cd9d0f5899225c95667
Author: Zhangshunyu 
Date:   2016-09-08T07:48:03Z

Save useInvertedIndex info into thrift store

commit ecd5403105fd37da239db66bd313cf548a532eef
Author: Zhangshunyu 
Date:   2016-09-08T07:48:15Z

Save useInvertedIndex info into thrift store




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata pull request #90: [CARBONDATA-175]Fix Bug: Load Decimal...

2016-09-08 Thread lion-x
Github user lion-x closed the pull request at:

https://github.com/apache/incubator-carbondata/pull/90


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata pull request #140: [CARBONDATA-227] In block distributi...

2016-09-08 Thread gvramana
Github user gvramana commented on a diff in the pull request:

https://github.com/apache/incubator-carbondata/pull/140#discussion_r77950753
  
--- Diff: 
integration/spark/src/main/scala/org/apache/carbondata/spark/rdd/CarbonScanRDD.scala
 ---
@@ -73,7 +73,7 @@ class CarbonScanRDD[V: ClassTag](
 baseStoreLocation: String)
   extends RDD[V](sc, Nil) with Logging {
 
-  val defaultParallelism = sc.defaultParallelism
+  var defaultParallelism = sc.defaultParallelism
--- End diff --

now member is not required, make it a private val.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-carbondata pull request #137: [CARBONDATA-222] Handled query issue...

2016-09-08 Thread gvramana
Github user gvramana commented on a diff in the pull request:

https://github.com/apache/incubator-carbondata/pull/137#discussion_r77950155
  
--- Diff: 
core/src/main/java/org/apache/carbondata/core/carbon/datastore/impl/btree/BTreeDataRefNodeFinder.java
 ---
@@ -240,9 +240,16 @@ private int compareIndexes(IndexKey first, IndexKey 
second) {
   firstNoDictionaryKeyBuffer.getShort(nonDictionaryKeyOffset + 
SHORT_SIZE_IN_BYTES);
   secondNodeDictionaryLength =
   secondNoDictionaryKeyBuffer.getShort(nonDictionaryKeyOffset 
+ SHORT_SIZE_IN_BYTES);
-  compareResult = ByteUtil.UnsafeComparer.INSTANCE
-  .compareTo(first.getNoDictionaryKeys(), actualOffset, 
firstNoDcitionaryLength,
-  second.getNoDictionaryKeys(), actualOffset, 
secondNodeDictionaryLength);
+  int minLength = Math.min(firstNoDcitionaryLength, 
secondNodeDictionaryLength);
--- End diff --

@kumarvishal09 please comment on this. I am not getting how actualOffset is 
same for both keybuffers. 
Also as I know length can be calculated by nextOffset-currentOffset. Please 
give the structure of data stored and how this function works 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---