[jira] [Created] (CARBONDATA-192) Invalidate table from hive context while dropping the table

2016-08-29 Thread Manohar Vanam (JIRA)
Manohar Vanam created CARBONDATA-192: Summary: Invalidate table from hive context while dropping the table Key: CARBONDATA-192 URL: https://issues.apache.org/jira/browse/CARBONDATA-192 Project: Ca

[GitHub] incubator-carbondata pull request #82: [CARBONDATA-165] Support loading fact...

2016-08-29 Thread QiangCai
Github user QiangCai commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/82#discussion_r76737910 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/util/GlobalDictionaryUtil.scala --- @@ -650,6 +650,51 @@ object GlobalDi

[GitHub] incubator-carbondata pull request #82: [CARBONDATA-165] Support loading fact...

2016-08-29 Thread manishgupta88
Github user manishgupta88 commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/82#discussion_r76736815 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/util/GlobalDictionaryUtil.scala --- @@ -650,6 +650,51 @@ object Glo

[GitHub] incubator-carbondata pull request #82: [CARBONDATA-165] Support loading fact...

2016-08-29 Thread foryou2030
Github user foryou2030 commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/82#discussion_r76726188 --- Diff: core/src/main/java/org/apache/carbondata/core/util/CarbonUtil.java --- @@ -1443,5 +1446,32 @@ public static int getDictionaryChunkSi

[jira] [Created] (CARBONDATA-191) load data is null when quote char is single and no '\n' being end.

2016-08-29 Thread Jay (JIRA)
Jay created CARBONDATA-191: -- Summary: load data is null when quote char is single and no '\n' being end. Key: CARBONDATA-191 URL: https://issues.apache.org/jira/browse/CARBONDATA-191 Project: CarbonData

[GitHub] incubator-carbondata pull request #104: [CARBONDATA-188] Compress CSV file b...

2016-08-29 Thread QiangCai
Github user QiangCai commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/104#discussion_r76723873 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/csv/CarbonTextFile.scala --- @@ -36,6 +36,8 @@ private[csv] object Carb

[GitHub] incubator-carbondata pull request #104: [CARBONDATA-188] Compress CSV file b...

2016-08-29 Thread QiangCai
Github user QiangCai commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/104#discussion_r76723805 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/util/GlobalDictionaryUtil.scala --- @@ -364,6 +364,7 @@ object GlobalDi

[GitHub] incubator-carbondata pull request #104: [CARBONDATA-188] Compress CSV file b...

2016-08-29 Thread QiangCai
Github user QiangCai commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/104#discussion_r76723773 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/rdd/CarbonDataRDDFactory.scala --- @@ -657,6 +657,8 @@ object CarbonDat

Re: A warning when loading data

2016-08-29 Thread Zen Wellon
Thank you Ravi, but I've set hadoop.tmp.dir in hadoop's core_site.xml. I'll build the master and try it again. 2016-08-30 0:11 GMT+08:00 Ravindra Pesala : > Hi Zen, > > It seems this issue is related to the PR > https://github.com/apache/incubator-carbondata/pull/89 .And it is merged > to > mast

[GitHub] incubator-carbondata pull request #105: [CARBONDATA-189] Drop database casca...

2016-08-29 Thread sujith71955
Github user sujith71955 commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/105#discussion_r76657713 --- Diff: integration/spark/src/main/scala/org/apache/spark/sql/CarbonSqlParser.scala --- @@ -1342,4 +1345,9 @@ class CarbonSqlParser()

Re: A warning when loading data

2016-08-29 Thread Ravindra Pesala
Hi Zen, It seems this issue is related to the PR https://github.com/apache/incubator-carbondata/pull/89 .And it is merged to master. Alternatively please try to add hadoop.tmp.dir to carbon.properties file to solve this issue. Thanks, Ravi On 29 August 2016 at 20:44, Zen Wellon wrote: > I don

[GitHub] incubator-carbondata pull request #108: [CARBONDATA-190]Data mismatch issue ...

2016-08-29 Thread kumarvishal09
GitHub user kumarvishal09 opened a pull request: https://github.com/apache/incubator-carbondata/pull/108 [CARBONDATA-190]Data mismatch issue in case of filter query Issue steps:1. create table , then restart the server and then do data load, in that case filter query record count i

[jira] [Created] (CARBONDATA-190) Data mismatch issue

2016-08-29 Thread kumar vishal (JIRA)
kumar vishal created CARBONDATA-190: --- Summary: Data mismatch issue Key: CARBONDATA-190 URL: https://issues.apache.org/jira/browse/CARBONDATA-190 Project: CarbonData Issue Type: Bug

[GitHub] incubator-carbondata pull request #82: [CARBONDATA-165] Support loading fact...

2016-08-29 Thread manishgupta88
Github user manishgupta88 commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/82#discussion_r76625697 --- Diff: core/src/main/java/org/apache/carbondata/core/util/CarbonUtil.java --- @@ -1443,5 +1446,32 @@ public static int getDictionaryChun

Re: A warning when loading data

2016-08-29 Thread Zen Wellon
I don't think it's raised by lockfile, because I've tried to recreate a new table with a totally different name. However, I'll check it tomorrow. 2016-08-29 23:09 GMT+08:00 Ravindra Pesala : > Hi, > > Did you check if any locks are created under system temp folder with > //lockfile, if it exists

Re: A warning when loading data

2016-08-29 Thread Ravindra Pesala
Hi, Did you check if any locks are created under system temp folder with //lockfile, if it exists please delete and try. Thanks, Ravi. On 29 August 2016 at 20:29, Zen Wellon wrote: > Hi Ravi, > > After I upgrade carbon to 0.1.0, this problem occurs every time when I try > to load data, and I'm

Re: A warning when loading data

2016-08-29 Thread Zen Wellon
Hi Ravi, After I upgrade carbon to 0.1.0, this problem occurs every time when I try to load data, and I'm sure no other carbon is running because I use my personal dev spark-cluster, I've also tried to recreate a new table, but it's still there.. 2016-08-29 18:11 GMT+08:00 Ravindra Pesala : > Hi

[GitHub] incubator-carbondata pull request #107: [WIP]quotechar is single without new...

2016-08-29 Thread Jay357089
GitHub user Jay357089 opened a pull request: https://github.com/apache/incubator-carbondata/pull/107 [WIP]quotechar is single without newLine You can merge this pull request into a Git repository by running: $ git pull https://github.com/Jay357089/incubator-carbondata quoteNew

[GitHub] incubator-carbondata pull request #88: [CARBONDATA-173]The exception info is...

2016-08-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-carbondata/pull/88 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fe

[GitHub] incubator-carbondata pull request #92: [CARBONDATA-176] Deletion of compacte...

2016-08-29 Thread ravikiran23
Github user ravikiran23 commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/92#discussion_r76619356 --- Diff: processing/src/main/java/org/apache/carbondata/lcm/status/SegmentStatusManager.java --- @@ -449,6 +457,12 @@ public void writeLoad

[GitHub] incubator-carbondata pull request #81: [CARBONDATA-132] Fix the bug that the...

2016-08-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-carbondata/pull/81 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fe

[GitHub] incubator-carbondata pull request #92: [CARBONDATA-176] Deletion of compacte...

2016-08-29 Thread ManoharVanam
Github user ManoharVanam commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/92#discussion_r76608195 --- Diff: processing/src/main/java/org/apache/carbondata/lcm/status/SegmentStatusManager.java --- @@ -449,6 +457,12 @@ public void writeLoa

[GitHub] incubator-carbondata pull request #92: [CARBONDATA-176] Deletion of compacte...

2016-08-29 Thread ravikiran23
Github user ravikiran23 commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/92#discussion_r76606724 --- Diff: processing/src/main/java/org/apache/carbondata/lcm/status/SegmentStatusManager.java --- @@ -410,18 +410,26 @@ public void writeLoa

[GitHub] incubator-carbondata pull request #92: [CARBONDATA-176] Deletion of compacte...

2016-08-29 Thread ManoharVanam
Github user ManoharVanam commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/92#discussion_r76606495 --- Diff: processing/src/main/java/org/apache/carbondata/lcm/status/SegmentStatusManager.java --- @@ -410,18 +410,26 @@ public void writeLo

[GitHub] incubator-carbondata pull request #106: [CARBONDATA-160]Data mismatch issue ...

2016-08-29 Thread kumarvishal09
GitHub user kumarvishal09 opened a pull request: https://github.com/apache/incubator-carbondata/pull/106 [CARBONDATA-160]Data mismatch issue in case of multiple segment with different dictionary key size Problem:In case of multiple segment and each segment keygenertaor key size is

[GitHub] incubator-carbondata pull request #104: [CARBONDATA-188] Compress CSV file b...

2016-08-29 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/104#discussion_r76595559 --- Diff: processing/src/main/java/org/apache/carbondata/processing/csvreaderstep/UnivocityCsvParser.java --- @@ -112,25 +116,29 @@ private voi

[GitHub] incubator-carbondata pull request #105: [CARBONDATA-189] Drop database casca...

2016-08-29 Thread nareshpr
GitHub user nareshpr opened a pull request: https://github.com/apache/incubator-carbondata/pull/105 [CARBONDATA-189] Drop database cascade should be restricted Reason: Carbondata will not support "Drop database dbname cascade" When user provides this command, carbon will validate

[jira] [Created] (CARBONDATA-189) Drop database dbname cascade should be restricted in carbondata

2016-08-29 Thread Naresh P R (JIRA)
Naresh P R created CARBONDATA-189: - Summary: Drop database dbname cascade should be restricted in carbondata Key: CARBONDATA-189 URL: https://issues.apache.org/jira/browse/CARBONDATA-189 Project: Carb

Re: A warning when loading data

2016-08-29 Thread Ravindra Pesala
Hi, Are you getting this exception continuously for every load? Usually it occurs when you try to load the data concurrently to the same table. So please make sure that no other instance of carbon is running and data load on the same table is not happening. Check if any locks are created under sys

[GitHub] incubator-carbondata pull request #104: [CARBONDATA-188] Compress CSV file b...

2016-08-29 Thread Zhangshunyu
Github user Zhangshunyu commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/104#discussion_r76580960 --- Diff: processing/src/main/java/org/apache/carbondata/processing/csvreaderstep/UnivocityCsvParser.java --- @@ -112,25 +116,29 @@ private

[GitHub] incubator-carbondata pull request #92: [CARBONDATA-176] Deletion of compacte...

2016-08-29 Thread ravikiran23
Github user ravikiran23 commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/92#discussion_r76581081 --- Diff: processing/src/main/java/org/apache/carbondata/lcm/status/SegmentStatusManager.java --- @@ -410,6 +410,14 @@ public void writeLoad

[GitHub] incubator-carbondata pull request #104: [CARBONDATA-188] Compress CSV file b...

2016-08-29 Thread jackylk
GitHub user jackylk opened a pull request: https://github.com/apache/incubator-carbondata/pull/104 [CARBONDATA-188] Compress CSV file before loading Currently when loading CarbonData file using Spark Dataframe API, it will firstly save as CSV file then load to CarbonData file.

[jira] [Created] (CARBONDATA-188) Compress CSV file while loading

2016-08-29 Thread Jacky Li (JIRA)
Jacky Li created CARBONDATA-188: --- Summary: Compress CSV file while loading Key: CARBONDATA-188 URL: https://issues.apache.org/jira/browse/CARBONDATA-188 Project: CarbonData Issue Type: Improvem

[jira] [Created] (CARBONDATA-187) when using Decimal type as dictionary the generated surrogate key would mismatch for the same values during increment load

2016-08-29 Thread zhangshunyu (JIRA)
zhangshunyu created CARBONDATA-187: -- Summary: when using Decimal type as dictionary the generated surrogate key would mismatch for the same values during increment load Key: CARBONDATA-187 URL: https://issues.apa

[GitHub] incubator-carbondata pull request #103: Fix the bug that when using Decimal ...

2016-08-29 Thread Zhangshunyu
GitHub user Zhangshunyu opened a pull request: https://github.com/apache/incubator-carbondata/pull/103 Fix the bug that when using Decimal type as dictionary gen surrogate key will mismatch for the same values during increment load. ## Why raise this pr? **Fix bug: when using De

A warning when loading data

2016-08-29 Thread Zen Wellon
Hi guys, When I tried to load some data into carbondata table with carbon 0.1.0, I met a problem below. WARN 29-08 15:40:17,535 - Lost task 10.0 in stage 2.1 (TID 365, amlera-30-6.gtj): java.lang.RuntimeException: Dictionary file ***(sensitive column) is locked for updation. Please try after some

Re: [Exception] a thrift related problem occured when trying 0.0.1 release version

2016-08-29 Thread Zen Wellon
yes, I resolved this problem by deleting the old carbon metastore. 2016-08-27 0:18 GMT+08:00 Ravindra Pesala : > Hi William, > > It may be because you are using old carbon store. Please try using new > store path. There were changes in thrift so old store won't work on this > release. > > Thanks

[GitHub] incubator-carbondata pull request #102: [CARBONDATA-186] Except compaction a...

2016-08-29 Thread nareshpr
GitHub user nareshpr opened a pull request: https://github.com/apache/incubator-carbondata/pull/102 [CARBONDATA-186] Except compaction all other alter operations on carbon table will be unsupported. Reason: As Carbon table will not support alter operations except compaction, all th