date:20170228

[GitHub] incubator-carbondata issue #618: [CARBONDATA-734] Support the syntax of 'STO...

2017-02-28 Thread CarbonDataQA

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/618
  
Can one of the admins verify this patch?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Updated] (CARBONDATA-734) Can't create parquet/orc table with CarbonSession

2017-02-28 Thread Yadong Qi (JIRA)


 [ 
https://issues.apache.org/jira/browse/CARBONDATA-734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yadong Qi updated CARBONDATA-734:
-
Description: 
When I create parquet table with the command below:
{code}
import org.apache.spark.sql.SparkSession 
import org.apache.spark.sql.CarbonSession._
val carbon = 
SparkSession.builder().config(sc.getConf).getOrCreateCarbonSession("hdfs://100.0.0.4:9000/user/hive/warehouse/carbon.store")
carbon.sql("create table src(key int, value string) stored as parquet")
{code}
It will failed with the error info below:
{code}
java.lang.RuntimeException: [1.1] failure: identifier matching regex (?i)ALTER 
expected

create table src(key int, value string) stored as parquet
^
  at scala.sys.package$.error(package.scala:27)
  at 
org.apache.spark.sql.parser.CarbonSpark2SqlParser.parse(CarbonSpark2SqlParser.scala:45)
  at 
org.apache.spark.sql.parser.CarbonSparkSqlParser.parsePlan(CarbonSparkSqlParser.scala:51)
  at org.apache.spark.sql.SparkSession.sql(SparkSession.scala:592)
  ... 50 elided
{code}


  was:
When I create parquet table using the below command:
{code}
import org.apache.spark.sql.SparkSession 
import org.apache.spark.sql.CarbonSession._
val carbon = 
SparkSession.builder().config(sc.getConf).getOrCreateCarbonSession("hdfs://100.0.0.4:9000/user/hive/warehouse/carbon.store")
carbon.sql("create table src(key int, value string) stored as parquet")
{code}
It will failed with the error info below:
{code}
java.lang.RuntimeException: [1.1] failure: identifier matching regex (?i)ALTER 
expected

create table src(key int, value string) stored as parquet
^
  at scala.sys.package$.error(package.scala:27)
  at 
org.apache.spark.sql.parser.CarbonSpark2SqlParser.parse(CarbonSpark2SqlParser.scala:45)
  at 
org.apache.spark.sql.parser.CarbonSparkSqlParser.parsePlan(CarbonSparkSqlParser.scala:51)
  at org.apache.spark.sql.SparkSession.sql(SparkSession.scala:592)
  ... 50 elided
{code}



> Can't create parquet/orc table with CarbonSession
> -
>
> Key: CARBONDATA-734
> URL: https://issues.apache.org/jira/browse/CARBONDATA-734
> Project: CarbonData
>  Issue Type: Bug
>  Components: spark-integration
>Affects Versions: 1.1.0-incubating
>Reporter: Yadong Qi
>
> When I create parquet table with the command below:
> {code}
> import org.apache.spark.sql.SparkSession 
> import org.apache.spark.sql.CarbonSession._
> val carbon = 
> SparkSession.builder().config(sc.getConf).getOrCreateCarbonSession("hdfs://100.0.0.4:9000/user/hive/warehouse/carbon.store")
> carbon.sql("create table src(key int, value string) stored as parquet")
> {code}
> It will failed with the error info below:
> {code}
> java.lang.RuntimeException: [1.1] failure: identifier matching regex 
> (?i)ALTER expected
> create table src(key int, value string) stored as parquet
> ^
>   at scala.sys.package$.error(package.scala:27)
>   at 
> org.apache.spark.sql.parser.CarbonSpark2SqlParser.parse(CarbonSpark2SqlParser.scala:45)
>   at 
> org.apache.spark.sql.parser.CarbonSparkSqlParser.parsePlan(CarbonSparkSqlParser.scala:51)
>   at org.apache.spark.sql.SparkSession.sql(SparkSession.scala:592)
>   ... 50 elided
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Created] (CARBONDATA-734) Can't create parquet/orc table with carbonsession

2017-02-28 Thread Yadong Qi (JIRA)

Yadong Qi created CARBONDATA-734:


 Summary: Can't create parquet/orc table with carbonsession
 Key: CARBONDATA-734
 URL: https://issues.apache.org/jira/browse/CARBONDATA-734
 Project: CarbonData
  Issue Type: Bug
  Components: spark-integration
Affects Versions: 1.1.0-incubating
Reporter: Yadong Qi


When I create parquet table using the below command:
{code}
import org.apache.spark.sql.SparkSession 
import org.apache.spark.sql.CarbonSession._
val carbon = 
SparkSession.builder().config(sc.getConf).getOrCreateCarbonSession("hdfs://100.0.0.4:9000/user/hive/warehouse/carbon.store")
carbon.sql("create table src(key int, value string) stored as parquet")
{code}
It will failed with the error info below:
{code}
java.lang.RuntimeException: [1.1] failure: identifier matching regex (?i)ALTER 
expected

create table src_004(key int, value string) stored as parquet
^
  at scala.sys.package$.error(package.scala:27)
  at 
org.apache.spark.sql.parser.CarbonSpark2SqlParser.parse(CarbonSpark2SqlParser.scala:45)
  at 
org.apache.spark.sql.parser.CarbonSparkSqlParser.parsePlan(CarbonSparkSqlParser.scala:51)
  at org.apache.spark.sql.SparkSession.sql(SparkSession.scala:592)
  ... 50 elided
{code}




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (CARBONDATA-734) Can't create parquet/orc table with CarbonSession

2017-02-28 Thread Yadong Qi (JIRA)


 [ 
https://issues.apache.org/jira/browse/CARBONDATA-734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yadong Qi updated CARBONDATA-734:
-
Description: 
When I create parquet table using the below command:
{code}
import org.apache.spark.sql.SparkSession 
import org.apache.spark.sql.CarbonSession._
val carbon = 
SparkSession.builder().config(sc.getConf).getOrCreateCarbonSession("hdfs://100.0.0.4:9000/user/hive/warehouse/carbon.store")
carbon.sql("create table src(key int, value string) stored as parquet")
{code}
It will failed with the error info below:
{code}
java.lang.RuntimeException: [1.1] failure: identifier matching regex (?i)ALTER 
expected

create table src(key int, value string) stored as parquet
^
  at scala.sys.package$.error(package.scala:27)
  at 
org.apache.spark.sql.parser.CarbonSpark2SqlParser.parse(CarbonSpark2SqlParser.scala:45)
  at 
org.apache.spark.sql.parser.CarbonSparkSqlParser.parsePlan(CarbonSparkSqlParser.scala:51)
  at org.apache.spark.sql.SparkSession.sql(SparkSession.scala:592)
  ... 50 elided
{code}


  was:
When I create parquet table using the below command:
{code}
import org.apache.spark.sql.SparkSession 
import org.apache.spark.sql.CarbonSession._
val carbon = 
SparkSession.builder().config(sc.getConf).getOrCreateCarbonSession("hdfs://100.0.0.4:9000/user/hive/warehouse/carbon.store")
carbon.sql("create table src(key int, value string) stored as parquet")
{code}
It will failed with the error info below:
{code}
java.lang.RuntimeException: [1.1] failure: identifier matching regex (?i)ALTER 
expected

create table src_004(key int, value string) stored as parquet
^
  at scala.sys.package$.error(package.scala:27)
  at 
org.apache.spark.sql.parser.CarbonSpark2SqlParser.parse(CarbonSpark2SqlParser.scala:45)
  at 
org.apache.spark.sql.parser.CarbonSparkSqlParser.parsePlan(CarbonSparkSqlParser.scala:51)
  at org.apache.spark.sql.SparkSession.sql(SparkSession.scala:592)
  ... 50 elided
{code}



> Can't create parquet/orc table with CarbonSession
> -
>
> Key: CARBONDATA-734
> URL: https://issues.apache.org/jira/browse/CARBONDATA-734
> Project: CarbonData
>  Issue Type: Bug
>  Components: spark-integration
>Affects Versions: 1.1.0-incubating
>Reporter: Yadong Qi
>
> When I create parquet table using the below command:
> {code}
> import org.apache.spark.sql.SparkSession 
> import org.apache.spark.sql.CarbonSession._
> val carbon = 
> SparkSession.builder().config(sc.getConf).getOrCreateCarbonSession("hdfs://100.0.0.4:9000/user/hive/warehouse/carbon.store")
> carbon.sql("create table src(key int, value string) stored as parquet")
> {code}
> It will failed with the error info below:
> {code}
> java.lang.RuntimeException: [1.1] failure: identifier matching regex 
> (?i)ALTER expected
> create table src(key int, value string) stored as parquet
> ^
>   at scala.sys.package$.error(package.scala:27)
>   at 
> org.apache.spark.sql.parser.CarbonSpark2SqlParser.parse(CarbonSpark2SqlParser.scala:45)
>   at 
> org.apache.spark.sql.parser.CarbonSparkSqlParser.parsePlan(CarbonSparkSqlParser.scala:51)
>   at org.apache.spark.sql.SparkSession.sql(SparkSession.scala:592)
>   ... 50 elided
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (CARBONDATA-370) Abnormal behaviour of datatype Int & bigInt

2017-02-28 Thread anubhav tarar (JIRA)


[ 
https://issues.apache.org/jira/browse/CARBONDATA-370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889559#comment-15889559
 ] 

anubhav tarar commented on CARBONDATA-370:
--

i think this issue is resolved u can check with latest build

> Abnormal behaviour of datatype Int & bigInt
> ---
>
> Key: CARBONDATA-370
> URL: https://issues.apache.org/jira/browse/CARBONDATA-370
> Project: CarbonData
>  Issue Type: Bug
>Reporter: SWATI RAO
>Assignee: Rahul Kumar
>
> The specified data-type range for Int & bigInt is:
> INT –––> -2147483648 to 2147483647
> BIGINT ––> -922337203685477580807 to 922337203685477580806
>  but I found abnormal behaviour in these data-type . 
> 1.When I insert beyond range in Int it allows range even beyond bigInt. 
> 2.When I insert into bigInt it doesn’t accept all values following in its 
> range.
>  



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Resolved] (CARBONDATA-719) Add a release guide in documentation

2017-02-28 Thread Liang Chen (JIRA)


 [ 
https://issues.apache.org/jira/browse/CARBONDATA-719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Liang Chen resolved CARBONDATA-719.
---
   Resolution: Fixed
Fix Version/s: 1.0.1-incubating
   1.1.0-incubating

> Add a release guide in documentation
> 
>
> Key: CARBONDATA-719
> URL: https://issues.apache.org/jira/browse/CARBONDATA-719
> Project: CarbonData
>  Issue Type: Task
>  Components: docs
>Reporter: Jean-Baptiste Onofré
>Assignee: Jean-Baptiste Onofré
> Fix For: 1.1.0-incubating, 1.0.1-incubating
>
>  Time Spent: 1h 40m
>  Remaining Estimate: 0h
>
> We have to provide a release guide explaining the steps to perform a 
> CarbonData release.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[GitHub] incubator-carbondata pull request #617: [CARBONDATA-719] Add release guide

2017-02-28 Thread asfgit

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-carbondata/pull/617


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #617: [CARBONDATA-719] Add release guide

2017-02-28 Thread chenliang613

Github user chenliang613 commented on the issue:

https://github.com/apache/incubator-carbondata/pull/617
  
LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Comment Edited] (CARBONDATA-722) Add direct links to contribution guide, mailing lists, source repositories and Jira

2017-02-28 Thread Liang Chen (JIRA)


[ 
https://issues.apache.org/jira/browse/CARBONDATA-722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15888263#comment-15888263
 ] 

Liang Chen edited comment on CARBONDATA-722 at 2/28/17 3:42 PM:


Already added apache jira link to website


was (Author: chenliang613):
Already add apache jira link to website

> Add direct links to contribution guide, mailing lists, source repositories 
> and Jira
> ---
>
> Key: CARBONDATA-722
> URL: https://issues.apache.org/jira/browse/CARBONDATA-722
> Project: CarbonData
>  Issue Type: Task
>  Components: website
>Reporter: Jean-Baptiste Onofré
>Assignee: Jean-Baptiste Onofré
>
> In order to facilitate contribution, we should provide direct links and 
> visibility to the contribution guide, mailing lists, source repositories and 
> Jira directly on the website.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (CARBONDATA-722) Add direct links to contribution guide, mailing lists, source repositories and Jira

2017-02-28 Thread Liang Chen (JIRA)


[ 
https://issues.apache.org/jira/browse/CARBONDATA-722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15888263#comment-15888263
 ] 

Liang Chen commented on CARBONDATA-722:
---

Already add apache jira link to website

> Add direct links to contribution guide, mailing lists, source repositories 
> and Jira
> ---
>
> Key: CARBONDATA-722
> URL: https://issues.apache.org/jira/browse/CARBONDATA-722
> Project: CarbonData
>  Issue Type: Task
>  Components: website
>Reporter: Jean-Baptiste Onofré
>Assignee: Jean-Baptiste Onofré
>
> In order to facilitate contribution, we should provide direct links and 
> visibility to the contribution guide, mailing lists, source repositories and 
> Jira directly on the website.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[GitHub] incubator-carbondata issue #617: [CARBONDATA-719] Add release guide

2017-02-28 Thread CarbonDataQA

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/617
  
Build Success with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/984/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata pull request #617: [CARBONDATA-719] Add release guide

2017-02-28 Thread jbonofre

Github user jbonofre commented on a diff in the pull request:


https://github.com/apache/incubator-carbondata/pull/617#discussion_r103474923
  
--- Diff: docs/release-guide.md ---
@@ -0,0 +1,482 @@
+
+
+# Apache CarbonData Release Guide
+
+Apache CarbonData periodically declares and publishes releases.
+
+Each release is executed by a _Release Manager_, who is selected among the 
CarbonData committers.
+ This document describes the process that the Release Manager follows to 
perform a release. Any 
+ changes to this process should be discussed and adopted on the 
+ [dev@ mailing list](mailto:d...@carbondata.incubator.apache.org).
+ 
+Please remember that publishing software has legal consequences. This 
guide complements the 
+foundation-wide [Product Release 
Policy](http://www.apache.org/dev/release.html) and [Release 
+Distribution Policy](http://www.apache.org/dev/release-distribution).
+
+## Decide to release
+
+Deciding to release and selecting a Release Manager is the first step of 
the release process. 
+This is a consensus-based decision of the entire community.
+
+Anybody can propose a release on the dev@ mailing list, giving a solid 
argument and nominating a 
+committer as the Release Manager (including themselves). There's no formal 
process, no vote 
+requirements, and no timing requirements. Any objections should be 
resolved by consensus before 
+starting the release.
+
+_Checklist to proceed to next step:_
+
+1. Community agrees to release
+2. Community selects a Release Manager
+
+## Prepare for the release
+
+Before your first release, you should perform one-time configuration 
steps. This will set up your
+ security keys for signing the artifacts and access release repository.
+ 
+To prepare for each release, you should audit the project status in the 
Jira, and do necessary 
+bookkeeping. Finally, you should tag a release.
+
+### One-time setup instructions
+
+ GPG Key
+
+You need to have a GPG key to sign the release artifacts. Please be aware 
of the ASF-wide 
+[release signing 
guidelines](https://www.apache.org/dev/release-signing.html). If you don't have 
+a GPG key associated with your Apache account, please create one according 
to the guidelines.
+
+Determine your Apache GPG key and key ID, as follows:
+
+```
+gpg --list-keys
+```
+
+This will list your GPG keys. One of these should reflect your Apache 
account, for exemple:
+
+```
+pub   2048R/845E6689 2016-02-23
+uid  Nomen Nescio 
+sub   2048R/BA4D50BE 2016-02-23
+```
+
+Here, the key ID is the 8-digit hex string in the `pub` line: `845E6689`.
+
+Now, add your Apache GPG key to the CarbonData's `KEYS` file in `dev` and 
`release` repositories 
+at `dist.apache.org`. Follow the instructions listed at the top of these 
files.
+ 
+Configure `git` to use this key when signing code by giving it your key 
ID, as follows:
+
+```
+git config --global user.signingkey 845E6689
+```
+
+You may drop the `--global` option if you'd prefer to use this key for the 
current repository only.
+
+You may wish to start `gpg-agent` to unlock your GPG key only once using 
your passphrase. 
+Otherwise, you may need to enter this passphrase several times. The setup 
of `gpg-agent` varies 
+based on operating system, but may be something like this:
+
+```
+eval $(gpg-agent --daemon --no-grab --write-env-file $HOME/.gpg-agent-info)
+export GPG_TTY=$(tty)
+export GPG_AGENT_INFO
+```
+
+ Access to Apache Nexus
+
+Configure access to the [Apache Nexus 
repository](https://repository.apache.org), used for 
+staging repository and promote the artifacts to Maven Central.
+
+1. You log in with your Apache account.
+2. Confirm you have appropriate access by finding `org.apache.carbondata` 
under `Staging Profiles`.
+3. Navigate to your `Profile` (top right dropdown menu of the page).
+4. Choose `User Token` from the dropdown, then click `Access User Token`. 
Copy a snippet of the 
+Maven XML configuration block.
+5. Insert this snippet twice into your global Maven `settings.xml` file, 
typically `${HOME]/
+.m2/settings.xml`. The end result should look like this, where 
`TOKEN_NAME` and `TOKEN_PASSWORD` 
+are your secret tokens:
+
+```
+ 
+   
+ 
+   apache.releases.https
+   TOKEN_NAME
+   TOKEN_PASSWORD
+ 
+ 
+   apache.snapshots.https
+   TOKEN_NAME
+   TOKEN_PASSWORD
+ 
+   
+ 
+```
+
+ Create a new version in Jira
+
+When contributors resolve an issue in Jira, they are tagging it with a

[GitHub] incubator-carbondata pull request #617: [CARBONDATA-719] Add release guide

2017-02-28 Thread chenliang613

Github user chenliang613 commented on a diff in the pull request:


https://github.com/apache/incubator-carbondata/pull/617#discussion_r103472571
  
--- Diff: docs/release-guide.md ---
@@ -0,0 +1,482 @@
+
+
+# Apache CarbonData Release Guide
+
+Apache CarbonData periodically declares and publishes releases.
+
+Each release is executed by a _Release Manager_, who is selected among the 
CarbonData committers.
+ This document describes the process that the Release Manager follows to 
perform a release. Any 
+ changes to this process should be discussed and adopted on the 
+ [dev@ mailing list](mailto:d...@carbondata.incubator.apache.org).
+ 
+Please remember that publishing software has legal consequences. This 
guide complements the 
+foundation-wide [Product Release 
Policy](http://www.apache.org/dev/release.html) and [Release 
+Distribution Policy](http://www.apache.org/dev/release-distribution).
+
+## Decide to release
+
+Deciding to release and selecting a Release Manager is the first step of 
the release process. 
+This is a consensus-based decision of the entire community.
+
+Anybody can propose a release on the dev@ mailing list, giving a solid 
argument and nominating a 
+committer as the Release Manager (including themselves). There's no formal 
process, no vote 
+requirements, and no timing requirements. Any objections should be 
resolved by consensus before 
+starting the release.
+
+_Checklist to proceed to next step:_
+
+1. Community agrees to release
+2. Community selects a Release Manager
+
+## Prepare for the release
+
+Before your first release, you should perform one-time configuration 
steps. This will set up your
+ security keys for signing the artifacts and access release repository.
+ 
+To prepare for each release, you should audit the project status in the 
Jira, and do necessary 
+bookkeeping. Finally, you should tag a release.
+
+### One-time setup instructions
+
+ GPG Key
+
+You need to have a GPG key to sign the release artifacts. Please be aware 
of the ASF-wide 
+[release signing 
guidelines](https://www.apache.org/dev/release-signing.html). If you don't have 
+a GPG key associated with your Apache account, please create one according 
to the guidelines.
+
+Determine your Apache GPG key and key ID, as follows:
+
+```
+gpg --list-keys
+```
+
+This will list your GPG keys. One of these should reflect your Apache 
account, for exemple:
+
+```
+pub   2048R/845E6689 2016-02-23
+uid  Nomen Nescio 
+sub   2048R/BA4D50BE 2016-02-23
+```
+
+Here, the key ID is the 8-digit hex string in the `pub` line: `845E6689`.
+
+Now, add your Apache GPG key to the CarbonData's `KEYS` file in `dev` and 
`release` repositories 
+at `dist.apache.org`. Follow the instructions listed at the top of these 
files.
+ 
+Configure `git` to use this key when signing code by giving it your key 
ID, as follows:
+
+```
+git config --global user.signingkey 845E6689
+```
+
+You may drop the `--global` option if you'd prefer to use this key for the 
current repository only.
+
+You may wish to start `gpg-agent` to unlock your GPG key only once using 
your passphrase. 
+Otherwise, you may need to enter this passphrase several times. The setup 
of `gpg-agent` varies 
+based on operating system, but may be something like this:
+
+```
+eval $(gpg-agent --daemon --no-grab --write-env-file $HOME/.gpg-agent-info)
+export GPG_TTY=$(tty)
+export GPG_AGENT_INFO
+```
+
+ Access to Apache Nexus
+
+Configure access to the [Apache Nexus 
repository](https://repository.apache.org), used for 
+staging repository and promote the artifacts to Maven Central.
+
+1. You log in with your Apache account.
+2. Confirm you have appropriate access by finding `org.apache.carbondata` 
under `Staging Profiles`.
+3. Navigate to your `Profile` (top right dropdown menu of the page).
+4. Choose `User Token` from the dropdown, then click `Access User Token`. 
Copy a snippet of the 
+Maven XML configuration block.
+5. Insert this snippet twice into your global Maven `settings.xml` file, 
typically `${HOME]/
+.m2/settings.xml`. The end result should look like this, where 
`TOKEN_NAME` and `TOKEN_PASSWORD` 
+are your secret tokens:
+
+```
+ 
+   
+ 
+   apache.releases.https
+   TOKEN_NAME
+   TOKEN_PASSWORD
+ 
+ 
+   apache.snapshots.https
+   TOKEN_NAME
+   TOKEN_PASSWORD
+ 
+   
+ 
+```
+
+ Create a new version in Jira
+
+When contributors resolve an issue in Jira, they are tagging it with a

[GitHub] incubator-carbondata issue #614: [CARBONDATA-714]Documented how to handle ba...

2017-02-28 Thread CarbonDataQA

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/614
  
Build Success with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/983/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #616: [CARBONDATA-708] Fixed Between Filter Issue...

2017-02-28 Thread CarbonDataQA

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/616
  
Build Success with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/982/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #578: [CARBONDATA-684] Improve Tests and Coverage...

2017-02-28 Thread chenliang613

Github user chenliang613 commented on the issue:

https://github.com/apache/incubator-carbondata/pull/578
  
retest this please


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #614: [CARBONDATA-714]Documented how to handle ba...

2017-02-28 Thread chenliang613

Github user chenliang613 commented on the issue:

https://github.com/apache/incubator-carbondata/pull/614
  
retest this please


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #616: [CARBONDATA-708] Fixed Between Filter Issue...

2017-02-28 Thread chenliang613

Github user chenliang613 commented on the issue:

https://github.com/apache/incubator-carbondata/pull/616
  
add to whitelist


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Resolved] (CARBONDATA-733) Fixed testcase failure issue

2017-02-28 Thread Liang Chen (JIRA)


 [ 
https://issues.apache.org/jira/browse/CARBONDATA-733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Liang Chen resolved CARBONDATA-733.
---
   Resolution: Fixed
Fix Version/s: 1.0.1-incubating

> Fixed testcase failure issue 
> -
>
> Key: CARBONDATA-733
> URL: https://issues.apache.org/jira/browse/CARBONDATA-733
> Project: CarbonData
>  Issue Type: Bug
>Reporter: kumar vishal
>Assignee: kumar vishal
> Fix For: 1.0.1-incubating
>
>  Time Spent: 1h
>  Remaining Estimate: 0h
>
> Fixed testcase failure issue 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[GitHub] incubator-carbondata issue #617: [CARBONDATA-719] Add release guide

2017-02-28 Thread CarbonDataQA

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/617
  
Build Success with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/981/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #617: [CARBONDATA-719] Add release guide

2017-02-28 Thread chenliang613

Github user chenliang613 commented on the issue:

https://github.com/apache/incubator-carbondata/pull/617
  
retest this please


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata pull request #615: [CARBONDATA-733]Fixed Testcase failu...

2017-02-28 Thread asfgit

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-carbondata/pull/615


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #615: [CARBONDATA-733]Fixed Testcase failure Issu...

2017-02-28 Thread chenliang613

Github user chenliang613 commented on the issue:

https://github.com/apache/incubator-carbondata/pull/615
  
LGTM, verified.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #617: [CARBONDATA-719] Add release guide

2017-02-28 Thread CarbonDataQA

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/617
  
Build Failed  with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/980/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Resolved] (CARBONDATA-724) Improve contribution guide

2017-02-28 Thread JIRA


 [ 
https://issues.apache.org/jira/browse/CARBONDATA-724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jean-Baptiste Onofré resolved CARBONDATA-724.
-
Resolution: Fixed

> Improve contribution guide
> --
>
> Key: CARBONDATA-724
> URL: https://issues.apache.org/jira/browse/CARBONDATA-724
> Project: CarbonData
>  Issue Type: Task
>  Components: docs, website
>Reporter: Jean-Baptiste Onofré
>Assignee: Jean-Baptiste Onofré
>
> Some minor improvements can be added to the contribution guide, especially 
> for the merge, ...



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[GitHub] incubator-carbondata issue #617: [CARBONDATA-719] Add release guide

2017-02-28 Thread jbonofre

Github user jbonofre commented on the issue:

https://github.com/apache/incubator-carbondata/pull/617
  
R: @chenliang613 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata pull request #617: [CARBONDATA-719] Add release guide

2017-02-28 Thread jbonofre

GitHub user jbonofre opened a pull request:

https://github.com/apache/incubator-carbondata/pull/617

[CARBONDATA-719] Add release guide

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [X] Make sure the PR title is formatted like:
   `[CARBONDATA-] Description of pull request`
 - [X] Make sure tests pass via `mvn clean verify`. (Even better, enable
   Travis-CI on your fork and ensure the whole test matrix passes).
 - [X] Replace `` in the title with the actual Jira issue
   number, if there is one.
 - [X] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.txt).
 - [X] Testing done
 
Please provide details on 
- Whether new unit test cases have been added or why no new tests 
are required?
- What manual testing you have done?
- Any additional information to help reviewers in testing this 
change.
 
 - [X] For large changes, please consider breaking it into sub-tasks under 
an umbrella JIRA. 
 
---


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/jbonofre/incubator-carbondata CARBONDATA-719

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-carbondata/pull/617.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #617


commit a749337e115d998beaed618751d9a916881d31f4
Author: Jean-Baptiste OnofrÃ© 
Date:   2017-02-27T12:32:24Z

[CARBONDATA-719] Add release guide




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #616: [CARBONDATA-708] Fixed Between Filter Issue...

2017-02-28 Thread CarbonDataQA

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/616
  
Can one of the admins verify this patch?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata pull request #616: [CARBONDATA-708] Fixed Between Filte...

2017-02-28 Thread bhavya411

GitHub user bhavya411 opened a pull request:

https://github.com/apache/incubator-carbondata/pull/616

[CARBONDATA-708] Fixed Between Filter Issue for Pushed Filters in case it 
was applied â¦

Fixed Between Filter Issue for Pushed Filters in case it was applied on 
Dimension
Test
Add Examples of Between Filter
Removed Scalastyle 
Manually Test BETWEEN Filter
Run Unit Test Cases

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/bhavya411/incubator-carbondata CARBONDATA-708

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-carbondata/pull/616.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #616


commit 1f537953419e7201bb314492656bf58a9a335546
Author: Bhavya 
Date:   2017-02-28T12:19:21Z

Fixed Between Filter Issue for Pushed Filters in case it was applied on 
Dimension




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #615: [CARBONDATA-733]Fixed Testcase failure Issu...

2017-02-28 Thread CarbonDataQA

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/615
  
Build Success with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/979/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #578: [CARBONDATA-684] Improve Tests and Coverage...

2017-02-28 Thread CarbonDataQA

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/578
  
Build Failed  with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/978/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #578: [CARBONDATA-684] Improve Tests and Coverage...

2017-02-28 Thread Vimal-Das

Github user Vimal-Das commented on the issue:

https://github.com/apache/incubator-carbondata/pull/578
  
retest this please


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #615: [CARBONDATA-733]Fixed Testcase failure Issu...

2017-02-28 Thread CarbonDataQA

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/615
  
Build Failed  with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/977/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #615: [CARBONDATA-733]Fixed Testcase failure Issu...

2017-02-28 Thread chenliang613

Github user chenliang613 commented on the issue:

https://github.com/apache/incubator-carbondata/pull/615
  
Tested at my machine, it is failed, please check : 

Tests in error:
  BlockIndexStoreTest.testLoadAndGetTaskIdToSegmentsMapForSingleSegment:85 
NullPointer
  
BlockIndexStoreTest.testloadAndGetTaskIdToSegmentsMapForDifferentSegmentLoadedConcurrently:180
 NullPointer
  
BlockIndexStoreTest.testloadAndGetTaskIdToSegmentsMapForSameBlockLoadedConcurrently:120
 NullPointer

Tests run: 13, Failures: 0, Errors: 3, Skipped: 0

[INFO] 

[INFO] Reactor Summary:
[INFO]
[INFO] Apache CarbonData :: Parent  SUCCESS [  
3.391 s]
[INFO] Apache CarbonData :: Common  SUCCESS [  
3.242 s]
[INFO] Apache CarbonData :: Core .. SUCCESS [ 
33.859 s]
[INFO] Apache CarbonData :: Processing  FAILURE [  
9.038 s]


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata pull request #615: [CARBONDATA-733]FixedTestcasefailure...

2017-02-28 Thread kumarvishal09

GitHub user kumarvishal09 opened a pull request:

https://github.com/apache/incubator-carbondata/pull/615

[CARBONDATA-733]FixedTestcasefailureIssue

Fixed test case failure issue in case of V3 format with No inverted index

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/kumarvishal09/incubator-carbondata 
FixedTestcasefailureIssue

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-carbondata/pull/615.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #615


commit 80c5c41c6f6007dcd17f0df27c4e72f628db3c67
Author: kumarvishal 
Date:   2017-02-28T11:21:50Z

FixedTestcasefailureIssue




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Created] (CARBONDATA-733) Fixed testcase failure issue

2017-02-28 Thread kumar vishal (JIRA)

kumar vishal created CARBONDATA-733:
---

 Summary: Fixed testcase failure issue 
 Key: CARBONDATA-733
 URL: https://issues.apache.org/jira/browse/CARBONDATA-733
 Project: CarbonData
  Issue Type: Bug
Reporter: kumar vishal
Assignee: kumar vishal


Fixed testcase failure issue 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[GitHub] incubator-carbondata issue #578: [CARBONDATA-684] Improve Tests and Coverage...

2017-02-28 Thread CarbonDataQA

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/578
  
Build Failed  with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/976/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-carbondata issue #578: [CARBONDATA-684] Improve Tests and Coverage...

2017-02-28 Thread Vimal-Das

Github user Vimal-Das commented on the issue:

https://github.com/apache/incubator-carbondata/pull/578
  
retest this please


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Assigned] (CARBONDATA-704) data mismatch between hive and carbondata after loading for bigint values

2017-02-28 Thread anubhav tarar (JIRA)


 [ 
https://issues.apache.org/jira/browse/CARBONDATA-704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

anubhav tarar reassigned CARBONDATA-704:


Assignee: anubhav tarar

> data mismatch between hive and carbondata after loading for bigint values
> -
>
> Key: CARBONDATA-704
> URL: https://issues.apache.org/jira/browse/CARBONDATA-704
> Project: CarbonData
>  Issue Type: Bug
>  Components: data-load
>Affects Versions: 1.0.0-incubating
>Reporter: SWATI RAO
>Assignee: anubhav tarar
> Attachments: Test_Data1 (4).csv
>
>
> carbondata
> 0: jdbc:hive2://localhost:1> create table Test_Boundary (c1_int 
> int,c2_Bigint Bigint,c3_Decimal Decimal(38,30),c4_double double,c5_string 
> string,c6_Timestamp Timestamp,c7_Datatype_Desc string) STORED BY 
> 'org.apache.carbondata.format' ;
> 0: jdbc:hive2://localhost:1>  LOAD DATA INPATH 
> 'hdfs://localhost:54310/Test_Data1.csv' INTO table Test_Boundary OPTIONS  
>   
> ('DELIMITER'=',','QUOTECHAR'='','BAD_RECORDS_ACTION'='FORCE','FILEHEADER'='');
> 0: jdbc:hive2://localhost:1> select c2_Bigint from Test_Boundary;
> +--+--+
> |  c2_Bigint   |
> +--+--+
> | NULL |
> | NULL |
> | NULL |
> | 9223372036854775807  |
> | 9223372036854775807  |
> | 9223372036854775807  |
> | 9223372036854775807  |
> | 9223372036854775807  |
> | 9223372036854775807  |
> | 9223372036854775807  |
> | 9223372036854775807  |
> | 9223372036854775807  |
> | 9223372036854775807  |
> | 9223372036854775807  |
> | 9223372036854775807  |
> | 9223372036854775807  |
> +--+--+
> but in hive
> create table Test_Boundary_hive (c1_int int,c2_Bigint Bigint,c3_Decimal 
> Decimal(38,30),c4_double double,c5_string string,c6_Timestamp 
> Timestamp,c7_Datatype_Desc string)  ROW FORMAT DELIMITED FIELDS TERMINATED BY 
> ",";
> LOAD DATA LOCAL INPATH 'Test_Data1.csv' into table Test_Boundary_hive;
> select c2_Bigint from Test_Boundary_hive;
> +---+--+
> |   c2_Bigint   |
> +---+--+
> | 1234  |
> | 2345  |
> | 3456  |
> | 4567  |
> | 9223372036854775807   |
> | -9223372036854775808  |
> | -9223372036854775807  |
> | -9223372036854775806  |
> | -9223372036854775805  |
> | 0 |
> | 9223372036854775807   |
> | 9223372036854775807   |
> | 9223372036854775807   |
> | NULL  |
> | NULL  |
> | NULL  |
> +---+--+



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[GitHub] incubator-carbondata issue #578: [CARBONDATA-684] Improve Tests and Coverage...

2017-02-28 Thread CarbonDataQA

Github user CarbonDataQA commented on the issue:

https://github.com/apache/incubator-carbondata/pull/578
  
Build Failed  with Spark 1.6.2, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/974/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Created] (CARBONDATA-732) User unable to execute the select/Load query using thrift server.

2017-02-28 Thread Vinod Rohilla (JIRA)

Vinod Rohilla created CARBONDATA-732:


 Summary: User unable to execute the select/Load query using thrift 
server. 
 Key: CARBONDATA-732
 URL: https://issues.apache.org/jira/browse/CARBONDATA-732
 Project: CarbonData
  Issue Type: Bug
  Components: sql
Affects Versions: 1.0.0-incubating
 Environment: Spark 2.1
Reporter: Vinod Rohilla
 Attachments: LOG_FIle

Result does not display to user while hit Select/Load query.

Steps to reproduce:
1:Hit the query :

0: jdbc:hive2://localhost:1> select * from t4;
Note: Cursor Keep blinking on beeline.

2: Logs on Thrift server:

Error sending result 
StreamResponse{streamId=/jars/carbondata_2.11-1.0.0-incubating-SNAPSHOT-shade-hadoop2.2.0.jar,
 byteCount=19350001, 
body=FileSegmentManagedBuffer{file=/opt/spark-2.1.0/carbonlib/carbondata_2.11-1.0.0-incubating-SNAPSHOT-shade-hadoop2.2.0.jar,
 offset=0, length=19350001}} to /192.168.2.179:48291; closing connection
java.lang.AbstractMethodError
at io.netty.util.ReferenceCountUtil.touch(ReferenceCountUtil.java:73)
at 
io.netty.channel.DefaultChannelPipeline.touch(DefaultChannelPipeline.java:107)
at 
io.netty.channel.AbstractChannelHandlerContext.write(AbstractChannelHandlerContext.java:811)
at 
io.netty.channel.AbstractChannelHandlerContext.write(AbstractChannelHandlerContext.java:724)
at 
io.netty.handler.codec.MessageToMessageEncoder.write(MessageToMessageEncoder.java:111)
at 
io.netty.channel.AbstractChannelHandlerContext.invokeWrite0(AbstractChannelHandlerContext.java:739)
at 
io.netty.channel.AbstractChannelHandlerContext.invokeWrite(AbstractChannelHandlerContext.java:731)
at 
io.netty.channel.AbstractChannelHandlerContext.write(AbstractChannelHandlerContext.java:817)
at 
io.netty.channel.AbstractChannelHandlerContext.write(AbstractChannelHandlerContext.java:724)
at 
io.netty.handler.timeout.IdleStateHandler.write(IdleStateHandler.java:305)
at 
io.netty.channel.AbstractChannelHandlerContext.invokeWrite0(AbstractChannelHandlerContext.java:739)
at 
io.netty.channel.AbstractChannelHandlerContext.invokeWriteAndFlush(AbstractChannelHandlerContext.java:802)
at 
io.netty.channel.AbstractChannelHandlerContext.write(AbstractChannelHandlerContext.java:815)
at 
io.netty.channel.AbstractChannelHandlerContext.writeAndFlush(AbstractChannelHandlerContext.java:795)
at 
io.netty.channel.AbstractChannelHandlerContext.writeAndFlush(AbstractChannelHandlerContext.java:832)
at 
io.netty.channel.DefaultChannelPipeline.writeAndFlush(DefaultChannelPipeline.java:1032)
at 
io.netty.channel.AbstractChannel.writeAndFlush(AbstractChannel.java:296)
at 
org.apache.spark.network.server.TransportRequestHandler.respond(TransportRequestHandler.java:194)
at 
org.apache.spark.network.server.TransportRequestHandler.processStreamRequest(TransportRequestHandler.java:150)
at 
org.apache.spark.network.server.TransportRequestHandler.handle(TransportRequestHandler.java:111)
at 
org.apache.spark.network.server.TransportChannelHandler.channelRead0(TransportChannelHandler.java:119)
at 
org.apache.spark.network.server.TransportChannelHandler.channelRead0(TransportChannelHandler.java:51)
at 
io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at 
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at 
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:349)
at 
io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:341)
at 
io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at 
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at 
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:349)
at 
io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:341)
at 
io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at 
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at 
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:349)
at 
io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:341)
at 
org.apache.spark.network.util.TransportFrameDecoder.channelRead(TransportFrameDecoder.java:85)
at 
io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at

[GitHub] incubator-carbondata pull request #611: [CARBONDATA-731] Enhance and correct...

2017-02-28 Thread Hexiaoqiao

Github user Hexiaoqiao commented on a diff in the pull request:


https://github.com/apache/incubator-carbondata/pull/611#discussion_r103396441
  
--- Diff: docs/installation-guide.md ---
@@ -92,77 +96,87 @@ To get started with CarbonData : [Quick 
Start](quick-start-guide.md), [DDL Opera
 
The following steps are only for Driver Nodes. (Driver nodes are the 
one which starts the spark context.)
 
-* [Build the 
CarbonData](https://cwiki.apache.org/confluence/display/CARBONDATA/Building+CarbonData+And+IDE+Configuration)
 project and get the assembly jar from 
"./assembly/target/scala-2.10/carbondata_xxx.jar" and put in the 
``"/carbonlib"`` folder.
+1. [Build the 
CarbonData](https://cwiki.apache.org/confluence/display/CARBONDATA/Building+CarbonData+And+IDE+Configuration)
 project and get the assembly jar from 
`./assembly/target/scala-2.1x/carbondata_xxx.jar` and copy to 
`/carbonlib` folder.
+
+**NOTE**: Create the carbonlib folder if it does not exists inside 
`` path.
 
-  NOTE: Create the carbonlib folder if it does not exists inside 
``""`` path.
+2. Copy the `./processing/carbonplugins` folder from CarbonData repository 
to `/carbonlib/` folder.
 
-* Copy "carbonplugins" folder to ``"/carbonlib"`` folder from 
"./processing/" folder of CarbonData repository.
-  carbonplugins will contain .kettle folder.
+**NOTE**: carbonplugins will contain .kettle folder.
 
-* Copy the "carbon.properties.template" to 
``"/conf/carbon.properties"`` folder from conf folder of CarbonData 
repository.
-* Modify the parameters in "spark-default.conf" located in the 
``"/conf``"
+3. Copy the `./conf/carbon.properties.template` file from CarbonData 
repository to `/conf/` folder and rename the file to 
`carbon.properties`.
+
+4. Create `tar,gz` file of carbonlib folder and move it inside the 
carbonlib folder.
+
+```
+   cd 
+   tar -zcvf carbondata.tar.gz carbonlib/
+   mv carbondata.tar.gz carbonlib/
+```
+
+5. Configure the properties mentioned in the following table in 
`/conf/spark-defaults.conf` file.
 
 | Property | Description | Value |
 
|-|--|--|
-| spark.master | Set this value to run the Spark in yarn cluster mode. | 
Set "yarn-client" to run the Spark in yarn cluster mode. |
-| spark.yarn.dist.files | Comma-separated list of files to be placed in 
the working directory of each executor. 
|``""/conf/carbon.properties`` |
-| spark.yarn.dist.archives | Comma-separated list of archives to be 
extracted into the working directory of each executor. 
|``""/carbonlib/carbondata_xxx.jar`` |
-| spark.executor.extraJavaOptions | A string of extra JVM options to pass 
to executors. For instance  NOTE: You can enter multiple values separated by 
space. 
|``-Dcarbon.properties.filepath=""/conf/carbon.properties``
 |
-| spark.executor.extraClassPath | Extra classpath entries to prepend to 
the classpath of executors. NOTE: If SPARK_CLASSPATH is defined in 
spark-env.sh, then comment it and append the values in below parameter 
spark.driver.extraClassPath 
|``""/carbonlib/carbonlib/carbondata_xxx.jar`` |
-| spark.driver.extraClassPath | Extra classpath entries to prepend to the 
classpath of the driver. NOTE: If SPARK_CLASSPATH is defined in spark-env.sh, 
then comment it and append the value in below parameter 
spark.driver.extraClassPath. 
|``""/carbonlib/carbonlib/carbondata_xxx.jar`` |
-| spark.driver.extraJavaOptions | A string of extra JVM options to pass to 
the driver. For instance, GC settings or other logging. 
|``-Dcarbon.properties.filepath=""/conf/carbon.properties``
 |
-| carbon.kettle.home | Path that will be used by CarbonData internally to 
create graph for loading the data. 
|``""/carbonlib/carbonplugins`` |
+| spark.master | Set this value to run the Spark in yarn cluster mode. | 
Set yarn-client to run the Spark in yarn cluster mode. |
+| spark.yarn.dist.files | Comma-separated list of files to be placed in 
the working directory of each executor. |""/conf/carbon.properties |
+| spark.yarn.dist.archives | Comma-separated list of archives to be 
extracted into the working directory of each executor. 
|""/carbonlib/carbondata.tar.gz |
+| spark.executor.extraJavaOptions | A string of extra JVM options to pass 
to executors. For instance  **NOTE**: You can enter multiple values separated 
by space. |-Dcarbon.properties.filepath=carbon.properties |
+| spark.executor.extraClassPath | Extra classpath entries to prepend to 
the classpath of executors. **NOTE**: If SPARK_CLASSPATH is defined in

42 matches

Mail list logo