[GitHub] incubator-carbondata pull request #24: Correct the log info

[Zhangshunyu]

GitHub user Zhangshunyu opened a pull request:

https://github.com/apache/incubator-carbondata/pull/24

Correct the log info



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/Zhangshunyu/incubator-carbondata info

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-carbondata/pull/24.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #24


commit e03c277d1e2327a4972fe34ece0c58b316371925
Author: Zhangshunyu 
Date:   2016-07-06T03:49:41Z

correct the log info




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Commented] (CARBONDATA-42) Missing Code on Github for Compilation

[Ravindra Pesala (JIRA)]

[ 
https://issues.apache.org/jira/browse/CARBONDATA-42?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363709#comment-15363709
 ] 

Ravindra Pesala commented on CARBONDATA-42:
---

carbon-format is having generated thrift classes so that is why intelij is not 
able to resolve the dependencies.
To fix this issue, First do the maven build and add the generated jar file from 
carbondata/format module 
 to the project 
class path.
For example 'Open Module Settings' on core module and add the above jar 
dependency to it. In the same way you can add for processing and 
integration/spark modules as well.

> Missing Code on Github for Compilation 
> ---
>
> Key: CARBONDATA-42
> URL: https://issues.apache.org/jira/browse/CARBONDATA-42
> Project: CarbonData
>  Issue Type: Bug
> Environment: Error:(35, 24) java: package org.carbondata.format does 
> not exist
>Reporter: Ahmed Abdelhamid
>Priority: Blocker
>  Labels: github-import
>
> The package; 
> Error:(35, 24) java: package org.carbondata.format does not exist
> Is not available in the source code on Github and it is causing 100 error 
> when trying to make the project in Intellij.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

??????scala> cc.sql(s"load data inpath 'hdfs:/

[caiqiang]

From the data loading log,  I find this table is not a carbon table.
Need to create carbon table and load data again.


--  --
??: "??";;
: 2016??7??5??(??) 4:17
??: "caiqiang"; 

: scala> cc.sql(s"load data inpath 'hdfs:/



scala> cc.sql(s"load data inpath 
'hdfs://cdncluster/tmp/csv-panda_quality_v1_20160625/part-0.csv' into table 
williamtable02")
INFO  05-07 16:11:30,316 - main Query [LOAD DATA INPATH 
'HDFS://CDNCLUSTER/TMP/CSV-PANDA_QUALITY_V1_20160625/PART-0.CSV' INTO TABLE 
WILLIAMTABLE02]
INFO  05-07 16:11:30,379 - 
INFO  05-07 16:11:30,379 - 
INFO  05-07 16:11:30,379 - 
INFO  05-07 16:11:30,411 - 
INFO  05-07 16:11:30,414 - Parsing command: load data inpath 
'hdfs://cdncluster/tmp/csv-panda_quality_v1_20160625/part-0.csv' into table 
williamtable02
INFO  05-07 16:11:31,203 - Parse Completed
INFO  05-07 16:11:31,204 - 
INFO  05-07 16:11:31,206 - 
INFO  05-07 16:11:31,254 - 0: get_table : db=default tbl=williamtable02
INFO  05-07 16:11:31,254 - ugi=allwefantasy ip=unknown-ip-addr  
cmd=get_table : db=default tbl=williamtable02
INFO  05-07 16:11:31,572 - Semantic Analysis Completed
INFO  05-07 16:11:31,572 - 
INFO  05-07 16:11:31,579 - Returning Hive schema: Schema(fieldSchemas:null, 
properties:null)
INFO  05-07 16:11:31,579 - 
INFO  05-07 16:11:31,579 - Concurrency mode is disabled, not creating a lock 
manager
INFO  05-07 16:11:31,580 - 
INFO  05-07 16:11:31,580 - Starting 
command(queryId=allwefantasy_20160705161130_e7a86d50-fbcd-402f-90f7-36b97ab224ef):
 load data inpath 
'hdfs://cdncluster/tmp/csv-panda_quality_v1_20160625/part-0.csv' into table 
williamtable02
INFO  05-07 16:11:31,587 - 
INFO  05-07 16:11:31,587 - 
INFO  05-07 16:11:31,587 - 
INFO  05-07 16:11:31,588 - Starting task [Stage-0:MOVE] in serial mode
INFO  05-07 16:11:31,589 - Loading data to table default.williamtable02 from 
hdfs://cdncluster/tmp/csv-panda_quality_v1_20160625/part-0.csv
INFO  05-07 16:11:31,589 - 0: get_table : db=default tbl=williamtable02
INFO  05-07 16:11:31,589 - ugi=allwefantasy ip=unknown-ip-addr  
cmd=get_table : db=default tbl=williamtable02
INFO  05-07 16:11:31,749 - 0: get_table : db=default tbl=williamtable02
INFO  05-07 16:11:31,749 - ugi=allwefantasy ip=unknown-ip-addr  
cmd=get_table : db=default tbl=williamtable02
INFO  05-07 16:11:31,942 - Renaming src: 
hdfs://cdncluster/tmp/csv-panda_quality_v1_20160625/part-0.csv, dest: 
hdfs://cdncluster/user/hive/warehouse/williamtable02/part-0.csv, Status:true
chgrp: changing ownership of 
'hdfs://cdncluster/user/hive/warehouse/williamtable02/part-0.csv': User 
does not belong to cdnuser
INFO  05-07 16:11:32,009 - 0: alter_table: db=default tbl=williamtable02 
newtbl=williamtable02
INFO  05-07 16:11:32,009 - ugi=allwefantasy ip=unknown-ip-addr  
cmd=alter_table: db=default tbl=williamtable02 newtbl=williamtable02
INFO  05-07 16:11:32,285 - Updating table stats fast for williamtable02
INFO  05-07 16:11:32,285 - Updated size of table williamtable02 to 389088954
INFO  05-07 16:11:32,425 - 
INFO  05-07 16:11:32,426 - Starting task [Stage-1:STATS] in serial mode
INFO  05-07 16:11:32,426 - Executing stats task
INFO  05-07 16:11:32,427 - 0: get_table : db=default tbl=williamtable02
INFO  05-07 16:11:32,427 - ugi=allwefantasy ip=unknown-ip-addr  
cmd=get_table : db=default tbl=williamtable02
INFO  05-07 16:11:32,560 - 0: get_table : db=default tbl=williamtable02
INFO  05-07 16:11:32,561 - ugi=allwefantasy ip=unknown-ip-addr  
cmd=get_table : db=default tbl=williamtable02
INFO  05-07 16:11:32,706 - 0: alter_table: db=default tbl=williamtable02 
newtbl=williamtable02
INFO  05-07 16:11:32,706 - ugi=allwefantasy ip=unknown-ip-addr  
cmd=alter_table: db=default tbl=williamtable02 newtbl=williamtable02
INFO  05-07 16:11:32,939 - Updating table stats fast for williamtable02
INFO  05-07 16:11:32,939 - Updated size of table williamtable02 to 389088954
INFO  05-07 16:11:32,984 - Table default.williamtable02 stats: [numFiles=1, 
totalSize=389088954]
INFO  05-07 16:11:32,984 - 
INFO  05-07 16:11:32,984 - 
INFO  05-07 16:11:32,985 - OK
INFO  05-07 16:11:32,985 - 
INFO  05-07 16:11:32,985 - 
INFO  05-07 16:11:32,985 - 
res4: org.apache.spark.sql.SchemaRDD = []


scala> cc.sql("select count(*) from williamtable02").show
INFO  05-07 16:12:10,533 - main Query [SELECT COUNT(*) FROM WILLIAMTABLE02]
INFO  05-07 16:12:10,541 - Parsing command: select count(*) from williamtable02
INFO  05-07 16:12:10,553 - Parse Completed
INFO  05-07 16:12:10,569 - Parsing command: select count(*) from williamtable02
INFO  05-07 16:12:10,570 - Parse Completed
INFO  05-07 16:12:10,619 - 0: get_table : db=default tbl=williamtable02
INFO  05-07 16:12:10,619 - ugi=allwefantasy ip=unknown-ip-addr  
cmd=get_table : db=default tbl=williamtable02
INFO  05-07 16:12:10,731 - 0: get_table : db=default 

Re: Urgent Error: package org.carbondata.format does not exist

[Ahmed Abdelhamid]

Where Thirft compiler needs to be?

On Tue, Jul 5, 2016 at 7:46 PM Ahmed Abdelhamid  wrote:

> I see, I have an error building Thrift.
>
> Let me check and get back to you.
>
> On Tue, Jul 5, 2016 at 7:35 PM Vimal Das Kammath <
> vimaldas.kamm...@gmail.com> wrote:
>
>> Probably org.carbondata.format is not getting build in your environment.
>> org.carbondata.format requires Apache Thrift compiler to be built.
>>
>> Can you share the maven console messages so that we can assist further.
>>
>> On Wed, Jul 6, 2016 at 7:55 AM, Ahmed Abdelhamid  wrote:
>>
>> > Hi All,
>> >
>> > The subject error happens when I clone the Github repository and try to
>> > make carbon-core.
>> >
>> > I believe there is a possibility that there are some missing code from
>> the
>> > repository.
>> >
>> > Please advise,
>> >
>> > Samy
>> >
>>
>