I could not solve the problem so I had to recreate the table from another temp table
I think its issue with ORC file format may be we can post to dev@ or wait for some dev to response On Mon, Jul 20, 2015 at 1:51 PM, patcharee <patcharee.thong...@uni.no> wrote: > Hi, > > I created a hive table stored as orc file (partitioned and compressed by > ZLIB) from Hive CLI, added data into this table by a Spark application. > After adding I was able to query data and everything looked fine. Then I > concatenated the table from Hive CLI. After that I am not able to query > data, like select count(*) from Table, any more, just got error line 1:1 > character '' not supported here, no matter Tez or MR engine. > > How can you solve the problem in your case? > > BR, > Patcharee > > > > On 18. juli 2015 21:26, Nitin Pawar wrote: > > can you tell exactly what steps you did/? > also did you try running the query with processing to MR instead of tez? > not sure this issue with orc file formats .. i had once faced issues on > alter table for orc backed tabled on adding a new column > > On Sun, Jul 19, 2015 at 12:05 AM, pth001 <patcharee.thong...@uni.no> > wrote: > >> Hi, >> >> The query result> >> >> 1 12 361 190 12.64043 -5.970886 8.559207 0.0 >> 0.0 0.0 -19.686993 1308.8047 99848.0 0.006196644 0.0 >> 0.0 301.27475 0.38247046 0.0 NULL 1 1 2008 1 >> 1 12 361 220 12.513598 -6.3671713 7.3927946 0.0 >> 0.0 0.0 -22.300392 1441.0547 99848.0 0.0050846506 0.0 >> 0.0 112.20787 0.30459523 0.0 NULL 1 1 2008 1 >> 5 12 250 368 2415.195 5.172235 4.9027147 >> -0.024408612 0.0 23590.553 -38.96928 -1130.0469 74660.54 >> 2.5969802E-4 9.706164E-11 23054.268 0.0 0.24196737 0.0 >> NULL 1 1 2008 1 >> 9 12 144 94 12.251964 12.081688 -9.59462 0.0 >> 0.0 0.0 -25.93576 258.65625 99848.0 0.0021708217 0.0 >> 0.0 1.2963213 1.1560266 0.0 NULL 1 1 2008 1 >> 9 12 145 84 12.302098 7.752461 -12.183463 0.0 >> 0.0 0.0 -24.983763 351.1953 99848.0 0.0023723599 0.0 >> 0.0 1.4137375 0.99239886 0.0 NULL 1 1 2008 1 >> >> I stored table in orc format, partitioned and compressed by ZLIB. The >> problem happened just after I concatenate table. >> >> BR, >> Patcharee >> >> On 18/07/15 12:46, Nitin Pawar wrote: >> >> select * without where will work because it does not involve file >> processing >> I suspect the problem is with field delimiter so i asked for records so >> that we can see whats the data in each column >> >> are you using csv file with columns delimited by some char and it has >> numeric data in quotes ? >> >> On Sat, Jul 18, 2015 at 3:58 PM, patcharee <patcharee.thong...@uni.no> >> wrote: >> >>> This select * from table limit 5; works, but not others. So? >>> >>> Patcharee >>> >>> >>> On 18. juli 2015 12:08, Nitin Pawar wrote: >>> >>> can you do select * from table limit 5; >>> >>> On Sat, Jul 18, 2015 at 3:35 PM, patcharee <patcharee.thong...@uni.no> >>> wrote: >>> >>>> Hi, >>>> >>>> I am using hive 0.14 with Tez engine. Found a weird problem. Any >>>> suggestions? >>>> >>>> hive> select count(*) from 4D; >>>> line 1:1 character '' not supported here >>>> line 1:2 character '' not supported here >>>> line 1:3 character '' not supported here >>>> line 1:4 character '' not supported here >>>> line 1:5 character '' not supported here >>>> line 1:6 character '' not supported here >>>> line 1:7 character '' not supported here >>>> line 1:8 character '' not supported here >>>> line 1:9 character '' not supported here >>>> ... >>>> ... >>>> line 1:131 character '' not supported here >>>> line 1:132 character '' not supported here >>>> line 1:133 character '' not supported here >>>> line 1:134 character '' not supported here >>>> line 1:135 character '' not supported here >>>> line 1:136 character '' not supported here >>>> line 1:137 character '' not supported here >>>> line 1:138 character '' not supported here >>>> line 1:139 character '' not supported here >>>> line 1:140 character '' not supported here >>>> line 1:141 character '' not supported here >>>> line 1:142 character '' not supported here >>>> line 1:143 character '' not supported here >>>> line 1:144 character '' not supported here >>>> line 1:145 character '' not supported here >>>> line 1:146 character '' not supported here >>>> >>>> BR, >>>> Patcharee >>>> >>>> >>>> >>> >>> >>> -- >>> Nitin Pawar >>> >>> >>> >> >> >> -- >> Nitin Pawar >> >> >> > > > -- > Nitin Pawar > > > -- Nitin Pawar
