DB2 DDL to Hive DDL conversion **Need Help**

Hi, We have almost 1000 DB2 RDBMS tables and for those we have the DDLs (script) available. We are looking for a way to convert all these DB2 DDLs into Hive DDL without writing Hive DDL statements for each and every table. Means, is there an automated tool available to do this? If not, then can

External table returns no result.

Hi, Trying to run queries over HDFS data using Hive external table. Created a table using the following syntax but select * from stats returns no result. CREATE EXTERNAL TABLE `stats`( > `filename` string, > `ts` string, > `type` string, > `module` string, > `method` string, > `line` string, >

RE: Apache sqoop and hive

Why don't you write a simple shell scripts that connects to MySQL DB gets a list of tables stored in a temp file and then use a loop to call for Sqoop for every table? This is IMO much better, and provides you more control. HTH On 19/02/2016 04:17, Archana Patel wrote: > hi , Divya > >

Re: Hive query on Tez slower than on MR (fails in some cases) ..

> On Tez, this is run as a single DAG of M-R+ ... Can't tell which vertex is the slow one in this. More tooling for isolating which vertex is taking up time (and which task) https://github.com/apache/tez/tree/master/tez-tools/swimlanes or alternatively run

RE: Apache sqoop and hive

hi , Divya Actually i am able to import single table but want to import whole database into hive. I did this. sqoop import --connect jdbc:mysql://localhost:3306/sample--username root -P --table demo--hive-import--hive-table default.demo -m 1 --driver com.mysql.jdbc.Driver

Re: What is the real meaning of negative value in Vertex.

Typically when I have seen this the jobs were failing. Is yours completing successfully? -Kevin > On Feb 18, 2016, at 4:58 PM, mahender bigdata > wrote: > > Hi , > > Can any one throw some information on below results of TEZ. What is the > real meaning

Hive fails with IOException: Error writing to server on long query

> I have an external table defined over a folder that contains XML documents. > There is 1 column in this table with the column containing each documents > data as a string. > > I am trying to create a view on top of the XML data with xpaths. So for > example, > > CREATE VIEW myview

Not able to get selective cols in orc using mapreduce

Hi, I am reading ORC format using map reduce program. I am using ORCNewInputFormat as an input format. I want to select few fields out of 50+ column table while reading. Though i am setting hive.io.file.readcolumn.ids and hive.io.file.read.all.columns, it is still selecting all columns in mapper.

Re: Stroing boolean value in Hive table

Hi Alan, Thanks for answering. In HDi 3.1, boolean variables are stored as 0 or 1 , but from HDI 3.3 , we see Boolean variables are stored as True or False in Hive External Table ( i.e Hive File data). Cast or Case will work definitely, I'm thinking of any hive setting available to store 1

Re: Hive 2 release what is new in this release please

> Is there such notes as what is new in Hive 2 say new features etc? Sergey had a in-depth presentation at the last meetup Notable omission - Jason's custom edge for Tez, which

Re: Apache hive and sqoop

There is a flag to import all tables of a database called import-all-tables but this does not bring in DB properties. Data for each table will be stored in a separate directory which would be named after the table name. > On Feb 18, 2016, at 12:07 PM, Archana Patel wrote: >

Hive 2 release what is new in this release please

Is there such notes as what is new in Hive 2 say new features etc? I don't mean Jira list J Primarily interested on what has been added such as partition pruning etc. Thanks, -- Dr Mich Talebzadeh LinkedIn https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw

Apache hive and sqoop

HI , I am new to hive. And I have a question that is it possible to import whole database of mysql to hive using apache sqoop. I have already imported data of mysql to hive for one table. Thanks in advance. Archana Skype id(live:archana961)

Apache sqoop and hive

hi, I am trying to import all tables from mysql to hive by using apache sqoop but its having problem. And i have added mysql-connector-java-5.0.8-bin.jar also still having problem. Can anybody help on this who has tried this already or any idea. Thanks , Archana Patel skype(live:archana961)

Re: hive installation

try this : https://stackoverflow.com/questions/26968712/mysql-connection-error-with-hive *Ritesh Kumar Singh,* *https://riteshtoday.wordpress.com/* On Thu, Feb 18, 2016 at 5:27 PM, wrote: > Hi, > > I installed hive-2.0.0 and derby-10-12.1.1.

Re: Stroing boolean value in Hive table

How the data is stored is up to the storage format (text, rcfile, orc, etc.). Do you mean in your text file you’d like booleans stored as 0 or 1? You could use the case statement to convert them to integers like: select case _boolvar_ when true then 1 when false then 0 end from … Alan. > On

RE: Difference between RC file format & Parquet file format

ORC has what is called storage index built in that provide data + statistics. It provide stats at file, stripe and rowgroup (batches of rows) levels. In terms of efficiency, for Data warehouse applications it is best format I believe On 18/02/2016 07:38, Abhishek Dubey wrote: > I think

hive installation

Hi, I installed hive-2.0.0 and derby-10-12.1.1. My hadoop version is 2.5.2, java is 1.7.79. I followed the instruction on http://www.tutorialspoint.com/hive/hive_installation.htm when I run hive, the following errors showed on the terminal. Many thanks for the help! SLF4J: Class path contains

Re: Difference between RC file format & Parquet file format

ORC was created inside hive instead of (as it should have been i think) as a file format library that hive can depend on, and other frameworks as well. it seems to be part of hive's annoying tendency not to think of itself as a java library. On Thu, Feb 18, 2016 at 2:38 AM, Abhishek Dubey

Re: How to find hive version using hive editor in hue ?

See set command usage here: https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Cli#LanguageManualCli-HiveInteractiveShellCommands On Thursday, 18 February 2016, Abhishek Dubey wrote: > Thanks Bennie, It worked ! > > Would you like to tell us what else

Stroing boolean value in Hive table

Hi, How can we store Boolean value with 1 or 0 instead of storing true or false string. we can make use of CAST function to convert boolean into 1 or 0. Is there any built-in setting in hive, which enable and store hive Boolean column values in 0 or 1 instead of true and false.

Re: How to find hive version using hive editor in hue ?

Not directly but indirectly doing: set system:sun.java.command; That will likely give the the jar name which includes the version. On 18/02/16 08:12, Abhishek Dubey wrote: Thanks in advance.. *Warm Regards,* *Abhishek Dubey*

Re: Release 1.2.1 missing hwi-war file

Same issue is in latest hive version 2.0.0. Could anyone help how to resolve this issue?? Thanks in advance!! On 15-Feb-2016 10:37 am, "Hanish Bansal" wrote: > Hi All, > > We are trying to use Hive Web Interface (HWI). Hive version is latest i.e. > 1.2.1. > >