Re: Fwd: Custom Input Format for Sequence Files

Hello I think you must add in SequenceFile that line terminated by not new line '/n' but char that indicate EOF (end of file). Try and let share your expérience ;) Good luck Le 13 févr. 2015 17:59, Varsha Raveendran varsha.raveend...@gmail.com a écrit : Hello! I have csv files which are small

Sqoop and rejected rows in export process

;) -- --- Life and Relations are not binary *Matouk IFTISSEN | Consultant BI Big Data[image: http://www.ysance.com] * 24 rue du sentier - 75002 Paris - www.ysance.com http://www.ysance.com/ Fax : +33 1 73 72 97 26 *Ysance sur* :*Twitter* http://twitter.com/ysance* | Facebook https

Re: [ANNOUNCE] New Hive PMC Members - Szehon Ho, Vikram Dixit, Jason Dere, Owen O'Malley and Prasanth Jayachandran

Congratulations ;) Le 29 janv. 2015 05:00, Jimmy Xiang jxi...@cloudera.com a écrit : Congrats!! On Wed, Jan 28, 2015 at 7:20 PM, Devopam Mittra devo...@gmail.com wrote: +1 Congratulations !! warm regards Devopam On Thu, Jan 29, 2015 at 2:45 AM, Carl Steinbach c...@apache.org

Hive count(*) anormal result-- it returns just last number of inserted records

, ... or is there a proprety that should be set ??). for Infos: Hive -- 0.13 (or later) Hadoop-- HDP 2.1.3 More thanks for your answers. Regards -- --- Life and Relations are not binary *Matouk IFTISSEN | Consultant BI Big Data[image: http://www.ysance.com] * 24 rue du sentier

Re: FW: hive server2 jdbc

Hello can you try this: String sql = use prod ; show tables; If it works use this syntaxe, because I think that hive jdbc (or one of its jar like thrift metastore) point the default schéma !!. Hopes helping you ;) Le 11 nov. 2014 02:09, Sathi Chowdhury sathi.chowdh...@lithium.com a écrit :

Re: Hive-server2 trying to execute local mapreduce

*Matouk IFTISSEN | Consultant BI Big Data[image: http://www.ysance.com] * 24 rue du sentier - 75002 Paris - www.ysance.com http://www.ysance.com/ Fax : +33 1 73 72 97 26 *Ysance sur* :*Twitter* http://twitter.com/ysance* | Facebook https://www.facebook.com/pages/Ysance/131036788697 | Google+ https

Re: Unable to Add UDF Jar from JDBC Java Client

is prohibited when received in error. Impetus does not represent, warrant and/or guarantee, that the integrity of this communication has been maintained nor that the communication is free of errors, virus, interception or interference. -- *Matouk IFTISSEN | Consultant BI Big Data [image: http

Re: Alter location of database in Hive

Hello If you do alter location 'new-location' in your all tables it does not work ? Le 1 juil. 2014 03:15, Prem Yadav ipremya...@gmail.com a écrit : I think you should be able to copy the data to a different location and then drop the old db, and create a new one with the new location. On

Re: hive date format

use ; unix_timestamp(field_date,'DD-MMM-') 2014-06-25 23:20 GMT+02:00 rpriaa...@gmail.com rpriaa...@gmail.com: Hi, Please can someone tell me how to change the date format in hive. I need it in the format '25-JUN-2014' -- Regards, riad -- *Matouk IFTISSEN | Consultant BI

Re: hive date format

sorry use this : from_unixtime(field_date,'DD-MMM-') 2014-06-25 23:27 GMT+02:00 Matouk IFTISSEN matouk.iftis...@ysance.com: use ; unix_timestamp(field_date,'DD-MMM-') 2014-06-25 23:20 GMT+02:00 rpriaa...@gmail.com rpriaa...@gmail.com: Hi, Please can someone tell me how

Re: hive date format

from_unixtime(timestamp in bigint, dd-MMM-). dd vs DD does make a difference in the output. -Deepesh On Wed, Jun 25, 2014 at 2:30 PM, Matouk IFTISSEN matouk.iftis...@ysance.com wrote: sorry use this : from_unixtime(field_date,'DD-MMM-') 2014-06-25 23:27 GMT+02:00 Matouk IFTISSEN

Re: Hive 0.13 map 100 % reduce 100% and the reduce decrise to 75 % ( in join or lag function)

On Mon, Jun 23, 2014 at 3:15 AM, Matouk IFTISSEN matouk.iftis...@ysance.com wrote: My HDFS space is so big I dont thiks this isthe cause of the problem. I will test to increase java heap memory in hive-env.sh file 2014-06-23 11:06 GMT+02:00 Nagarjuna Vissarapu nagarjuna.v...@gmail.com

Hive 0.13 map 100 % reduce 100% and the reduce decrise to 75 % ( in join or lag function)

Eban Blvd. PO Box 4125, Herzliya 46140 IL P: +972-9-9518147 |M: +972-54-5671337|F: +972-9-9584736 *Pursway.com* http://www.pursway.com/ -- *Matouk IFTISSEN | Consultant BI Big Data* * [image: http://www.ysance.com] * 24 rue du sentier - 75002 Paris - www.ysance.com Fax : +33 1 73 72 97

Re: How to extract multi-match in one line with regexp_extract function?

2014', '(.*) (.*) (.*)', '$1,$2,$3'), ',') from dual; OK [World,Cup,2014] Regards, André On 10 June 2014 20:11, Matouk IFTISSEN matouk.iftis...@ysance.com wrote: Hello, I have a table that each record is in one line (line), and I want to extract all patterns those match in each line

How to extract multi-match in one line with regexp_extract function?

) how can I extract all patterns those match in each line ?? select (line,'*.(pattern_match).*, index_group) as matchs from my_table Thanks by advance ;) -- *Matouk IFTISSEN | Consultant BI Big Data[image: http://www.ysance.com] * 24 rue du sentier - 75002 Paris - www.ysance.com http

Hive: regexp_extract to extract muti match in one line??

) how can I extract all pattern match in each line ?? select (line,'*.(pattern_match_group).*, index_group) as truc from my_table Thanks by advance ;) Matouk -- *Matouk IFTISSEN | Consultant BI Big Data[image: http://www.ysance.com] * 24 rue du sentier - 75002 Paris - www.ysance.com http

Re: Hive Table : Read or load data in Hive Table from plural subdirectories

filter files to use multiple tables, but recursion is designed in. Sent from my gadget. Please excuse any spelling errors. On May 14, 2014, at 7:31 AM, Matouk IFTISSEN matouk.iftis...@ysance.com wrote: Hé Geeks, Is there a best manner to load or read data in hive table (normal or external

Hive Table : Read or load data in Hive Table from plural subdirectories

) are in those subdirectories!!!, how can I read them with one/two Hive tables ? Thanks by advance -- *Matouk IFTISSEN | Consultant BI Big Data[image: http://www.ysance.com] * 24 rue du sentier - 75002 Paris - www.ysance.com http://www.ysance.com/ Fax : +33 1 73 72 97 26 *Ysance sur* :*Twitter* http

Re: set hive.cli.print.header=true

help me. -- Thanks, *Kishore * -- *Matouk IFTISSEN | Consultant BI Big Data [image: http://www.ysance.com] * 24 rue du sentier - 75002 Paris - www.ysance.com http://www.ysance.com/ Fax : +33 1 73 72 97 26 *Ysance sur* :*Twitter* http://twitter.com/ysance* | Facebook https

Re: How To Change Location of Hive Log File

hive.querylog.location= It works fine, but when I have a map-join in the sql , it will still go to /tmp instead of the value i provided. Please help. Thanks, Moiz -- *Matouk IFTISSEN | Consultant BI Big Data [image: http://www.ysance.com] * 24 rue du sentier - 75002 Paris - www.ysance.com http

Re: hbase importtsv

and then delete it from your system. -- *Matouk IFTISSEN | Consultant BI Big Data [image: http://www.ysance.com] * 24 rue du sentier - 75002 Paris - www.ysance.com http://www.ysance.com/ Mob : +33 6 78 51 18 69 || Fax : +33 1 73 72 97 26 *Ysance sur* :*Twitter* http://twitter.com/ysance* | Facebook https

Re: Find a date that is in the range of any array dates in Hive

have never written a UDF or Generic UDF and would need some help from the forum members. Please advise. Regards, Raj -- *Matouk IFTISSEN | Consultant BI Big Data [image: http://www.ysance.com] * 24 rue du sentier - 75002 Paris - www.ysance.com http://www.ysance.com/ Mob : +33 6 78 51 18 69

Re: Hive 0.11 Hive 0.12 - Hive MySQL Metastore is not used for INSERT

t2 SELECT t.* FROM t1 t; select * from t2; select count(*) from t2; -- done quit; --- Testing Procedure : Comment/Uncomment the lines for table t2 Can someone throw some light on this? Thanks Naga -- *Matouk IFTISSEN | Consultant BI Big Data [image: http

Re: Hive external table partitions with less than symbol ?

Hello You can use concat function or case to do this like: Concat ('/data1/customer/', id) . Where id 1000 Etc.. Hope this help you ;) Le 3 nov. 2013 23:51, Raj Hadoop hadoop...@yahoo.com a écrit : All, I want to create partitions like the below and create a hive external table. How can

Re: Hive external table partitions with less than symbol ?

that? On Monday, November 4, 2013 3:34 AM, Matouk IFTISSEN matouk.iftis...@ysance.com wrote: Hello You can use concat function or case to do this like: Concat ('/data1/customer/', id) . Where id 1000 Etc.. Hope this help you ;) Le 3 nov. 2013 23:51, Raj Hadoop hadoop...@yahoo.com a écrit

Re: Select statements return null

with this. Is there a way (a debug flag) to make the jackson parser emit the current token? Sunita On Wed, Jul 31, 2013 at 4:06 AM, Matouk IFTISSEN matouk.iftis...@ysance.com wrote: Hello Sanita, If you use a JSON try to add the jar 'hive-json-serde.jar' before you upload your data in the final table

Re: Select statements return null

Hello Sanita, If you use a JSON try to add the jar 'hive-json-serde.jar' before you upload your data in the final table. And also try to make your date attributes in String format first to debug (if this is the cause). I don't know if you are using an external table with regular expressions

Re: Hive does not package a custom inputformat in the MR job jar when the custom inputformat class is add as aux jar.

that is what I search for a long time, and no responses. But if you are not in the cloud (AWS, Azure,...) you can add the jar for your all Datanodes in $HADOOP_HOME/lib , and then restart the service mapreduce-tasktracker like this /etc/init.d/*mapreduce-tasktracker stop

A question goes on my mind : Can we (other applications) use HDFS without MapReduce ?

Hello, Can we (other applications) use HDFS without invoking MapReduce operations? Thanks for your answers.

Re: A question goes on my mind : Can we (other applications) use HDFS without MapReduce ?

PM, Matouk IFTISSEN wrote: Hello, Can we (other applications) use HDFS without invoking MapReduce operations? Thanks for your answers.

Re: start hive2 error

hello, verify if ZooKeeper is running on port 2181 (not on port 2281 like you have in Hive-site.xml) if changing port don't work assure that your Zookeeper quorum is listining on port 2281. 2013/7/10 ch huang justlo...@gmail.com i try start hiveserver2 ,buy error in log file ,why ? i use hive

Re: Need help in Hive

Hello, Try this function in hive query: 1- transform your data (type integer ) in timestamp (linux), then do this: 2- from_unixtimeyour_date_timestamp), 'mm:ss') AS time Hope this, you will give help. 2013/7/8 Maheedhar Reddy maheedhar...@gmail.com Hi All, I have Hive 0.8.0 version

How Can I store the Hive query result in one file ?

Hello Hive users, Is there a manner to store the Hive query result (SELECT *.) in a specfique and alone file (given the file name) like (INSERT OVERWRITE LOCAL DIRECTORY '/directory_path_name/')? Thanks for your answers

Re: How Can I store the Hive query result in one file ?

want it to write into a named file on hdfs only? On Thu, Jul 4, 2013 at 3:12 PM, Matouk IFTISSEN matouk.iftis...@ysance.com wrote: Hello Hive users, Is there a manner to store the Hive query result (SELECT *.) in a specfique and alone file (given the file name) like (INSERT OVERWRITE

Re: Correct way of using regexserde

result. And the jar is also added. Warm Regards, Tariq cloudfront.blogspot.com On Mon, Jul 1, 2013 at 1:39 PM, Matouk IFTISSEN matouk.iftis...@ysance.com wrote: Hello, try to delete output.regex = %1$s and store your data in file then pricise where the file is located STORED

Powershell script and Hive command dfs moveFromLocal dont' work ??

Hello I meet I real problem when I lanch a powershell script that execute un other Hive sript below (that cut file from local to HDFS (hortonwork on azure) : Hive script in file “mon_scipt_hive’’ dfs -moveFromLocal D:\Users\admin\Desktop\rep_depot\sous_rep\ /test_rep_courant and

RE: Powershell script and Hive command dfs moveFromLocal dont' work ??

better then she'll scripting. On Monday, June 17, 2013, Matouk IFTISSEN matouk.iftis...@ysance.com wrote: Hello I meet I real problem when I lanch a powershell script that execute un other Hive sript below (that cut file from local to HDFS (hortonwork on azure) : Hive script in file

Re: Need help in recovering hive tables

Hello, See your mMetastore to know where your data are stored in HDFS, and you can recover it directely esle dont' change your hive metastore and repar your hadoop system ;) Matouk 2013/6/12 Hamza Asad hamza.asa...@gmail.com My hadoop crashes suddenly and not coming out from safe mode. i take

Re: Need help in recovering hive tables

, Jun 12, 2013 at 1:12 PM, Matouk IFTISSEN matouk.iftis...@ysance.com wrote: Hello, See your mMetastore to know where your data are stored in HDFS, and you can recover it directely esle dont' change your hive metastore and repar your hadoop system ;) Matouk 2013/6/12 Hamza Asad hamza.asa

RE: Hive Header line in Select query help?

/jira/browse/HIVE-4346 2013/6/7 Nitin Pawar nitinpawar...@gmail.com if you do not have hiverc file then you can create one and use it with --hiveconf along side your hive execution you also set the same value just before your select query starts On Thu, Jun 6, 2013 at 10:13 PM, Matouk IFTISSEN

RE: Hive Header line in Select query help?

query help? if you look at the setting it says hive.cli that means it is supposed to work on cli only. Which interface you want to use it ? On Thu, Jun 6, 2013 at 9:12 PM, Matouk IFTISSEN matouk.iftis...@ysance.com wrote: Hello Ivry bady, I want to know if is there a way to export

RE: Hive Header line in Select query help?

@hive.apache.org *Objet :* Re: Hive Header line in Select query help? why don't you set the variable in your script or in the hiverc file ? then it will work all the time On Thu, Jun 6, 2013 at 9:43 PM, Matouk IFTISSEN matouk.iftis...@ysance.com wrote: I use a script to query Hive and store

what impact for changing the property hive.exec.parallel=true?

Hello every one, Can anyone tell me what impact can affect jobs (or queries) if we turn on (make to true ) the propriety hive.exec.parallel (by default it is set to false)? Thanks for your answers. Matouk Iftissen miftis...@cyres.frmailto:miftis...@cyres.fr [Description : file:///D:/Documents

RE: Unable to merge 3 tables in hive

Hi, are you using import-all-tables tool ? if this is make sure that you respect consigns of this sqoop tool. See the sqoop user guide : http://sqoop.apache.org/docs/1.4.0-incubating/SqoopUserGuide.html#id1766722 For more information. -Message d'origine- De : iwannaplay games

connector ODBC hive (cloudera) and IBM cognos

Hello every one Is there any driver ODBC developed by cloudera or others (rather then ODBC developed for Tableau because it does not work on Windows Server 2008 R2 64bit) to use it with cognos BI server (8.4) for OS (on Windows Server 2008 R2 64bit). Thanks. Best regards. Matouk Iftissen

RE: Data Loaded but Select returns nothing!

What do you use CLI (from command) or UI like HUE ? if you use CLI make sure that you are in hive cmd (.../bin /hive) De : Kuldeep Chitrakar [mailto:kuldeep.chitra...@synechron.com] Envoyé : lundi 30 juillet 2012 13:59 À : user@hive.apache.org Objet : Data Loaded but Select returns nothing!