Re: Hive Table : Read or load data in Hive Table from plural subdirectories

2014-05-27 Thread Weiner Benedikt
Hi, meines Wissens waren das Test / Playground Server für die Jungs aus Karlsruhe ( Joachim und Ben) die mal für vinsight Ops geplant waren. Das ist schon sehr alt. Aus meiner Sicht keine Aktion notwendig. Viele Grüße Benedikt On 27 May 2014, at 12:06 pm, Matouk IFTISSEN mailto:matouk.iftis.

Re: Hive Table : Read or load data in Hive Table from plural subdirectories

2014-05-27 Thread Matouk IFTISSEN
That is what I have done and works normaly ;) Thanks Saurabh. 2014-05-27 0:46 GMT+02:00 Db-Blog : > Implement dynamic Partitioning on daily cadence. > Example: > ParentDirectory/partition=Day1/Day1_n_files.gz > ParentDirectory/partition=Day2/Day2_n_files.gz > ParentDirectory/partition=Day30/Day3

Re: Hive Table : Read or load data in Hive Table from plural subdirectories

2014-05-26 Thread Db-Blog
Implement dynamic Partitioning on daily cadence. Example: ParentDirectory/partition=Day1/Day1_n_files.gz ParentDirectory/partition=Day2/Day2_n_files.gz ParentDirectory/partition=Day30/Day30_n_files.gz And so on... You can also opt for Monthly partitions rather than daily by comparing the file

Re: Hive Table : Read or load data in Hive Table from plural subdirectories

2014-05-16 Thread Matouk IFTISSEN
files are all the same format (.gz) but they are in different subdirectories !! my problematique is : I want to do an import by day from oracle to hdfs (in directory : hdfs_my_parent_directory/import_dir_day1/part_data_import.gz hdfs_my_parent_directory/import_dir_day2/part_data_import.gz ...

Hive Table : Read or load data in Hive Table from plural subdirectories

2014-05-14 Thread Matouk IFTISSEN
Hé Geeks, Is there a best manner to load or read data in hive table (normal or external) from plural subdirectories? exemple : I have a directory my_directory and in there are lot of subdirectory ie: my_directory --> my_subdirectory1 , my_subdirectory2, ..., my_subdirectoryx and my data (files) are

Re: Hive Table : Read or load data in Hive Table from plural subdirectories

2014-05-14 Thread Joshua Fennessy
If those files are all the same format, you would point the Hive table to the parent directory. It will resource through and find all of the files to include on the table. You can filter files to use multiple tables, but recursion is designed in. Sent from my gadget. Please excuse any spelli