Hi All, https://issues.apache.org/jira/browse/HIVE-4997 patch helped!
On Tue, Mar 17, 2015 at 1:05 AM, Suraj Nayak <snay...@gmail.com> wrote: > Hi, > > I tried reading data via HCatalog for 1 Hive table in MapReduce using > something similar to > https://cwiki.apache.org/confluence/display/Hive/HCatalog+InputOutput#HCatalogInputOutput-RunningMapReducewithHCatalog. > I was able to read successfully. > > Now am trying to read 2 tables, as the requirement is to join 2 tables. I > did not find API similar to *FileInputFormat.addInputPaths* in > *HCatInputFormat*. What is the equivalent of the same in HCat ? > > I had performed join using FilesInputFormat in HDFS(by getting split > information in mapper). This article( > http://www.codingjunkie.com/mapreduce-reduce-joins) helped me code join. > <http://www.codingjunkie.com/mapreduce-reduce-joins/> Can someone suggest > how I can perform join operation using HCatalog ? > > Briefly, the aim is to > > - Read 2 tables (almost similar schema) > - If key exists in both the table send it to same reducer. > - Do some processing on the records in reducer. > - Save the output into file/Hive table. > > *P.S : The reason for using MapReduce to perform join is because of > complex requirement which can't be solved via Hive/Pig directly. * > > Any help will be greatly appreciated :) > > -- > Thanks > Suraj Nayak M > -- Thanks Suraj Nayak M
