Re: Hbase to hive

2013-10-23 Thread samir das mohapatra
Hbase with hive provides the result handler , which will take the  java
classes , so you can write your own code for you BL.

Regards,
samir.


On Tue, Oct 15, 2013 at 3:11 AM, abhisekgun...@yahoo.com <
abhisekgun...@yahoo.com> wrote:

> Hi All,
>
> Can somebody suggest a solution on my problem below.
>
> 1. The data is maintained and constantly updated in hbase.
>
> 2. The user wants to query the data from hive.
>
> The requirement is to write a programs that can move data from hbase to
> hive based on certain criteria.
>
> Please advice.
>
> Thanks,
>
> Abhishek
>
> Sent from my HTC
>
>


Re: Need Urgent Help on Architecture

2012-05-22 Thread samir das mohapatra
OK Thanks


On Mon, May 21, 2012 at 11:40 PM, Robert Evans  wrote:

> All attachments are stripped when sent to the mailing list.  You will need
> to use another service if you want us to see the diagram.
>
>
> On 5/18/12 12:50 PM, "samir das mohapatra" 
> wrote:
>
> Hi harsh,
>
>   I wanted to implement one Workflow within the MAPPER. I am Sharing my
> concept through the Architecture Diagram, Please correct me if I am wrong
>   and suggest me any Good Approach for that
>
>   Many thanks  in advance)
>
>  Thanks
> samir
>
>


Re: [VOTE - RELEASE PLAN] create branch-1.1 and make release candidate 1.1.0

2012-05-18 Thread samir das mohapatra
+1 Thanks Mattf

On Fri, May 18, 2012 at 7:22 AM, Matt Foley  wrote:

> Hi all,
> I would like to branch "branch-1.1" from the current HEAD of branch-1,
> and proceed to make a release candidate for hadoop-1.1.0 from it.
> I'm also hereby offering to be Release Manager for branch-1.1, as I have
> been
> for branch-1.0.
>
> There's a LOT of stuff in branch-1, over 80 patches not in the branch-1.0
> line, so I anticipate
> the need for some stabilization.  So I'll float the RC0 for a week or so,
> before possibly calling
> a vote on it.  Sound okay?
>
> Somewhat to my surprise, I found that our bylaws require a seven-day formal
> vote
> on this proposal.  So, please vote.  Voting will close on Thursday 24 May,
> 7pm PDT.
>
> Best regards,
> --Matt
>


Need Urgent help

2012-05-18 Thread samir das mohapatra
Hi

   I wanted to implement one Workflow within the MAPPER. I am Sharing my
concept through the Architecture Diagram, Please correct me if I am wrong
   and suggest me any Good Approach for that

   Many thanks  in advance)

  Thanks


Need Urgent Help on Architecture

2012-05-18 Thread samir das mohapatra
Hi harsh,

   I wanted to implement one Workflow within the MAPPER. I am Sharing my
concept through the Architecture Diagram, Please correct me if I am wrong
   and suggest me any Good Approach for that

   Many thanks  in advance)

  Thanks
samir


Re: Hadoop - Distributed sorting

2012-05-15 Thread samir das mohapatra
Hi
  Steps to do this:
1) Map: It will only define the key value for each number
 2) Combiner : To sort locally  over chunk of dataset .
 3) Reducer: It will sort after over whole chunk globally-->
OUT PUT as sorted

Note: set combiner and reducer as Same class.

Example:
  Let us assume that our data set (integers) is constrained between 100 to
200 and we have 5 files each containing 1000 random integers between 100
and 200 (so a total of 5000 integers between 100 and 200). We read each
file into a Map and then in the Reduce phase, we produce a final Map which
contains the count of all the integers. Now if we sort all the integers
from the final Map and output it
into a list data structure in the form of  then we have
sorted all the data (see figure below). Aside : In Java, you don’t even
have to come up with the data-structure that I am talking about, if you
just use a 
TreeMapin
the final Reduce phase, then all the keys (i.e. data) are already
sorted
as long as the key type (e.g. String, Integer, etc.) implements the
Comparableinterface
(
Hadoop  has something similar called
WritableComparableand
I am using a TreeMap that takes Strings as keys in
Reducer


Thanks
   Samir
On Tue, May 15, 2012 at 11:31 PM, @dataElGrande wrote:

>
> Check out Pentaho's howto's when dealing with Hadoop or NoSQL or anything
> big
> data related. http://wiki.pentaho.com/display/BAD/How+To%27s
>
>
> madhu_sushmi wrote:
> >
> > Hi,
> > I need to implement distributed sorting using Hadoop. I am quite new to
> > Hadoop and I am getting confused. If I want to implement Merge sort, what
> > my Map and reduce should be doing. ? Should all the sorting happen at
> > reduce side?
> >
> > Please help. This is an urgent requirement. Please guide me.
> >
> > Thanks,
> > Madhu
> >
>
> --
> View this message in context:
> http://old.nabble.com/Hadoop---Distributed-sorting-tp32876784p33849704.html
> Sent from the Hadoop core-dev mailing list archive at Nabble.com.
>
>