How do I limit queries made to my Hadoop Cluster

[Boudreau, Carl]

Dear Hadoop Expert,

This is my first post to this group, and I am new to Hadoop, so if this is not 
the correct list please excuse me.  If you have a better group please let me 
know by replying directly to me.

I have a challenge before me.  In my Hadoop system I have data from three 
companies called ABC, XYZ, and 123.  And because of my Business Need; all the 
records from these three companies are in the same data store.  The records are 
randomly mixed so one record could be a record from ABC and the next could be 
from XYX or 123. When I query my Hadoop system, for all records that have the 
last name of Boudreau for data analytical work; I get all 3000 records that 
have the last name Boudreau.

However, I also have a contract with ABC, that says I cannot aggregate their 
records.  So I need a way to apply these contract rules when the data is 
queried.  Please note: I have given 20 other developers access to my Hadoop 
system, but I am responsible to mirage the contractual obligations for my 
customers

What is the best way about going about this?

Can or do I write a Plug-in or modify YARN to have it check my contract rules 
prior to returning a dataset?  Can or do I write a plug in for each and every 
Gateway Application such as Pig, Elastic Search, MapR, etc (about 10 
applications that have access to my Hadoop system)

What are other options?

I have installed, configured and running Hadoop onto my local machine.  I have 
the source code also downloaded onto my machine, and I am able to dig into it 
and compile it.

Regards Carl

This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the intended
recipient or his or her authorized agent, the reader is hereby notified
that any dissemination, distribution or copying of this e-mail is
prohibited. If you have received this e-mail in error, please notify the
sender by replying to this message and delete this e-mail immediately.

2 items - RE: Unsubscribe & A better ListSrv for beginners.

[Boudreau, Carl]

Dear Sys Admin,
Can the footer on the ListSrv be edited to include unsubscribe steps?

To the rest of the group,
I have been listen quietly on the side in an attempt to learn Hadoop prior 
to attempting the install and configuration process.  Unfortunately, most of 
the terms I am reading are going over my head (Microsoft/C# background, with a 
beginner Red Hat installer and user)  My Manager had asked I start looking into 
it, thus why I have joined this list.  But this group might be too high level 
for my needs.  Is there a better ListSrv for me to join?

If there is anyone here that has been where I have and got to the place I need 
to be; please feel free to connect with me.

Regards Carl

P.S. Sath,
  I am sorry you were sent the response; it was unwarranted.  Would you 
mind taking the high road and dropping it?  ☺


From: Sath [mailto:neiodavi...@gmail.com]
Sent: Wednesday, December 02, 2015 2:45 PM
To: Namikaze Minato
Cc: user@hadoop.apache.org
Subject: Re: Unsubscribe

Namikaze

I know its a mailing list. I am not expecting you to do my dirty work. 
First of all who are you. I didn't address you.

   You have no right to use such language. I can sue you for this.

   I get every day loads of emails for unsubscribe. I could have reacted but 
being professional is to have an empathy for understanding. I unsubscribed 
earlier as suggested by the apache rules but it didn't unsubscribe.

   So i waited 4 months to send request again, as per loads of unsubscribe 
emails i thought probably its the way.

 If you are associated with this responsibility then you should have changed 
the system for better, not being abusive with fowl language.

That shows your character and unprofessional attitude. It turn out to be as you 
did the same mistake by using fowl language in email list. Whats about that.

You owe an apology!!!

With all respect
Sath

Sent from my iPhone

On Dec 2, 2015, at 1:21 AM, Namikaze Minato 
> wrote:
Hello. This is not a forum but a mailing list.

And I am saying this because you somehow expect people in the mailing list will 
do your dirty work of unsubscribing you when you can do it yourself???

I have already addressed politely dozens of other users in the same situation 
as you, had you bothered reading my emails, you would have known how to 
unsubscribe instead of polluting everyone's mailbox.

I could write to you once again how to do it but I won't give you this pleasure 
and let you look into your own mailbox for that piece of information.

On 2 December 2015 at 04:48, Sath 
> wrote:
Namikaze

Its not professional to use fowl language in a forum like this.

If you have an issue with my unsubscribe address it politely..

This shows what kind of people are heading this forum.

With all due respect

Sent from my iPhone

On Dec 1, 2015, at 4:05 PM, Namikaze Minato 
> wrote:
ARE YOU FUCKING KIDDING ME

On 2 December 2015 at 00:47, Sath 
> wrote:
Unsubscribe

Sent from my iPhone



This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the intended
recipient or his or her authorized agent, the reader is hereby notified
that any dissemination, distribution or copying of this e-mail is
prohibited. If you have received this e-mail in error, please notify the
sender by replying to this message and delete this e-mail immediately.

RE: 2 items - Thanks for the reply Ted & Rich.

[Boudreau, Carl]

This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the intended
recipient or his or her authorized agent, the reader is hereby notified
that any dissemination, distribution or copying of this e-mail is
prohibited. If you have received this e-mail in error, please notify the
sender by replying to this message and delete this e-mail immediately.