Re: Inconsistent behavior in datanode between hdfs CLI and application

happens if we remove protobuf-util. It's not easy since one of the key features of our app is that it hides the details of your cloud storage without relying on your filesystem having those filesystems mounted as remote drives. On Tue, Nov 10, 2020 at 11:53 AM Bear Giles wrote: > I'm see

Inconsistent behavior in datanode between hdfs CLI and application

ing bumping to 5.16) and made changes to the app so we can't really use it as a data point. -- Bear Giles Sr. Software Engineer bgi...@snaplogic.com Mobile: 720-749-7876 <http://www.snaplogic.com/about-us/jobs> *SnapLogic Inc | 1825 South Grant Street | San Mateo CA | USA * Thi

Re: Questions about Setting Up Encryption

configure encryption without kerberos you will have > "free" encrypted access, meaning: the communication on the wire will be > encrypted, but the users that have services access will be managed at > operating system level. > > Regards > On 08/01/2020 18:42, Bear Gi

Re: Questions about Setting Up Encryption

; and then enable an application's TLS settings to achieve >> encryption-in-motion. >> >> What is my best strategy for Hadoop? Here are a couple of questions: >> >> 1) The docs say I have to create a new directory, but can I configure >> HDFS Transparent E

Re: Kerberos impersonation question

ndles user authentication (and creating the UGI) in a different subproject than where we use it - it's easy to get out of sync in these circumstances. Bear On Wed, Jan 31, 2018 at 7:38 AM, Bear Giles <bgi...@snaplogic.com> wrote: > I figured it out. Of course it's obvious in retrospect. &

Re: Kerberos impersonation question

but the real user had the SIMPLE or KERBEROS authentication method and information. It would probably be a Good Idea to mention this in the javadoc if it's not in the most recent versions. :-) On Tue, Jan 30, 2018 at 3:29 PM, Bear Giles <bgi...@snaplogic.com> wrote: > Back with a

Kerberos impersonation question

t org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:720) │ exc: ... 34 more Bear Giles Sr. Java Application Engineer bgi...@snaplogic.com Mobile: 720-749-7876 <http://www.snaplogic.com/about-us/jobs> *SnapLogic Inc | 929 Pearl St #200 | 8

Re: Kerberos auth + user impersonation

Superusers.html > > Jorge Machado > www.jmachado.me > > > > > > On 26 Jan 2018, at 14:57, Bear Giles <bgi...@snaplogic.com> wrote: > > Thanks all. > > I've made the changes but am still getting an error. Notab

Re: Kerberos auth + user impersonation

ter, you'd also need to configure KMS > proxyuser as well. https://www.cloudera.com/documentation/enterprise/ > latest/topics/cdh_sg_kms_security.html It isn't that obvious from CDH > documentation nor Apache Hadoop doc. > > > On Thu, Jan 25, 2018 at 7:24 AM, Bear Giles <bgi...@

Kerberos auth + user impersonation

dfs@REALM? alice/supergroup@REALM? Is there (note: We're using CDH and I'm setting this on the 'advanced configuration snippets' page. I saved the settings and restarted the servers but I'm not sure that the files are actually being updated. I've also changed the configuration files manually.) --

Cross-security model access to HDFS?

for SIMPLE authentication / authorization false? Or does that fail? (I've think it's the latter but I can't rule out that we're doing something odd and preventing it from working.) Thanks. -- Bear Giles Sr. Java Application Engineer bgi...@snaplogic.com Mobile: 720-749-7876 <h

embedded HDFS cluster + Kerberos question

as doing 'sudo / find -name "*.keytab"' on some of my actual clusters to see where the file is located, with no luck. Where do the server keytab files go? -- Bear Giles Sr. Java Application Engineer bgi...@snaplogic.com Mobile: 720-749-7876 <http://www.snaplogic.com/