Hadoop 2.8.0: Job console output suggesting non-existent rmserver 8088:proxy URI

Hi again, my attempts to Kerberise our Hadoop instance seem to have things working OK, although one of the users has reported the following issue: The console output, from a running job, suggests following a link to the RM server's WebGUI, akin to

Re: When is an hdfs-* service restart required?

Hi Kellen! The first part of the configuration is a good indication of which service you need to restart. Unfortunately the only way to be completely sure is to read the codez. e.g. most hdfs configuration is mapped to variables in DFSConfigKeys $ find . -name *.java | grep -v test | xargs grep

Re: When is an hdfs-* service restart required?

Restarting datanode(s) only is OK in this case. Thanks, > On Sep 7, 2017, at 10:46 AM, Kellen Arb wrote: > > Hello, > > I have a seemingly simple question, to which I can't find a clear answer. > > Which services/node-types must be restarted for each of the configuration

When is an hdfs-* service restart required?

Hello, I have a seemingly simple question, to which I can't find a clear answer. Which services/node-types must be restarted for each of the configuration properties? For example, if I update the 'dfs.datanode.handler.count' property in the `hdfs-site.xml` configuration file, which services

Re: Sqoop and kerberos ldap hadoop authentication

Hi, The message "User xxx not found" feels more like group mapping error. Do you have the relevant logs? Integrating AD with Hadoop can be non-trivial, and Cloudera's general recommendation is to use third party authentication integrator like SSSD or Centrify, instead of using LdapGroupsMapping.

Re: Sqoop and kerberos ldap hadoop authentication

Yes it works. However this doesn't work with Microsoft SQL server Sent from my iPhone > On 7 Sep 2017, at 10:09, dna_29a wrote: > > Hi, > I want to run sqoop jobs under kerberos authentication. If I have a ticket > for local Kerberos user (local KDC and user exists as

Sqoop and kerberos ldap hadoop authentication

Hi,I want to run sqoop jobs under kerberos authentication. If I have a ticket for local Kerberos user (local KDC and user exists as linux user on each host), sqoop works fine. Also, Kerberos uses cross-realm trust and accept Active Directory authentication. In this case, if I got ticket fot AD

Re: HDFS: Confused about "immutability" wrt overwrites

Hi, Immutability is about rewriting a file (random access). That is massively used by databases for example. On HDFS you can only append new data to file. HDFS have permission like a Posix File System, so you can remove the 'w' permisson on the file if you want to prevent deletion/overwrite. You

HDFS: Confused about "immutability" wrt overwrites

Greetings, I've been tinkering with HDFS, and I'm a bit confused about its alleged immutability. Basically, according to the interwebz (and my interpretation of the documentation), data in HDFS is immutable. However, when I tell the HDFS Java client to overwrite an existing file with garbage, it