mssql bulk copy dat files

2015-02-23 Thread Jonathan Aquilina
Can hadoop process dat files that are generated by MS SQL bulk copy? -- Regards, Jonathan Aquilina Founder Eagle Eye T

Re: mssql bulk copy dat files

2015-02-23 Thread Jonathan Aquilina
We are using sqlcmd at the moment I was just curious though as Bulk copy can copy to files rows really quickly into and out of a db. --- Regards, Jonathan Aquilina Founder Eagle Eye T On 2015-02-23 12:07, Alexander Alten-Lorenz wrote: Not per default. But you can use sqoop to offload the

Hadoop and nslcd

2015-02-23 Thread Andrew Johnson
Hey everyone, I am seeing an intermittent issue with the Namenode looking up the groups for a given user. We are using JniBasedUnixGroupsMapping. I see messages like the following in the namenode logs: 015-02-23 15:42:37,184 WARN org.apache.hadoop.security.UserGroupInformation: No groups

Re: Hadoop and nslcd

2015-02-23 Thread Jens Scheidtmann
Dear Andrew, Increase the log level of this class to DEBUG. Then you should be able to see what's going on. Best regards, Jens Am Montag, 23. Februar 2015 schrieb Andrew Johnson : Hey everyone, I am seeing an intermittent issue with the Namenode looking up the groups for a given user. We

Re: Hadoop and nslcd

2015-02-23 Thread daemeon reiydelle
look for busy network resulting in network timeouts to LDAP server (assuming LDAP itself is not overloaded). *...* *“Life should not be a journey to the grave with the intention of arriving safely in apretty and well preserved body, but rather to skid in broadside in a cloud of

Re: recombining split files after data is processed

2015-02-23 Thread Alexander Alten-Lorenz
You could attach the hadoop dfs command per bootstrap. http://stackoverflow.com/questions/12055595/emr-how-to-join-files-into-one http://stackoverflow.com/questions/12055595/emr-how-to-join-files-into-one BR, Alex On 23 Feb 2015, at 08:10, Jonathan Aquilina jaquil...@eagleeyet.net wrote:

Re: recombdfcxtxàining I Kidd is siren our ID jeidn xixxziidxidid xznxixjxxidnxxufxjxjxxixxxnxjxnxnnxxkdjdidxidirjfkcir split begun bugged defend cuts cDNA shy beget scent jxn filnes afhbter data is p

2015-02-23 Thread Rudra Tripathy
Fccxx c bbhxnnh

Re: tracking remote reads in datanode logs

2015-02-23 Thread Drake민영근
I found this in the mapreduce am log. 2015-02-23 11:22:45,576 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: PendingReds:1 ScheduledMaps:5 ScheduledReds:0 AssignedMaps:0 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:0

Re: tracking remote reads in datanode logs

2015-02-23 Thread Drake민영근
Hi, Igor Did you look at the mapreduce application master log? I think the local or rack local map tasks are logged in the MapReduce AM log. Good luck. Drake 민영근 Ph.D kt NexR On Tue, Feb 24, 2015 at 3:30 AM, Igor Bogomolov igor.bogomo...@gmail.com wrote: Hi all, In a small cluster of 5

Re: Using Slider as a default mechanism for HBase on HDP 2.2

2015-02-23 Thread Ted Yu
Ambari 1.7.0 allows deploying hbase through Slider using Views. Click on Views on the left hand side. Expand Slider and click on 'Create Instance' In the dialog, fill in Ambari Server Cluster REST API URL. e.g. http://c6401.ambari.apache.org:8080/api/v1/clusters/c1 After creating the View, select