RE: Sqoop import Mysql to hive import Partitions

2016-02-04 Thread Chinnappan Chandrasekaran
sqoop import --table tablename\ --connect jdbc:mysql:servername\dbname --username dbuser --password pw \ --fields-terminated-by "\t" -- hive-partition-key -- hive-import /--hive-partition-key is Name of a hive field to partition are sharded on Thanks & Regards Chandrasekaran Technical Consulta

Re: ProcFsBasedProcessTree and clean pages in smaps

2016-02-04 Thread Chris Nauroth
Hello Jan, I am moving this thread from user@hadoop.apache.org to yarn-...@hadoop.apache.org, since it's less a question of general usage and more a question of internal code implementation details and possible enhancements. I think the issue is that it's not guaranteed in the general case that P

ProcFsBasedProcessTree and clean pages in smaps

2016-02-04 Thread Jan Lukavský
Hello, I have a question about the way LinuxResourceCalculatorPlugin calculates memory consumed by process tree (it is calculated via ProcfsBasedProcessTree class). When we enable caching (disk) in apache spark jobs run on YARN cluster, the node manager starts to kill the containers while rea