Re: Hive utf8

2013-01-15 Thread Nitin Pawar
forgot to add JIRA https://issues.apache.org/jira/browse/HIVE-1505 On Wed, Jan 16, 2013 at 1:25 PM, Nitin Pawar wrote: > you may be running into this > > > > > On Wed, Jan 16, 2013 at 7:24 AM, springring wrote: > >> Hi, >> >>I put some file include chinese into HDFS. >>And read the fil

Re: Hive utf8

2013-01-15 Thread Nitin Pawar
you may be running into this On Wed, Jan 16, 2013 at 7:24 AM, springring wrote: > Hi, > >I put some file include chinese into HDFS. >And read the file as "hadoop fs -cat /user/hive/warehouse/..." , is > ok, I can see the chinese. > > But when I open the table in hive, I can't read

Re: development environment for hadoop core

2013-01-15 Thread Surenkumar Nihalani
I use Eclipse. I haven't figured out how to run and use mvn from it. I just use it as a editor. I have a git repo in commons/src. A branch for each jira. I rebase on branches to keep pulling in svn updates on branches. On Jan 15, 2013, at 9:08 PM, Andy Isaacson wrote: > On Tue, Jan 15, 2013

Re: development environment for hadoop core

2013-01-15 Thread Andy Isaacson
On Tue, Jan 15, 2013 at 3:50 PM, Erik Paulson wrote: > I'm curious what Hadoop developers use for their day-to-day hacking on > Hadoop. I'm talking changes to the Hadoop libraries and daemons, and not > developing Map-Reduce jobs or using using the HDFS Client libraries to talk > to a filesystem f

Hive utf8

2013-01-15 Thread springring
Hi, I put some file include chinese into HDFS. And read the file as "hadoop fs -cat /user/hive/warehouse/..." , is ok, I can see the chinese. But when I open the table in hive, I can't read chinese(english is ok )why?

Re: development environment for hadoop core

2013-01-15 Thread Todd Lipcon
Hi Erik, When I started out on Hadoop development, I used to use emacs for most of my development. I eventually "saw the light" and switched to eclipse with a bunch of emacs keybindings - using an IDE is really handy in Java for functions like "find callers of", quick navigation to types, etc. eta

[jira] [Created] (HADOOP-9218) Document the Rpc-wrappers used internally

2013-01-15 Thread Sanjay Radia (JIRA)
Sanjay Radia created HADOOP-9218: Summary: Document the Rpc-wrappers used internally Key: HADOOP-9218 URL: https://issues.apache.org/jira/browse/HADOOP-9218 Project: Hadoop Common Issue Type:

development environment for hadoop core

2013-01-15 Thread Erik Paulson
Hello - I'm curious what Hadoop developers use for their day-to-day hacking on Hadoop. I'm talking changes to the Hadoop libraries and daemons, and not developing Map-Reduce jobs or using using the HDFS Client libraries to talk to a filesystem from an application. I've checked out Hadoop, made mi

[jira] [Created] (HADOOP-9217) Print tread dumps when hadoop-common tests fail

2013-01-15 Thread Andrey Klochkov (JIRA)
Andrey Klochkov created HADOOP-9217: --- Summary: Print tread dumps when hadoop-common tests fail Key: HADOOP-9217 URL: https://issues.apache.org/jira/browse/HADOOP-9217 Project: Hadoop Common

[jira] [Created] (HADOOP-9216) CompressionCodecFactory#getCodecClasses should trim the result of parsing by Configuration.

2013-01-15 Thread Tsuyoshi OZAWA (JIRA)
Tsuyoshi OZAWA created HADOOP-9216: -- Summary: CompressionCodecFactory#getCodecClasses should trim the result of parsing by Configuration. Key: HADOOP-9216 URL: https://issues.apache.org/jira/browse/HADOOP-9216

[jira] [Resolved] (HADOOP-9210) bad mirror in download list

2013-01-15 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson resolved HADOOP-9210. --- Resolution: Not A Problem Release Note: From IRC, "hadoop can't do anything about it, a

[jira] [Reopened] (HADOOP-9070) Kerberos SASL server cannot find kerberos key

2013-01-15 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reopened HADOOP-9070: - > Kerberos SASL server cannot find kerberos key > -

[jira] [Resolved] (HADOOP-9197) Some little confusion in official documentation

2013-01-15 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HADOOP-9197. - Resolution: Invalid Jason, for now I am going to resolve this jira as invalid, since you

[jira] [Created] (HADOOP-9215) libhadoop.so doesn't exist (only libhadoop.so.1.0.0)

2013-01-15 Thread Thomas Graves (JIRA)
Thomas Graves created HADOOP-9215: - Summary: libhadoop.so doesn't exist (only libhadoop.so.1.0.0) Key: HADOOP-9215 URL: https://issues.apache.org/jira/browse/HADOOP-9215 Project: Hadoop Common

[jira] [Created] (HADOOP-9214) Update touchz to allow modifying atime and mtime

2013-01-15 Thread Brian Burton (JIRA)
Brian Burton created HADOOP-9214: Summary: Update touchz to allow modifying atime and mtime Key: HADOOP-9214 URL: https://issues.apache.org/jira/browse/HADOOP-9214 Project: Hadoop Common Issu

Re: Hadoop datajoin package

2013-01-15 Thread Harsh J
Ah, my bad. The two appear to be different things. I am not aware of any work being done for that datajoin tool package; also not sure if its really used out there. On Tue, Jan 15, 2013 at 4:51 PM, Hemanth Yamijala wrote: > Thanks, Harsh. > > Where does this fit in then ? > > > http://svn.apache

Re: Hadoop datajoin package

2013-01-15 Thread Hemanth Yamijala
Thanks, Harsh. Where does this fit in then ? http://svn.apache.org/repos/asf/hadoop/common/trunk/hadoop-tools/hadoop-datajoin/src/main/java/org/apache/hadoop/contrib/utils/join/ Is it to be deprecated and removed ? Thanks Hemanth On Mon, Jan 14, 2013 at 8:08 PM, Harsh J wrote: > Already don

[jira] [Created] (HADOOP-9213) Create a Jenkins job to run jcarder

2013-01-15 Thread Tom White (JIRA)
Tom White created HADOOP-9213: - Summary: Create a Jenkins job to run jcarder Key: HADOOP-9213 URL: https://issues.apache.org/jira/browse/HADOOP-9213 Project: Hadoop Common Issue Type: Task

[jira] [Created] (HADOOP-9212) Potential deadlock in FileSystem.Cache/IPC/UGI

2013-01-15 Thread Tom White (JIRA)
Tom White created HADOOP-9212: - Summary: Potential deadlock in FileSystem.Cache/IPC/UGI Key: HADOOP-9212 URL: https://issues.apache.org/jira/browse/HADOOP-9212 Project: Hadoop Common Issue Type:

Re: python streaming error

2013-01-15 Thread Simone Leo
Hello, you can use the Pydoop HDFS API to work with HDFS files: >>> import pydoop.hdfs as hdfs >>> with hdfs.open('hdfs://localhost:8020/user/myuser/filename') as f: ... for line in f: ... do_something(line) As you can see, the API is very similar to that of ordinary Python file

Build failed in Jenkins: Hadoop-Common-trunk #654

2013-01-15 Thread Apache Jenkins Server
See Changes: [eli] Add missing file from previous commit. [eli] HADOOP-9178. src/main/conf is missing hadoop-policy.xml. Contributed by Sandy Ryza [suresh] HDFS-4375. Use token request messages defined in hadoop common. Contribut

Build failed in Jenkins: Hadoop-Common-0.23-Build #495

2013-01-15 Thread Apache Jenkins Server
See Changes: [tgraves] HADOOP-9181. Set daemon flag for HttpServer's QueuedThreadPool (Liang Xie via tgraves) [tgraves] YARN-170. NodeManager stop() gets called twice on shutdown (Sandy Ryza via tgraves) [tgraves] HADOOP-909