[jira] [Created] (HADOOP-8431) Running distcp wo args throws IllegalArgumentException

[Eli Collins (JIRA)]

Eli Collins created HADOOP-8431:
---

 Summary: Running distcp wo args throws IllegalArgumentException
 Key: HADOOP-8431
 URL: https://issues.apache.org/jira/browse/HADOOP-8431
 Project: Hadoop Common
  Issue Type: Bug
Affects Versions: 2.0.0-alpha
Reporter: Eli Collins


Running distcp w/o args results in the following:

{noformat}
hadoop-3.0.0-SNAPSHOT $ ./bin/hadoop distcp
12/05/23 18:49:04 ERROR tools.DistCp: Invalid arguments: 
java.lang.IllegalArgumentException: Target path not specified
at org.apache.hadoop.tools.OptionsParser.parse(OptionsParser.java:86)
at org.apache.hadoop.tools.DistCp.run(DistCp.java:102)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.tools.DistCp.main(DistCp.java:368)
Invalid arguments: Target path not specified
{noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HADOOP-8430) Backport new FileSystem methods introduced by HADOOP-8014 to branch-1

[Eli Collins (JIRA)]

Eli Collins created HADOOP-8430:
---

 Summary: Backport new FileSystem methods introduced by HADOOP-8014 
to branch-1 
 Key: HADOOP-8430
 URL: https://issues.apache.org/jira/browse/HADOOP-8430
 Project: Hadoop Common
  Issue Type: Bug
Reporter: Eli Collins
Assignee: Eli Collins


Per HADOOP-8422 let's backport the new FileSystem methods from HADOOP-8014 to 
branch-1 so users can transition over in Hadoop 1.x releases, which helps 
upstream projects like HBase work against federation (see HBASE-6067). 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HADOOP-8429) Update index.html for docs site to reflect appropriate version in branch-2

[Arun C Murthy (JIRA)]

Arun C Murthy created HADOOP-8429:
-

 Summary: Update index.html for docs site to reflect appropriate 
version in branch-2
 Key: HADOOP-8429
 URL: https://issues.apache.org/jira/browse/HADOOP-8429
 Project: Hadoop Common
  Issue Type: Bug
Reporter: Arun C Murthy


Currently says 0.23, I noticed this while releasing 2.0.0-alpha. (For now, I'll 
manually fix it).

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HADOOP-8428) service commands don't actually shutdown the hadoop processes

[Jeremy Hanna (JIRA)]

Jeremy Hanna created HADOOP-8428:


 Summary: service commands don't actually shutdown the hadoop 
processes
 Key: HADOOP-8428
 URL: https://issues.apache.org/jira/browse/HADOOP-8428
 Project: Hadoop Common
  Issue Type: Bug
Affects Versions: 1.0.2
Reporter: Jeremy Hanna


Using the debian package for hadoop 1.0.2, I try to do 'service hadoop-namenode 
stop' or 'service hadoop-jobtracker stop' and it outputs that it is trying to 
stop the service, e.g. "Stopping Apache Hadoop Job Tracker server: 
hadoop-jobtracker."  However doing 'ps -ef | grep hadoop' still shows both of 
those still running even after a couple of minutes waiting.  I have to manually 
kill the processes and delete the process id in order to restart them.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HADOOP-8427) Convert Forrest docs to APT

[Eli Collins (JIRA)]

Eli Collins created HADOOP-8427:
---

 Summary: Convert Forrest docs to APT
 Key: HADOOP-8427
 URL: https://issues.apache.org/jira/browse/HADOOP-8427
 Project: Hadoop Common
  Issue Type: Task
  Components: documentation
Affects Versions: 2.0.0
Reporter: Eli Collins


Some of the forrest docs content in src/docs/src/documentation/content/xdocs 
has not yet been converted to APT and moved to src/site/apt. Let's convert the 
forrest docs that haven't been converted yet to new APT content in 
hadoop-common/src/site/apt (and link the new content into 
hadoop-project/src/site/apt/index.apt.vm) and remove all forrest dependencies.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Resolved] (HADOOP-8412) TestModTime, TestDelegationToken and TestAuthenticationToken fail intermittently on Windows

[Ivan Mitic (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HADOOP-8412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ivan Mitic resolved HADOOP-8412.


Resolution: Fixed

> TestModTime, TestDelegationToken and TestAuthenticationToken fail 
> intermittently on Windows
> ---
>
> Key: HADOOP-8412
> URL: https://issues.apache.org/jira/browse/HADOOP-8412
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: test
>Affects Versions: 1.0.0
>Reporter: Ivan Mitic
>Assignee: Ivan Mitic
> Attachments: HADOOP-8412-branch-1-win.patch
>
>
> Jira tracking failures from the summary.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

Re: cmake

[Roman Shaposhnik]

On Wed, May 23, 2012 at 8:58 AM, Owen O'Malley  wrote:
> After a quick look at cmake, it seems reasonable. Please use feature tests
> rather than OS tests. (By that I mean that if Solaris needs "foobar.h" and
> RHEL needs "sys/foobar.h" to get the definition for foobar, the code should
> ifdef whether they need sys/foobar.h and not if it is solaris or not.)
>
> On a related note, on what platforms does the native code currently compile
> and work?
>
> I've compiled and tested on:
>  RHEL & CentOS 5
>  RHEL & CentOS 6
>
> I've heard of it compiling on:
>  Solaris
>
> What other ones are out there?

Bigtop routinely compiles and tests native code on the following list
of platforms:
http://bigtop01.cloudera.org:8080/view/Bigtop-trunk/job/Bigtop-trunk-Hadoop/

Thanks,
Roman.

Re: cmake

[Eli Collins]

On Wed, May 23, 2012 at 8:58 AM, Owen O'Malley  wrote:
> After a quick look at cmake, it seems reasonable. Please use feature tests
> rather than OS tests. (By that I mean that if Solaris needs "foobar.h" and
> RHEL needs "sys/foobar.h" to get the definition for foobar, the code should
> ifdef whether they need sys/foobar.h and not if it is solaris or not.)
>
> On a related note, on what platforms does the native code currently compile
> and work?
>
> I've compiled and tested on:
>  RHEL & CentOS 5
>  RHEL & CentOS 6
>
> I've heard of it compiling on:
>  Solaris
>
> What other ones are out there?

Also multiple versions of OUL, SLES, Debian, and Ubuntu.

Re: cmake

[Owen O'Malley]

After a quick look at cmake, it seems reasonable. Please use feature tests
rather than OS tests. (By that I mean that if Solaris needs "foobar.h" and
RHEL needs "sys/foobar.h" to get the definition for foobar, the code should
ifdef whether they need sys/foobar.h and not if it is solaris or not.)

On a related note, on what platforms does the native code currently compile
and work?

I've compiled and tested on:
  RHEL & CentOS 5
  RHEL & CentOS 6

I've heard of it compiling on:
  Solaris

What other ones are out there?

[jira] [Reopened] (HADOOP-8422) FileSystem#getDefaultBlockSize and Replication don't use the given path

[Daryn Sharp (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HADOOP-8422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Daryn Sharp reopened HADOOP-8422:
-


Re-opening and re-targeting to 1.x for a backport of replication factor and 
block size fixes for {{ViewFileSystem}}.

> FileSystem#getDefaultBlockSize and Replication don't use the given path
> ---
>
> Key: HADOOP-8422
> URL: https://issues.apache.org/jira/browse/HADOOP-8422
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: fs
>Affects Versions: 1.0.3
>Reporter: Eli Collins
>Priority: Minor
>
> The javadocs for FileSystem#getDefaultBlockSize and 
> FileSystem#getDefaultReplication claim that "The given path will be used to 
> locate the actual filesystem" however they both ignore the path.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

Re: Powered By wrtie permission application

[Mikhail Yakshin]

Yep, thanks. One little glitch on addition, though: an automatic
checker finds "t.co" in the entry I've tried to add first (as our main
homepage is www.opensta_t.co_m). I've worked it around by specifying
an alternate homepage (www.openstat.ru, which does not contain
"t.co"), but I guess this one's worth fixing. Probably it will hurt a
lot of URLs that just contain "t.co" - currently PoweredBy page
includes a lot of such URLs.

On Wed, May 23, 2012 at 3:53 PM, Harsh J  wrote:
> List - I've handled this.
>
> On Wed, May 23, 2012 at 2:04 PM, Mikhail Yakshin
>  wrote:
>> Hi,
>>
>> I'd like to apply for write permission for Hadoop wiki for account
>> "Mikhail Yakshin" to add our company to Hadoop PoweredBy list at
>> http://wiki.apache.org/hadoop/PoweredBy
>>
>> --
>> WBR, Mikhail Yakshin
>
>
>
> --
> Harsh J



-- 
WBR, Mikhail Yakshin

Re: Powered By wrtie permission application

[Harsh J]

List - I've handled this.

On Wed, May 23, 2012 at 2:04 PM, Mikhail Yakshin
 wrote:
> Hi,
>
> I'd like to apply for write permission for Hadoop wiki for account
> "Mikhail Yakshin" to add our company to Hadoop PoweredBy list at
> http://wiki.apache.org/hadoop/PoweredBy
>
> --
> WBR, Mikhail Yakshin



-- 
Harsh J

Re: cmake

[Steve Loughran]

On 22 May 2012 11:33, Radim Kolar  wrote:

> i have better experience with scons instead of cmake
>

mmm, may be better to jump beyond make altogether to the higher levels of
nativeish build tools.

What would be good is that the output can be parsed by jenkins & have that
set up to build and test on windows and linux (and maybe BSD, OS/X if they
can play with VMs)

Build failed in Jenkins: Hadoop-Common-0.23-Build #261

[Apache Jenkins Server]

See 

--
[...truncated 12430 lines...]
  [javadoc] Loading source files for package org.apache.hadoop.fs.ftp...
  [javadoc] Loading source files for package org.apache.hadoop.fs.kfs...
  [javadoc] Loading source files for package org.apache.hadoop.fs.local...
  [javadoc] Loading source files for package org.apache.hadoop.fs.permission...
  [javadoc] Loading source files for package org.apache.hadoop.fs.s3...
  [javadoc] Loading source files for package org.apache.hadoop.fs.s3native...
  [javadoc] Loading source files for package org.apache.hadoop.fs.shell...
  [javadoc] Loading source files for package org.apache.hadoop.fs.viewfs...
  [javadoc] Loading source files for package org.apache.hadoop.http...
  [javadoc] Loading source files for package org.apache.hadoop.http.lib...
  [javadoc] Loading source files for package org.apache.hadoop.io...
  [javadoc] Loading source files for package org.apache.hadoop.io.compress...
  [javadoc] Loading source files for package 
org.apache.hadoop.io.compress.bzip2...
  [javadoc] Loading source files for package 
org.apache.hadoop.io.compress.lz4...
  [javadoc] Loading source files for package 
org.apache.hadoop.io.compress.snappy...
  [javadoc] Loading source files for package 
org.apache.hadoop.io.compress.zlib...
  [javadoc] Loading source files for package org.apache.hadoop.io.file.tfile...
  [javadoc] Loading source files for package org.apache.hadoop.io.nativeio...
  [javadoc] Loading source files for package org.apache.hadoop.io.retry...
  [javadoc] Loading source files for package org.apache.hadoop.io.serializer...
  [javadoc] Loading source files for package 
org.apache.hadoop.io.serializer.avro...
  [javadoc] Loading source files for package org.apache.hadoop.ipc...
  [javadoc] Loading source files for package org.apache.hadoop.ipc.metrics...
  [javadoc] Loading source files for package org.apache.hadoop.jmx...
  [javadoc] Loading source files for package org.apache.hadoop.log...
  [javadoc] Loading source files for package org.apache.hadoop.log.metrics...
  [javadoc] Loading source files for package org.apache.hadoop.metrics...
  [javadoc] Loading source files for package org.apache.hadoop.metrics.file...
  [javadoc] Loading source files for package 
org.apache.hadoop.metrics.ganglia...
  [javadoc] Loading source files for package org.apache.hadoop.metrics.jvm...
  [javadoc] Loading source files for package org.apache.hadoop.metrics.spi...
  [javadoc] Loading source files for package org.apache.hadoop.metrics.util...
  [javadoc] Loading source files for package org.apache.hadoop.metrics2...
  [javadoc] Loading source files for package 
org.apache.hadoop.metrics2.annotation...
  [javadoc] Loading source files for package 
org.apache.hadoop.metrics2.filter...
  [javadoc] Loading source files for package org.apache.hadoop.metrics2.impl...
  [javadoc] Loading source files for package org.apache.hadoop.metrics2.lib...
  [javadoc] Loading source files for package org.apache.hadoop.metrics2.sink...
  [javadoc] Loading source files for package 
org.apache.hadoop.metrics2.sink.ganglia...
  [javadoc] Loading source files for package 
org.apache.hadoop.metrics2.source...
  [javadoc] Loading source files for package org.apache.hadoop.metrics2.util...
  [javadoc] Loading source files for package org.apache.hadoop.net...
  [javadoc] Loading source files for package org.apache.hadoop.record...
  [javadoc] Loading source files for package 
org.apache.hadoop.record.compiler...
  [javadoc] Loading source files for package 
org.apache.hadoop.record.compiler.ant...
  [javadoc] Loading source files for package 
org.apache.hadoop.record.compiler.generated...
  [javadoc] Loading source files for package org.apache.hadoop.record.meta...
  [javadoc] Loading source files for package org.apache.hadoop.security...
  [javadoc] Loading source files for package 
org.apache.hadoop.security.authorize...
  [javadoc] Loading source files for package org.apache.hadoop.security.token...
  [javadoc] Loading source files for package 
org.apache.hadoop.security.token.delegation...
  [javadoc] Loading source files for package org.apache.hadoop.tools...
  [javadoc] Loading source files for package org.apache.hadoop.util...
  [javadoc] Loading source files for package org.apache.hadoop.util.bloom...
  [javadoc] Loading source files for package org.apache.hadoop.util.hash...
  [javadoc] 2 errors
 [xslt] Processing 

 to 

 [xslt] Loading stylesheet 
/home/jenkins/tools/findbugs/latest/src/xsl/default.xsl
[INFO] Executed tasks
[INFO] 
[INFO] --- maven-antrun-plugin:1.6:run (pre-dist) @ hadoop-common ---
[INFO] Executing tasks

main:
[INFO] Executed ta

Powered By wrtie permission application

[Mikhail Yakshin]

Hi,

I'd like to apply for write permission for Hadoop wiki for account
"Mikhail Yakshin" to add our company to Hadoop PoweredBy list at
http://wiki.apache.org/hadoop/PoweredBy

-- 
WBR, Mikhail Yakshin

[jira] [Created] (HADOOP-8426) API to get info for deprecated key

[Subroto Sanyal (JIRA)]

Subroto Sanyal created HADOOP-8426:
--

 Summary: API to get info for deprecated key
 Key: HADOOP-8426
 URL: https://issues.apache.org/jira/browse/HADOOP-8426
 Project: Hadoop Common
  Issue Type: Bug
  Components: conf
Affects Versions: 0.23.1
Reporter: Subroto Sanyal


The current version of Hadoop deprecates many keys but, takes care of adding 
the new keys to the configuration accordingly.
For the end user only logs are there which indicates the key is deprecated and 
the message also suggests the new key to be used.

I was thinking; there should be an API/Utility which could probably provide the 
new key information when called with old key.
Using this API the user can judge in runtime to use the old key or new key.
Currently the Configuration provides an API only to check whether a key is 
deprecated or not but, doesn't provides a way to get the corresponding new key.


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

Re: subscribe hadoop

[shashwat shriparv]

I did not study sir, i m just working on it still learning and doing. :)
Just start putting hand on it you will get to know hadoop then only..

Regards
Shashwat Shriparv

On Wed, May 23, 2012 at 7:12 AM, han tai  wrote:

> Good morning Mr.
>
> Thanks a lot!
> How long have you study hadoop?
> Are you working with hadoop?
> I do envy you.
>
> best wishes!
>
> On 23 May 2012 04:07, shashwat shriparv  wrote:
>
> > ha ha Really need to ask that? search learn share... just type on any
> > search engine : "hadoop tutorial" thats all
> >
> > On Tue, May 22, 2012 at 7:47 PM, han tai  wrote:
> >
> > > Good evenning Mr.
> > > I want to know how does you learn hadoop?
> > >
> > > On 18 May 2012 03:59, shashwat shriparv 
> > wrote:
> > >
> > > > Learn hadoop and share your knowledge you will get friends
> > > automatically..
> > > >
> > > >
> > > > On Thu, May 17, 2012 at 12:30 PM, han tai 
> > wrote:
> > > >
> > > > > sorry~
> > > > > Good afternoon Mr.
> > > > > I'd  subscribed hadoop just now
> > > > > I want to learn hadoop,and want to making some friends!
> > > > >
> > > > > On 17 May 2012 14:54, Harsh J  wrote:
> > > > >
> > > > > > Hey Han,
> > > > > >
> > > > > > Welcome! :)
> > > > > >
> > > > > > Please read http://hadoop.apache.org/common/mailing_lists.htmlon
> > > how
> > > > > > to subscribe properly. You need to mail common-dev-subscribe@,
> not
> > > > > > common-dev@ directly.
> > > > > >
> > > > > > On Thu, May 17, 2012 at 12:22 PM, han tai 
> > > > wrote:
> > > > > > > hello,I want to  subscribe hadoop
> > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Harsh J
> > > > > >
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > >
> > > >
> > > > ∞
> > > > Shashwat Shriparv
> > > >
> > >
> >
> >
> >
> > --
> >
> >
> > ∞
> > Shashwat Shriparv
> >
>



-- 


∞
Shashwat Shriparv