not spin up a MiniDFSCluster for every test
> ---
>
> Key: HDFS-17539
> URL: https://issues.apache.org/jira/browse/HDFS-17539
> Project: Hadoop HDFS
> Is
Felix N created HDFS-17539:
--
Summary: TestFileChecksum should not spin up a MiniDFSCluster for
every test
Key: HDFS-17539
URL: https://issues.apache.org/jira/browse/HDFS-17539
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-16702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun resolved HDFS-16702.
-
Hadoop Flags: Reviewed
Resolution: Fixed
> MiniDFSCluster should report cause of exception
Steve Vaughan created HDFS-16702:
Summary: MiniDFSCluster should report cause of exception in
assertion error
Key: HDFS-16702
URL: https://issues.apache.org/jira/browse/HDFS-16702
Project: Hadoop
Viraj Jasani created HDFS-16522:
---
Summary: Set Http and Ipc ports for Datanodes in MiniDFSCluster
Key: HDFS-16522
URL: https://issues.apache.org/jira/browse/HDFS-16522
Project: Hadoop HDFS
: Fixed
> Fix MiniDFSCluster restart in case of multiple namenodes
>
>
> Key: HDFS-16373
> URL: https://issues.apache.org/jira/browse/HDFS-16373
> Project: Hadoop HDFS
>
Ayush Saxena created HDFS-16373:
---
Summary: Fix MiniDFSCluster restart in case of multiple namenodes
Key: HDFS-16373
URL: https://issues.apache.org/jira/browse/HDFS-16373
Project: Hadoop HDFS
Set dfs.namenode.redundancy.considerLoad to false in MiniDFSCluster
> ---
>
> Key: HDFS-15659
> URL: https://issues.apache.org/jira/browse/HDFS-15659
> Project: Hadoop HDFS
> Issue Type: Sub-task
Sayed Mohammad Hossein Torabi created HDFS-15688:
Summary: Improve MiniDFSCluster by a adding a default constructor
Key: HDFS-15688
URL: https://issues.apache.org/jira/browse/HDFS-15688
Akira Ajisaka created HDFS-15659:
Summary: Set dfs.namenode.redundancy.considerLoad to false in
MiniDFSCluster
Key: HDFS-15659
URL: https://issues.apache.org/jira/browse/HDFS-15659
Project: Hadoop
He Xiaoqiao created HDFS-14385:
--
Summary: RBF: Optimize MiniRouterDFSCluster with optional light
weight MiniDFSCluster
Key: HDFS-14385
URL: https://issues.apache.org/jira/browse/HDFS-14385
Project
wilderchen created HDFS-13771:
-
Summary: enableManagedDfsDirsRedundancy typo in creating
MiniDFSCluster
Key: HDFS-13771
URL: https://issues.apache.org/jira/browse/HDFS-13771
Project: Hadoop HDFS
Anbang Hu created HDFS-13725:
Summary: Randomize MiniDFSCluster base directory in
AdminStatesBaseTest
Key: HDFS-13725
URL: https://issues.apache.org/jira/browse/HDFS-13725
Project: Hadoop HDFS
Anbang Hu created HDFS-13652:
Summary: Randomize baseDir for MiniDFSCluster in TestBlockScanner
Key: HDFS-13652
URL: https://issues.apache.org/jira/browse/HDFS-13652
Project: Hadoop HDFS
Issue
Anbang Hu created HDFS-13649:
Summary: Randomize baseDir for MiniDFSCluster in
TestReconstructStripedFile and TestReconstructStripedFileWithRandomECPolicy
Key: HDFS-13649
URL: https://issues.apache.org/jira/browse
Anbang Hu created HDFS-13631:
Summary: TestDFSAdmin#testCheckNumOfBlocksInReportCommand should
use a separate MiniDFSCluster path
Key: HDFS-13631
URL: https://issues.apache.org/jira/browse/HDFS-13631
Anbang Hu created HDFS-13629:
Summary: Some tests in TestDiskBalancerCommand fail on Windows due
to MiniDFSCluster path conflict and improper path usage
Key: HDFS-13629
URL: https://issues.apache.org/jira/browse/HDFS
Erik Krogen created HDFS-13523:
--
Summary: Support observer nodes in MiniDFSCluster
Key: HDFS-13523
URL: https://issues.apache.org/jira/browse/HDFS-13523
Project: Hadoop HDFS
Issue Type: Sub
Xiao Liang created HDFS-13408:
-
Summary: MiniDFSCluster to support being built on randomized base
directory
Key: HDFS-13408
URL: https://issues.apache.org/jira/browse/HDFS-13408
Project: Hadoop HDFS
Íñigo Goiri created HDFS-13276:
--
Summary: TestDistributedFileSystem doesn't cleanup MiniDFSCluster
if test times out
Key: HDFS-13276
URL: https://issues.apache.org/jira/browse/HDFS-13276
Project: H
Erik Krogen created HDFS-13265:
--
Summary: MiniDFSCluster should set reasonable defaults to reduce
resource consumption
Key: HDFS-13265
URL: https://issues.apache.org/jira/browse/HDFS-13265
Project
Yiqun Lin created HDFS-13210:
Summary: Fix the typo in MiniDFSCluster class
Key: HDFS-13210
URL: https://issues.apache.org/jira/browse/HDFS-13210
Project: Hadoop HDFS
Issue Type: Bug
Jeff Saremi created HDFS-12902:
--
Summary: IOException when running MiniDfsCluster on Windows:
Failed to save in any storage directories while saving namespace
Key: HDFS-12902
URL: https://issues.apache.org/jira
Daryn Sharp created HDFS-12173:
--
Summary: MiniDFSCluster cannot reliably use NameNode#stop
Key: HDFS-12173
URL: https://issues.apache.org/jira/browse/HDFS-12173
Project: Hadoop HDFS
Issue Type
James Clampffer created HDFS-12111:
--
Summary: libhdfs++: Expose HA and Kerberos options for C++
minidfscluster bindings
Key: HDFS-12111
URL: https://issues.apache.org/jira/browse/HDFS-12111
Project
James Clampffer created HDFS-11807:
--
Summary: libhdfs++: Get minidfscluster tests running under valgrind
Key: HDFS-11807
URL: https://issues.apache.org/jira/browse/HDFS-11807
Project: Hadoop HDFS
t;Not A
Problem".
> Accelerate TestDiskBalancerCommand using static shared MiniDFSCluster
> -
>
> Key: HDFS-11089
> URL: https://issues.apache.org/jira/browse/HDFS-11089
>
Xiaobing Zhou created HDFS-11089:
Summary: Accelerate TestDiskBalancerCommand using static shared
MiniDFSCluster
Key: HDFS-11089
URL: https://issues.apache.org/jira/browse/HDFS-11089
Project: Hadoop
Xiaobing Zhou created HDFS-11079:
Summary: Accelerate TestQuotaByStorageType using shared
MiniDFSCluster
Key: HDFS-11079
URL: https://issues.apache.org/jira/browse/HDFS-11079
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiaobing Zhou reopened HDFS-10824:
--
> MiniDFSCluster#storageCapacities has no effects on real capac
like this was committed to trunk, branch-2,
branch-2.8. Thanks for working on this [~iwasakims]!
> Some tests using MiniDFSCluster errored complaining port in use
> ---
>
> Key: HDFS-9333
>
Xiaobing Zhou created HDFS-10824:
Summary: MiniDFSCluster#storageCapacities has no effects on real
capacity
Key: HDFS-10824
URL: https://issues.apache.org/jira/browse/HDFS-10824
Project: Hadoop HDFS
Daryn Sharp created HDFS-10743:
--
Summary: MiniDFSCluster test runtimes can be drastically reduce
Key: HDFS-10743
URL: https://issues.apache.org/jira/browse/HDFS-10743
Project: Hadoop HDFS
Issue
otherwise.
> Make MiniDFSCluster AutoCloseable
> -
>
> Key: HDFS-10661
> URL: https://issues.apache.org/jira/browse/HDFS-10661
> Project: Hadoop HDFS
> Issue Type: Improvement
>
Akira Ajisaka created HDFS-10661:
Summary: Make MiniDFSCluster AutoCloseable
Key: HDFS-10661
URL: https://issues.apache.org/jira/browse/HDFS-10661
Project: Hadoop HDFS
Issue Type
Xiaobing Zhou created HDFS-10577:
Summary: Support building MiniDFSCluster from JSON
Key: HDFS-10577
URL: https://issues.apache.org/jira/browse/HDFS-10577
Project: Hadoop HDFS
Issue Type
James Clampffer created HDFS-10492:
--
Summary: libhdfs++: Clean up minidfscluster tests
Key: HDFS-10492
URL: https://issues.apache.org/jira/browse/HDFS-10492
Project: Hadoop HDFS
Issue Type
Vinayakumar B created HDFS-10384:
Summary: MiniDFSCluster doesnt support multiple HTTPS server
instances
Key: HDFS-10384
URL: https://issues.apache.org/jira/browse/HDFS-10384
Project: Hadoop HDFS
Xiaoyu Yao created HDFS-10371:
-
Summary: MiniDFSCluster#restartDataNode does not always stop DN
before start DN
Key: HDFS-10371
URL: https://issues.apache.org/jira/browse/HDFS-10371
Project: Hadoop HDFS
John Zhuge created HDFS-10300:
-
Summary: TestDistCpSystem should share MiniDFSCluster
Key: HDFS-10300
URL: https://issues.apache.org/jira/browse/HDFS-10300
Project: Hadoop HDFS
Issue Type
John Zhuge created HDFS-10287:
-
Summary: MiniDFSCluster should implement AutoCloseable
Key: HDFS-10287
URL: https://issues.apache.org/jira/browse/HDFS-10287
Project: Hadoop HDFS
Issue Type
Anu Engineer created HDFS-9834:
--
Summary: OzoneHandler : Enable MiniDFSCluster based testing for
Ozone
Key: HDFS-9834
URL: https://issues.apache.org/jira/browse/HDFS-9834
Project: Hadoop HDFS
John Zhuge created HDFS-9728:
Summary: TestDFSShell should not create MiniDFSCluster in each
test case
Key: HDFS-9728
URL: https://issues.apache.org/jira/browse/HDFS-9728
Project: Hadoop HDFS
Tony Wu created HDFS-9490:
-
Summary: MiniDFSCluster should change block generation stamp via
FsDatasetTestUtils
Key: HDFS-9490
URL: https://issues.apache.org/jira/browse/HDFS-9490
Project: Hadoop HDFS
in MiniDFSCluster#shutdown
>
>
> Key: HDFS-4764
> URL: https://issues.apache.org/jira/browse/HDFS-4764
> Project: Hadoop HDFS
> Issue Type: Bug
> Compo
/jira/browse/HBASE-14684
Could you tell me what's the difference especially MiniDFSCluster between
two versions.
Thanks!
Tony Wu created HDFS-9308:
-
Summary: Add truncateMeta() to MiniDFSCluster
Key: HDFS-9308
URL: https://issues.apache.org/jira/browse/HDFS-9308
Project: Hadoop HDFS
Issue Type: Improvement
Josh Elser created HDFS-9226:
Summary: MiniDFSCluster leaks dependency Mockito via
DataNodeTestUtils
Key: HDFS-9226
URL: https://issues.apache.org/jira/browse/HDFS-9226
Project: Hadoop HDFS
Siqi Li created HDFS-9142:
-
Summary: Namenode Http address is not configured correctly for
federated cluster in MiniDFSCluster
Key: HDFS-9142
URL: https://issues.apache.org/jira/browse/HDFS-9142
Project
James Clampffer created HDFS-9062:
-
Summary: Add a parameter to MiniDFSCluster to turn off security
checks on the domain socked path
Key: HDFS-9062
URL: https://issues.apache.org/jira/browse/HDFS-9062
Vinayakumar B created HDFS-8524:
---
Summary: Add tests for StartupProgress with using MiniDFSCluster
Key: HDFS-8524
URL: https://issues.apache.org/jira/browse/HDFS-8524
Project: Hadoop HDFS
EDUCE-6320, and for this, I need a mini
>> cluster for the tests. The hadoop-mapreduce-client-core imports the
>> hadoop-hdfs in the „test“ scope, but the MiniDFSCluster is not present
>> there, as it is in the „test“ sources of said module. What grinds my gears
>> is that whe
> On 19 Apr 2015, at 09:21, Jens Rabe wrote:
>
> Hello,
>
> I wanted to write a fix for MAPREDUCE-6320, and for this, I need a mini
> cluster for the tests. The hadoop-mapreduce-client-core imports the
> hadoop-hdfs in the „test“ scope, but the MiniDFSCluster is not pr
Hello,
I wanted to write a fix for MAPREDUCE-6320, and for this, I need a mini cluster
for the tests. The hadoop-mapreduce-client-core imports the hadoop-hdfs in the
„test“ scope, but the MiniDFSCluster is not present there, as it is in the
„test“ sources of said module. What grinds my gears
Steve Loughran created HDFS-8043:
Summary: NPE in MiniDFSCluster teardown
Key: HDFS-8043
URL: https://issues.apache.org/jira/browse/HDFS-8043
Project: Hadoop HDFS
Issue Type: Bug
Chris Nauroth created HDFS-7632:
---
Summary: MiniDFSCluster configures DataNode data directories
incorrectly if using more than 1 DataNode and more than 2 storage locations per
DataNode.
Key: HDFS-7632
URL: https
Haohui Mai created HDFS-7360:
Summary: Test libhdfs3 against MiniDFSCluster
Key: HDFS-7360
URL: https://issues.apache.org/jira/browse/HDFS-7360
Project: Hadoop HDFS
Issue Type: Sub-task
Konstantin Shvachko created HDFS-7329:
-
Summary: MiniDFSCluster should log the exception when
createNameNodesAndSetConf() fails.
Key: HDFS-7329
URL: https://issues.apache.org/jira/browse/HDFS-7329
Chris Nauroth created HDFS-7127:
---
Summary: TestLeaseRecovery leaks MiniDFSCluster instances.
Key: HDFS-7127
URL: https://issues.apache.org/jira/browse/HDFS-7127
Project: Hadoop HDFS
Issue Type
Tsz Wo Nicholas Sze created HDFS-6878:
-
Summary: Change MiniDFSCluster to support StorageType
configuration for individual directories
Key: HDFS-6878
URL: https://issues.apache.org/jira/browse/HDFS-6878
Daryn Sharp created HDFS-6773:
-
Summary: MiniDFSCluster can run dramatically faster
Key: HDFS-6773
URL: https://issues.apache.org/jira/browse/HDFS-6773
Project: Hadoop HDFS
Issue Type
Chris Nauroth created HDFS-6678:
---
Summary: MiniDFSCluster may still be partially running after
initialization fails.
Key: HDFS-6678
URL: https://issues.apache.org/jira/browse/HDFS-6678
Project: Hadoop
Hortonworks
> http://hortonworks.com/
>
>
>
> On Tue, Jun 17, 2014 at 7:46 PM, Bernd Eckenfels
> wrote:
>
> > Hello,
> >
> > in the Commons VFS project we have a Provider for HDFS. This
> > Provider is unit-tested with the help of the excelent MiniDFS
onworks
http://hortonworks.com/
On Tue, Jun 17, 2014 at 7:46 PM, Bernd Eckenfels
wrote:
> Hello,
>
> in the Commons VFS project we have a Provider for HDFS. This
> Provider is unit-tested with the help of the excelent MiniDFSCluster
> component.
>
> A while back I en
Hello,
in the Commons VFS project we have a Provider for HDFS. This
Provider is unit-tested with the help of the excelent MiniDFSCluster
component.
A while back I enabled automated testing on Windows (cause it worked
for me), but I did not realize it only works with cygwin (namely
ls.exe) in the
Kihwal Lee created HDFS-6360:
Summary: MiniDFSCluster can cause unexpected side effects due to
sharing of config
Key: HDFS-6360
URL: https://issues.apache.org/jira/browse/HDFS-6360
Project: Hadoop HDFS
Steve Loughran created HDFS-5678:
Summary: deadlock in MiniDFSCluster caused by logging
Key: HDFS-5678
URL: https://issues.apache.org/jira/browse/HDFS-5678
Project: Hadoop HDFS
Issue Type
[
https://issues.apache.org/jira/browse/HDFS-5528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Binglin Chang resolved HDFS-5528.
-
Resolution: Duplicate
> NPE in instantiating MiniDFSClus
Junping Du created HDFS-5528:
Summary: NPE in instantiating MiniDFSCluster
Key: HDFS-5528
URL: https://issues.apache.org/jira/browse/HDFS-5528
Project: Hadoop HDFS
Issue Type: Bug
Affects
haosdent created HDFS-5356:
--
Summary: MiniDFSCluster shoud close all open FileSystems when
shutdown()
Key: HDFS-5356
URL: https://issues.apache.org/jira/browse/HDFS-5356
Project: Hadoop HDFS
Issue
Alejandro Abdelnur created HDFS-5328:
Summary: MiniDFSCluster times out at startup
Key: HDFS-5328
URL: https://issues.apache.org/jira/browse/HDFS-5328
Project: Hadoop HDFS
Issue Type
Alejandro Abdelnur created HDFS-5160:
Summary: MiniDFSCluster webui does not work
Key: HDFS-5160
URL: https://issues.apache.org/jira/browse/HDFS-5160
Project: Hadoop HDFS
Issue Type: Bug
Chuan Liu created HDFS-5093:
---
Summary: TestGlobPaths should re-use the MiniDFSCluster to avoid
failure on Windows
Key: HDFS-5093
URL: https://issues.apache.org/jira/browse/HDFS-5093
Project: Hadoop HDFS
Andrew Wang created HDFS-4764:
-
Summary: TestBlockReaderLocalLegacy flakes in
MiniDFSCluster#shutdown
Key: HDFS-4764
URL: https://issues.apache.org/jira/browse/HDFS-4764
Project: Hadoop HDFS
Suresh Srinivas created HDFS-4676:
-
Summary: TestHDFSFileSystemContract should set MiniDFSCluster
variable to null to free up memory
Key: HDFS-4676
URL: https://issues.apache.org/jira/browse/HDFS-4676
Andrew Purtell created HDFS-4392:
Summary: Use NetUtils#getFreeSocketPort in MiniDFSCluster
Key: HDFS-4392
URL: https://issues.apache.org/jira/browse/HDFS-4392
Project: Hadoop HDFS
Issue
Luke Lu created HDFS-4313:
-
Summary: MiniDFSCluster throws NPE if umask is more permissive
than 022
Key: HDFS-4313
URL: https://issues.apache.org/jira/browse/HDFS-4313
Project: Hadoop HDFS
Issue
Chris Nauroth created HDFS-4275:
---
Summary: MiniDFSCluster-based tests fail on Windows due to failure
to delete test name node directory
Key: HDFS-4275
URL: https://issues.apache.org/jira/browse/HDFS-4275
Stephen Chu created HDFS-4237:
-
Summary: Add unit tests for HTTP-based filesystems against secure
MiniDFSCluster
Key: HDFS-4237
URL: https://issues.apache.org/jira/browse/HDFS-4237
Project: Hadoop HDFS
Eli Collins created HDFS-3936:
-
Summary: MiniDFSCluster shutdown may fail due to
BlocksMap#getBlockCollection NPE
Key: HDFS-3936
URL: https://issues.apache.org/jira/browse/HDFS-3936
Project: Hadoop HDFS
Eli Collins created HDFS-3928:
-
Summary: MiniDFSCluster should reset the first ExitException on
shutdown
Key: HDFS-3928
URL: https://issues.apache.org/jira/browse/HDFS-3928
Project: Hadoop HDFS
clusters to
be started at the same time that use the same base directory effectively
invalidating one of them. The best option is to change data directory (for
example "data", "data1", "data2") for every instance that share the same
MiniDFSCluster base directory o
On 5 September 2012 18:42, Vladimir Rozov wrote:
> There are few methods on MiniDFSCluster class that are declared as static
> (getBlockFile, getStorageDirPath), though as long as MiniDFSCluster is not
> a singleton they should be instance methods not class methods.
These aren'
Thanks Colin. I filed https://issues.apache.org/jira/browse/HDFS-3892 . I'll
look into it.
Thank you,
Vlad
- Original Message -
From: "Colin McCabe"
To: hdfs-dev@hadoop.apache.org
Sent: Wednesday, September 5, 2012 1:19:37 PM
Subject: Re: MiniDFSCluster
Vlad Rozov created HDFS-3892:
Summary: Few static methods of MiniDFSCluster class incorrectly
assume that it is a singleton
Key: HDFS-3892
URL: https://issues.apache.org/jira/browse/HDFS-3892
Project
Hi Vlad,
I think you might be on to something. File a JIRA?
It should be a simple improvement, I think.
cheers,
Colin
On Wed, Sep 5, 2012 at 10:42 AM, Vladimir Rozov wrote:
> There are few methods on MiniDFSCluster class that are declared as static
> (getBlockFile, getStorageD
There are few methods on MiniDFSCluster class that are declared as static
(getBlockFile, getStorageDirPath), though as long as MiniDFSCluster is not a
singleton they should be instance methods not class methods. In my tests I see
that starting second instance of MiniDFSCluster invalidates the
Version/s: (was: 2.2.0-alpha)
Hadoop Flags: Reviewed
I've committed this to branch-2 and branch-0.23. Thanks Colin.
> Port MiniDFSCluster enableManagedDfsDirsRedundancy option to
Eli Collins created HDFS-3682:
-
Summary: MiniDFSCluster#init should provide more info when it fails
Key: HDFS-3682
URL: https://issues.apache.org/jira/browse/HDFS-3682
Project: Hadoop HDFS
Issue
Eli Collins created HDFS-3663:
-
Summary: MiniDFSCluster should capture the code path that led to
the first ExitException
Key: HDFS-3663
URL: https://issues.apache.org/jira/browse/HDFS-3663
Project
Arun C Murthy created HDFS-3614:
---
Summary: HDFS-3049 broke MR1 compile via an incompatible change to
MiniDFSCluster
Key: HDFS-3614
URL: https://issues.apache.org/jira/browse/HDFS-3614
Project: Hadoop
Eli Collins created HDFS-3582:
-
Summary: Hook System.exit in MiniDFSCluster
Key: HDFS-3582
URL: https://issues.apache.org/jira/browse/HDFS-3582
Project: Hadoop HDFS
Issue Type: Improvement
CLI-based driver for MiniDFSCluster
---
Key: HDFS-3167
URL: https://issues.apache.org/jira/browse/HDFS-3167
Project: Hadoop HDFS
Issue Type: New Feature
Components: test
Reporter: Henry
HA: MiniDFSCluster should configure conf with actual address of NN in case of
non-federated, non-HA cluster
---
Key: HDFS-3033
URL: https://issues.apache.org
Thanks a lot for the review, Todd. I've just committed this to the HA branch.
> HA: MiniDFSCluster does not delete standby NN name dirs during format
> -
>
> Key: HDFS-2974
>
HA: MiniDFSCluster does not delete standby NN name dirs during format
-
Key: HDFS-2974
URL: https://issues.apache.org/jira/browse/HDFS-2974
Project: Hadoop HDFS
Issue Type
TestDFSHAAdmin needs tests with MiniDFSCluster
--
Key: HDFS-2937
URL: https://issues.apache.org/jira/browse/HDFS-2937
Project: Hadoop HDFS
Issue Type: Sub-task
Components: ha
Affects
v3 to HA branch
> HA: MiniDFSCluster support to mix and match federation with HA
> --
>
> Key: HDFS-2591
> URL: https://issues.apache.org/jira/browse/HDFS-2591
>
HA: MiniDFSCluster support to mix and match federation with HA
--
Key: HDFS-2591
URL: https://issues.apache.org/jira/browse/HDFS-2591
Project: Hadoop HDFS
Issue Type: Sub-task
Enhance MiniDFSCluster to improve testing of network topology distance related
issues.
--
Key: HDFS-1962
URL: https://issues.apache.org/jira/browse/HDFS-1962
Project
1 - 100 of 124 matches
Mail list logo
