[
https://issues.apache.org/jira/browse/HDFS-5550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Fengdong Yu resolved HDFS-5550.
---
Resolution: Not A Problem
I closed this issue. during upgrade, we need to run -initializeSharedEdits
[
https://issues.apache.org/jira/browse/HDFS-5553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Fengdong Yu resolved HDFS-5553.
---
Resolution: Not A Problem
I closed this issue. during upgrade, we need to empty JN's edit's dir
See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/802/
###
## LAST 60 LINES OF THE CONSOLE
###
[...truncated 7892 lines...]
[ERROR]
See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/802/changes
Changes:
[kihwal] svn merge -c 1545322 merging from trunk to branch-0.23 to fix
HDFS-5266. Datanode cannot roll back to previous layout version.
--
[...truncated 7699 lines...]
[ERROR]
See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1594/
###
## LAST 60 LINES OF THE CONSOLE
###
[...truncated 11782 lines...]
main:
[mkdir] Created dir:
See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1594/changes
Changes:
[jing9] HDFS-5538. URLConnectionFactory should pick up the SSL related
configuration by default. Contributed by Haohui Mai.
[vinodkv] YARN-1314. Fixed DistributedShell to not fail with multiple arguments
for a shell
[
https://issues.apache.org/jira/browse/HDFS-5235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haohui Mai resolved HDFS-5235.
--
Resolution: Later
HDFS-5230 reimplements XDR using ByteBuffer which reduces the amount of copies.
This
Hi,
Recently I've been focusing on fixing hftp / hsftp / webhdfs / swebhdfs in
various set ups. Now we have reached the state that all the above file
systems can work in both secure and insecure clusters, and transfer data
through both http and https.
Taking a step back, these file systems are
Hey Haohui,
Seems reasonable to mark hftp and hsftp as deprecated in 2.x and remove
them from trunk (for 3.x).
Thanks,
Eli
On Tuesday, November 26, 2013, Haohui Mai wrote:
Hi,
Recently I've been focusing on fixing hftp / hsftp / webhdfs / swebhdfs in
various set ups. Now we have reached
Thanks Haohui for all your hard work in this area. I am +1 on this proposal.
On Tue, Nov 26, 2013 at 12:50 PM, Haohui Mai h...@hortonworks.com wrote:
Hi,
Recently I've been focusing on fixing hftp / hsftp / webhdfs / swebhdfs in
various set ups. Now we have reached the state that all the
Curious to know usage of webhdfs for Hadoop 1.0. Are people using it in
production?
Reason I ask is because we use lot of hftp to transfer data between Hadoop
1.0 and Hadoop 2.0 as of today.
Removing hftp would mean that anyone using Hadoop 1.0 and Hadoop 3.0 would
have to move to webhdfs, right?
The problem with replacing hftp with WebHDFS is caused by both the datanode web
interface and the WebHDFS servlet shareing the same jetty container. If I want
to prevent downloads via webhdfs to corportate workstations, I have to firewall
the jetty port. But firewalling the jetty port on the
Hi Lohit,
Some of our customers are running Hadoop 1.3, and they run distcp to
transfer data via webhdfs in production.
We use distcp to transfer data between Hadoop 1.x and Hadoop 2.x. As far as
I know webhdfs is the most reliable way to transfer data between secure and
insecure clusters across
Hi Adam,
I agree that having some admission controls in webhdfs would be great, and
you can sort of work around it by keeping both hftp and webhdfs around.
However, I think this is irrelevant to whether we should deprecate hftp /
hsftp.
~Haohui
On Tue, Nov 26, 2013 at 2:06 PM, Adam Faris
I meant HDP 1.3, which is based on Hadoop 1.2.
~Haohui
On Tue, Nov 26, 2013 at 2:19 PM, Haohui Mai h...@hortonworks.com wrote:
Hi Lohit,
Some of our customers are running Hadoop 1.3, and they run distcp to
transfer data via webhdfs in production.
We use distcp to transfer data between
Adam Faris created HDFS-5569:
Summary: WebHDFS should support a deny/allow list for data access
Key: HDFS-5569
URL: https://issues.apache.org/jira/browse/HDFS-5569
Project: Hadoop HDFS
Issue
Haohui Mai created HDFS-5570:
Summary: Deprecate hftp / hsftp and replace them with webhdfs /
swebhdfs
Key: HDFS-5570
URL: https://issues.apache.org/jira/browse/HDFS-5570
Project: Hadoop HDFS
Lars Hofhansl created HDFS-5571:
---
Summary: postScannerFilterRow consumes a lot of CPU in tall table
scans
Key: HDFS-5571
URL: https://issues.apache.org/jira/browse/HDFS-5571
Project: Hadoop HDFS
+1
WebHDFS has been around for two years and has become mature. It is a rewrite
of HFTP and is intended to replace HFTP as stated in my blog [1]. Now is
indeed a good time to deprecate HFTP.
Haohui, thanks a lot for adding swebhdfs and fixing the secure setups!
Tsz-Wo
[1]
Gordon Wang created HDFS-5572:
-
Summary: Hadoop NFS rpc service port is not configurable
Key: HDFS-5572
URL: https://issues.apache.org/jira/browse/HDFS-5572
Project: Hadoop HDFS
Issue Type: Bug
+1
So I've reviewed most of Haohui's patch for developing swebhdfs,
fixing https setup for hsftp, and supporting HA in webhdfs. For both
webhdfs and swebhdfs we have run system tests on both secured and
insecure cluster, including running distcp to transfer data between
1.x and 2.x. I believe
Fengdong Yu created HDFS-5573:
-
Summary: CacheAdmin doesn't work
Key: HDFS-5573
URL: https://issues.apache.org/jira/browse/HDFS-5573
Project: Hadoop HDFS
Issue Type: Bug
Components:
22 matches
Mail list logo
