[jira] [Created] (HADOOP-13873) log DNS addresses on s3a init

2016-12-08 Thread Steve Loughran (JIRA) 
Steve Loughran created HADOOP-13873:
---

 Summary: log DNS addresses on s3a init
 Key: HADOOP-13873
 URL: https://issues.apache.org/jira/browse/HADOOP-13873
 Project: Hadoop Common
  Issue Type: Sub-task
  Components: fs/s3
Reporter: Steve Loughran
Priority: Minor


HADOOP-13871 has shown that network problems can kill perf, and that it's v. 
hard to track down, even if you turn up the logging in hadoop.fs.s3a and 
com.amazon layers to debug.

we could maybe improve things by printing out the IPAddress of the s3 endpoint, 
as that could help with the network tracing. Printing from within hadoop shows 
the one given to S3a, not a different one returned by any load balancer.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2016-12-08 Thread Apache Jenkins Server 
For more details, see 
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/249/

[Dec 7, 2016 4:26:09 PM] (mingma) HDFS-10206. Datanodes not sorted properly by 
distance when the reader
[Dec 7, 2016 6:57:25 PM] (Sunil) YARN-5965. Retrospect 
ApplicationReport#getApplicationTimeouts.
[Dec 7, 2016 7:12:14 PM] (templedf) YARN-5136. Error in handling event type 
APP_ATTEMPT_REMOVED to the
[Dec 7, 2016 9:36:49 PM] (kasha) MAPREDUCE-6817. The format of job start time 
in JHS is different from
[Dec 7, 2016 11:07:25 PM] (rkanter) YARN-5963. Spelling errors in logging and 
exceptions for node manager,
[Dec 7, 2016 11:52:16 PM] (wang) HDFS-8630. WebHDFS : Support get/set/unset 
StoragePolicy. Contributed by
[Dec 8, 2016 2:06:25 AM] (aajisaka) HADOOP-13842. Update jackson from 1.9.13 to 
2.x in hadoop-maven-plugins.
[Dec 8, 2016 2:27:58 AM] (aajisaka) MAPREDUCE-4683. Create and distribute
[Dec 8, 2016 4:34:45 AM] (aajisaka) HDFS-11140. Directory Scanner should log 
startup message time correctly.
[Dec 8, 2016 4:37:06 AM] (aajisaka) Revert "HDFS-11140. Directory Scanner 
should log startup message time
[Dec 8, 2016 4:38:02 AM] (aajisaka) HDFS-11140. Directory Scanner should log 
startup message time correctly.




-1 overall


The following subsystems voted -1:
asflicense findbugs unit


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

Failed junit tests :

   hadoop.fs.viewfs.TestViewFileSystemWithAuthorityLocalFileSystem 
   hadoop.hdfs.TestErasureCodeBenchmarkThroughput 
   hadoop.yarn.server.timeline.webapp.TestTimelineWebServices 
   hadoop.yarn.server.TestContainerManagerSecurity 
   hadoop.yarn.server.TestMiniYarnClusterNodeUtilization 
  

   cc:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/249/artifact/out/diff-compile-cc-root.txt
  [4.0K]

   javac:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/249/artifact/out/diff-compile-javac-root.txt
  [168K]

   checkstyle:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/249/artifact/out/diff-checkstyle-root.txt
  [16M]

   pylint:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/249/artifact/out/diff-patch-pylint.txt
  [20K]

   shellcheck:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/249/artifact/out/diff-patch-shellcheck.txt
  [28K]

   shelldocs:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/249/artifact/out/diff-patch-shelldocs.txt
  [16K]

   whitespace:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/249/artifact/out/whitespace-eol.txt
  [11M]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/249/artifact/out/whitespace-tabs.txt
  [1.3M]

   findbugs:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/249/artifact/out/branch-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests.txt
  [4.0K]

   javadoc:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/249/artifact/out/diff-javadoc-javadoc-root.txt
  [2.2M]

   unit:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/249/artifact/out/patch-unit-hadoop-common-project_hadoop-common.txt
  [124K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/249/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
  [152K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/249/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-applicationhistoryservice.txt
  [12K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/249/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests.txt
  [316K]

   asflicense:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/249/artifact/out/patch-asflicense-problems.txt
  [4.0K]

Powered by Apache Yetus 0.4.0-SNAPSHOT   http://yetus.apache.org



-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org

[jira] [Created] (HADOOP-13874) TestSSLHttpServer failures

2016-12-08 Thread John Zhuge (JIRA) 
John Zhuge created HADOOP-13874:
---

 Summary: TestSSLHttpServer failures
 Key: HADOOP-13874
 URL: https://issues.apache.org/jira/browse/HADOOP-13874
 Project: Hadoop Common
  Issue Type: Bug
  Components: security, test
Affects Versions: 3.0.0-alpha2
Reporter: John Zhuge
Assignee: John Zhuge
Priority: Critical


All exceptions look like "Cannot support ... with currently installed 
providers". I am running Centos 7.2.1511 and native enabled.
{noformat}
Tests run: 5, Failures: 0, Errors: 3, Skipped: 0, Time elapsed: 1.593 sec <<< 
FAILURE! - in org.apache.hadoop.http.TestSSLHttpServer
testExclusiveEnabledCiphers(org.apache.hadoop.http.TestSSLHttpServer)  Time 
elapsed: 0.012 sec  <<< ERROR!
java.lang.IllegalArgumentException: Cannot support 
TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA with currently installed providers
at sun.security.ssl.CipherSuiteList.(CipherSuiteList.java:92)
at 
sun.security.ssl.SSLSocketImpl.setEnabledCipherSuites(SSLSocketImpl.java:2461)
at 
org.apache.hadoop.http.TestSSLHttpServer$PrefferedCipherSSLSocketFactory.createSocket(TestSSLHttpServer.java:269)
at 
sun.net.www.protocol.https.HttpsClient.afterConnect(HttpsClient.java:436)
at 
sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.connect(AbstractDelegateHttpsURLConnection.java:185)
at 
sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1513)
at 
sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441)
at 
sun.net.www.protocol.https.HttpsURLConnectionImpl.getInputStream(HttpsURLConnectionImpl.java:254)
at 
org.apache.hadoop.http.TestSSLHttpServer.testExclusiveEnabledCiphers(TestSSLHttpServer.java:227)

testOneEnabledCiphers(org.apache.hadoop.http.TestSSLHttpServer)  Time elapsed: 
0.004 sec  <<< ERROR!
java.lang.IllegalArgumentException: Cannot support 
TLS_ECDHE_RSA_WITH_RC4_128_SHA with currently installed providers
at sun.security.ssl.CipherSuiteList.(CipherSuiteList.java:92)
at 
sun.security.ssl.SSLSocketImpl.setEnabledCipherSuites(SSLSocketImpl.java:2461)
at 
org.apache.hadoop.http.TestSSLHttpServer$PrefferedCipherSSLSocketFactory.createSocket(TestSSLHttpServer.java:269)
at 
sun.net.www.protocol.https.HttpsClient.afterConnect(HttpsClient.java:436)
at 
sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.connect(AbstractDelegateHttpsURLConnection.java:185)
at 
sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1513)
at 
sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441)
at 
sun.net.www.protocol.https.HttpsURLConnectionImpl.getInputStream(HttpsURLConnectionImpl.java:254)
at 
org.apache.hadoop.http.TestSSLHttpServer.testOneEnabledCiphers(TestSSLHttpServer.java:200)

testExcludedCiphers(org.apache.hadoop.http.TestSSLHttpServer)  Time elapsed: 
0.015 sec  <<< ERROR!
java.lang.IllegalArgumentException: Cannot support 
TLS_ECDHE_RSA_WITH_RC4_128_SHA with currently installed providers
at sun.security.ssl.CipherSuiteList.(CipherSuiteList.java:92)
at 
sun.security.ssl.SSLSocketImpl.setEnabledCipherSuites(SSLSocketImpl.java:2461)
at 
org.apache.hadoop.http.TestSSLHttpServer$PrefferedCipherSSLSocketFactory.createSocket(TestSSLHttpServer.java:269)
at 
sun.net.www.protocol.https.HttpsClient.afterConnect(HttpsClient.java:436)
at 
sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.connect(AbstractDelegateHttpsURLConnection.java:185)
at 
sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1513)
at 
sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441)
at 
sun.net.www.protocol.https.HttpsURLConnectionImpl.getInputStream(HttpsURLConnectionImpl.java:254)
at 
org.apache.hadoop.http.TestSSLHttpServer.testExcludedCiphers(TestSSLHttpServer.java:176)
{noformat}

My source tree sync'd to:
{noformat}
9ef89ed HDFS-11140. Directory Scanner should log startup message time 
correctly. Contributed by Yiqun Lin.
{noformat}

My SSL environment:
{noformat}
$ curl -sS https://www.howsmyssl.com/a/check | python -m json.tool
{
"able_to_detect_n_minus_one_splitting": false,
"beast_vuln": false,
"ephemeral_keys_supported": true,
"given_cipher_suites": [
"TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384",
"TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA",
"TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256",
"TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA",
"TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384",
"TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA",
"TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256",
"TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA",
"TLS_DHE_RSA_WITH_AES_256_GCM_SHA384

[jira] [Created] (HADOOP-13875) HttpServer2 should support more SSL configuration properties

2016-12-08 Thread John Zhuge (JIRA) 
John Zhuge created HADOOP-13875:
---

 Summary: HttpServer2 should support more SSL configuration 
properties
 Key: HADOOP-13875
 URL: https://issues.apache.org/jira/browse/HADOOP-13875
 Project: Hadoop Common
  Issue Type: Improvement
  Components: security
Affects Versions: 3.0.0-alpha2
Reporter: John Zhuge
Assignee: John Zhuge


Support more SSL configuration properties:
- enabled.protocols
- includeProtocols/excludeProtocols/includeCipherSuites/excludeCipherSuites



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org

intermittent performance problems with branch-2.8 and s3 reads

2016-12-08 Thread Steve Loughran 
Has anyone else seen: https://issues.apache.org/jira/browse/HADOOP-13871

It's new, and I'm hoping just some local env/network problem.

Apache Hadoop qbt Report: trunk+JDK8 on Linux/ppc64le

2016-12-08 Thread Apache Jenkins Server 
For more details, see 
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/180/

[Dec 7, 2016 4:26:09 PM] (mingma) HDFS-10206. Datanodes not sorted properly by 
distance when the reader
[Dec 7, 2016 6:57:25 PM] (Sunil) YARN-5965. Retrospect 
ApplicationReport#getApplicationTimeouts.
[Dec 7, 2016 7:12:14 PM] (templedf) YARN-5136. Error in handling event type 
APP_ATTEMPT_REMOVED to the
[Dec 7, 2016 9:36:49 PM] (kasha) MAPREDUCE-6817. The format of job start time 
in JHS is different from
[Dec 7, 2016 11:07:25 PM] (rkanter) YARN-5963. Spelling errors in logging and 
exceptions for node manager,
[Dec 7, 2016 11:52:16 PM] (wang) HDFS-8630. WebHDFS : Support get/set/unset 
StoragePolicy. Contributed by
[Dec 8, 2016 2:06:25 AM] (aajisaka) HADOOP-13842. Update jackson from 1.9.13 to 
2.x in hadoop-maven-plugins.
[Dec 8, 2016 2:27:58 AM] (aajisaka) MAPREDUCE-4683. Create and distribute
[Dec 8, 2016 4:34:45 AM] (aajisaka) HDFS-11140. Directory Scanner should log 
startup message time correctly.
[Dec 8, 2016 4:37:06 AM] (aajisaka) Revert "HDFS-11140. Directory Scanner 
should log startup message time
[Dec 8, 2016 4:38:02 AM] (aajisaka) HDFS-11140. Directory Scanner should log 
startup message time correctly.
[Dec 8, 2016 10:23:56 AM] (sunilg) YARN-5970. Validate application update 
timeout request parameters.
[Dec 8, 2016 11:52:24 AM] (aajisaka) HDFS-11223. Fix typos in HttpFs 
documentations. Contributed by Yiqun
[Dec 8, 2016 1:27:43 PM] (brahma) HADOOP-13867. FilterFileSystem should 
override rename(.., options) to




-1 overall


The following subsystems voted -1:
compile unit


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc javac


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

Failed junit tests :

   hadoop.hdfs.TestEncryptedTransfer 
   hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer 
   hadoop.hdfs.web.TestWebHdfsTimeouts 
   hadoop.yarn.server.nodemanager.recovery.TestNMLeveldbStateStoreService 
   
hadoop.yarn.server.nodemanager.containermanager.logaggregation.TestLogAggregationService
 
   hadoop.yarn.server.nodemanager.TestNodeManagerShutdown 
   hadoop.yarn.server.timeline.TestRollingLevelDB 
   hadoop.yarn.server.timeline.TestTimelineDataManager 
   hadoop.yarn.server.timeline.TestLeveldbTimelineStore 
   hadoop.yarn.server.timeline.webapp.TestTimelineWebServices 
   hadoop.yarn.server.timeline.recovery.TestLeveldbTimelineStateStore 
   hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore 
   
hadoop.yarn.server.applicationhistoryservice.TestApplicationHistoryServer 
   hadoop.yarn.server.timelineservice.storage.common.TestRowKeys 
   hadoop.yarn.server.timelineservice.storage.common.TestKeyConverters 
   hadoop.yarn.server.timelineservice.storage.common.TestSeparator 
   hadoop.yarn.server.resourcemanager.recovery.TestLeveldbRMStateStore 
   hadoop.yarn.server.resourcemanager.TestRMRestart 
   hadoop.yarn.server.resourcemanager.TestResourceTrackerService 
   hadoop.yarn.server.TestMiniYarnClusterNodeUtilization 
   hadoop.yarn.server.TestContainerManagerSecurity 
   hadoop.yarn.server.timeline.TestLevelDBCacheTimelineStore 
   hadoop.yarn.server.timeline.TestOverrideTimelineStoreYarnClient 
   hadoop.yarn.server.timeline.TestEntityGroupFSTimelineStore 
   hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageApps 
   
hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRunCompaction
 
   
hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageEntities 
   hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRun 
   
hadoop.yarn.server.timelineservice.storage.TestPhoenixOfflineAggregationWriterImpl
 
   
hadoop.yarn.server.timelineservice.reader.TestTimelineReaderWebServicesHBaseStorage
 
   
hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowActivity 
   hadoop.yarn.applications.distributedshell.TestDistributedShell 
   hadoop.mapred.TestShuffleHandler 
   hadoop.mapreduce.v2.hs.TestHistoryServerLeveldbStateStoreService 

Timed out junit tests :

   org.apache.hadoop.hdfs.server.datanode.TestFsDatasetCache 
  

   compile:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/180/artifact/out/patch-compile-root.txt
  [176K]

   cc:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/180/artifact/out/patch-compile-root.txt
  [176K]

   javac:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/180/artifact/out/patch-compile-root.txt
  [176K]

   unit:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/180/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
  [200K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/180/artifact/out/patch-

[jira] [Created] (HADOOP-13876) S3Guard: better support for multi-bucket access including read-only

2016-12-08 Thread Aaron Fabbri (JIRA) 
Aaron Fabbri created HADOOP-13876:
-

 Summary: S3Guard: better support for multi-bucket access including 
read-only
 Key: HADOOP-13876
 URL: https://issues.apache.org/jira/browse/HADOOP-13876
 Project: Hadoop Common
  Issue Type: Sub-task
  Components: fs/s3
Affects Versions: HADOOP-13345
Reporter: Aaron Fabbri


HADOOP-13449 adds support for DynamoDBMetadataStore.

The code currently supports two options for choosing DynamoDB table names:
1. Use name of each s3 bucket and auto-create a DynamoDB table for each.
2. Configure a table name in the {{fs.s3a.s3guard.ddb.table}} parameter.

One of the issues is with accessing read-only buckets.  If a user accesses a 
read-only bucket with credentials that do not have DynamoDB write permissions, 
they will get errors when trying to access the read-only bucket.  This 
manifests causes test failures for {{ITestS3AAWSCredentialsProvider}}.

Goals for this JIRA:
- Fix {{ITestS3AAWSCredentialsProvider}} in a way that makes sense for the real 
use-case.
- Allow for a "one DynamoDB table per cluster" configuration with a way to 
chose which credentials are used for DynamoDB.
- Document limitations etc. in the s3guard.md site doc.





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org

[jira] [Created] (HADOOP-13877) S3Guard: fix TestDynamoDBMetadataStore when fs.s3a.s3guard.ddb.table is set

2016-12-08 Thread Aaron Fabbri (JIRA) 
Aaron Fabbri created HADOOP-13877:
-

 Summary: S3Guard: fix TestDynamoDBMetadataStore when 
fs.s3a.s3guard.ddb.table is set
 Key: HADOOP-13877
 URL: https://issues.apache.org/jira/browse/HADOOP-13877
 Project: Hadoop Common
  Issue Type: Sub-task
  Components: fs/s3
Affects Versions: HADOOP-13345
Reporter: Aaron Fabbri
Assignee: Aaron Fabbri


I see a couple of failures in the DynamoDB MetadataStore unit test when I set 
{{fs.s3a.s3guard.ddb.table}} in my test/resources/core-site.xml.

I have a fix already, so I'll take this JIRA.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org

[jira] [Reopened] (HADOOP-13852) hadoop build to allow hadoop version property to be explicitly set

2016-12-08 Thread Akira Ajisaka (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HADOOP-13852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira Ajisaka reopened HADOOP-13852:


Reverted this commit. Hi [~ste...@apache.org], would you move the setting to 
hadoop-project pom.xml?

> hadoop build to allow hadoop version property to be explicitly set
> --
>
> Key: HADOOP-13852
> URL: https://issues.apache.org/jira/browse/HADOOP-13852
> Project: Hadoop Common
>  Issue Type: New Feature
>  Components: build
>Affects Versions: 3.0.0-alpha1, 3.0.0-alpha2
>Reporter: Steve Loughran
>Assignee: Steve Loughran
>Priority: Minor
> Fix For: 3.0.0-alpha2
>
> Attachments: HADOOP-13852-001.patch, HADOOP-13852-002.patch
>
>
> Hive (and transitively) Spark, won't start on Hadoop 3.x as the shim layer 
> rejects Hadoop v3. As a workaround pending a Hive fix, allow the build to 
> have the Hadoop version (currently set to pom.version) to be overridden 
> manually.
> This will not affect version names of artifacts, merely the declared Hadoop 
> version visible in {{VersionInfo.getVersion()}}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org

[jira] [Created] (HADOOP-13878) Remove the usage of long deprecated UTF8 class

2016-12-08 Thread Akira Ajisaka (JIRA) 
Akira Ajisaka created HADOOP-13878:
--

 Summary: Remove the usage of long deprecated UTF8 class
 Key: HADOOP-13878
 URL: https://issues.apache.org/jira/browse/HADOOP-13878
 Project: Hadoop Common
  Issue Type: Improvement
Reporter: Akira Ajisaka






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org

Re: DI framework

2016-12-08 Thread John Zhuge 
Wow, it is extremely light weight! Surprised that it doesn't even use JSR
330.

John Zhuge
Software Engineer, Cloudera

On Sat, Nov 26, 2016 at 2:37 PM, Saikat Kanjilal 
wrote:

> https://github.com/pmazak/Spit-DI
>
>
> http://paulmazak.blogspot.com/2015/06/dependency-injection-on-hadoop.html
> 
> Dependency Injection on Hadoop (without Guice)
> 
> paulmazak.blogspot.com
> Does your Java map-reduce code look like a bunch of dominoes strung
> together, in which you can't play one piece until you have the other ...
>
>
>
>
> I've used spring in the past but this seems like a framework that has some
> potential.
> 
> GitHub - pmazak/Spit-DI: Spit is a lightweight dependency ...
> 
> github.com
> Spit-DI - Spit is a lightweight dependency injection class for Java.
>
>
>
>
> --
> *From:* John Zhuge 
> *Sent:* Saturday, November 26, 2016 2:23 PM
> *To:* common-dev@hadoop.apache.org
> *Subject:* Re: DI framework
>
> Guice is being used in production by YARN; in testing in by MapReduce and
> YARN.
>
> John Zhuge
> Software Engineer, Cloudera
>
> On Sat, Nov 26, 2016 at 12:52 PM, John Zhuge  wrote:
>
> > Hi all,
> >
> > Has there been any discussion on whether to use a DI (Dependency
> > Injection) framework? Which DI framework? Anybody got experience with
> > Dagger 2?
> >
> > Thanks,
> > John Zhuge
> > Software Engineer, Cloudera
> >
>

[jira] [Created] (HADOOP-13879) Remove deprecated FileSystem.getServerDefaults()

2016-12-08 Thread Akira Ajisaka (JIRA) 
Akira Ajisaka created HADOOP-13879:
--

 Summary: Remove deprecated FileSystem.getServerDefaults()
 Key: HADOOP-13879
 URL: https://issues.apache.org/jira/browse/HADOOP-13879
 Project: Hadoop Common
  Issue Type: Improvement
Reporter: Akira Ajisaka
Assignee: Akira Ajisaka






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org