[ https://issues.apache.org/jira/browse/HADOOP-12436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957296#comment-14957296 ]
Hudson commented on HADOOP-12436: --------------------------------- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2477 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2477/]) HADOOP-12436. GlobPattern regex library has performance issues with (aw: rev 0d77e85f0aa503fdb826886d867fe61c9e984073) * hadoop-project/pom.xml * hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics2/filter/AbstractPatternFilter.java * LICENSE.txt * hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics2/filter/RegexFilter.java * hadoop-common-project/hadoop-common/pom.xml * hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SaslRpcClient.java * hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/GlobPattern.java * hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestGlobPattern.java * hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics2/filter/GlobFilter.java * hadoop-common-project/hadoop-common/CHANGES.txt > GlobPattern regex library has performance issues with wildcard characters > ------------------------------------------------------------------------- > > Key: HADOOP-12436 > URL: https://issues.apache.org/jira/browse/HADOOP-12436 > Project: Hadoop Common > Issue Type: Improvement > Components: fs > Affects Versions: 2.2.0, 2.7.1 > Reporter: Matthew Paduano > Assignee: Matthew Paduano > Fix For: 3.0.0 > > Attachments: HADOOP-12436.01.patch, HADOOP-12436.02.patch, > HADOOP-12436.03.patch, HADOOP-12436.04.patch > > > java.util.regex classes have performance problems with certain wildcard > patterns. Namely, consecutive * characters in a file name (not properly > escaped as literals) will cause commands such as "hadoop fs -ls > file******name" to consume 100% CPU and probably never return in a reasonable > time (time scales with number of *'s). > Here is an example: > {noformat} > hadoop fs -touchz > /user/mattp/job_1429571161900_4222-1430338332599-tda%2D%2D\\\+\\\*\\\*\\\*\\\*\\\*\\\*\\\*\\\*\\\*\\\*\\\*\\\*\\\*\\\*\\\*\\\*\\\*\\\*\\\*\\\*\\\*\\\*\\\*\\\*\\\*\\\*\\\*\\\*\\\*\\\*\\\+\\\+\\\+...%270%27%28Stage-1430338580443-39-2000-SUCCEEDED-production%2Dhigh-1430338340360.jhist > hadoop fs -ls > /user/mattp/job_1429571161900_4222-1430338332599-tda%2D%2D+******************************+++...%270%27%28Stage-1430338580443-39-2000-SUCCEEDED-production%2Dhigh-1430338340360.jhist > {noformat} > causes: > {noformat} > PID COMMAND %CPU TIME > 14526 java 100.0 01:18.85 > {noformat} > Not every string of *'s causes this, but the above filename reproduces this > reliably. -- This message was sent by Atlassian JIRA (v6.3.4#6332)