[jira] [Commented] (KNOX-1517) Tests should be able to run from IDE

2018-10-05 Thread Larry McCay (JIRA)


[ 
https://issues.apache.org/jira/browse/KNOX-1517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16640515#comment-16640515
 ] 

Larry McCay commented on KNOX-1517:
---

That's a good question, [~risdenk].

I almost always just run 'mvn clean install' but I recall someone complaining 
that they want to build it once and break up the tests separately or something 
like that and just run 'mvn test'. I think it may be safe to assume install was 
run previously.

Try and reproduce the problem.

> Tests should be able to run from IDE
> 
>
> Key: KNOX-1517
> URL: https://issues.apache.org/jira/browse/KNOX-1517
> Project: Apache Knox
>  Issue Type: Improvement
>  Components: Build, Tests
>Reporter: Kevin Risden
>Assignee: Kevin Risden
>Priority: Major
> Fix For: 1.2.0
>
>
> This is a personal annoyance since I can't seem to run tests from IntelliJ 
> due to system properties and absolute paths being used. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KNOX-1080) Custom dispatch for NiFi should be moved to its own package

2018-10-05 Thread Jeff Storck (JIRA)


[ 
https://issues.apache.org/jira/browse/KNOX-1080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16640077#comment-16640077
 ] 

Jeff Storck commented on KNOX-1080:
---

[~risdenk] Thanks for the reminder.  Yes, I can create a patch for this.

> Custom dispatch for NiFi should be moved to its own package
> ---
>
> Key: KNOX-1080
> URL: https://issues.apache.org/jira/browse/KNOX-1080
> Project: Apache Knox
>  Issue Type: Improvement
>  Components: Server
>Affects Versions: 0.14.0
>Reporter: Jeff Storck
>Priority: Minor
> Fix For: 1.2.0
>
>
> The custom NiFi dispatch code should be moved from the 
> org.apache.knox.gateway.dispatch package to org.apache.knox.gateway.nifi 
> package. In addition, the default service.xml for the NiFi dispatch should be 
> updated to use the new package name.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KNOX-1517) Tests should be able to run from IDE

2018-10-05 Thread Larry McCay (JIRA)


[ 
https://issues.apache.org/jira/browse/KNOX-1517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16640088#comment-16640088
 ] 

Larry McCay commented on KNOX-1517:
---

Excellent, [~risdenk].

Let's make sure that a plan "mvn test" works as well.

> Tests should be able to run from IDE
> 
>
> Key: KNOX-1517
> URL: https://issues.apache.org/jira/browse/KNOX-1517
> Project: Apache Knox
>  Issue Type: Improvement
>  Components: Build, Tests
>Reporter: Kevin Risden
>Assignee: Kevin Risden
>Priority: Major
> Fix For: 1.2.0
>
>
> This is a personal annoyance since I can't seem to run tests from IntelliJ 
> due to system properties and absolute paths being used. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KNOX-1237) Knox DSL should support HBase Stateless Scanner

2018-10-05 Thread Dequan Chen (JIRA)


[ 
https://issues.apache.org/jira/browse/KNOX-1237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16640087#comment-16640087
 ] 

Dequan Chen commented on KNOX-1237:
---

[~risdenk] ,

As per your request, I just created [^KNOX-1237.patch] and uploaded to this 
JIRA. It is like the statefull scanner default - non inclusive for end-row.

Have a good day!

Dequan

 

 

> Knox DSL should support HBase Stateless Scanner
> ---
>
> Key: KNOX-1237
> URL: https://issues.apache.org/jira/browse/KNOX-1237
> Project: Apache Knox
>  Issue Type: Improvement
>  Components: ClientDSL
>Reporter: Kevin Risden
>Assignee: Dequan Chen
>Priority: Minor
> Attachments: KNOX-1237.patch
>
>
> KNOX-8 added support for HBase REST apis via Knox. The Knox DSL supports 
> stateful scanners as shown in the documentation 
> (https://knox.apache.org/books/knox-1-0-0/user-guide.html#table(String+tableName).scanner().create()+-+Scanner+Creation).
> HBase REST supports stateless scanners 
> ([https://hbase.apache.org/1.2/apidocs/org/apache/hadoop/hbase/rest/package-summary.html#operation_stateless_scanner])
>  which can be easily load balanced. The feature is not well documented in 
> HBase REST.
> Currently if using stateful scanners and Knox or HBase REST is being load 
> balanced, there will be an issue using that scanner. The stateless scanners 
> avoid this since they have all the information necessary.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KNOX-1517) Tests should be able to run from IDE

2018-10-05 Thread Kevin Risden (JIRA)


[ 
https://issues.apache.org/jira/browse/KNOX-1517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16640084#comment-16640084
 ] 

Kevin Risden commented on KNOX-1517:


[~lmccay] - FYI since you mentioned this over email the other day.

> Tests should be able to run from IDE
> 
>
> Key: KNOX-1517
> URL: https://issues.apache.org/jira/browse/KNOX-1517
> Project: Apache Knox
>  Issue Type: Improvement
>  Components: Build, Tests
>Reporter: Kevin Risden
>Assignee: Kevin Risden
>Priority: Major
> Fix For: 1.2.0
>
>
> This is a personal annoyance since I can't seem to run tests from IntelliJ 
> due to system properties and absolute paths being used. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (KNOX-1237) Knox DSL should support HBase Stateless Scanner

2018-10-05 Thread Dequan Chen (JIRA)


 [ 
https://issues.apache.org/jira/browse/KNOX-1237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Dequan Chen updated KNOX-1237:
--
Attachment: KNOX-1237.patch

> Knox DSL should support HBase Stateless Scanner
> ---
>
> Key: KNOX-1237
> URL: https://issues.apache.org/jira/browse/KNOX-1237
> Project: Apache Knox
>  Issue Type: Improvement
>  Components: ClientDSL
>Reporter: Kevin Risden
>Assignee: Dequan Chen
>Priority: Minor
> Attachments: KNOX-1237.patch
>
>
> KNOX-8 added support for HBase REST apis via Knox. The Knox DSL supports 
> stateful scanners as shown in the documentation 
> (https://knox.apache.org/books/knox-1-0-0/user-guide.html#table(String+tableName).scanner().create()+-+Scanner+Creation).
> HBase REST supports stateless scanners 
> ([https://hbase.apache.org/1.2/apidocs/org/apache/hadoop/hbase/rest/package-summary.html#operation_stateless_scanner])
>  which can be easily load balanced. The feature is not well documented in 
> HBase REST.
> Currently if using stateful scanners and Knox or HBase REST is being load 
> balanced, there will be an issue using that scanner. The stateless scanners 
> avoid this since they have all the information necessary.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KNOX-1517) Tests should be able to run from IDE

2018-10-05 Thread Kevin Risden (JIRA)


[ 
https://issues.apache.org/jira/browse/KNOX-1517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16640080#comment-16640080
 ] 

Kevin Risden commented on KNOX-1517:


I know one test that I don't quite understand is the search for 
"hadoop-example*.jar". I need to look at it closer to figure out why the actual 
hadoop-example jar file is needed and not just any file.

> Tests should be able to run from IDE
> 
>
> Key: KNOX-1517
> URL: https://issues.apache.org/jira/browse/KNOX-1517
> Project: Apache Knox
>  Issue Type: Improvement
>  Components: Build, Tests
>Reporter: Kevin Risden
>Assignee: Kevin Risden
>Priority: Major
> Fix For: 1.2.0
>
>
> This is a personal annoyance since I can't seem to run tests from IntelliJ 
> due to system properties and absolute paths being used. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KNOX-1516) Upgrade Jetty to 9.4.12

2018-10-05 Thread Kevin Risden (JIRA)


[ 
https://issues.apache.org/jira/browse/KNOX-1516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16639988#comment-16639988
 ] 

Kevin Risden commented on KNOX-1516:


WIP - https://github.com/apache/knox/pull/33

> Upgrade Jetty to 9.4.12
> ---
>
> Key: KNOX-1516
> URL: https://issues.apache.org/jira/browse/KNOX-1516
> Project: Apache Knox
>  Issue Type: Improvement
>Reporter: Kevin Risden
>Assignee: Kevin Risden
>Priority: Blocker
> Fix For: 1.2.0
>
>
> To support JDK 11 fully, Jetty needs to be upgraded to 9.4.12 
> (https://www.eclipse.org/lists/jetty-announce/msg00124.html)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KNOX-1517) Tests should be able to run from IDE

2018-10-05 Thread Kevin Risden (JIRA)


[ 
https://issues.apache.org/jira/browse/KNOX-1517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16639987#comment-16639987
 ] 

Kevin Risden commented on KNOX-1517:


WIP - https://github.com/apache/knox/pull/34

> Tests should be able to run from IDE
> 
>
> Key: KNOX-1517
> URL: https://issues.apache.org/jira/browse/KNOX-1517
> Project: Apache Knox
>  Issue Type: Improvement
>  Components: Build, Tests
>Reporter: Kevin Risden
>Assignee: Kevin Risden
>Priority: Major
> Fix For: 1.2.0
>
>
> This is a personal annoyance since I can't seem to run tests from IntelliJ 
> due to system properties and absolute paths being used. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KNOX-1517) Tests should be able to run from IDE

2018-10-05 Thread Kevin Risden (JIRA)


[ 
https://issues.apache.org/jira/browse/KNOX-1517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16639973#comment-16639973
 ] 

Kevin Risden commented on KNOX-1517:


This is definitely noticeable in the gateway-test module.

> Tests should be able to run from IDE
> 
>
> Key: KNOX-1517
> URL: https://issues.apache.org/jira/browse/KNOX-1517
> Project: Apache Knox
>  Issue Type: Improvement
>  Components: Build, Tests
>Reporter: Kevin Risden
>Assignee: Kevin Risden
>Priority: Major
> Fix For: 1.2.0
>
>
> This is a personal annoyance since I can't seem to run tests from IntelliJ 
> due to system properties and absolute paths being used. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Assigned] (KNOX-1237) Knox DSL should support HBase Stateless Scanner

2018-10-05 Thread Dequan Chen (JIRA)


 [ 
https://issues.apache.org/jira/browse/KNOX-1237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Dequan Chen reassigned KNOX-1237:
-

Assignee: Dequan Chen

> Knox DSL should support HBase Stateless Scanner
> ---
>
> Key: KNOX-1237
> URL: https://issues.apache.org/jira/browse/KNOX-1237
> Project: Apache Knox
>  Issue Type: Improvement
>  Components: ClientDSL
>Reporter: Kevin Risden
>Assignee: Dequan Chen
>Priority: Minor
>
> KNOX-8 added support for HBase REST apis via Knox. The Knox DSL supports 
> stateful scanners as shown in the documentation 
> (https://knox.apache.org/books/knox-1-0-0/user-guide.html#table(String+tableName).scanner().create()+-+Scanner+Creation).
> HBase REST supports stateless scanners 
> ([https://hbase.apache.org/1.2/apidocs/org/apache/hadoop/hbase/rest/package-summary.html#operation_stateless_scanner])
>  which can be easily load balanced. The feature is not well documented in 
> HBase REST.
> Currently if using stateful scanners and Knox or HBase REST is being load 
> balanced, there will be an issue using that scanner. The stateless scanners 
> avoid this since they have all the information necessary.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Work started] (KNOX-1517) Tests should be able to run from IDE

2018-10-05 Thread Kevin Risden (JIRA)


 [ 
https://issues.apache.org/jira/browse/KNOX-1517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Work on KNOX-1517 started by Kevin Risden.
--
> Tests should be able to run from IDE
> 
>
> Key: KNOX-1517
> URL: https://issues.apache.org/jira/browse/KNOX-1517
> Project: Apache Knox
>  Issue Type: Improvement
>  Components: Build, Tests
>Reporter: Kevin Risden
>Assignee: Kevin Risden
>Priority: Major
> Fix For: 1.2.0
>
>
> This is a personal annoyance since I can't seem to run tests from IntelliJ 
> due to system properties and absolute paths being used. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (KNOX-1517) Tests should be able to run from IDE

2018-10-05 Thread Kevin Risden (JIRA)
Kevin Risden created KNOX-1517:
--

 Summary: Tests should be able to run from IDE
 Key: KNOX-1517
 URL: https://issues.apache.org/jira/browse/KNOX-1517
 Project: Apache Knox
  Issue Type: Improvement
  Components: Build, Tests
Reporter: Kevin Risden
Assignee: Kevin Risden
 Fix For: 1.2.0


This is a personal annoyance since I can't seem to run tests from IntelliJ due 
to system properties and absolute paths being used. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KNOX-1237) Knox DSL should support HBase Stateless Scanner

2018-10-05 Thread Dequan Chen (JIRA)


[ 
https://issues.apache.org/jira/browse/KNOX-1237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16639969#comment-16639969
 ] 

Dequan Chen commented on KNOX-1237:
---

[~risdenk] ,

How are you?

I will create the patch for Knox Shell to run HBase statelesss scanner that is 
not inclusive. If you want an inclusive version for that, please let me know at 
your earliest convenience.

Have a good day!

Dequan

 

> Knox DSL should support HBase Stateless Scanner
> ---
>
> Key: KNOX-1237
> URL: https://issues.apache.org/jira/browse/KNOX-1237
> Project: Apache Knox
>  Issue Type: Improvement
>  Components: ClientDSL
>Reporter: Kevin Risden
>Priority: Minor
>
> KNOX-8 added support for HBase REST apis via Knox. The Knox DSL supports 
> stateful scanners as shown in the documentation 
> (https://knox.apache.org/books/knox-1-0-0/user-guide.html#table(String+tableName).scanner().create()+-+Scanner+Creation).
> HBase REST supports stateless scanners 
> ([https://hbase.apache.org/1.2/apidocs/org/apache/hadoop/hbase/rest/package-summary.html#operation_stateless_scanner])
>  which can be easily load balanced. The feature is not well documented in 
> HBase REST.
> Currently if using stateful scanners and Knox or HBase REST is being load 
> balanced, there will be an issue using that scanner. The stateless scanners 
> avoid this since they have all the information necessary.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Assigned] (KNOX-1516) Upgrade Jetty to 9.4.12

2018-10-05 Thread Kevin Risden (JIRA)


 [ 
https://issues.apache.org/jira/browse/KNOX-1516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kevin Risden reassigned KNOX-1516:
--

Assignee: Kevin Risden

> Upgrade Jetty to 9.4.12
> ---
>
> Key: KNOX-1516
> URL: https://issues.apache.org/jira/browse/KNOX-1516
> Project: Apache Knox
>  Issue Type: Improvement
>Reporter: Kevin Risden
>Assignee: Kevin Risden
>Priority: Blocker
> Fix For: 1.2.0
>
>
> To support JDK 11 fully, Jetty needs to be upgraded to 9.4.12 
> (https://www.eclipse.org/lists/jetty-announce/msg00124.html)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Work started] (KNOX-1516) Upgrade Jetty to 9.4.12

2018-10-05 Thread Kevin Risden (JIRA)


 [ 
https://issues.apache.org/jira/browse/KNOX-1516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Work on KNOX-1516 started by Kevin Risden.
--
> Upgrade Jetty to 9.4.12
> ---
>
> Key: KNOX-1516
> URL: https://issues.apache.org/jira/browse/KNOX-1516
> Project: Apache Knox
>  Issue Type: Improvement
>Reporter: Kevin Risden
>Assignee: Kevin Risden
>Priority: Blocker
> Fix For: 1.2.0
>
>
> To support JDK 11 fully, Jetty needs to be upgraded to 9.4.12 
> (https://www.eclipse.org/lists/jetty-announce/msg00124.html)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KNOX-1433) RMHaBaseDispatcher Class Cleanup - SafeModeException

2018-10-05 Thread Kevin Risden (JIRA)


[ 
https://issues.apache.org/jira/browse/KNOX-1433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16639852#comment-16639852
 ] 

Kevin Risden commented on KNOX-1433:


The only concern I have with this patch is SafeModeException is thrown when 
"body.contains("RetriableException")". I have never seen a RetriableException 
in YARN especially not in the YARN RM UI.

I checked the Hadoop source code for SafeModeException being thrown and only 
HDFS classes throw it. RetriableException is used by YARN to retry and then 
fail. I don't see it being displayed anywhere that Knox would pick it up.

> RMHaBaseDispatcher Class Cleanup - SafeModeException
> 
>
> Key: KNOX-1433
> URL: https://issues.apache.org/jira/browse/KNOX-1433
> Project: Apache Knox
>  Issue Type: Bug
>Reporter: Matthew Sharp
>Assignee: Kevin Risden
>Priority: Minor
> Fix For: 1.2.0
>
> Attachments: KNOX-1433.patch
>
>
> The RMHaBaseDispatcher appears to have been based heavily off HDFS HA 
> dispatch and has a couple areas that can be cleaned up. 
>  # SafeModeException - will never be thrown for RM
>  # retryRequest() - not used anywhere else outside SafeModeException



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KNOX-503) Tests which include expected unreachable hosts fail with wildcard DNS records

2018-10-05 Thread Kevin Risden (JIRA)


[ 
https://issues.apache.org/jira/browse/KNOX-503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16639870#comment-16639870
 ] 

Kevin Risden commented on KNOX-503:
---

Another option may be to add the trailing dot to ensure the DNS name is 
absolute.

http://www.dns-sd.org/trailingdotsindomainnames.html

> Tests which include expected unreachable hosts fail with wildcard DNS records
> -
>
> Key: KNOX-503
> URL: https://issues.apache.org/jira/browse/KNOX-503
> Project: Apache Knox
>  Issue Type: Bug
>  Components: Tests
>Affects Versions: 0.6.0
>Reporter: Kristopher Kane
>Priority: Minor
> Fix For: 1.2.0
>
> Attachments: KNOX-503-AuditLoggingTest-01.patch, 
> KNOX-503-HttpClientDispatchTest-01.patch, 
> KNOX-503-WebHdfsHaHttpClientDispatchTest-01.patch
>
>
> If the DNS zone of the build host contains wildcard DNS entries 
> (http://en.wikipedia.org/wiki/Wildcard_DNS_record) the following tests will 
> fail because 'unreachable-host' and  'outbound-host' will actually resolve: 
> AuditLoggingTest.java
> HttpClientDispatchTest.java
> WebHdfsHaHttpClientDispatchTest.java



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KNOX-503) Tests which include expected unreachable hosts fail with wildcard DNS records

2018-10-05 Thread Kevin Risden (JIRA)


[ 
https://issues.apache.org/jira/browse/KNOX-503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16639871#comment-16639871
 ] 

Kevin Risden commented on KNOX-503:
---

.local isn't a registered suffix but .invalid 
([https://en.wikipedia.org/wiki/.invalid)] is.

> Tests which include expected unreachable hosts fail with wildcard DNS records
> -
>
> Key: KNOX-503
> URL: https://issues.apache.org/jira/browse/KNOX-503
> Project: Apache Knox
>  Issue Type: Bug
>  Components: Tests
>Affects Versions: 0.6.0
>Reporter: Kristopher Kane
>Priority: Minor
> Fix For: 1.2.0
>
> Attachments: KNOX-503-AuditLoggingTest-01.patch, 
> KNOX-503-HttpClientDispatchTest-01.patch, 
> KNOX-503-WebHdfsHaHttpClientDispatchTest-01.patch
>
>
> If the DNS zone of the build host contains wildcard DNS entries 
> (http://en.wikipedia.org/wiki/Wildcard_DNS_record) the following tests will 
> fail because 'unreachable-host' and  'outbound-host' will actually resolve: 
> AuditLoggingTest.java
> HttpClientDispatchTest.java
> WebHdfsHaHttpClientDispatchTest.java



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KNOX-1152) Guard Against Missing Subject in Identity Assertion

2018-10-05 Thread Kevin Risden (JIRA)


[ 
https://issues.apache.org/jira/browse/KNOX-1152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16639848#comment-16639848
 ] 

Kevin Risden commented on KNOX-1152:


Not sure how to reproduce but updated the patch to apply cleanly.

> Guard Against Missing Subject in Identity Assertion
> ---
>
> Key: KNOX-1152
> URL: https://issues.apache.org/jira/browse/KNOX-1152
> Project: Apache Knox
>  Issue Type: Bug
>  Components: Server
>Affects Versions: 0.11.0, 0.12.0, 0.13.0, 0.14.0
>Reporter: Rick Kellogg
>Assignee: Larry McCay
>Priority: Minor
> Fix For: 1.2.0
>
> Attachments: KNOX-1152.patch, KNOX-1152B.patch
>
>
> Within the CommonIdentityAssertionFilter class, it is possible the evaluation 
> of the Subject can return null.  A check should be added for this, error 
> logged and IllegalStateException exception thrown.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (KNOX-1152) Guard Against Missing Subject in Identity Assertion

2018-10-05 Thread Kevin Risden (JIRA)


 [ 
https://issues.apache.org/jira/browse/KNOX-1152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kevin Risden updated KNOX-1152:
---
Attachment: KNOX-1152.patch

> Guard Against Missing Subject in Identity Assertion
> ---
>
> Key: KNOX-1152
> URL: https://issues.apache.org/jira/browse/KNOX-1152
> Project: Apache Knox
>  Issue Type: Bug
>  Components: Server
>Affects Versions: 0.11.0, 0.12.0, 0.13.0, 0.14.0
>Reporter: Rick Kellogg
>Assignee: Larry McCay
>Priority: Minor
> Fix For: 1.2.0
>
> Attachments: KNOX-1152.patch, KNOX-1152B.patch
>
>
> Within the CommonIdentityAssertionFilter class, it is possible the evaluation 
> of the Subject can return null.  A check should be added for this, error 
> logged and IllegalStateException exception thrown.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (KNOX-1355) Knox not honoring originalUrl when pac4j federation is used

2018-10-05 Thread Kevin Risden (JIRA)


 [ 
https://issues.apache.org/jira/browse/KNOX-1355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kevin Risden updated KNOX-1355:
---
Status: Patch Available  (was: Open)

> Knox not honoring originalUrl when pac4j federation is used
> ---
>
> Key: KNOX-1355
> URL: https://issues.apache.org/jira/browse/KNOX-1355
> Project: Apache Knox
>  Issue Type: Bug
>  Components: KnoxSSO
>Reporter: DIPAYAN BHOWMICK
>Priority: Major
> Fix For: 1.2.0
>
> Attachments: knox_fix_for_dp_keycloak.patch, knoxsso.xml, 
> sequence_diagram.txt
>
>
> I wanted to integrate Keycloak as the IdP provider for Knox using the pack4j 
> federation in Dataplane. This is for an SSO scenario and not Knox Gateway 
> proxy. So, requested to 
> gateway/knoxsso/api/v1/websso?originalUrl=https://dataplane.
> After, the redirection happens to Keycloak and successful authentication knox 
> rather than returning to the requested original URL, it is redirecting to the 
> original requestedURL (ie. 
> gateway/knoxsso/api/v1/websso?originalUrl=https://dataplane)
> The complete Sequence diagram is attached. [^sequence_diagram.txt]
> Also, knoxsso.xml is attached as an example. [^knoxsso.xml]



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (KNOX-1515) Upgrade shiro to 1.4.0 and ehcache to 2.6.11

2018-10-05 Thread Kevin Risden (JIRA)


 [ 
https://issues.apache.org/jira/browse/KNOX-1515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kevin Risden updated KNOX-1515:
---
Attachment: KNOX-1515.patch
Status: Patch Available  (was: In Progress)

> Upgrade shiro to 1.4.0 and ehcache to 2.6.11
> 
>
> Key: KNOX-1515
> URL: https://issues.apache.org/jira/browse/KNOX-1515
> Project: Apache Knox
>  Issue Type: Improvement
>Reporter: Kevin Risden
>Assignee: Kevin Risden
>Priority: Major
> Fix For: 1.2.0
>
> Attachments: KNOX-1515.patch
>
>
> shiro 1.2.6 -> 1.4.0
> ehcache-core 2.5.0 -> 2.6.11



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Comment Edited] (KNOX-1421) Enable OWASP Dependency Check

2018-10-05 Thread Kevin Risden (JIRA)


[ 
https://issues.apache.org/jira/browse/KNOX-1421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16638315#comment-16638315
 ] 

Kevin Risden edited comment on KNOX-1421 at 10/5/18 1:27 PM:
-

Attached latest report from [https://github.com/apache/knox/pull/31] (which is 
based on master with all the dependencies from KNOX-1484 upgraded). It has 
exclusions for matches that aren't correct as well.

Remaining dependencies:
 * jetty - Need to look at upgrading Jetty separately - see KNOX-1516 and 
KNOX-1431
 * hadoop - see KNOX-1501
 ** The one CVE about 3.0.0.alpha1 is incorrect but excluding it causes bad 
matches
 * htrace - Need to see if this dependency can be excluded
 * spring  -see- KNOX-1509- and KNOX-1513
 * apacheds - Looked at upgrading to AM25 instead of M24 but ran into 
DIRSERVER-224. Need to wait for next release to come out.


was (Author: risdenk):
Attached latest report from [https://github.com/apache/knox/pull/31] (which is 
based on master with all the dependencies from KNOX-1484 upgraded). It has 
exclusions for matches that aren't correct as well.

Remaining dependencies:
 * jetty - Need to look at upgrading Jetty separately - see KNOX-1516
 * hadoop - see KNOX-1501
 ** The one CVE about 3.0.0.alpha1 is incorrect but excluding it causes bad 
matches
 * htrace - Need to see if this dependency can be excluded
 * spring  -see- KNOX-1509- and KNOX-1513
 * apacheds - Looked at upgrading to AM25 instead of M24 but ran into 
DIRSERVER-224. Need to wait for next release to come out.

> Enable OWASP Dependency Check
> -
>
> Key: KNOX-1421
> URL: https://issues.apache.org/jira/browse/KNOX-1421
> Project: Apache Knox
>  Issue Type: New Feature
>  Components: Build
> Environment: All development, build, test, environments.
>Reporter: Albert Baker
>Assignee: Kevin Risden
>Priority: Major
>  Labels: build, security
> Fix For: 1.2.0
>
> Attachments: 
> dependency-check-report-58536bfa3e92a16a30297ae8ac49726b65de777d.html, 
> dependency-check-report-cb9911a25a2dae1abfd6c1e5a8ef0ee865afa4d9.html
>
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
>  Please add OWASP Dependency Check to the build (pom.xml).  OWASP DC makes an 
> outbound REST call to MITRE Common Vulnerabilities & Exposures (CVE) to 
> perform a lookup for each dependant .jar to list any/all known 
> vulnerabilities for each jar.  This step is needed because a manual MITRE CVE 
> lookup/check on the main component does not include checking for 
> vulnerabilities in components or in dependant libraries.
> OWASP Dependency check : 
> https://www.owasp.org/index.php/OWASP_Dependency_Check has plug-ins for most 
> Java build/make types (ant, maven, ivy, gradle).   
> Also, add the appropriate command to the nightly build to generate a report 
> of all known vulnerabilities in any/all third party libraries/dependencies 
> that get pulled in. example : mvn -Powasp -Dtest=false -DfailIfNoTests=false 
> clean aggregate
> Generating this report nightly/weekly will help inform the project's 
> development team if any dependant libraries have a newly discovered & 
> reported known vulnerailities.  Project teams that keep up with removing 
> vulnerabilities on a weekly basis will help protect businesses that rely on 
> these open source componets.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KNOX-1431) Upgrade Jetty version to 9.3.10

2018-10-05 Thread Kevin Risden (JIRA)


[ 
https://issues.apache.org/jira/browse/KNOX-1431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16639828#comment-16639828
 ] 

Kevin Risden commented on KNOX-1431:


[~yg54123] - Any update here? Not sure what kind of instability you are seeing 
but HBASE-19995 details a version of Jetty that has an issue under load.

> Upgrade Jetty version to 9.3.10
> ---
>
> Key: KNOX-1431
> URL: https://issues.apache.org/jira/browse/KNOX-1431
> Project: Apache Knox
>  Issue Type: Bug
>  Components: Server
>Affects Versions: 0.14.0, 1.1.0
>Reporter: Guang Yang
>Assignee: Guang Yang
>Priority: Major
> Fix For: 1.2.0
>
> Attachments: KNOX-1431.patch
>
>
> There is possible File Descriptor leak issue after EofException 
> ([https://github.com/eclipse/jetty.project/issues/634]) in lower version of 
> Jetty. So upgrading Jetty to 9.3.10 to fix the issue.
> Deployed and tested in our prod environment. It worked.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (KNOX-1516) Upgrade Jetty to 9.4.12

2018-10-05 Thread Kevin Risden (JIRA)
Kevin Risden created KNOX-1516:
--

 Summary: Upgrade Jetty to 9.4.12
 Key: KNOX-1516
 URL: https://issues.apache.org/jira/browse/KNOX-1516
 Project: Apache Knox
  Issue Type: Improvement
Reporter: Kevin Risden
 Fix For: 1.2.0


To support JDK 11 fully, Jetty needs to be upgraded to 9.4.12 
(https://www.eclipse.org/lists/jetty-announce/msg00124.html)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (KNOX-1516) Upgrade Jetty to 9.4.12

2018-10-05 Thread Kevin Risden (JIRA)


 [ 
https://issues.apache.org/jira/browse/KNOX-1516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kevin Risden updated KNOX-1516:
---
Priority: Blocker  (was: Major)

> Upgrade Jetty to 9.4.12
> ---
>
> Key: KNOX-1516
> URL: https://issues.apache.org/jira/browse/KNOX-1516
> Project: Apache Knox
>  Issue Type: Improvement
>Reporter: Kevin Risden
>Priority: Blocker
> Fix For: 1.2.0
>
>
> To support JDK 11 fully, Jetty needs to be upgraded to 9.4.12 
> (https://www.eclipse.org/lists/jetty-announce/msg00124.html)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KNOX-1516) Upgrade Jetty to 9.4.12

2018-10-05 Thread Kevin Risden (JIRA)


[ 
https://issues.apache.org/jira/browse/KNOX-1516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16639827#comment-16639827
 ] 

Kevin Risden commented on KNOX-1516:


Fix version of 1.2.0 is just to put as a marker out there. This upgrade is 
required for KNOX-1458

> Upgrade Jetty to 9.4.12
> ---
>
> Key: KNOX-1516
> URL: https://issues.apache.org/jira/browse/KNOX-1516
> Project: Apache Knox
>  Issue Type: Improvement
>Reporter: Kevin Risden
>Priority: Blocker
> Fix For: 1.2.0
>
>
> To support JDK 11 fully, Jetty needs to be upgraded to 9.4.12 
> (https://www.eclipse.org/lists/jetty-announce/msg00124.html)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (KNOX-1515) Upgrade shiro to 1.4.0 and ehcache to 2.6.11

2018-10-05 Thread Kevin Risden (JIRA)


 [ 
https://issues.apache.org/jira/browse/KNOX-1515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kevin Risden updated KNOX-1515:
---
Resolution: Fixed
Status: Resolved  (was: Patch Available)

> Upgrade shiro to 1.4.0 and ehcache to 2.6.11
> 
>
> Key: KNOX-1515
> URL: https://issues.apache.org/jira/browse/KNOX-1515
> Project: Apache Knox
>  Issue Type: Improvement
>Reporter: Kevin Risden
>Assignee: Kevin Risden
>Priority: Major
> Fix For: 1.2.0
>
> Attachments: KNOX-1515.patch
>
>
> shiro 1.2.6 -> 1.4.0
> ehcache-core 2.5.0 -> 2.6.11



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (KNOX-1515) Upgrade shiro to 1.4.0 and ehcache to 2.6.11

2018-10-05 Thread Kevin Risden (JIRA)


 [ 
https://issues.apache.org/jira/browse/KNOX-1515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kevin Risden updated KNOX-1515:
---
Issue Type: Sub-task  (was: Improvement)
Parent: KNOX-1484

> Upgrade shiro to 1.4.0 and ehcache to 2.6.11
> 
>
> Key: KNOX-1515
> URL: https://issues.apache.org/jira/browse/KNOX-1515
> Project: Apache Knox
>  Issue Type: Sub-task
>Reporter: Kevin Risden
>Assignee: Kevin Risden
>Priority: Major
> Fix For: 1.2.0
>
> Attachments: KNOX-1515.patch
>
>
> shiro 1.2.6 -> 1.4.0
> ehcache-core 2.5.0 -> 2.6.11



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KNOX-1515) Upgrade shiro to 1.4.0 and ehcache to 2.6.11

2018-10-05 Thread Kevin Risden (JIRA)


[ 
https://issues.apache.org/jira/browse/KNOX-1515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16639823#comment-16639823
 ] 

Kevin Risden commented on KNOX-1515:


https://git-wip-us.apache.org/repos/asf?p=knox.git;a=commitdiff;h=a3614db44251e644ac03c905f338faeadef8a17f

> Upgrade shiro to 1.4.0 and ehcache to 2.6.11
> 
>
> Key: KNOX-1515
> URL: https://issues.apache.org/jira/browse/KNOX-1515
> Project: Apache Knox
>  Issue Type: Improvement
>Reporter: Kevin Risden
>Assignee: Kevin Risden
>Priority: Major
> Fix For: 1.2.0
>
>
> shiro 1.2.6 -> 1.4.0
> ehcache-core 2.5.0 -> 2.6.11



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Resolved] (KNOX-1430) Potential output stream handle leak when copyLarge files in streamResponse

2018-10-05 Thread Larry McCay (JIRA)


 [ 
https://issues.apache.org/jira/browse/KNOX-1430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Larry McCay resolved KNOX-1430.
---
Resolution: Fixed

> Potential output stream handle leak when copyLarge files in streamResponse
> --
>
> Key: KNOX-1430
> URL: https://issues.apache.org/jira/browse/KNOX-1430
> Project: Apache Knox
>  Issue Type: Bug
>  Components: Server
>Affects Versions: 0.14.0, 1.1.0
>Reporter: Guang Yang
>Assignee: Guang Yang
>Priority: Major
> Fix For: 1.2.0
>
> Attachments: KNOX-1430.patch
>
>
> When Knox streams a large response, like download a 2G file through webhdfs. 
> The output stream handle will leak if there is an exception when copy the 
> large file. This fix move outputStream.close() to the finally block.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KNOX-1080) Custom dispatch for NiFi should be moved to its own package

2018-10-05 Thread Kevin Risden (JIRA)


[ 
https://issues.apache.org/jira/browse/KNOX-1080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16639806#comment-16639806
 ] 

Kevin Risden commented on KNOX-1080:


[~jtstorck] - Still planning to attach a patch for this?

> Custom dispatch for NiFi should be moved to its own package
> ---
>
> Key: KNOX-1080
> URL: https://issues.apache.org/jira/browse/KNOX-1080
> Project: Apache Knox
>  Issue Type: Improvement
>  Components: Server
>Affects Versions: 0.14.0
>Reporter: Jeff Storck
>Priority: Minor
> Fix For: 1.2.0
>
>
> The custom NiFi dispatch code should be moved from the 
> org.apache.knox.gateway.dispatch package to org.apache.knox.gateway.nifi 
> package. In addition, the default service.xml for the NiFi dispatch should be 
> updated to use the new package name.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KNOX-1237) Knox DSL should support HBase Stateless Scanner

2018-10-05 Thread Kevin Risden (JIRA)


[ 
https://issues.apache.org/jira/browse/KNOX-1237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16639801#comment-16639801
 ] 

Kevin Risden commented on KNOX-1237:


[~dequanchen] - If you were to upload a patch that would be helpful.

> Knox DSL should support HBase Stateless Scanner
> ---
>
> Key: KNOX-1237
> URL: https://issues.apache.org/jira/browse/KNOX-1237
> Project: Apache Knox
>  Issue Type: Improvement
>  Components: ClientDSL
>Reporter: Kevin Risden
>Priority: Minor
>
> KNOX-8 added support for HBase REST apis via Knox. The Knox DSL supports 
> stateful scanners as shown in the documentation 
> (https://knox.apache.org/books/knox-1-0-0/user-guide.html#table(String+tableName).scanner().create()+-+Scanner+Creation).
> HBase REST supports stateless scanners 
> ([https://hbase.apache.org/1.2/apidocs/org/apache/hadoop/hbase/rest/package-summary.html#operation_stateless_scanner])
>  which can be easily load balanced. The feature is not well documented in 
> HBase REST.
> Currently if using stateful scanners and Knox or HBase REST is being load 
> balanced, there will be an issue using that scanner. The stateless scanners 
> avoid this since they have all the information necessary.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KNOX-1430) Potential output stream handle leak when copyLarge files in streamResponse

2018-10-05 Thread Larry McCay (JIRA)


[ 
https://issues.apache.org/jira/browse/KNOX-1430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16639800#comment-16639800
 ] 

Larry McCay commented on KNOX-1430:
---

Thanks, [~risdenk]!

> Potential output stream handle leak when copyLarge files in streamResponse
> --
>
> Key: KNOX-1430
> URL: https://issues.apache.org/jira/browse/KNOX-1430
> Project: Apache Knox
>  Issue Type: Bug
>  Components: Server
>Affects Versions: 0.14.0, 1.1.0
>Reporter: Guang Yang
>Assignee: Guang Yang
>Priority: Major
> Fix For: 1.2.0
>
> Attachments: KNOX-1430.patch
>
>
> When Knox streams a large response, like download a 2G file through webhdfs. 
> The output stream handle will leak if there is an exception when copy the 
> large file. This fix move outputStream.close() to the finally block.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Assigned] (KNOX-1483) Evaluate gateway-provider-security-pac4j dependencies

2018-10-05 Thread Kevin Risden (JIRA)


 [ 
https://issues.apache.org/jira/browse/KNOX-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kevin Risden reassigned KNOX-1483:
--

Assignee: Kevin Risden

> Evaluate gateway-provider-security-pac4j dependencies
> -
>
> Key: KNOX-1483
> URL: https://issues.apache.org/jira/browse/KNOX-1483
> Project: Apache Knox
>  Issue Type: Improvement
>Reporter: Kevin Risden
>Assignee: Kevin Risden
>Priority: Minor
> Fix For: 1.2.0
>
>
> While looking at KNOX-1456, I found that there are lots of dependencies 
> pulled in for pac4j like Spring. Not sure all of these dependencies are 
> necessary.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (KNOX-1237) Knox DSL should support HBase Stateless Scanner

2018-10-05 Thread Kevin Risden (JIRA)


 [ 
https://issues.apache.org/jira/browse/KNOX-1237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kevin Risden updated KNOX-1237:
---
Fix Version/s: (was: 1.2.0)

> Knox DSL should support HBase Stateless Scanner
> ---
>
> Key: KNOX-1237
> URL: https://issues.apache.org/jira/browse/KNOX-1237
> Project: Apache Knox
>  Issue Type: Improvement
>  Components: ClientDSL
>Reporter: Kevin Risden
>Priority: Minor
>
> KNOX-8 added support for HBase REST apis via Knox. The Knox DSL supports 
> stateful scanners as shown in the documentation 
> (https://knox.apache.org/books/knox-1-0-0/user-guide.html#table(String+tableName).scanner().create()+-+Scanner+Creation).
> HBase REST supports stateless scanners 
> ([https://hbase.apache.org/1.2/apidocs/org/apache/hadoop/hbase/rest/package-summary.html#operation_stateless_scanner])
>  which can be easily load balanced. The feature is not well documented in 
> HBase REST.
> Currently if using stateful scanners and Knox or HBase REST is being load 
> balanced, there will be an issue using that scanner. The stateless scanners 
> avoid this since they have all the information necessary.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Closed] (KNOX-1483) Evaluate gateway-provider-security-pac4j dependencies

2018-10-05 Thread Kevin Risden (JIRA)


 [ 
https://issues.apache.org/jira/browse/KNOX-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kevin Risden closed KNOX-1483.
--

> Evaluate gateway-provider-security-pac4j dependencies
> -
>
> Key: KNOX-1483
> URL: https://issues.apache.org/jira/browse/KNOX-1483
> Project: Apache Knox
>  Issue Type: Improvement
>Reporter: Kevin Risden
>Assignee: Kevin Risden
>Priority: Minor
>
> While looking at KNOX-1456, I found that there are lots of dependencies 
> pulled in for pac4j like Spring. Not sure all of these dependencies are 
> necessary.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (KNOX-1483) Evaluate gateway-provider-security-pac4j dependencies

2018-10-05 Thread Kevin Risden (JIRA)


 [ 
https://issues.apache.org/jira/browse/KNOX-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kevin Risden updated KNOX-1483:
---
Fix Version/s: (was: 1.2.0)

> Evaluate gateway-provider-security-pac4j dependencies
> -
>
> Key: KNOX-1483
> URL: https://issues.apache.org/jira/browse/KNOX-1483
> Project: Apache Knox
>  Issue Type: Improvement
>Reporter: Kevin Risden
>Assignee: Kevin Risden
>Priority: Minor
>
> While looking at KNOX-1456, I found that there are lots of dependencies 
> pulled in for pac4j like Spring. Not sure all of these dependencies are 
> necessary.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Resolved] (KNOX-1483) Evaluate gateway-provider-security-pac4j dependencies

2018-10-05 Thread Kevin Risden (JIRA)


 [ 
https://issues.apache.org/jira/browse/KNOX-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kevin Risden resolved KNOX-1483.

Resolution: Duplicate

> Evaluate gateway-provider-security-pac4j dependencies
> -
>
> Key: KNOX-1483
> URL: https://issues.apache.org/jira/browse/KNOX-1483
> Project: Apache Knox
>  Issue Type: Improvement
>Reporter: Kevin Risden
>Assignee: Kevin Risden
>Priority: Minor
> Fix For: 1.2.0
>
>
> While looking at KNOX-1456, I found that there are lots of dependencies 
> pulled in for pac4j like Spring. Not sure all of these dependencies are 
> necessary.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)