[jira] [Commented] (TIKA-2608) tika matlab parser incorrectly identifies content type of minified javascript file

2018-03-16 Thread Nick Burch (JIRA)

[ 
https://issues.apache.org/jira/browse/TIKA-2608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402334#comment-16402334
 ] 

Nick Burch commented on TIKA-2608:
--

We've done some detection work on JavaScript and Matlab since 1.17, any chance 
you could try with a recent nightly build of Tika and see if that has already 
fixed your issue? (Tika 1.18 is probably still 1-2 weeks off, as we're waiting 
for a new PDFBox release first)

> tika matlab parser incorrectly identifies content type of minified javascript 
> file
> --
>
> Key: TIKA-2608
> URL: https://issues.apache.org/jira/browse/TIKA-2608
> Project: Tika
>  Issue Type: Bug
>  Components: parser
>Affects Versions: 1.17
> Environment: * xwiki 10.1,
>  * Tomcat 8 (8.0.32-1ubuntu1)
>  * Ubuntu 16.04.4 LTS
>  * Oracle Java 1.8.0_161-b12
>Reporter: pdwalker
>Priority: Minor
>
> When the tika "detects" the following file, it returns the wrong content type:
> {{$ curl -I 
> [https://wiki.charltonslaw.com/xwiki/webjars/wiki%3Ait/mxgraph-editor/3.7.2/mxGraphEditor.min.js]}}
>  {{HTTP/1.1 200 OK}}
>  {{Server: nginx/1.10.3 (Ubuntu)}}
>  {{Date: Fri, 16 Mar 2018 10:09:54 GMT}}
>  {{Content-Type: text/x-matlab}}
>  {{  [snip]}}
>  {{X-Frame-Options: SAMEORIGIN}}
> However, the unminified version of the same file returns the correct type:
> {{$ curl -I 
> [https://wiki.charltonslaw.com/xwiki/webjars/wiki%3Ait/mxgraph-editor/3.7.2/mxGraphEditor.js]}}
>  {{HTTP/1.1 200 OK}}
>  {{Server: nginx/1.10.3 (Ubuntu)}}
>  {{Date: Fri, 16 Mar 2018 10:10:25 GMT}}
>  {{Content-Type: application/javascript}}
>  {{  [snip]}}
>  {{X-Frame-Options: SAMEORIGIN}}
> The problem this causes is when my xwiki installation is behind an ssl proxy 
> (nginx) and I enable the add_header X-Content-Type-Options nosniff; header.  
> Modern browsers return the following error:
> {quote}Refused to execute script from 
> '[https://wiki.charltonslaw.com/xwiki/webjars/wiki%3Ait/mxgraph-editor/3.7.2/mxGraphEditor.min.js|https://wiki.proxy.domain/xwiki/webjars/wiki%3Ait/mxgraph-editor/3.7.2/mxGraphEditor.min.js]'
>  because its MIME type ('text/x-matlab') is not executable, and strict MIME 
> type checking is enabled.
> {quote}
> My "solution" is to disable the strict mime type checking in the ssl proxy, 
> but I don't think that is idea.  It'd be better of the matlab parser didn't 
> claim random minified js files as its own.
>  
> Note:
> Edit: I  marked the problem as being with the matlab parser, but that may be 
> incorrect - I'm not sure exactly what code actually does the detection.
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (TIKA-2609) Refine Emacs Lisp file recognition (.elc)

2018-03-16 Thread Andreas Meier (JIRA)
Andreas Meier created TIKA-2609:
---

 Summary: Refine Emacs Lisp file recognition (.elc)
 Key: TIKA-2609
 URL: https://issues.apache.org/jira/browse/TIKA-2609
 Project: Tika
  Issue Type: Improvement
  Components: core
Reporter: Andreas Meier


Some newer .elc files are not recognized properly by the current matcher.
 (Tested with emacs 24.4 files from 
[https://github.com/jwiegley/emacs-release/tree/master/lisp])

I created a regex that should handle these files similar to the linux magic:
{code:java}
# Emacs 18 - this is always correct, but not very magical.
0 string \012( Emacs v18 byte-compiled Lisp data
!:mime application/x-elc
# Emacs 19+ - ver. recognition added by Ian Springer
# Also applies to XEmacs 19+ .elc files; could tell them apart with regexs
# - Chris Chittleborough 
0 string ;ELC
>4 byte >18
>4 byte <32 Emacs/XEmacs v%d byte-compiled Lisp data
!:mime application/x-elc{code}
{code:xml}

  <_comment>Emacs Lisp bytecode
  




  

  
  

{code}
Please verify the hexvalues before committing.

 

Regards

 

Andreas



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (TIKA-2608) tika matlab parser incorrectly identifies content type of minified javascript file

2018-03-16 Thread pdwalker (JIRA)

[ 
https://issues.apache.org/jira/browse/TIKA-2608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401740#comment-16401740
 ] 

pdwalker commented on TIKA-2608:


running using the tiki-app-1.17.jar on the files results in the following:

 

{{*$ java -jar tika-app-1.17.jar -d mxGraphEditor.js*}}
{{Mar 16, 2018 6:57:53 PM org.apache.tika.config.InitializableProblemHandler$3 
handleInitializableProblem}}
{{WARNING: JBIG2ImageReader not loaded. jbig2 files will be ignored}}
{{See https://pdfbox.apache.org/2.0/dependencies.html#jai-image-io}}
{{for optional dependencies.}}
{{TIFFImageWriter not loaded. tiff files will not be processed}}
{{See https://pdfbox.apache.org/2.0/dependencies.html#jai-image-io}}
{{for optional dependencies.}}
{{J2KImageReader not loaded. JPEG2000 files will not be processed.}}
{{See https://pdfbox.apache.org/2.0/dependencies.html#jai-image-io}}
{{for optional dependencies.}}{{Mar 16, 2018 6:57:54 PM 
org.apache.tika.config.InitializableProblemHandler$3 
handleInitializableProblem}}
{{WARNING: org.xerial's sqlite-jdbc is not loaded.}}
{{Please provide the jar on your classpath to parse sqlite files.}}
{{See tika-parsers/pom.xml for the correct version.}}
{{*application/javascript*}}

and

{{*$ java -jar tika-app-1.17.jar -d mxGraphEditor.min.js*}}
{{Mar 16, 2018 6:58:11 PM org.apache.tika.config.InitializableProblemHandler$3 
handleInitializableProblem}}
{{WARNING: JBIG2ImageReader not loaded. jbig2 files will be ignored}}
{{See https://pdfbox.apache.org/2.0/dependencies.html#jai-image-io}}
{{for optional dependencies.}}
{{TIFFImageWriter not loaded. tiff files will not be processed}}
{{See https://pdfbox.apache.org/2.0/dependencies.html#jai-image-io}}
{{for optional dependencies.}}
{{J2KImageReader not loaded. JPEG2000 files will not be processed.}}
{{See https://pdfbox.apache.org/2.0/dependencies.html#jai-image-io}}
{{for optional dependencies.}}{{Mar 16, 2018 6:58:11 PM 
org.apache.tika.config.InitializableProblemHandler$3 
handleInitializableProblem}}
{{WARNING: org.xerial's sqlite-jdbc is not loaded.}}
{{Please provide the jar on your classpath to parse sqlite files.}}
{{See tika-parsers/pom.xml for the correct version.}}
{{*text/x-matlab*}}

So it is reproducible.

> tika matlab parser incorrectly identifies content type of minified javascript 
> file
> --
>
> Key: TIKA-2608
> URL: https://issues.apache.org/jira/browse/TIKA-2608
> Project: Tika
>  Issue Type: Bug
>  Components: parser
>Affects Versions: 1.17
> Environment: * xwiki 10.1,
>  * Tomcat 8 (8.0.32-1ubuntu1)
>  * Ubuntu 16.04.4 LTS
>  * Oracle Java 1.8.0_161-b12
>Reporter: pdwalker
>Priority: Minor
>
> When the tika "detects" the following file, it returns the wrong content type:
> {{$ curl -I 
> [https://wiki.charltonslaw.com/xwiki/webjars/wiki%3Ait/mxgraph-editor/3.7.2/mxGraphEditor.min.js]}}
>  {{HTTP/1.1 200 OK}}
>  {{Server: nginx/1.10.3 (Ubuntu)}}
>  {{Date: Fri, 16 Mar 2018 10:09:54 GMT}}
>  {{Content-Type: text/x-matlab}}
>  {{  [snip]}}
>  {{X-Frame-Options: SAMEORIGIN}}
> However, the unminified version of the same file returns the correct type:
> {{$ curl -I 
> [https://wiki.charltonslaw.com/xwiki/webjars/wiki%3Ait/mxgraph-editor/3.7.2/mxGraphEditor.js]}}
>  {{HTTP/1.1 200 OK}}
>  {{Server: nginx/1.10.3 (Ubuntu)}}
>  {{Date: Fri, 16 Mar 2018 10:10:25 GMT}}
>  {{Content-Type: application/javascript}}
>  {{  [snip]}}
>  {{X-Frame-Options: SAMEORIGIN}}
> The problem this causes is when my xwiki installation is behind an ssl proxy 
> (nginx) and I enable the add_header X-Content-Type-Options nosniff; header.  
> Modern browsers return the following error:
> {quote}Refused to execute script from 
> '[https://wiki.charltonslaw.com/xwiki/webjars/wiki%3Ait/mxgraph-editor/3.7.2/mxGraphEditor.min.js|https://wiki.proxy.domain/xwiki/webjars/wiki%3Ait/mxgraph-editor/3.7.2/mxGraphEditor.min.js]'
>  because its MIME type ('text/x-matlab') is not executable, and strict MIME 
> type checking is enabled.
> {quote}
> My "solution" is to disable the strict mime type checking in the ssl proxy, 
> but I don't think that is idea.  It'd be better of the matlab parser didn't 
> claim random minified js files as its own.
>  
> Note:
> Edit: I  marked the problem as being with the matlab parser, but that may be 
> incorrect - I'm not sure exactly what code actually does the detection.
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Issue Comment Deleted] (TIKA-2608) tika matlab parser incorrectly identifies content type of minified javascript file

2018-03-16 Thread pdwalker (JIRA)

 [ 
https://issues.apache.org/jira/browse/TIKA-2608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

pdwalker updated TIKA-2608:
---
Comment: was deleted

(was: I tried downloading the tiki-app.jar file from 
[http://tika.apache.org/download.html,] but the jar appears corrupted and the 
sha1/md5 sums do not match what is listed on the website.  :-\)

> tika matlab parser incorrectly identifies content type of minified javascript 
> file
> --
>
> Key: TIKA-2608
> URL: https://issues.apache.org/jira/browse/TIKA-2608
> Project: Tika
>  Issue Type: Bug
>  Components: parser
>Affects Versions: 1.17
> Environment: * xwiki 10.1,
>  * Tomcat 8 (8.0.32-1ubuntu1)
>  * Ubuntu 16.04.4 LTS
>  * Oracle Java 1.8.0_161-b12
>Reporter: pdwalker
>Priority: Minor
>
> When the tika "detects" the following file, it returns the wrong content type:
> {{$ curl -I 
> [https://wiki.charltonslaw.com/xwiki/webjars/wiki%3Ait/mxgraph-editor/3.7.2/mxGraphEditor.min.js]}}
>  {{HTTP/1.1 200 OK}}
>  {{Server: nginx/1.10.3 (Ubuntu)}}
>  {{Date: Fri, 16 Mar 2018 10:09:54 GMT}}
>  {{Content-Type: text/x-matlab}}
>  {{  [snip]}}
>  {{X-Frame-Options: SAMEORIGIN}}
> However, the unminified version of the same file returns the correct type:
> {{$ curl -I 
> [https://wiki.charltonslaw.com/xwiki/webjars/wiki%3Ait/mxgraph-editor/3.7.2/mxGraphEditor.js]}}
>  {{HTTP/1.1 200 OK}}
>  {{Server: nginx/1.10.3 (Ubuntu)}}
>  {{Date: Fri, 16 Mar 2018 10:10:25 GMT}}
>  {{Content-Type: application/javascript}}
>  {{  [snip]}}
>  {{X-Frame-Options: SAMEORIGIN}}
> The problem this causes is when my xwiki installation is behind an ssl proxy 
> (nginx) and I enable the add_header X-Content-Type-Options nosniff; header.  
> Modern browsers return the following error:
> {quote}Refused to execute script from 
> '[https://wiki.charltonslaw.com/xwiki/webjars/wiki%3Ait/mxgraph-editor/3.7.2/mxGraphEditor.min.js|https://wiki.proxy.domain/xwiki/webjars/wiki%3Ait/mxgraph-editor/3.7.2/mxGraphEditor.min.js]'
>  because its MIME type ('text/x-matlab') is not executable, and strict MIME 
> type checking is enabled.
> {quote}
> My "solution" is to disable the strict mime type checking in the ssl proxy, 
> but I don't think that is idea.  It'd be better of the matlab parser didn't 
> claim random minified js files as its own.
>  
> Note:
> Edit: I  marked the problem as being with the matlab parser, but that may be 
> incorrect - I'm not sure exactly what code actually does the detection.
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (TIKA-2608) tika matlab parser incorrectly identifies content type of minified javascript file

2018-03-16 Thread pdwalker (JIRA)

[ 
https://issues.apache.org/jira/browse/TIKA-2608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401734#comment-16401734
 ] 

pdwalker commented on TIKA-2608:


I tried downloading the tiki-app.jar file from 
[http://tika.apache.org/download.html,] but the jar appears corrupted and the 
sha1/md5 sums do not match what is listed on the website.  :-\

> tika matlab parser incorrectly identifies content type of minified javascript 
> file
> --
>
> Key: TIKA-2608
> URL: https://issues.apache.org/jira/browse/TIKA-2608
> Project: Tika
>  Issue Type: Bug
>  Components: parser
>Affects Versions: 1.17
> Environment: * xwiki 10.1,
>  * Tomcat 8 (8.0.32-1ubuntu1)
>  * Ubuntu 16.04.4 LTS
>  * Oracle Java 1.8.0_161-b12
>Reporter: pdwalker
>Priority: Minor
>
> When the tika "detects" the following file, it returns the wrong content type:
> {{$ curl -I 
> [https://wiki.charltonslaw.com/xwiki/webjars/wiki%3Ait/mxgraph-editor/3.7.2/mxGraphEditor.min.js]}}
>  {{HTTP/1.1 200 OK}}
>  {{Server: nginx/1.10.3 (Ubuntu)}}
>  {{Date: Fri, 16 Mar 2018 10:09:54 GMT}}
>  {{Content-Type: text/x-matlab}}
>  {{  [snip]}}
>  {{X-Frame-Options: SAMEORIGIN}}
> However, the unminified version of the same file returns the correct type:
> {{$ curl -I 
> [https://wiki.charltonslaw.com/xwiki/webjars/wiki%3Ait/mxgraph-editor/3.7.2/mxGraphEditor.js]}}
>  {{HTTP/1.1 200 OK}}
>  {{Server: nginx/1.10.3 (Ubuntu)}}
>  {{Date: Fri, 16 Mar 2018 10:10:25 GMT}}
>  {{Content-Type: application/javascript}}
>  {{  [snip]}}
>  {{X-Frame-Options: SAMEORIGIN}}
> The problem this causes is when my xwiki installation is behind an ssl proxy 
> (nginx) and I enable the add_header X-Content-Type-Options nosniff; header.  
> Modern browsers return the following error:
> {quote}Refused to execute script from 
> '[https://wiki.charltonslaw.com/xwiki/webjars/wiki%3Ait/mxgraph-editor/3.7.2/mxGraphEditor.min.js|https://wiki.proxy.domain/xwiki/webjars/wiki%3Ait/mxgraph-editor/3.7.2/mxGraphEditor.min.js]'
>  because its MIME type ('text/x-matlab') is not executable, and strict MIME 
> type checking is enabled.
> {quote}
> My "solution" is to disable the strict mime type checking in the ssl proxy, 
> but I don't think that is idea.  It'd be better of the matlab parser didn't 
> claim random minified js files as its own.
>  
> Note:
> Edit: I  marked the problem as being with the matlab parser, but that may be 
> incorrect - I'm not sure exactly what code actually does the detection.
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (TIKA-2608) tika matlab parser incorrectly identifies content type of minified javascript file

2018-03-16 Thread pdwalker (JIRA)

 [ 
https://issues.apache.org/jira/browse/TIKA-2608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

pdwalker updated TIKA-2608:
---
Description: 
When the tika "detects" the following file, it returns the wrong content type:

{{$ curl -I 
[https://wiki.charltonslaw.com/xwiki/webjars/wiki%3Ait/mxgraph-editor/3.7.2/mxGraphEditor.min.js]}}
 {{HTTP/1.1 200 OK}}
 {{Server: nginx/1.10.3 (Ubuntu)}}
 {{Date: Fri, 16 Mar 2018 10:09:54 GMT}}
 {{Content-Type: text/x-matlab}}
 {{  [snip]}}
 {{X-Frame-Options: SAMEORIGIN}}

However, the unminified version of the same file returns the correct type:

{{$ curl -I 
[https://wiki.charltonslaw.com/xwiki/webjars/wiki%3Ait/mxgraph-editor/3.7.2/mxGraphEditor.js]}}
 {{HTTP/1.1 200 OK}}
 {{Server: nginx/1.10.3 (Ubuntu)}}
 {{Date: Fri, 16 Mar 2018 10:10:25 GMT}}
 {{Content-Type: application/javascript}}
 {{  [snip]}}
 {{X-Frame-Options: SAMEORIGIN}}

The problem this causes is when my xwiki installation is behind an ssl proxy 
(nginx) and I enable the add_header X-Content-Type-Options nosniff; header.  

Modern browsers return the following error:
{quote}Refused to execute script from 
'[https://wiki.charltonslaw.com/xwiki/webjars/wiki%3Ait/mxgraph-editor/3.7.2/mxGraphEditor.min.js|https://wiki.proxy.domain/xwiki/webjars/wiki%3Ait/mxgraph-editor/3.7.2/mxGraphEditor.min.js]'
 because its MIME type ('text/x-matlab') is not executable, and strict MIME 
type checking is enabled.
{quote}
My "solution" is to disable the strict mime type checking in the ssl proxy, but 
I don't think that is idea.  It'd be better of the matlab parser didn't claim 
random minified js files as its own.

 

Note:

Edit: I  marked the problem as being with the matlab parser, but that may be 
incorrect - I'm not sure exactly what code actually does the detection.

 

  was:
When the tika "detects" the following file, it returns the wrong content type:

{{$ curl -I 
[https://wiki.charltonslaw.com/xwiki/webjars/wiki%3Ait/mxgraph-editor/3.7.2/mxGraphEditor.min.js]}}
 {{HTTP/1.1 200 OK}}
 {{Server: nginx/1.10.3 (Ubuntu)}}
 {{Date: Fri, 16 Mar 2018 10:09:54 GMT}}
 {{Content-Type: text/x-matlab}}
{{  [snip]}}
{{X-Frame-Options: SAMEORIGIN}}

However, the unminified version of the same file returns the correct type:

{{$ curl -I 
[https://wiki.charltonslaw.com/xwiki/webjars/wiki%3Ait/mxgraph-editor/3.7.2/mxGraphEditor.js]}}
 {{HTTP/1.1 200 OK}}
 {{Server: nginx/1.10.3 (Ubuntu)}}
 {{Date: Fri, 16 Mar 2018 10:10:25 GMT}}
 {{Content-Type: application/javascript}}
{{  [snip]}}
{{X-Frame-Options: SAMEORIGIN}}

The problem this causes is when my xwiki installation is behind an ssl proxy 
(nginx) and I enable the add_header X-Content-Type-Options nosniff; header.  

Modern browsers return the following error:
{quote}Refused to execute script from 
'[https://wiki.charltonslaw.com/xwiki/webjars/wiki%3Ait/mxgraph-editor/3.7.2/mxGraphEditor.min.js|https://wiki.proxy.domain/xwiki/webjars/wiki%3Ait/mxgraph-editor/3.7.2/mxGraphEditor.min.js]'
 because its MIME type ('text/x-matlab') is not executable, and strict MIME 
type checking is enabled.
{quote}
My "solution" is to disable the strict mime type checking in the ssl proxy, but 
I don't think that is idea.  It'd be better of the matlab parser didn't claim 
random minified js files as its own.


> tika matlab parser incorrectly identifies content type of minified javascript 
> file
> --
>
> Key: TIKA-2608
> URL: https://issues.apache.org/jira/browse/TIKA-2608
> Project: Tika
>  Issue Type: Bug
>  Components: parser
>Affects Versions: 1.17
> Environment: * xwiki 10.1,
>  * Tomcat 8 (8.0.32-1ubuntu1)
>  * Ubuntu 16.04.4 LTS
>  * Oracle Java 1.8.0_161-b12
>Reporter: pdwalker
>Priority: Minor
>
> When the tika "detects" the following file, it returns the wrong content type:
> {{$ curl -I 
> [https://wiki.charltonslaw.com/xwiki/webjars/wiki%3Ait/mxgraph-editor/3.7.2/mxGraphEditor.min.js]}}
>  {{HTTP/1.1 200 OK}}
>  {{Server: nginx/1.10.3 (Ubuntu)}}
>  {{Date: Fri, 16 Mar 2018 10:09:54 GMT}}
>  {{Content-Type: text/x-matlab}}
>  {{  [snip]}}
>  {{X-Frame-Options: SAMEORIGIN}}
> However, the unminified version of the same file returns the correct type:
> {{$ curl -I 
> [https://wiki.charltonslaw.com/xwiki/webjars/wiki%3Ait/mxgraph-editor/3.7.2/mxGraphEditor.js]}}
>  {{HTTP/1.1 200 OK}}
>  {{Server: nginx/1.10.3 (Ubuntu)}}
>  {{Date: Fri, 16 Mar 2018 10:10:25 GMT}}
>  {{Content-Type: application/javascript}}
>  {{  [snip]}}
>  {{X-Frame-Options: SAMEORIGIN}}
> The problem this causes is when my xwiki installation is behind an ssl proxy 
> (nginx) and I enable the add_header X-Content-Type-Options nosniff; header.  
> Modern browsers return the following error:
> {quote}Refused to execute script from 
> 

[jira] [Updated] (TIKA-2608) tika matlab parser incorrectly identifies content type of minified javascript file

2018-03-16 Thread pdwalker (JIRA)

 [ 
https://issues.apache.org/jira/browse/TIKA-2608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

pdwalker updated TIKA-2608:
---
Description: 
When the tika "detects" the following file, it returns the wrong content type:

{{$ curl -I 
[https://wiki.charltonslaw.com/xwiki/webjars/wiki%3Ait/mxgraph-editor/3.7.2/mxGraphEditor.min.js]}}
 {{HTTP/1.1 200 OK}}
 {{Server: nginx/1.10.3 (Ubuntu)}}
 {{Date: Fri, 16 Mar 2018 10:09:54 GMT}}
 {{Content-Type: text/x-matlab}}
{{  [snip]}}
{{X-Frame-Options: SAMEORIGIN}}

However, the unminified version of the same file returns the correct type:

{{$ curl -I 
[https://wiki.charltonslaw.com/xwiki/webjars/wiki%3Ait/mxgraph-editor/3.7.2/mxGraphEditor.js]}}
 {{HTTP/1.1 200 OK}}
 {{Server: nginx/1.10.3 (Ubuntu)}}
 {{Date: Fri, 16 Mar 2018 10:10:25 GMT}}
 {{Content-Type: application/javascript}}
{{  [snip]}}
{{X-Frame-Options: SAMEORIGIN}}

The problem this causes is when my xwiki installation is behind an ssl proxy 
(nginx) and I enable the add_header X-Content-Type-Options nosniff; header.  

Modern browsers return the following error:
{quote}Refused to execute script from 
'[https://wiki.charltonslaw.com/xwiki/webjars/wiki%3Ait/mxgraph-editor/3.7.2/mxGraphEditor.min.js|https://wiki.proxy.domain/xwiki/webjars/wiki%3Ait/mxgraph-editor/3.7.2/mxGraphEditor.min.js]'
 because its MIME type ('text/x-matlab') is not executable, and strict MIME 
type checking is enabled.
{quote}
My "solution" is to disable the strict mime type checking in the ssl proxy, but 
I don't think that is idea.  It'd be better of the matlab parser didn't claim 
random minified js files as its own.

  was:
When the tika "detects" the following file, it returns the wrong content type:

{{$ curl -I 
https://wiki.charltonslaw.com/xwiki/webjars/wiki%3Ait/mxgraph-editor/3.7.2/mxGraphEditor.min.js}}
{{HTTP/1.1 200 OK}}
{{Server: nginx/1.10.3 (Ubuntu)}}
{{Date: Fri, 16 Mar 2018 10:09:54 GMT}}
{{Content-Type: text/x-matlab}}
{{Connection: keep-alive}}
{{Access-Control-Allow-Origin: *}}
{{Set-Cookie: JSESSIONID=B1FD2399240BB7BEA6EC83095806491F; Path=/xwiki/; 
HttpOnly}}
{{Cache-Control: public}}
{{Expires: Sat, 16 Mar 2019 10:09:54 GMT}}
{{Last-Modified: Fri, 16 Mar 2018 10:09:54 GMT}}
{{Strict-Transport-Security: max-age=31536000; includeSubdomains}}
{{X-Frame-Options: SAMEORIGIN}}

However, the unminified version of the same file returns the correct type:

{{$ curl -I 
https://wiki.charltonslaw.com/xwiki/webjars/wiki%3Ait/mxgraph-editor/3.7.2/mxGraphEditor.js}}
{{HTTP/1.1 200 OK}}
{{Server: nginx/1.10.3 (Ubuntu)}}
{{Date: Fri, 16 Mar 2018 10:10:25 GMT}}
{{Content-Type: application/javascript}}
{{Connection: keep-alive}}
{{Access-Control-Allow-Origin: *}}
{{Set-Cookie: JSESSIONID=604F281C24DFD6C8897F0BEBDD123339; Path=/xwiki/; 
HttpOnly}}
{{Cache-Control: public}}
{{Expires: Sat, 16 Mar 2019 10:10:25 GMT}}
{{Last-Modified: Fri, 16 Mar 2018 10:10:25 GMT}}
{{Vary: Accept-Encoding}}
{{Strict-Transport-Security: max-age=31536000; includeSubdomains}}
{{X-Frame-Options: SAMEORIGIN}}

The problem this causes is when my xwiki installation is behind an ssl proxy 
(nginx) and I enable the add_header X-Content-Type-Options nosniff; header.  

Modern browsers return the following error:
{quote}Refused to execute script from 
'[https://wiki.proxy.domain/xwiki/webjars/wiki%3Ait/mxgraph-editor/3.7.2/mxGraphEditor.min.js]'
 because its MIME type ('text/x-matlab') is not executable, and strict MIME 
type checking is enabled.
{quote}
My "solution" is to disable the strict mime type checking in the ssl proxy, but 
I don't think that is idea.  It'd be better of the matlab parser didn't claim 
random minified js files as its own.


> tika matlab parser incorrectly identifies content type of minified javascript 
> file
> --
>
> Key: TIKA-2608
> URL: https://issues.apache.org/jira/browse/TIKA-2608
> Project: Tika
>  Issue Type: Bug
>  Components: parser
>Affects Versions: 1.17
> Environment: * xwiki 10.1,
>  * Tomcat 8 (8.0.32-1ubuntu1)
>  * Ubuntu 16.04.4 LTS
>  * Oracle Java 1.8.0_161-b12
>Reporter: pdwalker
>Priority: Minor
>
> When the tika "detects" the following file, it returns the wrong content type:
> {{$ curl -I 
> [https://wiki.charltonslaw.com/xwiki/webjars/wiki%3Ait/mxgraph-editor/3.7.2/mxGraphEditor.min.js]}}
>  {{HTTP/1.1 200 OK}}
>  {{Server: nginx/1.10.3 (Ubuntu)}}
>  {{Date: Fri, 16 Mar 2018 10:09:54 GMT}}
>  {{Content-Type: text/x-matlab}}
> {{  [snip]}}
> {{X-Frame-Options: SAMEORIGIN}}
> However, the unminified version of the same file returns the correct type:
> {{$ curl -I 
> [https://wiki.charltonslaw.com/xwiki/webjars/wiki%3Ait/mxgraph-editor/3.7.2/mxGraphEditor.js]}}
>  {{HTTP/1.1 200 OK}}
>  {{Server: nginx/1.10.3 (Ubuntu)}}
>  {{Date: Fri, 16 Mar 2018 10:10:25 GMT}}
>  

[jira] [Created] (TIKA-2608) tika matlab parser incorrectly identifies content type of minified javascript file

2018-03-16 Thread pdwalker (JIRA)
pdwalker created TIKA-2608:
--

 Summary: tika matlab parser incorrectly identifies content type of 
minified javascript file
 Key: TIKA-2608
 URL: https://issues.apache.org/jira/browse/TIKA-2608
 Project: Tika
  Issue Type: Bug
  Components: parser
Affects Versions: 1.17
 Environment: * xwiki 10.1,
 * Tomcat 8 (8.0.32-1ubuntu1)
 * Ubuntu 16.04.4 LTS
 * Oracle Java 1.8.0_161-b12
Reporter: pdwalker


When the tika "detects" the following file, it returns the wrong content type:

{{$ curl -I 
https://wiki.charltonslaw.com/xwiki/webjars/wiki%3Ait/mxgraph-editor/3.7.2/mxGraphEditor.min.js}}
{{HTTP/1.1 200 OK}}
{{Server: nginx/1.10.3 (Ubuntu)}}
{{Date: Fri, 16 Mar 2018 10:09:54 GMT}}
{{Content-Type: text/x-matlab}}
{{Connection: keep-alive}}
{{Access-Control-Allow-Origin: *}}
{{Set-Cookie: JSESSIONID=B1FD2399240BB7BEA6EC83095806491F; Path=/xwiki/; 
HttpOnly}}
{{Cache-Control: public}}
{{Expires: Sat, 16 Mar 2019 10:09:54 GMT}}
{{Last-Modified: Fri, 16 Mar 2018 10:09:54 GMT}}
{{Strict-Transport-Security: max-age=31536000; includeSubdomains}}
{{X-Frame-Options: SAMEORIGIN}}

However, the unminified version of the same file returns the correct type:

{{$ curl -I 
https://wiki.charltonslaw.com/xwiki/webjars/wiki%3Ait/mxgraph-editor/3.7.2/mxGraphEditor.js}}
{{HTTP/1.1 200 OK}}
{{Server: nginx/1.10.3 (Ubuntu)}}
{{Date: Fri, 16 Mar 2018 10:10:25 GMT}}
{{Content-Type: application/javascript}}
{{Connection: keep-alive}}
{{Access-Control-Allow-Origin: *}}
{{Set-Cookie: JSESSIONID=604F281C24DFD6C8897F0BEBDD123339; Path=/xwiki/; 
HttpOnly}}
{{Cache-Control: public}}
{{Expires: Sat, 16 Mar 2019 10:10:25 GMT}}
{{Last-Modified: Fri, 16 Mar 2018 10:10:25 GMT}}
{{Vary: Accept-Encoding}}
{{Strict-Transport-Security: max-age=31536000; includeSubdomains}}
{{X-Frame-Options: SAMEORIGIN}}

The problem this causes is when my xwiki installation is behind an ssl proxy 
(nginx) and I enable the add_header X-Content-Type-Options nosniff; header.  

Modern browsers return the following error:
{quote}Refused to execute script from 
'[https://wiki.proxy.domain/xwiki/webjars/wiki%3Ait/mxgraph-editor/3.7.2/mxGraphEditor.min.js]'
 because its MIME type ('text/x-matlab') is not executable, and strict MIME 
type checking is enabled.
{quote}
My "solution" is to disable the strict mime type checking in the ssl proxy, but 
I don't think that is idea.  It'd be better of the matlab parser didn't claim 
random minified js files as its own.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)