[
https://issues.apache.org/jira/browse/TIKA-5054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18139991#comment-18139991
]
Hudson commented on TIKA-5054:
------------------------------
SUCCESS: Integrated in Jenkins build Tika ยป tika-main-jdk17 #1782 (See
[https://ci-builds.apache.org/job/Tika/job/tika-main-jdk17/1782/])
TIKA-5054: Add tika-readability and opt-in jsoup filters for JSoupParser
(#3557) (github:
[https://github.com/apache/tika/commit/27c900968959f338c96d664e15ec9342a5b0eeca])
* (edit) NOTICE.txt
* (add)
tika-parsers/tika-parsers-standard/tika-parsers-standard-modules/tika-parser-microsoft-module/src/test/java/org/apache/tika/parser/microsoft/InlineHtmlNotFilteredTest.java
* (edit) docs/modules/ROOT/pages/migration-to-4x/migrating-tika-server-4x.adoc
* (edit) docs/modules/ROOT/pages/advanced/integration-testing/tika-app.adoc
* (add)
tika-readability/src/test/java/org/apache/tika/readability/ReadabilityTest.java
* (edit)
tika-parsers/tika-parsers-standard/tika-parsers-standard-modules/tika-parser-microsoft-module/src/main/java/org/apache/tika/parser/microsoft/OutlookExtractor.java
* (edit)
tika-parsers/tika-parsers-standard/tika-parsers-standard-modules/tika-parser-microsoft-module/src/main/java/org/apache/tika/parser/microsoft/JackcessExtractor.java
* (add) tika-readability/src/main/java/org/apache/tika/readability/Dom.java
* (add)
tika-parsers/tika-parsers-standard/tika-parsers-standard-modules/tika-parser-html-module/src/main/java/org/apache/tika/parser/html/JsoupFilter.java
* (edit) tika-bom/pom.xml
* (add)
tika-parsers/tika-parsers-standard/tika-parsers-standard-modules/tika-parser-html-module/src/test/java/org/apache/tika/parser/html/ReadabilityJsoupFilterTest.java
* (add)
tika-parsers/tika-parsers-standard/tika-parsers-standard-integration-tests/src/test/resources/configs/tika-config-readability.json
* (edit) tika-app/src/main/java/org/apache/tika/cli/TikaCLI.java
* (edit)
tika-handlers/tika-handler-boilerpipe/src/main/java/org/apache/tika/sax/boilerpipe/BoilerpipeContentHandler.java
* (edit)
tika-metadata-schema/src/main/resources/org/apache/tika/metadata/metadata-key-fields.json
* (edit)
tika-parsers/tika-parsers-standard/tika-parsers-standard-modules/tika-parser-microsoft-module/src/main/java/org/apache/tika/parser/microsoft/chm/ChmParser.java
* (add)
tika-readability/src/main/java/org/apache/tika/readability/ReadabilityLimitException.java
* (add)
tika-parsers/tika-parsers-standard/tika-parsers-standard-integration-tests/src/test/java/org/apache/tika/parser/html/ReadabilityConfigTest.java
* (add)
tika-parsers/tika-parsers-standard/tika-parsers-standard-modules/tika-parser-html-module/src/main/java/org/apache/tika/parser/html/CompositeJsoupFilter.java
* (edit) tika-app/src/main/java/org/apache/tika/gui/TikaGUI.java
* (add)
tika-core/src/main/java/org/apache/tika/metadata/ReadabilityMetadata.java
* (edit) CHANGES.txt
* (edit) pom.xml
* (add)
tika-readability/src/main/java/org/apache/tika/readability/Readability.java
* (edit) docs/modules/ROOT/nav.adoc
* (edit)
tika-parsers/tika-parsers-standard/tika-parsers-standard-modules/tika-parser-mail-module/src/main/java/org/apache/tika/parser/mail/MailContentHandler.java
* (add)
tika-readability/src/main/java/org/apache/tika/readability/ReadabilityOptions.java
* (edit) docs/modules/ROOT/pages/using-tika/cli/index.adoc
* (edit)
tika-parsers/tika-parsers-standard/tika-parsers-standard-modules/tika-parser-html-module/src/main/java/org/apache/tika/parser/html/HtmlHandler.java
* (edit) tika-app/src/test/java/org/apache/tika/cli/TikaCLITest.java
* (edit)
tika-metadata-schema/src/main/resources/org/apache/tika/metadata/metadata-keys.json
* (add) tika-readability/pom.xml
* (add)
tika-readability/src/test/resources/org/apache/tika/readability/known-failures.txt
* (add) tika-readability/src/main/java/org/apache/tika/readability/MiniJson.java
* (add) tika-readability/src/main/java/org/apache/tika/readability/Article.java
* (add) tika-readability/src/main/java/org/apache/tika/readability/JsCompat.java
* (add)
tika-readability/src/test/java/org/apache/tika/readability/UpstreamTestPagesTest.java
* (edit)
tika-serialization/src/main/java/org/apache/tika/serialization/ParseContextUtils.java
* (add)
tika-parsers/tika-parsers-standard/tika-parsers-standard-modules/tika-parser-html-module/src/main/java/org/apache/tika/parser/html/ReadabilityJsoupFilter.java
* (edit)
tika-parsers/tika-parsers-standard/tika-parsers-standard-modules/tika-parser-html-module/pom.xml
* (edit)
tika-parsers/tika-parsers-standard/tika-parsers-standard-modules/tika-parser-html-module/src/main/java/org/apache/tika/parser/html/JSoupParser.java
* (add)
tika-readability/src/main/java/org/apache/tika/readability/Readerable.java
* (edit) docs/modules/ROOT/pages/configuration/index.adoc
* (add)
tika-parsers/tika-parsers-standard/tika-parsers-standard-modules/tika-parser-mail-module/src/test/java/org/apache/tika/parser/mail/InlineHtmlNotFilteredTest.java
* (add) docs/modules/ROOT/pages/configuration/jsoup-filters.adoc
> Add a port of Mozilla's Readability.js
> --------------------------------------
>
> Key: TIKA-5054
> URL: https://issues.apache.org/jira/browse/TIKA-5054
> Project: Tika
> Issue Type: Task
> Reporter: Tim Allison
> Priority: Minor
>
> The boilerpipe handler is years out of date with dodgy dependencies. The
> lowest lift "modern" version is Mozilla's Readability. The readability4j
> project hasn't been updated in a while. Let's have Claude port Mozilla's to
> Java.
> We know this won't work generally against all the noisy html in the world,
> but it does help on some types of html.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
