[jira] [Updated] (NIFI-8518) Include edge case for JSON keys that contain whitespace in EvaluateJsonPath documentation
[
https://issues.apache.org/jira/browse/NIFI-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthew Lannan updated NIFI-8518:
-
Summary: Include edge case for JSON keys that contain whitespace in
EvaluateJsonPath documentation (was: Include edge case for JSON keys with
whitespace in EvaluateJsonPath documentation)
> Include edge case for JSON keys that contain whitespace in EvaluateJsonPath
> documentation
> -
>
> Key: NIFI-8518
> URL: https://issues.apache.org/jira/browse/NIFI-8518
> Project: Apache NiFi
> Issue Type: Improvement
> Components: Documentation & Website
>Affects Versions: 1.13.2
> Environment: Mac, BigSur 11.2.3, 32MB RAM, 8 Core Intel i9, 1 TB
> storage
>Reporter: Matthew Lannan
>Priority: Minor
> Labels: documentation, easyfix
>
> I would say this is borderline buggish - since
> {code:java}
> "bike color":{code}
> is a valid JSON key. However, EvaluateJsonPath will say
> {code:java}
> $.bike color{code}
> is not valid.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (NIFI-8518) Include edge case for JSON keys with whitespace in EvaluateJsonPath documentation
[
https://issues.apache.org/jira/browse/NIFI-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17339841#comment-17339841
]
Matthew Lannan commented on NIFI-8518:
--
Created PR : https://github.com/apache/nifi/pull/5058
> Include edge case for JSON keys with whitespace in EvaluateJsonPath
> documentation
> -
>
> Key: NIFI-8518
> URL: https://issues.apache.org/jira/browse/NIFI-8518
> Project: Apache NiFi
> Issue Type: Improvement
> Components: Documentation & Website
>Affects Versions: 1.13.2
> Environment: Mac, BigSur 11.2.3, 32MB RAM, 8 Core Intel i9, 1 TB
> storage
>Reporter: Matthew Lannan
>Priority: Minor
> Labels: documentation, easyfix
>
> I would say this is borderline buggish - since
> {code:java}
> "bike color":{code}
> is a valid JSON key. However, EvaluateJsonPath will say
> {code:java}
> $.bike color{code}
> is not valid.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (NIFI-8518) Include edge case for JSON keys with whitespace in EvaluateJsonPath documentation
Matthew Lannan created NIFI-8518:
Summary: Include edge case for JSON keys with whitespace in
EvaluateJsonPath documentation
Key: NIFI-8518
URL: https://issues.apache.org/jira/browse/NIFI-8518
Project: Apache NiFi
Issue Type: Improvement
Components: Documentation & Website
Affects Versions: 1.13.2
Environment: Mac, BigSur 11.2.3, 32MB RAM, 8 Core Intel i9, 1 TB
storage
Reporter: Matthew Lannan
I would say this is borderline buggish - since
{code:java}
"bike color":{code}
is a valid JSON key. However, EvaluateJsonPath will say
{code:java}
$.bike color{code}
is not valid.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (NIFI-8437) RecordReader 'Infer Schema' for large records may throw BufferedInputStream error
[
https://issues.apache.org/jira/browse/NIFI-8437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17325083#comment-17325083
]
Matthew Lannan commented on NIFI-8437:
--
Looks like a simple fix would be to check if the InputStream is markSupported
before calling reset().
{code:java}
finally { if(contentStream.markSupported()){contentStream.reset(); }}{code}
https://github.com/apache/nifi/blob/7fe8858d22f580ad9dcd96ebafb59dbe5e73f5cb/nifi-nar-bundles/nifi-standard-services/nifi-record-serialization-services-bundle/nifi-record-serialization-services/src/main/java/org/apache/nifi/schema/inference/InferSchemaAccessStrategy.java#L54
> RecordReader 'Infer Schema' for large records may throw BufferedInputStream
> error
> -
>
> Key: NIFI-8437
> URL: https://issues.apache.org/jira/browse/NIFI-8437
> Project: Apache NiFi
> Issue Type: Bug
> Components: Core Framework
>Affects Versions: 1.12.1
> Environment: Mac, BigSur 11.2.3, 32MB RAM, 8 Core Intel i9, 1 TB
> storage
>Reporter: Matthew Lannan
>Priority: Major
> Labels: easyfix, newbie
> Attachments: Nifi-stack-trace.txt,
> PDF_Encode_Decode_template-with-bug.xml
>
>
> In the RecordReader(s), if the Schema Access Strategy is set to Infer Schema
> and the record is a single large record(tested with record ~50MB), the
> InferSchemaAccessStrategy will error.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (NIFI-8437) RecordReader 'Infer Schema' for large records may throw BufferedInputStream error
[ https://issues.apache.org/jira/browse/NIFI-8437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17324014#comment-17324014 ] Matthew Lannan commented on NIFI-8437: -- Not sure it warrants a code change, it may suffice to just provide a warning in the processor's PropertyDescriptor. e.g. Can not infer schema for records larger than 10MB(or whatever the threshold is). > RecordReader 'Infer Schema' for large records may throw BufferedInputStream > error > - > > Key: NIFI-8437 > URL: https://issues.apache.org/jira/browse/NIFI-8437 > Project: Apache NiFi > Issue Type: Bug > Components: Core Framework >Affects Versions: 1.12.1 > Environment: Mac, BigSur 11.2.3, 32MB RAM, 8 Core Intel i9, 1 TB > storage >Reporter: Matthew Lannan >Priority: Major > Labels: easyfix, newbie > Attachments: Nifi-stack-trace.txt, > PDF_Encode_Decode_template-with-bug.xml > > > In the RecordReader(s), if the Schema Access Strategy is set to Infer Schema > and the record is a single large record(tested with record ~50MB), the > InferSchemaAccessStrategy will error. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (NIFI-8437) RecordReader 'Infer Schema' for large records may throw BufferedInputStream error
[ https://issues.apache.org/jira/browse/NIFI-8437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthew Lannan updated NIFI-8437: - Description: In the RecordReader(s), if the Schema Access Strategy is set to Infer Schema and the record is a single large record(tested with record ~50MB), the InferSchemaAccessStrategy will error. (was: In the `RecordReader(s)`, if the `Schema Access Strategy` is set to `Infer Schema` and the record is a single large record(tested with record ~50MB), the InferSchemaAccessStrategy will error.) > RecordReader 'Infer Schema' for large records may throw BufferedInputStream > error > - > > Key: NIFI-8437 > URL: https://issues.apache.org/jira/browse/NIFI-8437 > Project: Apache NiFi > Issue Type: Bug > Components: Core Framework >Affects Versions: 1.12.1 > Environment: Mac, BigSur 11.2.3, 32MB RAM, 8 Core Intel i9, 1 TB > storage >Reporter: Matthew Lannan >Priority: Major > Labels: easyfix, newbie > Attachments: Nifi-stack-trace.txt, > PDF_Encode_Decode_template-with-bug.xml > > > In the RecordReader(s), if the Schema Access Strategy is set to Infer Schema > and the record is a single large record(tested with record ~50MB), the > InferSchemaAccessStrategy will error. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (NIFI-8437) RecordReader 'Infer Schema' for large records may throw BufferedInputStream error
Matthew Lannan created NIFI-8437: Summary: RecordReader 'Infer Schema' for large records may throw BufferedInputStream error Key: NIFI-8437 URL: https://issues.apache.org/jira/browse/NIFI-8437 Project: Apache NiFi Issue Type: Bug Components: Core Framework Affects Versions: 1.12.1 Environment: Mac, BigSur 11.2.3, 32MB RAM, 8 Core Intel i9, 1 TB storage Reporter: Matthew Lannan Attachments: Nifi-stack-trace.txt, PDF_Encode_Decode_template-with-bug.xml In the `RecordReader(s)`, if the `Schema Access Strategy` is set to `Infer Schema` and the record is a single large record(tested with record ~50MB), the InferSchemaAccessStrategy will error. -- This message was sent by Atlassian Jira (v8.3.4#803005)
