uros-b commented on code in PR #57658:
URL: https://github.com/apache/spark/pull/57658#discussion_r3692731067
##########
docs/sql-data-sources-json.md:
##########
@@ -170,7 +170,7 @@ Data source options of JSON can be set via:
<td><code>PERMISSIVE</code></td>
<td>Allows a mode for dealing with corrupt records during parsing.<br>
<ul>
- <li><code>PERMISSIVE</code>: when it meets a corrupted record, puts the
malformed string into a field configured by
<code>columnNameOfCorruptRecord</code>, and sets malformed fields to
<code>null</code>. To keep corrupt records, an user can set a string type field
named <code>columnNameOfCorruptRecord</code> in an user-defined schema. If a
schema does not have the field, it drops corrupt records during parsing. When
inferring a schema, it implicitly adds a <code>columnNameOfCorruptRecord</code>
field in an output schema.</li>
+ <li><code>PERMISSIVE</code>: when it meets a corrupted record, puts the
malformed string into a field configured by
<code>columnNameOfCorruptRecord</code>, and sets malformed fields to
<code>null</code>. To capture the malformed string, an user can set a string
type field named <code>columnNameOfCorruptRecord</code> in an user-defined
schema. If a schema does not have the field, the corrupt record is still
retained with its malformed fields set to <code>null</code>, but the malformed
string is not available. When inferring a schema, it implicitly adds a
<code>columnNameOfCorruptRecord</code> field in an output schema.</li>
Review Comment:
```suggestion
<li><code>PERMISSIVE</code>: when it meets a corrupted record, puts
the malformed string into a field configured by
<code>columnNameOfCorruptRecord</code>, and sets malformed fields to
<code>null</code>. To capture the malformed string, a user can set a string
type field named <code>columnNameOfCorruptRecord</code> in a user-defined
schema. If a schema does not have the field, the corrupt record is still
retained with its malformed fields set to <code>null</code>, but the malformed
string is not available. When inferring a schema, it implicitly adds a
<code>columnNameOfCorruptRecord</code> field in an output schema.</li>
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
