[
https://issues.apache.org/jira/browse/SPARK-30901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
DavidXU updated SPARK-30901:
----------------------------
Description:
In Spark documentation :
[https://spark.apache.org/docs/2.4.0/streaming-kinesis-integration.html#configuring-spark-streaming-application]
I find that here we still give exemple like:
{{_".initialPositionInStream([initial position])"_}}
{{But in the code source of _spark-streaming-kinesis-asl_2.11-2.4.4_}}
I noticed:
_@deprecated("use initialPosition(initialPosition: KinesisInitialPosition)",
"2.3.0")_
_def initialPositionInStream(initialPosition: InitialPositionInStream):
Builder_
{{So, I think that the doc here should be updated, to give an exemple like:}}
{{_".initialPosition([initial position])"_}}
And the same thing goes to the description below:
"_{{[initial position]}}: Can be either
{{InitialPositionInStream.TRIM_HORIZON}} or {{InitialPositionInStream.LATEST}}_"
In fact, now we can use _{{KinesisInitialPositions.}}__{{TRIM_HORIZON
KinesisInitialPositions.LATEST or *KinesisInitialPositions.AT_TIMESTAMP*}}_
_{{**}}_{{(by using initialPosition in the place of initialPositionInStream)}}
was:
In Spark documentation :
[https://spark.apache.org/docs/2.4.0/streaming-kinesis-integration.html#configuring-spark-streaming-application]
I find that here we still give exemple like:
{{_".initialPositionInStream([initial position])"_}}
{{}}
{{But in the code source of _spark-streaming-kinesis-asl_2.11-2.4.4_}}
I noticed:
_@deprecated("use initialPosition(initialPosition: KinesisInitialPosition)",
"2.3.0")_
_def initialPositionInStream(initialPosition: InitialPositionInStream):
Builder_
{{So, I think that the doc here should be updated, to give an exemple like:}}
{{_".initialPosition([initial position])"_}}
{{}}
{{}}{{}}
And the same thing goes to the description below:
"_{{[initial position]}}: Can be either
{{InitialPositionInStream.TRIM_HORIZON}} or {{InitialPositionInStream.LATEST}}_"
In fact, now we can use _{{KinesisInitialPositions.}}__{{TRIM_HORIZON
KinesisInitialPositions.LATEST or *KinesisInitialPositions.AT_TIMESTAMP*}}_
_{{**}}_{{(by using }}{{initialPosition in the place of
initialPositionInStream)}}
{{}}
> [DOC] In streaming-kinesis-integration.md, the initialPosition method changed
> -----------------------------------------------------------------------------
>
> Key: SPARK-30901
> URL: https://issues.apache.org/jira/browse/SPARK-30901
> Project: Spark
> Issue Type: Bug
> Components: Documentation
> Affects Versions: 2.4.4
> Reporter: DavidXU
> Priority: Major
>
> In Spark documentation :
> [https://spark.apache.org/docs/2.4.0/streaming-kinesis-integration.html#configuring-spark-streaming-application]
> I find that here we still give exemple like:
> {{_".initialPositionInStream([initial position])"_}}
>
> {{But in the code source of _spark-streaming-kinesis-asl_2.11-2.4.4_}}
> I noticed:
> _@deprecated("use initialPosition(initialPosition: KinesisInitialPosition)",
> "2.3.0")_
> _def initialPositionInStream(initialPosition: InitialPositionInStream):
> Builder_
>
> {{So, I think that the doc here should be updated, to give an exemple like:}}
> {{_".initialPosition([initial position])"_}}
>
>
> And the same thing goes to the description below:
> "_{{[initial position]}}: Can be either
> {{InitialPositionInStream.TRIM_HORIZON}} or
> {{InitialPositionInStream.LATEST}}_"
> In fact, now we can use _{{KinesisInitialPositions.}}__{{TRIM_HORIZON
> KinesisInitialPositions.LATEST or *KinesisInitialPositions.AT_TIMESTAMP*}}_
> _{{**}}_{{(by using initialPosition in the place of initialPositionInStream)}}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
