Re: Removing Kinesis in Spark 4

2024-01-20 Thread Nicholas Chammas
assurance. On top of >>> that, I am not certain if the test cases, which require AWS credentials in >>> these modules, get verified during each Spark version release. >> >> Did we ever reach a decision about removing Kinesis in Spark 4? >> >> I was cleaning u

Re: Removing Kinesis in Spark 4

2024-01-20 Thread Sean Owen
d in any GitHub Actions > pipeline, so I think they significantly lack quality assurance. On top of > that, I am not certain if the test cases, which require AWS credentials in > these modules, get verified during each Spark version release. > > > Did we ever reach a decision about remo

Removing Kinesis in Spark 4

2024-01-20 Thread Nicholas Chammas
t; these modules, get verified during each Spark version release. Did we ever reach a decision about removing Kinesis in Spark 4? I was cleaning up some docs related to Kinesis and came across a reference to some Java API docs that I could not find <https://github.com/apache/spark/