btw, here is the Spark umbrella JIRA for Spark 4 (incl JDK 21)
https://issues.apache.org/jira/browse/SPARK-44111
Regards,
Matthias
On 8/8/2023 9:16 PM, arnab phani wrote:
Thanks for starting this discussion.
Mid-September sounds good. My current project, multi-location reuse is
still not robust enough to be released (need more testing and bug fixes). I
may need more than a month for the pending tasks. In that case, we may need
to push the release by a month.
A major release with JDK 17 and Spark 4 sounds great. However, besides
those I would love to see a well-integrated and robust GPU backend in
SystemDS 4.0.
Regards,
Arnab..
On Tue, Aug 8, 2023 at 8:25 PM Matthias Boehm <[email protected]> wrote:
Hi all,
I'd like to start a discussion on our next release (SystemDS 3.2) and
beyond. In the past 5 months we made quite a number of fixes and
improvements which I believe warrants a release in September or October.
Given our target release cadence of ~6 months, I would prefer mid
September. Are there major features you would want to bring in that
would take longer than beginning of September?
Beyond the SystemDS 3.x line, I further think that planning for SystemDS
4.0 would be a great opportunity to switch to Spark 4 (which is
currently underway) and potentially JDK 17 (including the vector API
which performs very well in early experiments).
Regards,
Matthias
