[jira] [Commented] (SPARK-25075) Build and test Spark against Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-25075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17501675#comment-17501675 ] Ismael Juma commented on SPARK-25075: - Yeah, I was asking since Kafka plans to drop support for

[jira] [Commented] (SPARK-25075) Build and test Spark against Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-25075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17498639#comment-17498639 ] Ismael Juma commented on SPARK-25075: - Is there a very rough timeline for 4.0 or it completely

[jira] [Comment Edited] (SPARK-25075) Build and test Spark against Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-25075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17498639#comment-17498639 ] Ismael Juma edited comment on SPARK-25075 at 2/27/22, 5:39 PM: --- Is there a

[jira] [Commented] (SPARK-36808) Upgrade Kafka to 2.8.1

[ https://issues.apache.org/jira/browse/SPARK-36808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17492248#comment-17492248 ] Ismael Juma commented on SPARK-36808: - I think it would be good to backport this to the stable

[jira] [Commented] (SPARK-33913) Upgrade Kafka to 2.8.0

[ https://issues.apache.org/jira/browse/SPARK-33913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17492247#comment-17492247 ] Ismael Juma commented on SPARK-33913: - Sounds good, I had not seen the other ticket. > Upgrade

[jira] [Comment Edited] (SPARK-33913) Upgrade Kafka to 2.8.0

[ https://issues.apache.org/jira/browse/SPARK-33913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17491535#comment-17491535 ] Ismael Juma edited comment on SPARK-33913 at 2/13/22, 9:17 AM: --- Note that

[jira] [Commented] (SPARK-33913) Upgrade Kafka to 2.8.0

[ https://issues.apache.org/jira/browse/SPARK-33913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17491535#comment-17491535 ] Ismael Juma commented on SPARK-33913: - Note that it may be a good idea to upgrade the stable branch

[jira] [Commented] (SPARK-25075) Build and test Spark against Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-25075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17350084#comment-17350084 ] Ismael Juma commented on SPARK-25075: - Yes, makes sense. When I mentioned Kafka 3.0 and Spark 3.2, I

[jira] [Commented] (SPARK-25075) Build and test Spark against Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-25075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17350068#comment-17350068 ] Ismael Juma commented on SPARK-25075: - Thanks Dongjoon, I totally agree that stable Scala 2.13

[jira] [Commented] (SPARK-25075) Build and test Spark against Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-25075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17349932#comment-17349932 ] Ismael Juma commented on SPARK-25075: - [~dongjoon] When do you intend to drop support for Scala

[jira] [Commented] (SPARK-28367) Kafka connector infinite wait because metadata never updated

[ https://issues.apache.org/jira/browse/SPARK-28367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087242#comment-17087242 ] Ismael Juma commented on SPARK-28367: - This should be unblocked since Spark has upgraded to Kafka

[jira] [Commented] (SPARK-31464) Upgrade Kafka to 2.5.0

[ https://issues.apache.org/jira/browse/SPARK-31464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087240#comment-17087240 ] Ismael Juma commented on SPARK-31464: - Thanks for upgrading so quickly. :) > Upgrade Kafka to 2.5.0

[jira] [Commented] (SPARK-25954) Upgrade to Kafka 2.1.0

[ https://issues.apache.org/jira/browse/SPARK-25954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16824226#comment-16824226 ] Ismael Juma commented on SPARK-25954: - That's awesome, sorry for the noise. > Upgrade to Kafka

[jira] [Commented] (SPARK-25954) Upgrade to Kafka 2.1.0

[ https://issues.apache.org/jira/browse/SPARK-25954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16824177#comment-16824177 ] Ismael Juma commented on SPARK-25954: - [~dongjoon] Kafka 2.2.0 has a fix for an issue that has

[jira] [Commented] (SPARK-18057) Update structured streaming kafka from 0.10.0.1 to 1.1.0

[ https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16501351#comment-16501351 ] Ismael Juma commented on SPARK-18057: - Yes, it is [~kabhwan]. The major version bump is simply

[jira] [Commented] (SPARK-18057) Update structured streaming kafka from 0.10.0.1 to 1.1.0

[ https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16496924#comment-16496924 ] Ismael Juma commented on SPARK-18057: - Apache Kafka 2.0.0 will include KIP-266 and KAFKA-4879 has

[jira] [Issue Comment Deleted] (SPARK-1145) Memory mapping with many small blocks can cause JVM allocation failures

[ https://issues.apache.org/jira/browse/SPARK-1145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated SPARK-1145: --- Comment: was deleted (was: Thanks for the additional information. The issue seems similar to

[jira] [Commented] (SPARK-1145) Memory mapping with many small blocks can cause JVM allocation failures

[ https://issues.apache.org/jira/browse/SPARK-1145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16285846#comment-16285846 ] Ismael Juma commented on SPARK-1145: Thanks for the additional information. The issue seems similar to

[jira] [Commented] (SPARK-18057) Update structured streaming kafka from 10.0.1 to 10.2.0

[ https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15983853#comment-15983853 ] Ismael Juma commented on SPARK-18057: - It's worth noting that no-one is working on that ticket at the

[jira] [Commented] (SPARK-18057) Update structured streaming kafka from 10.0.1 to 10.2.0

[ https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15982683#comment-15982683 ] Ismael Juma commented on SPARK-18057: - Thanks for the clarification [~zsxwing], that's helpful. >

[jira] [Commented] (SPARK-18057) Update structured streaming kafka from 10.0.1 to 10.2.0

[ https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15982153#comment-15982153 ] Ismael Juma commented on SPARK-18057: - [~helena], about KAFKA-4879, are you suggesting that it's a

[jira] [Comment Edited] (SPARK-18057) Update structured streaming kafka from 10.0.1 to 10.2.0

[ https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15982077#comment-15982077 ] Ismael Juma edited comment on SPARK-18057 at 4/24/17 11:07 PM: --- Hi. A few

[jira] [Commented] (SPARK-18057) Update structured streaming kafka from 10.0.1 to 10.2.0

[ https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15982077#comment-15982077 ] Ismael Juma commented on SPARK-18057: - Hi. A few clarifications below. "Based on previous kafka

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.10 Consumer API

[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15329044#comment-15329044 ] Ismael Juma commented on SPARK-12177: - {quote} b) the real benefit is security - I am personally a

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.10 Consumer API

[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15324126#comment-15324126 ] Ismael Juma commented on SPARK-12177: - {quote} I agree with Cody that the new Kafka consumer API

[jira] [Commented] (SPARK-6363) make scala 2.11 default language

[ https://issues.apache.org/jira/browse/SPARK-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15052631#comment-15052631 ] Ismael Juma commented on SPARK-6363: It's also worth pointing out that Scala 2.10 is no longer

[jira] [Commented] (SPARK-558) Simplify run script by relying on sbt to launch app

[ https://issues.apache.org/jira/browse/SPARK-558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129801#comment-14129801 ] Ismael Juma commented on SPARK-558: --- Probably stale, yes. Simplify run script by