[
https://issues.apache.org/jira/browse/SPARK-19677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15876747#comment-15876747
]
Heji Kim commented on SPARK-19677:
--
Thank you for reporting this issue! I just wanted to add that we
[
https://issues.apache.org/jira/browse/SPARK-18506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Heji Kim resolved SPARK-18506.
--
Resolution: Not A Problem
Just another library incompatibilty issue. We just downgraded the
[
https://issues.apache.org/jira/browse/SPARK-18506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Heji Kim updated SPARK-18506:
-
Summary: kafka 0.10 with Spark 2.02 auto.offset.reset=earliest will only
read from a single partition on
[
https://issues.apache.org/jira/browse/SPARK-18506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713476#comment-15713476
]
Heji Kim commented on SPARK-18506:
--
Breaking news I finally found the source of the problem. Our
[
https://issues.apache.org/jira/browse/SPARK-18506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Heji Kim updated SPARK-18506:
-
Summary: kafka 0.10 with Spark 2.02 auto.offset.reset=earliest will only
read from a single partition on
[
https://issues.apache.org/jira/browse/SPARK-18506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15709430#comment-15709430
]
Heji Kim commented on SPARK-18506:
--
Hi Cody.
I have tried roughly a similar configuration on GCP with
[
https://issues.apache.org/jira/browse/SPARK-18506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Heji Kim reopened SPARK-18506:
--
My team has asked me to reopen this issue to see if there can be any more
progress. We have implemented a
[
https://issues.apache.org/jira/browse/SPARK-18506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703328#comment-15703328
]
Heji Kim commented on SPARK-18506:
--
Hi Cody,
I am putting one last ditch effort into getting this to
[
https://issues.apache.org/jira/browse/SPARK-18506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15691582#comment-15691582
]
Heji Kim commented on SPARK-18506:
--
My ansible automation just downloads the official distributions and
[
https://issues.apache.org/jira/browse/SPARK-18506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Heji Kim resolved SPARK-18506.
--
Resolution: Workaround
I was able to replicate the single partition only problem in AWS with both YARN
[
https://issues.apache.org/jira/browse/SPARK-18506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15684995#comment-15684995
]
Heji Kim commented on SPARK-18506:
--
Just confirming that when I use ConsumerStrategy.Assign with all
[
https://issues.apache.org/jira/browse/SPARK-18506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15684844#comment-15684844
]
Heji Kim commented on SPARK-18506:
--
Firstly thank you Cody for the quick response. Our intention was not
[
https://issues.apache.org/jira/browse/SPARK-18506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15679667#comment-15679667
]
Heji Kim commented on SPARK-18506:
--
We have spent two weeks trying different configurations and
[
https://issues.apache.org/jira/browse/SPARK-18506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Heji Kim updated SPARK-18506:
-
Description:
Our team is trying to upgrade to Spark 2.0.2/Kafka
[
https://issues.apache.org/jira/browse/SPARK-18506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Heji Kim updated SPARK-18506:
-
Description:
Our team is trying to upgrade to Spark 2.0.2/Kafka
[
https://issues.apache.org/jira/browse/SPARK-18506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Heji Kim updated SPARK-18506:
-
Description:
Our team is trying to upgrade to Spark 2.0.2/Kafka
Heji Kim created SPARK-18506:
Summary: kafka 0.10 with Spark 2.02 auto.offset.reset=earliest
will only read from a single partition on a multi partition topic
Key: SPARK-18506
URL:
[
https://issues.apache.org/jira/browse/SPARK-11613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Heji Kim closed SPARK-11613.
Resolution: Fixed
> Kinesis ASL should allow caller to set ClientConfiguration for socket
> timeouts and
[
https://issues.apache.org/jira/browse/SPARK-11613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Heji Kim updated SPARK-11613:
-
Description:
Currently the Kinesis ASL does not allow configuration of Kinesis settings such
as
[
https://issues.apache.org/jira/browse/SPARK-11613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Heji Kim updated SPARK-11613:
-
Description:
Currently the Kinesis ASL does not allow configuration of connection settings
on
Heji Kim created SPARK-11613:
Summary: Kinesis ASL should allow caller to set
ClientConfiguration for socket timeouts and other connection settings
Key: SPARK-11613
URL:
[
https://issues.apache.org/jira/browse/SPARK-11613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Heji Kim updated SPARK-11613:
-
Description:
Currently the Kinesis ASL does not allow configuration of connection settings
on
[
https://issues.apache.org/jira/browse/SPARK-8939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739578#comment-14739578
]
Heji Kim edited comment on SPARK-8939 at 9/15/15 3:14 AM:
--
I was trying to
[
https://issues.apache.org/jira/browse/SPARK-8939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739578#comment-14739578
]
Heji Kim commented on SPARK-8939:
-
I was trying to upgrade to 1.5 today and could not submit drivers due
24 matches
Mail list logo
