[
https://issues.apache.org/jira/browse/SPARK-18787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aniket Bhatnagar updated SPARK-18787:
-
Description:
The documentation for the configuration spark.shuffle.io.preferDirectBufs
[
https://issues.apache.org/jira/browse/SPARK-18787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aniket Bhatnagar updated SPARK-18787:
-
Description:
The documentation for the configuration spark.shuffle.io.preferDirectBufs
Aniket Bhatnagar created SPARK-18787:
Summary: spark.shuffle.io.preferDirectBufs does not completely
turn off direct buffer usage by Netty
Key: SPARK-18787
URL:
[
https://issues.apache.org/jira/browse/SPARK-18251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15658492#comment-15658492
]
Aniket Bhatnagar edited comment on SPARK-18251 at 11/13/16 5:17 PM:
[
https://issues.apache.org/jira/browse/SPARK-18421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15661760#comment-15661760
]
Aniket Bhatnagar commented on SPARK-18421:
--
I agree that spark doesn't manage the storage and
Aniket Bhatnagar created SPARK-18421:
Summary: Dynamic disk allocation
Key: SPARK-18421
URL: https://issues.apache.org/jira/browse/SPARK-18421
Project: Spark
Issue Type: New Feature
[
https://issues.apache.org/jira/browse/SPARK-18251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15658492#comment-15658492
]
Aniket Bhatnagar commented on SPARK-18251:
--
Hi [~jayadevan.m]
Which version of scala spark did
[
https://issues.apache.org/jira/browse/SPARK-18273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aniket Bhatnagar closed SPARK-18273.
> DataFrameReader.load takes a lot of time to start the job if a lot of
> file/dir paths are
[
https://issues.apache.org/jira/browse/SPARK-18273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aniket Bhatnagar resolved SPARK-18273.
--
Resolution: Not A Problem
Glob patterns can be passed instead of full paths to reduce
[
https://issues.apache.org/jira/browse/SPARK-18273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15637731#comment-15637731
]
Aniket Bhatnagar commented on SPARK-18273:
--
Thanks [~srowen]. Didn't realize that I could
Aniket Bhatnagar created SPARK-18273:
Summary: DataFrameReader.load takes a lot of time to start the job
if a lot of file/dir paths are pass
Key: SPARK-18273
URL:
[
https://issues.apache.org/jira/browse/SPARK-18251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aniket Bhatnagar updated SPARK-18251:
-
Description:
I am running into a runtime exception when a DataSet is holding an Empty
[
https://issues.apache.org/jira/browse/SPARK-18251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aniket Bhatnagar updated SPARK-18251:
-
Description:
I am running into a runtime exception when a DataSet is holding an Empty
[
https://issues.apache.org/jira/browse/SPARK-18251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aniket Bhatnagar updated SPARK-18251:
-
Description:
I am running into a runtime exception when a DataSet is holding an Empty
[
https://issues.apache.org/jira/browse/SPARK-18251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aniket Bhatnagar updated SPARK-18251:
-
Description:
I am running into a runtime exception when a DataSet is holding an Empty
[
https://issues.apache.org/jira/browse/SPARK-18251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aniket Bhatnagar updated SPARK-18251:
-
Description:
I am running into a runtime exception when a DataSet is holding an Empty
[
https://issues.apache.org/jira/browse/SPARK-18251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aniket Bhatnagar updated SPARK-18251:
-
Description:
I am running into a runtime exception when a DataSet is holding an Empty
[
https://issues.apache.org/jira/browse/SPARK-18251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aniket Bhatnagar updated SPARK-18251:
-
Summary: DataSet API | RuntimeException: Null value appeared in
non-nullable field when
[
https://issues.apache.org/jira/browse/SPARK-18251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aniket Bhatnagar updated SPARK-18251:
-
Summary: DataSet RuntimeException: Null value appeared in non-nullable
field when
[
https://issues.apache.org/jira/browse/SPARK-18251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aniket Bhatnagar updated SPARK-18251:
-
Summary: DataSet | RuntimeException: Null value appeared in non-nullable
field when
Aniket Bhatnagar created SPARK-18251:
Summary: RuntimeException: Null value appeared in non-nullable
field when holding Option Case Class
Key: SPARK-18251
URL:
Aniket Bhatnagar created SPARK-8895:
---
Summary: MetricsSystem.removeSource not called in
StreamingContext.stop
Key: SPARK-8895
URL: https://issues.apache.org/jira/browse/SPARK-8895
Project: Spark
Aniket Bhatnagar created SPARK-8896:
---
Summary: StreamingSource should choose a unique name
Key: SPARK-8896
URL: https://issues.apache.org/jira/browse/SPARK-8896
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aniket Bhatnagar updated SPARK-8896:
Description:
If 2 instances of StreamingContext are created and run using the same
[
https://issues.apache.org/jira/browse/SPARK-8895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aniket Bhatnagar updated SPARK-8895:
Description:
StreamingContext calls env.metricsSystem.registerSource during its
[
https://issues.apache.org/jira/browse/SPARK-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aniket Bhatnagar updated SPARK-8896:
Description:
If 2 instances of StreamingContext are created and run using the same
[
https://issues.apache.org/jira/browse/SPARK-8895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aniket Bhatnagar updated SPARK-8895:
Description:
StreamingContext calls env.metricsSystem.registerSource during its
[
https://issues.apache.org/jira/browse/SPARK-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14618764#comment-14618764
]
Aniket Bhatnagar commented on SPARK-8896:
-
As per the documentation (scala docs),
Aniket Bhatnagar created SPARK-7788:
---
Summary: Streaming | Kinesis | KinesisReceiver blocks in onStart
Key: SPARK-7788
URL: https://issues.apache.org/jira/browse/SPARK-7788
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-6154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14537766#comment-14537766
]
Aniket Bhatnagar commented on SPARK-6154:
-
Yes. I haven't tested this approach
[
https://issues.apache.org/jira/browse/SPARK-6154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14528089#comment-14528089
]
Aniket Bhatnagar commented on SPARK-6154:
-
I ran into this as well and my fix was
[
https://issues.apache.org/jira/browse/SPARK-3638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14322518#comment-14322518
]
Aniket Bhatnagar commented on SPARK-3638:
-
Did you build spark with kinesis-asl
[
https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14293019#comment-14293019
]
Aniket Bhatnagar commented on SPARK-2243:
-
I am also interested in having this
Aniket Bhatnagar created SPARK-5330:
---
Summary: Core | Scala 2.11 | Transitive dependency on
com.fasterxml.jackson.core :jackson-core:2.3.1 causes compatibility issues
Key: SPARK-5330
URL:
[
https://issues.apache.org/jira/browse/SPARK-5330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14283432#comment-14283432
]
Aniket Bhatnagar commented on SPARK-5330:
-
One possible workaround is do define
[
https://issues.apache.org/jira/browse/SPARK-5164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aniket Bhatnagar resolved SPARK-5164.
-
Resolution: Duplicate
Duplicates and has similar findings to SPARK-1825.
YARN | Spark
Aniket Bhatnagar created SPARK-5164:
---
Summary: YARN | Spark job submits from windows machine to a linux
YARN cluster fail
Key: SPARK-5164
URL: https://issues.apache.org/jira/browse/SPARK-5164
[
https://issues.apache.org/jira/browse/SPARK-5164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aniket Bhatnagar updated SPARK-5164:
Description:
While submitting spark jobs from a windows machine to a linux YARN cluster,
[
https://issues.apache.org/jira/browse/SPARK-5164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aniket Bhatnagar updated SPARK-5164:
Description:
While submitting spark jobs from a windows machine to a linux YARN cluster,
[
https://issues.apache.org/jira/browse/SPARK-5164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14270533#comment-14270533
]
Aniket Bhatnagar commented on SPARK-5164:
-
First issue can be fixed by using
Aniket Bhatnagar created SPARK-5143:
---
Summary: spark-network-yarn 2.11 depends on spark-network-shuffle
2.10
Key: SPARK-5143
URL: https://issues.apache.org/jira/browse/SPARK-5143
Project: Spark
Aniket Bhatnagar created SPARK-5144:
---
Summary: spark-yarn module should be published
Key: SPARK-5144
URL: https://issues.apache.org/jira/browse/SPARK-5144
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-3452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14269145#comment-14269145
]
Aniket Bhatnagar commented on SPARK-3452:
-
I have opened another defect -
[
https://issues.apache.org/jira/browse/SPARK-3452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267469#comment-14267469
]
Aniket Bhatnagar commented on SPARK-3452:
-
Here is the exception I am getting
[
https://issues.apache.org/jira/browse/SPARK-3452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14266156#comment-14266156
]
Aniket Bhatnagar commented on SPARK-3452:
-
Ok.. I'll test this out by adding
[
https://issues.apache.org/jira/browse/SPARK-3452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14265749#comment-14265749
]
Aniket Bhatnagar commented on SPARK-3452:
-
I would like this to be revisited. The
Aniket Bhatnagar created SPARK-4862:
---
Summary: Streaming | Setting checkpoint as a local directory
results in Checkpoint RDD has different partitions error
Key: SPARK-4862
URL:
[
https://issues.apache.org/jira/browse/SPARK-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aniket Bhatnagar closed SPARK-3640.
---
Resolution: Not a Problem
Tested and Chris's suggestion of using EC2 IAM instance profile
[
https://issues.apache.org/jira/browse/SPARK-1350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14239060#comment-14239060
]
Aniket Bhatnagar commented on SPARK-1350:
-
I am using hadoop 2.5.0 (CDH). Agreed
[
https://issues.apache.org/jira/browse/SPARK-1350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14237525#comment-14237525
]
Aniket Bhatnagar commented on SPARK-1350:
-
[~sandyr] Using
[
https://issues.apache.org/jira/browse/SPARK-3638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14232719#comment-14232719
]
Aniket Bhatnagar commented on SPARK-3638:
-
Yes. You may want to open another JIRA
[
https://issues.apache.org/jira/browse/SPARK-3638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14231086#comment-14231086
]
Aniket Bhatnagar commented on SPARK-3638:
-
[~ashrafuzzaman] did you build using
[
https://issues.apache.org/jira/browse/SPARK-2321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14218063#comment-14218063
]
Aniket Bhatnagar commented on SPARK-2321:
-
Just a quick question, will the API be
Aniket Bhatnagar created SPARK-4473:
---
Summary: [Core] StageInfo should have ActiveJob's group ID as a
field
Key: SPARK-4473
URL: https://issues.apache.org/jira/browse/SPARK-4473
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196534#comment-14196534
]
Aniket Bhatnagar commented on SPARK-3640:
-
Thanks Chris for looking into this.
Aniket Bhatnagar created SPARK-3638:
---
Summary: Commons HTTP client dependency conflict in
extras/kinesis-asl module
Key: SPARK-3638
URL: https://issues.apache.org/jira/browse/SPARK-3638
Project:
Aniket Bhatnagar created SPARK-3639:
---
Summary: Kinesis examples set master as local
Key: SPARK-3639
URL: https://issues.apache.org/jira/browse/SPARK-3639
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-3638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aniket Bhatnagar updated SPARK-3638:
Component/s: Streaming
Commons HTTP client dependency conflict in extras/kinesis-asl
[
https://issues.apache.org/jira/browse/SPARK-3639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143108#comment-14143108
]
Aniket Bhatnagar commented on SPARK-3639:
-
If the community agrees this is an
Aniket Bhatnagar created SPARK-3640:
---
Summary: KinesisUtils should accept a credentials object instead
of forcing DefaultCredentialsProvider
Key: SPARK-3640
URL: https://issues.apache.org/jira/browse/SPARK-3640
[
https://issues.apache.org/jira/browse/SPARK-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143111#comment-14143111
]
Aniket Bhatnagar commented on SPARK-3640:
-
I understand that the credentials need
61 matches
Mail list logo
