Saisai Shao created AMBARI-17489:
Summary: Remove spark.yarn.max.executor.failures configuration in
Spark Ambari definition
Key: AMBARI-17489
URL: https://issues.apache.org/jira/browse/AMBARI-17489
[
https://issues.apache.org/jira/browse/SPARK-16230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15354280#comment-15354280
]
Saisai Shao commented on SPARK-16230:
-
I'm not sure which version Spark are you using? Here is a
[
https://issues.apache.org/jira/browse/SPARK-16265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15354207#comment-15354207
]
Saisai Shao commented on SPARK-16265:
-
If you want to run Spark on different JVM other than YARN, you
[
https://issues.apache.org/jira/browse/SPARK-16246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15352481#comment-15352481
]
Saisai Shao commented on SPARK-16246:
-
It would be better to have a thread dump about running
Saisai Shao created AMBARI-17459:
Summary: remove spark.driver.extraJavaOptions and
spark.yarn.am.extraJavaOptions property in HDP2.5 definition
Key: AMBARI-17459
URL:
[
https://issues.apache.org/jira/browse/AMBARI-17328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Saisai Shao updated AMBARI-17328:
-
Issue Type: Sub-task (was: Technical task)
> Spark2 history server quick link still point to
[
https://issues.apache.org/jira/browse/SPARK-16146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345984#comment-15345984
]
Saisai Shao commented on SPARK-16146:
-
I see, that could explain why executor get lost so frequently
Saisai Shao created SPARK-16166:
---
Summary: Correctly honor off heap memory usage in web ui and log
display
Key: SPARK-16166
URL: https://issues.apache.org/jira/browse/SPARK-16166
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-16146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345942#comment-15345942
]
Saisai Shao commented on SPARK-16146:
-
If it is due to preemption, AM log will show the details of
[
https://issues.apache.org/jira/browse/AMBARI-17391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345864#comment-15345864
]
Saisai Shao commented on AMBARI-17391:
--
Hi [~jluniya], I think we should also has such change in
[
https://issues.apache.org/jira/browse/SPARK-16085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345445#comment-15345445
]
Saisai Shao commented on SPARK-16085:
-
[~yeshavora], it is the expected behavior, the spark UI will
[
https://issues.apache.org/jira/browse/AMBARI-17328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15340981#comment-15340981
]
Saisai Shao commented on AMBARI-17328:
--
CC [~jluniya] [~zjffdu] please help to review.
> Spark2
Saisai Shao created AMBARI-17328:
Summary: Spark2 history server quick link still point to spark1 url
Key: AMBARI-17328
URL: https://issues.apache.org/jira/browse/AMBARI-17328
Project: Ambari
[
https://issues.apache.org/jira/browse/SPARK-15984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15339136#comment-15339136
]
Saisai Shao commented on SPARK-15984:
-
I see. Here it is because user didn't specify this
[
https://issues.apache.org/jira/browse/SPARK-15984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15337278#comment-15337278
]
Saisai Shao commented on SPARK-15984:
-
Is there any problem? I guess you might set max app attempt to
[
https://issues.apache.org/jira/browse/SPARK-15343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15335039#comment-15335039
]
Saisai Shao commented on SPARK-15343:
-
If timeline is enabled, YarnClient will also post some events
[
https://issues.apache.org/jira/browse/SPARK-15343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Saisai Shao updated SPARK-15343:
Attachment: (was: jersey-client-2.22.2.jar)
> NoClassDefFoundError when initializing Spark
[
https://issues.apache.org/jira/browse/SPARK-15343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Saisai Shao updated SPARK-15343:
Attachment: jersey-client-2.22.2.jar
> NoClassDefFoundError when initializing Spark with YARN
>
[
https://issues.apache.org/jira/browse/SPARK-15343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334719#comment-15334719
]
Saisai Shao commented on SPARK-15343:
-
The class ClientConfig is still existed but the package name
[
https://issues.apache.org/jira/browse/SPARK-15343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334683#comment-15334683
]
Saisai Shao edited comment on SPARK-15343 at 6/16/16 9:06 PM:
--
[~vanzin]
[
https://issues.apache.org/jira/browse/SPARK-15343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334683#comment-15334683
]
Saisai Shao commented on SPARK-15343:
-
[~vanzin] [~srowen], I don't think it is a vendor specific
Saisai Shao created SPARK-15990:
---
Summary: Support rolling log aggregation for Spark running on YARN
Key: SPARK-15990
URL: https://issues.apache.org/jira/browse/SPARK-15990
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-15690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15328378#comment-15328378
]
Saisai Shao commented on SPARK-15690:
-
I see. Since everything is in a single process, looks like
[
https://issues.apache.org/jira/browse/SPARK-15690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15328255#comment-15328255
]
Saisai Shao commented on SPARK-15690:
-
Hi [~rxin], what's the meaning of "single-process", is that
[
https://issues.apache.org/jira/browse/AMBARI-17204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15327859#comment-15327859
]
Saisai Shao commented on AMBARI-17204:
--
CC [~zjffdu], please help to review.
> Fix bug in for
[
https://issues.apache.org/jira/browse/AMBARI-17204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Saisai Shao updated AMBARI-17204:
-
Attachment: (was: AMBARI-17204.patch)
> Fix bug in for Spark2 thrift server definition
>
[
https://issues.apache.org/jira/browse/AMBARI-17204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Saisai Shao updated AMBARI-17204:
-
Attachment: AMBARI-17204.patch
> Fix bug in for Spark2 thrift server definition
>
[
https://issues.apache.org/jira/browse/AMBARI-17204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Saisai Shao reassigned AMBARI-17204:
Assignee: Saisai Shao
> Fix bug in for Spark2 thrift server definition
>
Saisai Shao created AMBARI-17204:
Summary: Fix bug in for Spark2 thrift server definition
Key: AMBARI-17204
URL: https://issues.apache.org/jira/browse/AMBARI-17204
Project: Ambari
Issue
[
https://issues.apache.org/jira/browse/AMBARI-16864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15327702#comment-15327702
]
Saisai Shao commented on AMBARI-16864:
--
Patch is submitted, please review [~jluniya], thanks a lot.
[
https://issues.apache.org/jira/browse/SPARK-15828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15322892#comment-15322892
]
Saisai Shao commented on SPARK-15828:
-
OK, I guess you're running on AWS or similar cloud
[
https://issues.apache.org/jira/browse/SPARK-15828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15322865#comment-15322865
]
Saisai Shao commented on SPARK-15828:
-
I see, but I don't clearly understand your scenario, are the
[
https://issues.apache.org/jira/browse/SPARK-15800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15322804#comment-15322804
]
Saisai Shao commented on SPARK-15800:
-
{quote}
Spark is currently running using the Resource Manager,
[
https://issues.apache.org/jira/browse/SPARK-15801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15322800#comment-15322800
]
Saisai Shao commented on SPARK-15801:
-
It has already been mentioned in {{spark-submit --help}}:
[
https://issues.apache.org/jira/browse/SPARK-15828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15322788#comment-15322788
]
Saisai Shao commented on SPARK-15828:
-
I think this issue is not related to dynamic allocation, if
Saisai Shao created SPARK-15698:
---
Summary: Ability to remove old metadata for structure streaming
MetadataLog
Key: SPARK-15698
URL: https://issues.apache.org/jira/browse/SPARK-15698
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-15683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15309139#comment-15309139
]
Saisai Shao commented on SPARK-15683:
-
Hi [~tgraves], please see this JIRA SPARK-15659, I submitted a
[
https://issues.apache.org/jira/browse/SPARK-15479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15307387#comment-15307387
]
Saisai Shao commented on SPARK-15479:
-
I guess using "yarn kill" to stop the application has a
[
https://issues.apache.org/jira/browse/SPARK-15659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Saisai Shao updated SPARK-15659:
Component/s: SQL
> Ensure FileSystem is gotten from path in InMemoryCatalog
>
Saisai Shao created SPARK-15659:
---
Summary: Ensure FileSystem is gotten from path in InMemoryCatalog
Key: SPARK-15659
URL: https://issues.apache.org/jira/browse/SPARK-15659
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/AMBARI-16864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15306170#comment-15306170
]
Saisai Shao commented on AMBARI-16864:
--
Hi [~jluniya], two questions about unit test:
1. How do I
[
https://issues.apache.org/jira/browse/SPARK-15564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303442#comment-15303442
]
Saisai Shao commented on SPARK-15564:
-
According to the your description, I guess you're running
[
https://issues.apache.org/jira/browse/SPARK-15564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303442#comment-15303442
]
Saisai Shao edited comment on SPARK-15564 at 5/27/16 4:04 AM:
--
According to
[
https://issues.apache.org/jira/browse/SPARK-15556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301738#comment-15301738
]
Saisai Shao commented on SPARK-15556:
-
I see, thanks a lot for your comment. sorry to bring in noise.
[
https://issues.apache.org/jira/browse/SPARK-15548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301734#comment-15301734
]
Saisai Shao commented on SPARK-15548:
-
I did a quick test on the shuffle file removing, actually
Saisai Shao created SPARK-15556:
---
Summary: Add new Dataset API to get the codegen info for Dataset
Key: SPARK-15556
URL: https://issues.apache.org/jira/browse/SPARK-15556
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-15548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301670#comment-15301670
]
Saisai Shao edited comment on SPARK-15548 at 5/26/16 7:45 AM:
--
There will be
[
https://issues.apache.org/jira/browse/SPARK-15548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301670#comment-15301670
]
Saisai Shao commented on SPARK-15548:
-
>From my understanding this problem is not only a yarn
[
https://issues.apache.org/jira/browse/SPARK-12893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Saisai Shao closed SPARK-12893.
---
Resolution: Not A Problem
> RM redirects to incorrect URL in Spark HistoryServer for yarn-cluster
[
https://issues.apache.org/jira/browse/SPARK-15541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301352#comment-15301352
]
Saisai Shao commented on SPARK-15541:
-
This method which returns {{KeySetView}} only exists in jdk
[
https://issues.apache.org/jira/browse/SPARK-13955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15300071#comment-15300071
]
Saisai Shao commented on SPARK-13955:
-
You will have 3 options to upload jars to distributed cache:
[
https://issues.apache.org/jira/browse/AMBARI-16864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299704#comment-15299704
]
Saisai Shao commented on AMBARI-16864:
--
Thanks [~jluniya], I will add some unit tests about it.
>
[
https://issues.apache.org/jira/browse/SPARK-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297827#comment-15297827
]
Saisai Shao commented on SPARK-15368:
-
Maybe you could try {{SPARK_DIST_CLASSPATH}}, I'm not sure it
[
https://issues.apache.org/jira/browse/SPARK-15329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15294653#comment-15294653
]
Saisai Shao commented on SPARK-15329:
-
{code}
2016-05-15 00:06:08,368 WARN
[
https://issues.apache.org/jira/browse/SPARK-15443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Saisai Shao updated SPARK-15443:
Description:
Currently when called `explain()` on streaming dataset, it will only get the
parsed
[
https://issues.apache.org/jira/browse/SPARK-15443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Saisai Shao updated SPARK-15443:
Description:
Currently when called `explain()` on streaming dataset, it will only get the
parsed
Saisai Shao created SPARK-15443:
---
Summary: Properly explain the streaming queries
Key: SPARK-15443
URL: https://issues.apache.org/jira/browse/SPARK-15443
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/AMBARI-16759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Saisai Shao updated AMBARI-16759:
-
Description:
Remove useless log dir definition in Spark service definition.
In Spark service
[
https://issues.apache.org/jira/browse/AMBARI-16759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Saisai Shao updated AMBARI-16759:
-
Summary: Remove useless Spark definitions (was: Remove useless log dir
definition in Spark
Saisai Shao created AMBARI-16759:
Summary: Remove useless log dir definition in Spark Ambari
definition
Key: AMBARI-16759
URL: https://issues.apache.org/jira/browse/AMBARI-16759
Project: Ambari
[
https://issues.apache.org/jira/browse/AMBARI-16753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15290510#comment-15290510
]
Saisai Shao commented on AMBARI-16753:
--
CC [~sumitmohanty] [~jluniya], please help to review,
[
https://issues.apache.org/jira/browse/AMBARI-16753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Saisai Shao reassigned AMBARI-16753:
Assignee: Saisai Shao
> Add new Spark2 service definition to Ambari
>
Saisai Shao created AMBARI-16753:
Summary: Add new Spark2 service definition to Ambari
Key: AMBARI-16753
URL: https://issues.apache.org/jira/browse/AMBARI-16753
Project: Ambari
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-15375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Saisai Shao updated SPARK-15375:
Summary: Add ConsoleSink for structure streaming to display the dataframe
on the fly (was: Add
Saisai Shao created SPARK-15375:
---
Summary: Add ConsoleSink for structure sink to display the
dataframe on the fly
Key: SPARK-15375
URL: https://issues.apache.org/jira/browse/SPARK-15375
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15288049#comment-15288049
]
Saisai Shao commented on SPARK-15368:
-
Maybe you could try {{SPARK_CLASSPATH}}, though deprecated
[
https://issues.apache.org/jira/browse/SPARK-15371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15288013#comment-15288013
]
Saisai Shao commented on SPARK-15371:
-
I think what you mentioned above is relate to this JIRA
[
https://issues.apache.org/jira/browse/SPARK-15329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15284292#comment-15284292
]
Saisai Shao commented on SPARK-15329:
-
Check the container log is an effective way, using {{yarn
[
https://issues.apache.org/jira/browse/SPARK-15283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Saisai Shao updated SPARK-15283:
Component/s: YARN
> YARN Application should get FAILED state if driver is failed in yarn-client
>
[
https://issues.apache.org/jira/browse/SPARK-14963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273412#comment-15273412
]
Saisai Shao commented on SPARK-14963:
-
OK, I will do it.
> YarnShuffleService should use YARN
[
https://issues.apache.org/jira/browse/SPARK-15146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15272058#comment-15272058
]
Saisai Shao commented on SPARK-15146:
-
Oh, I see, that is valid solution for it. Seems no need to
[
https://issues.apache.org/jira/browse/SPARK-15146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Saisai Shao closed SPARK-15146.
---
Resolution: Not A Problem
> Allow specifying kafka parameters through configurations
>
[
https://issues.apache.org/jira/browse/SPARK-15146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271962#comment-15271962
]
Saisai Shao commented on SPARK-15146:
-
[~c...@koeninger.org], what is your opinion on the JIRA?
Saisai Shao created SPARK-15146:
---
Summary: Allow specifying kafka parameters through configurations
Key: SPARK-15146
URL: https://issues.apache.org/jira/browse/SPARK-15146
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15267857#comment-15267857
]
Saisai Shao commented on SPARK-15039:
-
[~ltsai], do you have a exception stack about the failure you
[
https://issues.apache.org/jira/browse/SPARK-14963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15263706#comment-15263706
]
Saisai Shao commented on SPARK-14963:
-
Hi [~tgraves], would you mind me taking a crack at this if
Saisai Shao created SPARK-14836:
---
Summary: Zip local jars before uploading to distributed cache
Key: SPARK-14836
URL: https://issues.apache.org/jira/browse/SPARK-14836
Project: Spark
Issue
Saisai Shao created SPARK-14788:
---
Summary: Initial number of executors should honor min number if
streaming dynamic allocation is enabled
Key: SPARK-14788
URL: https://issues.apache.org/jira/browse/SPARK-14788
[
https://issues.apache.org/jira/browse/SPARK-14725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249557#comment-15249557
]
Saisai Shao commented on SPARK-14725:
-
I think now it forces to use RPC and there's no other option
[
https://issues.apache.org/jira/browse/SPARK-14723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15247384#comment-15247384
]
Saisai Shao commented on SPARK-14723:
-
It would be better not to set fix version and target version.
[
https://issues.apache.org/jira/browse/SPARK-14725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15247358#comment-15247358
]
Saisai Shao edited comment on SPARK-14725 at 4/19/16 8:13 AM:
--
I just search
[
https://issues.apache.org/jira/browse/SPARK-14725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15247358#comment-15247358
]
Saisai Shao commented on SPARK-14725:
-
I just search the repl code, from my understanding seems
[
https://issues.apache.org/jira/browse/SPARK-14725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Saisai Shao updated SPARK-14725:
Priority: Minor (was: Major)
> Remove HttpServer
> -
>
> Key:
[
https://issues.apache.org/jira/browse/SPARK-14725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Saisai Shao updated SPARK-14725:
Issue Type: Bug (was: Sub-task)
Parent: (was: SPARK-11806)
> Remove HttpServer
>
[
https://issues.apache.org/jira/browse/SPARK-14725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15247318#comment-15247318
]
Saisai Shao commented on SPARK-14725:
-
OK, let me check first :).
> Remove HttpServer
>
[
https://issues.apache.org/jira/browse/SPARK-14725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15247316#comment-15247316
]
Saisai Shao commented on SPARK-14725:
-
I think now it changes to use RPC instead of Http, please see
[
https://issues.apache.org/jira/browse/SPARK-14725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15247293#comment-15247293
]
Saisai Shao commented on SPARK-14725:
-
What's your opinion [~rxin] [~andrewor14]?
> Remove
Saisai Shao created SPARK-14725:
---
Summary: Remove HttpServer
Key: SPARK-14725
URL: https://issues.apache.org/jira/browse/SPARK-14725
Project: Spark
Issue Type: Sub-task
Components:
[
https://issues.apache.org/jira/browse/SPARK-14453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245048#comment-15245048
]
Saisai Shao commented on SPARK-14453:
-
Yes, this should be a part of SPARK-12344. Since SPARK-12344
Saisai Shao created SPARK-14455:
---
Summary: ReceiverTracker#allocatedExecutors throw NPE for
receiver-less streaming application
Key: SPARK-14455
URL: https://issues.apache.org/jira/browse/SPARK-14455
[
https://issues.apache.org/jira/browse/SPARK-14453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Saisai Shao updated SPARK-14453:
Priority: Minor (was: Major)
> Consider removing SPARK_JAVA_OPTS env variable
>
Saisai Shao created SPARK-14453:
---
Summary: Consider removing SPARK_JAVA_OPTS env variable
Key: SPARK-14453
URL: https://issues.apache.org/jira/browse/SPARK-14453
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-14423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15227664#comment-15227664
]
Saisai Shao commented on SPARK-14423:
-
I will fix it soon.
> Handle jar conflict issue when
Saisai Shao created SPARK-14423:
---
Summary: Handle jar conflict issue when uploading to distributed
cache
Key: SPARK-14423
URL: https://issues.apache.org/jira/browse/SPARK-14423
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-14062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Saisai Shao updated SPARK-14062:
Summary: Put metrics.properties to distributed cache for Spark running on
Yarn. Also Fix log4j
[
https://issues.apache.org/jira/browse/SPARK-14062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Saisai Shao updated SPARK-14062:
Summary: Put metrics.properties to distributed cache for Spark running on
Yarn. Also Fix log3j
[
https://issues.apache.org/jira/browse/SPARK-14151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15211640#comment-15211640
]
Saisai Shao commented on SPARK-14151:
-
Yes, sure I will add the doc.
> Propose to refactor and
[
https://issues.apache.org/jira/browse/SPARK-14151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15211634#comment-15211634
]
Saisai Shao commented on SPARK-14151:
-
I'm currently working on the second choice, to offer external
[
https://issues.apache.org/jira/browse/SPARK-14151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Saisai Shao updated SPARK-14151:
Summary: Propose to refactor and expose Metrics Sink and Source interface
(was: Propose to expose
[
https://issues.apache.org/jira/browse/SPARK-14151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15211562#comment-15211562
]
Saisai Shao commented on SPARK-14151:
-
Yes, that's what I'm thinking about, from the code level, I
901 - 1000 of 1493 matches
Mail list logo
