GitHub user crjk21 opened a pull request:
https://github.com/apache/spark/pull/17853
Branch 2.2
## What changes were proposed in this pull request?
(Please fill in changes proposed in this fix)
## How was this patch tested?
(Please explain how this patch was tested. E.g. unit tests, integration
tests, manual tests)
(If this patch involves UI changes, please attach a screenshot; otherwise,
remove this)
Please review http://spark.apache.org/contributing.html before opening a
pull request.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/apache/spark branch-2.2
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/17853.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #17853
commit ecf5605a104be67b29d29c00dc98ddab7975c9c1
Author: éå°é¾ 10207633
Date: 2017-04-18T17:02:21Z
[SPARK-20354][CORE][REST-API] When I request access to the 'http:
//ip:port/api/v1/applications' link, return 'sparkUser' is empty in REST API.
## What changes were proposed in this pull request?
When I request access to the 'http: //ip:port/api/v1/applications' link,
get the json. I need the 'sparkUser' field specific value, because my Spark big
data management platform needs to filter through this field which user submits
the application to facilitate my administration and query, but the current
return of the json string is empty, causing me this Function can not be
achieved, that is, I do not know who the specific application is submitted by
this REST Api.
**current return json:**
[ {
"id" : "app-20170417152053-",
"name" : "KafkaWordCount",
"attempts" : [ {
"startTime" : "2017-04-17T07:20:51.395GMT",
"endTime" : "1969-12-31T23:59:59.999GMT",
"lastUpdated" : "2017-04-17T07:20:51.395GMT",
"duration" : 0,
**"sparkUser" : "",**
"completed" : false,
"endTimeEpoch" : -1,
"startTimeEpoch" : 1492413651395,
"lastUpdatedEpoch" : 1492413651395
} ]
} ]
**When I fix this question, return json:**
[ {
"id" : "app-20170417154201-",
"name" : "KafkaWordCount",
"attempts" : [ {
"startTime" : "2017-04-17T07:41:57.335GMT",
"endTime" : "1969-12-31T23:59:59.999GMT",
"lastUpdated" : "2017-04-17T07:41:57.335GMT",
"duration" : 0,
**"sparkUser" : "mr",**
"completed" : false,
"startTimeEpoch" : 1492414917335,
"endTimeEpoch" : -1,
"lastUpdatedEpoch" : 1492414917335
} ]
} ]
## How was this patch tested?
manual tests
Please review http://spark.apache.org/contributing.html before opening a
pull request.
Author: éå°é¾ 10207633
Author: guoxiaolong
Author: guoxiaolongzte
Closes #17656 from guoxiaolongzte/SPARK-20354.
(cherry picked from commit 1f81dda37cfc2049fabd6abd93ef3720d0aa03ea)
Signed-off-by: Marcelo Vanzin
commit 7dbc0a9101954f1d514b97143b24fbe1e439181b
Author: Kyle Kelley
Date: 2017-04-18T19:35:27Z
[SPARK-20360][PYTHON] reprs for interpreters
## What changes were proposed in this pull request?
Establishes a very minimal `_repr_html_` for PySpark's `SparkContext`.
## How was this patch tested?
nteract:
Jupyter:
Hydrogen:
Author: Kyle Kelley
Closes #17662 from rgbkrk/repr.
(cherry picked from commit f654b39a63d4f9b118733733c7ed2a1b58649e3d)
Signed-off-by: Holden Karau
commit 6a25d391f81eed5f23e105c2db427ae8bb032752
Author: Tathagata Das
Date: 2017-04-18T23:10:40Z
[SPARK-20377][SS] Fix JavaStructuredSessionization example
## What changes were proposed in this pull request?
Extra accessors in java bean class causes incorrect encoder generation,
which corrupted the state when using timeouts.
## How was this patch tested?
manually ran the example
Author: Tathagata Das
Closes #17676 from tdas/SPARK-20377.
(cherry picked from commit 74aa0df8f7f132b62754e5159262e4a5b9b641ab)
Signed-off-by: Tathagata Das
commit a33d448058ae6608d1031c4c34334778b3c39675
Author: Kazuaki Ishizaki
Date: 2017-04-19T02:58:05Z
[SPARK-20254][SQL] Remove unnecessary da
