[
https://issues.apache.org/jira/browse/PIRK-21?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432899#comment-15432899
]
ASF GitHub Bot commented on PIRK-21:
------------------------------------
Github user ellisonanne commented on a diff in the pull request:
https://github.com/apache/incubator-pirk/pull/76#discussion_r75877912
--- Diff: src/main/resources/pirk.properties ---
@@ -28,7 +28,8 @@ local.pirk.properties.dir=/root/
##
##Spark path for SparkLauncher
##
-spark.home = /usr
+#spark.home = /usr
+spark.home=/opt/cloudera/parcels/CDH/lib/spark
--- End diff --
Yes, this is for the CDH cluster that I am doing some of the testing on - I
will remove it
(It is, however, an example of how to alternately set the spark.home
property for different cluster configurations)
> Apache Spark Streaming Implementation
> -------------------------------------
>
> Key: PIRK-21
> URL: https://issues.apache.org/jira/browse/PIRK-21
> Project: PIRK
> Issue Type: Improvement
> Components: Responder
> Reporter: Ellison Anne Williams
> Assignee: Ellison Anne Williams
>
> Provide a Spark streaming implementation for Pirk.
> Although there is discussion and a forthcoming JIRA issue for Pirk
> integration with Apache Beam, we can, at the very least, use this
> implementation to benchmark straight Spark Streaming vs Beam + Spark
> Streaming.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
