[ 
https://issues.apache.org/jira/browse/SPARK-17944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15582817#comment-15582817
 ] 

Erik O'Shaughnessy commented on SPARK-17944:
--------------------------------------------

AFAIK, check-hostname is a Solaris specific script written to provide a fully 
qualified host name to sendmail.

I am fairly certain that before SPARK-16962 there were no Apache Spark 
installations on Solaris SPARC platforms external to Oracle. My management 
assures me that there is significant interest in having Apache Spark work 
"out-of-the-box" on Solaris SPARC, thus my (admittedly recent) participation in 
Apache Spark.

As far as your second question, whether "we know it otherwise works" on 
Solaris, the only evidence I can offer is the paucity of issues raised as a 
consequence of Oracle running Apache Spark on Solaris; SPARK-13776 which 
tickled a Jetty bug and SPARK-16962 which addresses unaligned memory accesses.  
The only other major problem we have encountered is with an Apache Spark 
dependency, snappy-java, that does not support 64-bit Solaris SPARC (yet). We 
have patches in-house which are under legal review.

I'll be happy to write a {{sbin/spark-funcs.sh}} so we have something concrete 
to discuss. 



> sbin/start-* scripts use of `hostname -f` fail with Solaris 
> ------------------------------------------------------------
>
>                 Key: SPARK-17944
>                 URL: https://issues.apache.org/jira/browse/SPARK-17944
>             Project: Spark
>          Issue Type: Bug
>    Affects Versions: 2.0.1
>         Environment: Solaris 10, Solaris 11
>            Reporter: Erik O'Shaughnessy
>            Priority: Trivial
>
> {{$SPARK_HOME/sbin/start-master.sh}} fails:
> {noformat}
> $ ./start-master.sh 
> usage: hostname [[-t] system_name]
>        hostname [-D]
> starting org.apache.spark.deploy.master.Master, logging to 
> /home/eoshaugh/local/spark/logs/spark-eoshaugh-org.apache.spark.deploy.master.Master-1-m7-16-002-ld1.out
> failed to launch org.apache.spark.deploy.master.Master:
>     --properties-file FILE Path to a custom Spark properties file.
>                            Default is conf/spark-defaults.conf.
> full log in 
> /home/eoshaugh/local/spark/logs/spark-eoshaugh-org.apache.spark.deploy.master.Master-1-m7-16-002-ld1.out
> {noformat}
> I found SPARK-17546 which changed the invocation of hostname in 
> sbin/start-master.sh, sbin/start-slaves.sh and sbin/start-mesos-dispatcher.sh 
> to include the flag {{-f}}, which is not a valid command line option for the 
> Solaris hostname implementation. 
> As a workaround, Solaris users can substitute:
> {noformat}
> `/usr/sbin/check-hostname | awk '{print $NF}'`
> {noformat}
> Admittedly not an obvious fix, but it provides equivalent functionality. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to