Hi Rahul,
Spark will be available in Fedora 21 (see:
https://fedoraproject.org/wiki/SIGs/bigdata/packaging/Spark), currently
scheduled on 2014-10-14 but they already have produced spec files and source
RPMs.
If you are stuck with EL6 like me, you can have a look at the attached spec
file, which you can probably adapt to your need.
Christophe.
On 04/04/2014 09:10, Rahul Singhal wrote:
Hello Community,
This is my first mail to the list and I have a small question. The maven build
page<http://spark.apache.org/docs/latest/building-with-maven.html#building-spark-debian-packages>
mentions a way to create a debian package but I was wondering if there is a simple
way (preferably through maven) to create a RPM package. Is there a script (which is
probably used for spark releases) that I can get my hands on? Or should I write one
on my own?
P.S. I don't want to use the "alien" software to convert a debian package to a
RPM.
Thanks,
Rahul Singhal
________________________________
Kelkoo SAS
Société par Actions Simplifiée
Au capital de € 4.168.964,30
Siège social : 8, rue du Sentier 75002 Paris
425 093 069 RCS Paris
Ce message et les pièces jointes sont confidentiels et établis à l'attention
exclusive de leurs destinataires. Si vous n'êtes pas le destinataire de ce
message, merci de le détruire et d'en avertir l'expéditeur.
Name: spark
Version: 0.9.0
# Build time settings
%global _full_version %{version}-incubating
%global _final_name %{name}-%{_full_version}
%global _spark_hadoop_version 2.2.0
%global _spark_dir /opt
Release: 2
Summary: Lightning-fast cluster computing
Group: Development/Libraries
License: ASL 2.0
URL: http://spark.apache.org/
Source0: http://www.eu.apache.org/dist/incubator/spark/%{_final_name}/%{_final_name}.tgz
BuildRequires: git
Requires: /bin/bash
Requires: /bin/sh
Requires: /usr/bin/env
%description
Apache Spark is a fast and general engine for large-scale data processing.
%prep
%setup -q -n %{_final_name}
%build
SPARK_HADOOP_VERSION=%{_spark_hadoop_version} SPARK_YARN=true ./sbt/sbt assembly
find bin -type f -name '*.cmd' -exec rm -f {} \;
%install
mkdir -p ${RPM_BUILD_ROOT}%{_spark_dir}/%{name}/%{_final_name}/{conf,jars}
echo "Spark %{_full_version} built for Hadoop %{_spark_hadoop_version}" > "${RPM_BUILD_ROOT}%{_spark_dir}/%{name}/%{_final_name}/RELEASE"
cp assembly/target/scala*/spark-assembly-%{_full_version}-hadoop%{_spark_hadoop_version}.jar ${RPM_BUILD_ROOT}%{_spark_dir}/%{name}/%{_final_name}/jars/spark-assembly-hadoop.jar
cp conf/*.template ${RPM_BUILD_ROOT}%{_spark_dir}/%{name}/%{_final_name}/conf
cp -r bin ${RPM_BUILD_ROOT}%{_spark_dir}/%{name}/%{_final_name}
cp -r python ${RPM_BUILD_ROOT}%{_spark_dir}/%{name}/%{_final_name}
cp -r sbin ${RPM_BUILD_ROOT}%{_spark_dir}/%{name}/%{_final_name}
%files
%defattr(-,root,root,-)
%{_spark_dir}/%{name}
%changelog
* Mon Mar 31 2014 Christophe Préaud <[email protected]> 0.9.0-2
- Use description and Summary from Fedora RPM
* Wed Mar 26 2014 Christophe Préaud <[email protected]> 0.9.0-1
- first version with changelog :-)
