Hi Marvin, These are not actually files compiled from our source code, but third-party dependencies that are not published to Maven. SBT is a Scala-based build tool where you need that JAR to run. Where exactly is the policy on including these kinds of JARs?
The reason we went with them is because we saw other projects do it. For example, Kafka, which also builds using SBT, ships with sbt.jar. Matei On Dec 14, 2013, at 10:58 AM, Marvin Humphrey <mar...@rectangular.com> wrote: > On Sat, Dec 14, 2013 at 10:37 AM, Henry Saputra <henry.sapu...@gmail.com> > wrote: >> When you said "However they both contain binaries, which is not good." >> were you talking about the "spark-0.8.1-incubating-bin-* files ? > > There seem to be compiled files in the source archive. > > marvin@knut:~/spark $ tar -zxf spark-0.8.1-incubating.tgz > marvin@knut:~/spark $ cd spark-0.8.1-incubating > marvin@knut:~/spark/spark-0.8.1-incubating $ find . -print | grep ".jar$" > ./assembly/lib/net/sf/py4j/py4j/0.7/py4j-0.7.jar > ./core/src/test/resources/uncommons-maths-1.2.2.jar > ./repl/lib/scala-jline.jar > ./sbt/sbt-launch-0.11.3-2.jar > ./streaming/lib/org/apache/kafka/kafka/0.7.2-spark/kafka-0.7.2-spark.jar > marvin@knut:~/spark/spark-0.8.1-incubating $ > > One option for addressing that issue would be to move all compiled > dependencies to an accompanying "-deps" archive. > > Marvin Humphrey > > --------------------------------------------------------------------- > To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org > For additional commands, e-mail: general-h...@incubator.apache.org > --------------------------------------------------------------------- To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
