Re: New Metrics Sink class not packaged in spark-assembly jar

2015-02-09 Thread Patrick Wendell
Hi Judy, If you have added source files in the sink/ source folder, they should appear in the assembly jar when you build. One thing I noticed is that you are looking inside the /dist folder. That only gets populated if you run make-distribution. The normal development process is just to do mvn

New Metrics Sink class not packaged in spark-assembly jar

2015-02-09 Thread Judy Nash
Hello, Working on SPARK-5708https://issues.apache.org/jira/browse/SPARK-5708 - Add Slf4jSink to Spark Metrics Sink. Wrote a new Slf4jSink class (see patch attached), but the new class is not packaged as part of spark-assembly jar. Do I need to update build config somewhere to have this

RE: New Metrics Sink class not packaged in spark-assembly jar

2015-02-09 Thread Judy Nash
: New Metrics Sink class not packaged in spark-assembly jar Actually, to correct myself, the assembly jar is in assembly/target/scala-2.11 (I think). On Mon, Feb 9, 2015 at 10:42 PM, Patrick Wendell pwend...@gmail.commailto:pwend...@gmail.com wrote: Hi Judy, If you have added source files