Re: Changing log level of spark

2014-07-01 Thread Philip Limbeck
in the jar I package with `sbt assembly`. That >> works fine for me, at least on the driver. >> >> Tobias >> >> On Wed, Jun 25, 2014 at 2:25 PM, Philip Limbeck >> wrote: >> > Hi! >> > >> > According to >> > >> https://

Changing log level of spark

2014-06-24 Thread Philip Limbeck
Hi! According to https://spark.apache.org/docs/0.9.0/configuration.html#configuring-logging, changing log-level is just a matter of creating a log4j.properties (which is in the classpath of spark) and changing log level there for the root logger. I did this steps on every node in the cluster (mast

Spark switch to debug loglevel

2014-06-24 Thread Philip Limbeck
Hi! According to https://spark.apache.org/docs/0.9.0/configuration.html#configuring-logging, changing log-level is just a matter of creating a log4j.properties (which is in the classpath of spark) and changing log level there for the root logger. I did this steps on every node in the cluster (mast

Problem with HBase external table on freshly created EMR cluster

2014-03-05 Thread Philip Limbeck
Hi! I created an EMR cluster with Spark and HBase according to http://aws.amazon.com/articles/4926593393724923 with --hbase flag to include HBase. Although spark and shark both work nicely with the provided S3 examples, there is a problem with external tables pointing to the HBase instance. We cr