Compiling ERROR for Spark MetricsSystem

2015-12-11 Thread Haijia Zhou 
Hi,

0 down vote 
favorite


I'm trying to register a custom Spark metrics source to Spark metrics system 
with following code:

val source = new CustomMetricSource() 
SparkEnv.get.metricsSystem.registerSource(source)

Then the code failed compiling with following error:

Error:scalac: Error: bad symbolic reference. A signature in MetricsSystem.class 
refers to term servlet in value org.jetty which is not available. It may be 
completely missing from the current classpath, or the version on the classpath 
might be incompatible with the version used when compiling MetricsSystem.class. 
scala.reflect.internal.Types$TypeError: bad symbolic reference. A signature in 
MetricsSystem.class refers to term servlet in value org.jetty which is not 
available. It may be completely missing from the current classpath, or the 
version on the classpath might be incompatible with the version used when 
compiling MetricsSystem.class. at 
scala.reflect.internal.pickling.UnPickler$Scan.toTypeError(UnPickler.scala:847) 
at 
scala.reflect.internal.pickling.UnPickler$Scan$LazyTypeRef.complete(UnPickler.scala:854)
 at 
scala.reflect.internal.pickling.UnPickler$Scan$LazyTypeRef.load(UnPickler.scala:863)
 at scala.reflect.internal.Symbols$Symbol.typeParams(Symbols.scala:1489) at 
scala.tools.nsc.transform.SpecializeTypes$$anonfun$scala$tools$nsc$transform$SpecializeTypes$$normalizeMember$1.apply(SpecializeTypes.scala:798)
 at 
scala.tools.nsc.transform.SpecializeTypes$$anonfun$scala$tools$nsc$transform$SpecializeTypes$$normalizeMember$1.apply(SpecializeTypes.scala:798)
 at scala.reflect.internal.SymbolTable.atPhase(SymbolTable.scala:207) at 
scala.reflect.internal.SymbolTable.beforePhase(SymbolTable.scala:215) at 
scala.tools.nsc.transform.SpecializeTypes.scala$tools$nsc$transform$SpecializeTypes$$normalizeMember(SpecializeTypes.scala:797)
 at 
scala.tools.nsc.transform.SpecializeTypes$$anonfun$22.apply(SpecializeTypes.scala:751)
 at 
scala.tools.nsc.transform.SpecializeTypes$$anonfun$22.apply(SpecializeTypes.scala:749)
 at 
scala.collection.TraversableLike$$anonfun$flatMap$1.apply(TraversableLike.scala:251)
 at 
scala.collection.TraversableLike$$anonfun$flatMap$1.apply(TraversableLike.scala:251)
 at scala.collection.immutable.List.foreach(List.scala:318) at 
scala.collection.TraversableLike$class.flatMap(TraversableLike.scala:251) at 
scala.collection.AbstractTraversable.flatMap(Traversable.scala:105) at 
scala.tools.nsc.transform.SpecializeTypes.specializeClass(SpecializeTypes.scala:749)
 at 
scala.tools.nsc.transform.SpecializeTypes.transformInfo(SpecializeTypes.scala:1172)
 at 
scala.tools.nsc.transform.InfoTransform$Phase$$anon$1.transform(InfoTransform.scala:38)
 at scala.reflect.internal.Symbols$Symbol.rawInfo(Symbols.scala:1321) at 
scala.reflect.internal.Symbols$Symbol.info(Symbols.scala:1241) at 
scala.reflect.internal.Symbols$Symbol.isDerivedValueClass(Symbols.scala:658) at 
scala.reflect.internal.Symbols$Symbol.isMethodWithExtension(Symbols.scala:661) 
at 
scala.tools.nsc.transform.Erasure$ErasureTransformer$$anon$1.preEraseNormalApply(Erasure.scala:1100)
 at 
scala.tools.nsc.transform.Erasure$ErasureTransformer$$anon$1.preEraseApply(Erasure.scala:1195)
 at 
scala.tools.nsc.transform.Erasure$ErasureTransformer$$anon$1.preErase(Erasure.scala:1205)
 at 
scala.tools.nsc.transform.Erasure$ErasureTransformer$$anon$1.transform(Erasure.scala:1280)
 at 
scala.tools.nsc.transform.Erasure$ErasureTransformer$$anon$1.transform(Erasure.scala:1030)
 at scala.reflect.internal.Trees$$anonfun$itransform$2.apply(Trees.scala:1235) 
at scala.reflect.internal.Trees$$anonfun$itransform$2.apply(Trees.scala:1233) 
at scala.reflect.api.Trees$Transformer.atOwner(Trees.scala:2936) at 
scala.tools.nsc.transform.TypingTransformers$TypingTransformer.atOwner(TypingTransformers.scala:34)
 at 
scala.tools.nsc.transform.TypingTransformers$TypingTransformer.atOwner(TypingTransformers.scala:28)
 at 
scala.tools.nsc.transform.TypingTransformers$TypingTransformer.atOwner(TypingTransformers.scala:19)
 at scala.reflect.internal.Trees$class.itransform(Trees.scala:1232) at 
scala.reflect.internal.SymbolTable.itransform(SymbolTable.scala:13) at 
scala.reflect.internal.SymbolTable.itransform(SymbolTable.scala:13) at 
scala.reflect.api.Trees$Transformer.transform(Trees.scala:2897) at 
scala.tools.nsc.transform.TypingTransformers$TypingTransformer.transform(TypingTransformers.scala:48)
 at 
scala.tools.nsc.transform.Erasure$ErasureTransformer$$anon$1.transform(Erasure.scala:1288)
 at 
scala.tools.nsc.transform.Erasure$ErasureTransformer$$anon$1.transform(Erasure.scala:1030)
 at 
scala.reflect.api.Trees$Transformer$$anonfun$transformStats$1.apply(Trees.scala:2927)
 at 
scala.reflect.api.Trees$Transformer$$anonfun$transformStats$1.apply(Trees.scala:2925)
 at scala.collection.immutable.List.loop$1(List.scala:170) at

Re: Compiling ERROR for Spark MetricsSystem

2015-12-11 Thread Jean-Baptiste Onofré 

Hi,

can you check the scala version you use ? 2.10 or 2.11 ?

Thanks,
Regards
JB

On 12/11/2015 05:47 PM, Haijia Zhou wrote:

Hi,

0down vote favorite


**


I'm trying to register a custom Spark metrics source to Spark metrics
system with following code:

val source = new CustomMetricSource()
SparkEnv.get.metricsSystem.registerSource(source)

Then the code failed compiling with following error:

Error:scalac: Error: bad symbolic reference. A signature in
MetricsSystem.class refers to term servlet in value org.jetty which is
not available. It may be completely missing from the current classpath,
or the version on the classpath might be incompatible with the version
used when compiling MetricsSystem.class.
scala.reflect.internal.Types$TypeError: bad symbolic reference. A
signature in MetricsSystem.class refers to term servlet in value
org.jetty which is not available. It may be completely missing from the
current classpath, or the version on the classpath might be incompatible
with the version used when compiling MetricsSystem.class. at
scala.reflect.internal.pickling.UnPickler$Scan.toTypeError(UnPickler.scala:847)
at
scala.reflect.internal.pickling.UnPickler$Scan$LazyTypeRef.complete(UnPickler.scala:854)
at
scala.reflect.internal.pickling.UnPickler$Scan$LazyTypeRef.load(UnPickler.scala:863)
at scala.reflect.internal.Symbols$Symbol.typeParams(Symbols.scala:1489)
at
scala.tools.nsc.transform.SpecializeTypes$$anonfun$scala$tools$nsc$transform$SpecializeTypes$$normalizeMember$1.apply(SpecializeTypes.scala:798)
at
scala.tools.nsc.transform.SpecializeTypes$$anonfun$scala$tools$nsc$transform$SpecializeTypes$$normalizeMember$1.apply(SpecializeTypes.scala:798)
at scala.reflect.internal.SymbolTable.atPhase(SymbolTable.scala:207) at
scala.reflect.internal.SymbolTable.beforePhase(SymbolTable.scala:215) at
scala.tools.nsc.transform.SpecializeTypes.scala$tools$nsc$transform$SpecializeTypes$$normalizeMember(SpecializeTypes.scala:797)
at
scala.tools.nsc.transform.SpecializeTypes$$anonfun$22.apply(SpecializeTypes.scala:751)
at
scala.tools.nsc.transform.SpecializeTypes$$anonfun$22.apply(SpecializeTypes.scala:749)
at
scala.collection.TraversableLike$$anonfun$flatMap$1.apply(TraversableLike.scala:251)
at
scala.collection.TraversableLike$$anonfun$flatMap$1.apply(TraversableLike.scala:251)
at scala.collection.immutable.List.foreach(List.scala:318) at
scala.collection.TraversableLike$class.flatMap(TraversableLike.scala:251) at
scala.collection.AbstractTraversable.flatMap(Traversable.scala:105) at
scala.tools.nsc.transform.SpecializeTypes.specializeClass(SpecializeTypes.scala:749)
at
scala.tools.nsc.transform.SpecializeTypes.transformInfo(SpecializeTypes.scala:1172)
at
scala.tools.nsc.transform.InfoTransform$Phase$$anon$1.transform(InfoTransform.scala:38)
at scala.reflect.internal.Symbols$Symbol.rawInfo(Symbols.scala:1321) at
scala.reflect.internal.Symbols$Symbol.info(Symbols.scala:1241) at
scala.reflect.internal.Symbols$Symbol.isDerivedValueClass(Symbols.scala:658)
at
scala.reflect.internal.Symbols$Symbol.isMethodWithExtension(Symbols.scala:661)
at
scala.tools.nsc.transform.Erasure$ErasureTransformer$$anon$1.preEraseNormalApply(Erasure.scala:1100)
at
scala.tools.nsc.transform.Erasure$ErasureTransformer$$anon$1.preEraseApply(Erasure.scala:1195)
at
scala.tools.nsc.transform.Erasure$ErasureTransformer$$anon$1.preErase(Erasure.scala:1205)
at
scala.tools.nsc.transform.Erasure$ErasureTransformer$$anon$1.transform(Erasure.scala:1280)
at
scala.tools.nsc.transform.Erasure$ErasureTransformer$$anon$1.transform(Erasure.scala:1030)
at
scala.reflect.internal.Trees$$anonfun$itransform$2.apply(Trees.scala:1235)
at
scala.reflect.internal.Trees$$anonfun$itransform$2.apply(Trees.scala:1233)
at scala.reflect.api.Trees$Transformer.atOwner(Trees.scala:2936) at
scala.tools.nsc.transform.TypingTransformers$TypingTransformer.atOwner(TypingTransformers.scala:34)
at
scala.tools.nsc.transform.TypingTransformers$TypingTransformer.atOwner(TypingTransformers.scala:28)
at
scala.tools.nsc.transform.TypingTransformers$TypingTransformer.atOwner(TypingTransformers.scala:19)
at scala.reflect.internal.Trees$class.itransform(Trees.scala:1232) at
scala.reflect.internal.SymbolTable.itransform(SymbolTable.scala:13) at
scala.reflect.internal.SymbolTable.itransform(SymbolTable.scala:13) at
scala.reflect.api.Trees$Transformer.transform(Trees.scala:2897) at
scala.tools.nsc.transform.TypingTransformers$TypingTransformer.transform(TypingTransformers.scala:48)
at
scala.tools.nsc.transform.Erasure$ErasureTransformer$$anon$1.transform(Erasure.scala:1288)
at
scala.tools.nsc.transform.Erasure$ErasureTransformer$$anon$1.transform(Erasure.scala:1030)
at
scala.reflect.api.Trees$Transformer$$anonfun$transformStats$1.apply(Trees.scala:2927)
at
scala.reflect.api.Trees$Transformer$$anonfun$transformStats$1.apply(Trees.scala:2925)
at