Why spark 1.6.1 wokers auto stopped and can not register with master:Worker registration failed: Duplicate worker ID?

2016-05-17 Thread sunday2000
Hi,
  
   A client woker auto stoppped, and has this error message, do u know why this 
happen?
  
 16/05/18 03:34:37 INFO Worker: Master with url spark://master:7077 requested 
this worker to reconnect.
16/05/18 03:34:37 INFO Worker: Not spawning another attempt to register with 
the master, since there is an attempt scheduled already.
16/05/18 03:34:37 INFO Worker: Master with url spark://master:7077 requested 
this worker to reconnect.
16/05/18 03:34:37 INFO Worker: Not spawning another attempt to register with 
the master, since there is an attempt scheduled already.
16/05/18 03:34:37 ERROR Worker: Worker registration failed: Duplicate worker ID

?????? Why spark 1.6.1 master can not monitor and start a auto stop worker?

2016-05-16 Thread sunday2000
I Use $SPARK_HOME/sbin/start-slave.sh client10, get this error:
  
 org.apache.spark.deploy.worker.Worker running as process 5490.  Stop it first.
  

 

 --  --
  ??: "Ted Yu";<yuzhih...@gmail.com>;
 : 2016??5??17??(??) 10:22
 ??????: "sunday2000"<2314476...@qq.com>; 
 : "user"<user@spark.apache.org>; 
 : Re: Why spark 1.6.1 master can not monitor and start a auto stop worker?

 

 I guess 2.0 would be released before Spark Summit.
 
 On Mon, May 16, 2016 at 7:19 PM, sunday2000 <2314476...@qq.com> wrote:
  Hi,
   I found the bug status is : Solved, then when will release the solved 
version?
  

 

 --  --
  ??: "Ted Yu";<yuzhih...@gmail.com>;
 : 2016??5??17??(??) 9:58
 ??: "sunday2000"<2314476...@qq.com>; 
 : "user"<user@spark.apache.org>; 
 : Re: Why spark 1.6.1 master can not monitor and start a auto stop worker?

   

 Please take a look at this JIRA:  
 [SPARK-13604][CORE] Sync worker's state after registering with master



 
 On Mon, May 16, 2016 at 6:54 PM, sunday2000 <2314476...@qq.com> wrote:
  Hi,
  
   A client woker stoppped, and has this error message, do u know why this 
happen?
  
 16/05/17 03:42:20 INFO Worker: Not spawning another attempt to register with 
the master, since there is an attempt scheduled already.
16/05/17 03:42:20 INFO Worker: Master with url spark://master:7077 requested 
this worker to reconnect.
16/05/17 03:42:20 INFO Worker: Not spawning another attempt to register with 
the master, since there is an attempt scheduled already.
16/05/17 03:42:20 INFO Worker: Master with url spark://master:7077 requested 
this worker to reconnect.
16/05/17 03:42:20 INFO Worker: Not spawning another attempt to register with 
the master, since there is an attempt scheduled already.
16/05/17 03:42:20 INFO Worker: Master with url spark://master:7077 requested 
this worker to reconnect.
16/05/17 03:42:20 INFO Worker: Not spawning another attempt to register with 
the master, since there is an attempt scheduled already.
16/05/17 03:42:21 ERROR Worker: Worker registration failed: Duplicate worker ID

?????? Why spark 1.6.1 master can not monitor and start a auto stop worker?

2016-05-16 Thread sunday2000
Hi,
   I found the bug status is : Solved, then when will release the solved 
version?
  

 

 --  --
  ??: "Ted Yu";<yuzhih...@gmail.com>;
 : 2016??5??17??(??) ????9:58
 ??????: "sunday2000"<2314476...@qq.com>; 
 : "user"<user@spark.apache.org>; 
 : Re: Why spark 1.6.1 master can not monitor and start a auto stop worker?

 

 Please take a look at this JIRA:  
 [SPARK-13604][CORE] Sync worker's state after registering with master



 
 On Mon, May 16, 2016 at 6:54 PM, sunday2000 <2314476...@qq.com> wrote:
  Hi,
  
   A client woker stoppped, and has this error message, do u know why this 
happen?
  
 16/05/17 03:42:20 INFO Worker: Not spawning another attempt to register with 
the master, since there is an attempt scheduled already.
16/05/17 03:42:20 INFO Worker: Master with url spark://master:7077 requested 
this worker to reconnect.
16/05/17 03:42:20 INFO Worker: Not spawning another attempt to register with 
the master, since there is an attempt scheduled already.
16/05/17 03:42:20 INFO Worker: Master with url spark://master:7077 requested 
this worker to reconnect.
16/05/17 03:42:20 INFO Worker: Not spawning another attempt to register with 
the master, since there is an attempt scheduled already.
16/05/17 03:42:20 INFO Worker: Master with url spark://master:7077 requested 
this worker to reconnect.
16/05/17 03:42:20 INFO Worker: Not spawning another attempt to register with 
the master, since there is an attempt scheduled already.
16/05/17 03:42:21 ERROR Worker: Worker registration failed: Duplicate worker ID

Why spark 1.6.1 master can not monitor and start a auto stop worker?

2016-05-16 Thread sunday2000
Hi,
  
   A client woker stoppped, and has this error message, do u know why this 
happen?
  
 16/05/17 03:42:20 INFO Worker: Not spawning another attempt to register with 
the master, since there is an attempt scheduled already.
16/05/17 03:42:20 INFO Worker: Master with url spark://master:7077 requested 
this worker to reconnect.
16/05/17 03:42:20 INFO Worker: Not spawning another attempt to register with 
the master, since there is an attempt scheduled already.
16/05/17 03:42:20 INFO Worker: Master with url spark://master:7077 requested 
this worker to reconnect.
16/05/17 03:42:20 INFO Worker: Not spawning another attempt to register with 
the master, since there is an attempt scheduled already.
16/05/17 03:42:20 INFO Worker: Master with url spark://master:7077 requested 
this worker to reconnect.
16/05/17 03:42:20 INFO Worker: Not spawning another attempt to register with 
the master, since there is an attempt scheduled already.
16/05/17 03:42:21 ERROR Worker: Worker registration failed: Duplicate worker ID

Why spark 1.6.1 run so slow?

2016-05-12 Thread sunday2000
Hi,
   When we use spark 1.6.1 to word count a file of 25M bytes , with 2 nodes in 
cluster mode, it cost 10 seconds to finish the task.
  
   Why so slow ? Could you tell why?

Why spark give out this error message?

2016-05-12 Thread sunday2000
Hi,
   Do u know what this message mean?
  
 org.apache.spark.shuffle.FetchFailedException: Failed to connect to 
localhost/127.0.0.1:50606
at 
org.apache.spark.storage.ShuffleBlockFetcherIterator.throwFetchFailedException(ShuffleBlockFetcherIterator.scala:323)
at 
org.apache.spark.storage.ShuffleBlockFetcherIterator.next(ShuffleBlockFetcherIterator.scala:300)
at 
org.apache.spark.storage.ShuffleBlockFetcherIterator.next(ShuffleBlockFetcherIterator.scala:51)
at scala.collection.Iterator$$anon$11.next(Iterator.scala:328)
at scala.collection.Iterator$$anon$13.hasNext(Iterator.scala:371)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at 
org.apache.spark.util.CompletionIterator.hasNext(CompletionIterator.scala:32)
at 
org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:39)
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327)
at scala.collection.Iterator$class.foreach(Iterator.scala:727)
at scala.collection.AbstractIterator.foreach(Iterator.scala:1157)
at 
org.apache.spark.api.python.PythonRDD$.writeIteratorToStream(PythonRDD.scala:452)
at 
org.apache.spark.api.python.PythonRunner$WriterThread$$anonfun$run$3.apply(PythonRDD.scala:280)
at org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1765)
at 
org.apache.spark.api.python.PythonRunner$WriterThread.run(PythonRDD.scala:239)
Caused by: java.io.IOException: Failed to connect to localhost/127.0.0.1:50606

Will this affect the result of spark?

2016-05-11 Thread sunday2000
Hi,
   When running spark in cluster mode, it give out this warning message 
occasionally, will it affect the final result?
  
  ERROR CoarseGrainedExecutorBackend: Driver 192.168.1.1:45725 disassociated! 
Shutting down.

?????? spark 1.6.1 build failure of : scala-maven-plugin

2016-05-05 Thread sunday2000
Hi,
  I built spark 1.6.1 on Linux redhat 2.6.32-279.el6.x86_64 server, with JDK: 
jdk1.8.0_91 




--  --
??: "Divya Gehlot";<divya.htco...@gmail.com>;
: 2016??5??5??(??) ????10:41
??????: "sunday2000"<2314476...@qq.com>; 
: "user"<user@spark.apache.org>; "user"<u...@phoenix.apache.org>; 
: Re: spark 1.6.1 build failure of : scala-maven-plugin



Hi,
My Javac version 


C:\Users\Divya>javac -version
javac 1.7.0_79



C:\Users\Divya>java -version
java version "1.7.0_79"
Java(TM) SE Runtime Environment (build 1.7.0_79-b15)
Java HotSpot(TM) 64-Bit Server VM (build 24.79-b02, mixed mode)



Do I need use higher version ?




Thanks,
Divya 



On 4 May 2016 at 21:31, sunday2000 <2314476...@qq.com> wrote:
Check your javac version, and update it.




--  --
??: "Divya Gehlot";<divya.htco...@gmail.com>;
: 2016??5??4??(??) 11:25
??: "sunday2000"<2314476...@qq.com>; 
: "user"<user@spark.apache.org>; "user"<u...@phoenix.apache.org>; 
: Re: spark 1.6.1 build failure of : scala-maven-plugin



Hi ,Even I am getting the similar error 
Failed to execute goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile

When I tried to build Phoenix Project using maven .
Maven version : 3.3
Java version - 1.7_67
Phoenix - downloaded latest master from Git hub
If anybody find the the resolution please share.




Thanks,
Divya 


On 3 May 2016 at 10:18, sunday2000 <2314476...@qq.com> wrote:
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 14.765 s
[INFO] Finished at: 2016-05-03T10:08:46+08:00
[INFO] Final Memory: 35M/191M
[INFO] 
[ERROR] Failed to execute goal 
net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first) on 
project spark-test-tags_2.10: Execution scala-compile-first of goal 
net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed. CompileFailed -> 
[Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal 
net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first) on 
project spark-test-tags_2.10: Execution scala-compile-first of goal 
net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed.
at 
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:224)
at 
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at 
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at 
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at 
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at 
org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at 
org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:307)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:193)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:106)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:862)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:286)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:197)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 
org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at 
org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at 
org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at 
org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.PluginExecutionException: Execution 
scala-compile-first of goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile 
failed.
at 
org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:145)
at 
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
... 20 more
Caused by: Compile failed via zinc server
at 
sbt_inc.SbtIncrementalCompiler.zincCompile(SbtIncrementalCompiler.java:136)
at 
sbt_i

?????? spark 1.6.1 build failure of : scala-maven-plugin

2016-05-04 Thread sunday2000
Check your javac version, and update it.




--  --
??: "Divya Gehlot";<divya.htco...@gmail.com>;
: 2016??5??4??(??) ????11:25
??????: "sunday2000"<2314476...@qq.com>; 
: "user"<user@spark.apache.org>; "user"<u...@phoenix.apache.org>; 
: Re: spark 1.6.1 build failure of : scala-maven-plugin



Hi ,Even I am getting the similar error 
Failed to execute goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile

When I tried to build Phoenix Project using maven .
Maven version : 3.3
Java version - 1.7_67
Phoenix - downloaded latest master from Git hub
If anybody find the the resolution please share.




Thanks,
Divya 


On 3 May 2016 at 10:18, sunday2000 <2314476...@qq.com> wrote:
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 14.765 s
[INFO] Finished at: 2016-05-03T10:08:46+08:00
[INFO] Final Memory: 35M/191M
[INFO] 
[ERROR] Failed to execute goal 
net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first) on 
project spark-test-tags_2.10: Execution scala-compile-first of goal 
net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed. CompileFailed -> 
[Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal 
net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first) on 
project spark-test-tags_2.10: Execution scala-compile-first of goal 
net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed.
at 
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:224)
at 
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at 
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at 
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at 
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at 
org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at 
org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:307)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:193)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:106)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:862)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:286)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:197)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 
org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at 
org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at 
org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at 
org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.PluginExecutionException: Execution 
scala-compile-first of goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile 
failed.
at 
org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:145)
at 
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
... 20 more
Caused by: Compile failed via zinc server
at 
sbt_inc.SbtIncrementalCompiler.zincCompile(SbtIncrementalCompiler.java:136)
at 
sbt_inc.SbtIncrementalCompiler.compile(SbtIncrementalCompiler.java:86)
at 
scala_maven.ScalaCompilerSupport.incrementalCompile(ScalaCompilerSupport.java:303)
at 
scala_maven.ScalaCompilerSupport.compile(ScalaCompilerSupport.java:119)
at 
scala_maven.ScalaCompilerSupport.doExecute(ScalaCompilerSupport.java:99)
at scala_maven.ScalaMojoSupport.execute(ScalaMojoSupport.java:482)
at 
org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:134)
... 21 more
[ERROR] 
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :spark-test-tags_2.10

?????? spark 1.6.1 build failure of : scala-maven-plugin

2016-05-03 Thread sunday2000
Problem solved, by use a newer version javac:
 [INFO] 
[INFO] BUILD SUCCESS
[INFO] 
[INFO] Total time: 02:07 h
[INFO] Finished at: 2016-05-03T19:51:15+08:00
[INFO] Final Memory: 392M/1520M
[INFO] 
  

 

 --  --
  ??: "sunday2000";<2314476...@qq.com>;
 : 2016??5??3??(??) 11:41
 ??: "Ted Yu"<yuzhih...@gmail.com>; 
 : "user"<user@spark.apache.org>; 
 : ?? spark 1.6.1 build failure of : scala-maven-plugin

 

 
  I use this command:
 

 build/mvn clean -Phive -Phive-thriftserver -Pyarn -Phadoop-2.6 -Psparkr 
-Dhadoop.version=2.7.0 package -DskipTests -X
 

 and get this failure message:
 [INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 14.567 s
[INFO] Finished at: 2016-05-03T11:40:32+08:00
[INFO] Final Memory: 42M/192M
[INFO] 
[ERROR] Failed to execute goal 
net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first) on 
project spark-test-tags_2.10: Execution scala-compile-first of goal 
net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed. CompileFailed -> 
[Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal 
net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first) on 
project spark-test-tags_2.10: Execution scala-compile-first of goal 
net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed.
at 
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:224)
at 
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at 
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at 
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at 
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at 
org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at 
org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:307)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:193)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:106)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:862)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:286)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:197)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 
org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at 
org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at 
org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at 
org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.PluginExecutionException: Execution 
scala-compile-first of goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile 
failed.
at 
org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:145)
at 
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
... 20 more
Caused by: javac returned nonzero exit code
at sbt.compiler.JavaCompiler$JavaTool0.compile(JavaCompiler.scala:77)
at sbt.compiler.JavaTool$class.apply(JavaCompiler.scala:35)
at sbt.compiler.JavaCompiler$JavaTool0.apply(JavaCompiler.scala:63)
at sbt.compiler.JavaCompiler$class.compile(JavaCompiler.scala:21)
at sbt.compiler.JavaCompiler$JavaTool0.compile(JavaCompiler.scala:63)
at 
sbt.compiler.AggressiveCompile$$anonfun$3$$anonfun$compileJava$1$1.apply$mcV$sp(AggressiveCompile.scala:127)
at 
sbt.compiler.AggressiveCompile$$anonfun$3$$anonfun$compileJava$1$1.apply(AggressiveCompile.scala:127)
at 
sbt.compiler.AggressiveCompile$$anonfun$3$$anonfun$compileJava$1$1.apply(AggressiveCompile.scala:127)
at 
sbt.compiler.AggressiveCompile.sbt$compiler$AggressiveCompile$$timed(AggressiveCompile.scala:166)
at 
sbt.

?????? spark 1.6.1 build failure of : scala-maven-plugin

2016-05-02 Thread sunday2000
:37)
at sbt.inc.IncrementalCompile$.apply(Compile.scala:27)
at sbt.compiler.AggressiveCompile.compile2(AggressiveCompile.scala:157)
at sbt.compiler.AggressiveCompile.compile1(AggressiveCompile.scala:71)
at com.typesafe.zinc.Compiler.compile(Compiler.scala:184)
at com.typesafe.zinc.Compiler.compile(Compiler.scala:164)
at 
sbt_inc.SbtIncrementalCompiler.compile(SbtIncrementalCompiler.java:92)
at 
scala_maven.ScalaCompilerSupport.incrementalCompile(ScalaCompilerSupport.java:303)
at 
scala_maven.ScalaCompilerSupport.compile(ScalaCompilerSupport.java:119)
at 
scala_maven.ScalaCompilerSupport.doExecute(ScalaCompilerSupport.java:99)
at scala_maven.ScalaMojoSupport.execute(ScalaMojoSupport.java:482)
at 
org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:134)
... 21 more
[ERROR] 
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :spark-test-tags_2.10




--  --
??: "Ted Yu";<yuzhih...@gmail.com>;
: 2016??5??3??(??) 11:21
??: "sunday2000"<2314476...@qq.com>; 
: "user"<user@spark.apache.org>; 
: Re: spark 1.6.1 build failure of : scala-maven-plugin



I rebuilt 1.6.1 locally:
[INFO] Spark Project External Kafka ... SUCCESS [ 30.868 s]
[INFO] Spark Project Examples . SUCCESS [02:29 min]
[INFO] Spark Project External Kafka Assembly .. SUCCESS [  9.644 s]
[INFO] 
[INFO] BUILD SUCCESS
[INFO] 
[INFO] Total time: 23:51 min
[INFO] Finished at: 2016-05-02T20:17:36-07:00
[INFO] Final Memory: 116M/4074M



Here was the command I used:


build/mvn clean -Phive -Phive-thriftserver -Pyarn -Phadoop-2.6 -Psparkr 
-Dhadoop.version=2.7.0 package -DskipTests



I used Java 1.8.0_65




Can you specify -X on mvn command line ?


On Mon, May 2, 2016 at 7:51 PM, sunday2000 <2314476...@qq.com> wrote:

Hi,

  This is not a continuation of a previous query, and now building  by connect 
to inernet without a proxy as before.

  After disable Zinc, get this errormessage:

[ERROR] Failed to execute goal 
net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first) on 
project spark-test-tags_2.10: Execution scala-compile-first of goal 
net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed. CompileFailed -> 
[Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal 
net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first) on 
project spark-test-tags_2.10: Execution scala-compile-first of goal 
net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed.
at 
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:224)
at 
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at 
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)

java version:
java -version
java version "1.8.0_91"
Java(TM) SE Runtime Environment (build 1.8.0_91-b14)
Java HotSpot(TM) 64-Bit Server VM (build 25.91-b14, mixed mode)


maven version:
spark-1.6.1/build/apache-maven-3.3.3/bin/mvn






--  --
??: "Ted Yu";<yuzhih...@gmail.com>;
: 2016??5??3??(??) 10:43
??: "sunday2000"<2314476...@qq.com>; 
: "user"<user@spark.apache.org>; 
: Re: spark 1.6.1 build failure of : scala-maven-plugin



Looks like this was continuation of your previous query.

If that is the case, please use original thread so that people can have more 
context.


Have you tried disabling Zinc server ?


What's the version of Java / maven you're using ?


Are you behind proxy ?


Finally the 1.6.1 artifacts are available in many places. Is there any 
modification you have done which requires rebuilding ?


Cheers


On Mon, May 2, 2016 at 7:18 PM, sunday2000 <2314476...@qq.com> wrote:
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 14.765 s
[INFO] Finished at: 2016-05-03T10:08:46+08:00
[INFO] Final Memory: 35M/191M
[INFO] 
[ERROR] Failed to execute goal 
net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first) on 
project spark-test-tags_2.10: 

?????? spark 1.6.1 build failure of : scala-maven-plugin

2016-05-02 Thread sunday2000
Hi,

  This is not a continuation of a previous query, and now building  by connect 
to inernet without a proxy as before.

  After disable Zinc, get this errormessage:

[ERROR] Failed to execute goal 
net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first) on 
project spark-test-tags_2.10: Execution scala-compile-first of goal 
net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed. CompileFailed -> 
[Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal 
net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first) on 
project spark-test-tags_2.10: Execution scala-compile-first of goal 
net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed.
at 
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:224)
at 
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at 
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)

java version:
java -version
java version "1.8.0_91"
Java(TM) SE Runtime Environment (build 1.8.0_91-b14)
Java HotSpot(TM) 64-Bit Server VM (build 25.91-b14, mixed mode)


maven version:
spark-1.6.1/build/apache-maven-3.3.3/bin/mvn






--  --
??: "Ted Yu";<yuzhih...@gmail.com>;
: 2016??5??3??(??) 10:43
??: "sunday2000"<2314476...@qq.com>; 
: "user"<user@spark.apache.org>; 
: Re: spark 1.6.1 build failure of : scala-maven-plugin



Looks like this was continuation of your previous query.

If that is the case, please use original thread so that people can have more 
context.


Have you tried disabling Zinc server ?


What's the version of Java / maven you're using ?


Are you behind proxy ?


Finally the 1.6.1 artifacts are available in many places. Is there any 
modification you have done which requires rebuilding ?


Cheers


On Mon, May 2, 2016 at 7:18 PM, sunday2000 <2314476...@qq.com> wrote:
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 14.765 s
[INFO] Finished at: 2016-05-03T10:08:46+08:00
[INFO] Final Memory: 35M/191M
[INFO] 
[ERROR] Failed to execute goal 
net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first) on 
project spark-test-tags_2.10: Execution scala-compile-first of goal 
net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed. CompileFailed -> 
[Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal 
net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first) on 
project spark-test-tags_2.10: Execution scala-compile-first of goal 
net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed.
at 
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:224)
at 
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at 
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at 
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at 
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at 
org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at 
org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:307)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:193)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:106)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:862)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:286)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:197)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 
org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at 
org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at 
org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at 
org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.PluginExecutionException: Execution 
scala-compile-first of goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile 
failed.
   

spark 1.6.1 build failure of : scala-maven-plugin

2016-05-02 Thread sunday2000
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 14.765 s
[INFO] Finished at: 2016-05-03T10:08:46+08:00
[INFO] Final Memory: 35M/191M
[INFO] 
[ERROR] Failed to execute goal 
net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first) on 
project spark-test-tags_2.10: Execution scala-compile-first of goal 
net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed. CompileFailed -> 
[Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal 
net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first) on 
project spark-test-tags_2.10: Execution scala-compile-first of goal 
net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed.
at 
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:224)
at 
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at 
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at 
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at 
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at 
org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at 
org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:307)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:193)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:106)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:862)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:286)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:197)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 
org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at 
org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at 
org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at 
org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.PluginExecutionException: Execution 
scala-compile-first of goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile 
failed.
at 
org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:145)
at 
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
... 20 more
Caused by: Compile failed via zinc server
at 
sbt_inc.SbtIncrementalCompiler.zincCompile(SbtIncrementalCompiler.java:136)
at 
sbt_inc.SbtIncrementalCompiler.compile(SbtIncrementalCompiler.java:86)
at 
scala_maven.ScalaCompilerSupport.incrementalCompile(ScalaCompilerSupport.java:303)
at 
scala_maven.ScalaCompilerSupport.compile(ScalaCompilerSupport.java:119)
at 
scala_maven.ScalaCompilerSupport.doExecute(ScalaCompilerSupport.java:99)
at scala_maven.ScalaMojoSupport.execute(ScalaMojoSupport.java:482)
at 
org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:134)
... 21 more
[ERROR] 
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :spark-test-tags_2.10

?????? Why Non-resolvable parent POM for org.apache.spark:spark-parent_2.10:1.6.1:Couldnottransfer artifact org.apache:apache:pom:14 from/to central(https://repo1.maven.org/maven2):repo1.maven.org:unk

2016-05-02 Thread sunday2000
:27)
at sbt.compiler.AggressiveCompile.compile2(AggressiveCompile.scala:157)
at sbt.compiler.AggressiveCompile.compile1(AggressiveCompile.scala:71)
at com.typesafe.zinc.Compiler.compile(Compiler.scala:184)
at com.typesafe.zinc.Compiler.compile(Compiler.scala:164)
at 
sbt_inc.SbtIncrementalCompiler.compile(SbtIncrementalCompiler.java:92)
at 
scala_maven.ScalaCompilerSupport.incrementalCompile(ScalaCompilerSupport.java:303)
at 
scala_maven.ScalaCompilerSupport.compile(ScalaCompilerSupport.java:119)
at 
scala_maven.ScalaCompilerSupport.doExecute(ScalaCompilerSupport.java:99)
at scala_maven.ScalaMojoSupport.execute(ScalaMojoSupport.java:482)
at 
org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:134)
... 21 more
[ERROR] 
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :spark-test-tags_2.10





--  --
??: "Ted Yu";<yuzhih...@gmail.com>;
: 2016??5??2??(??) 0:09
??: "sunday2000"<2314476...@qq.com>; 
: "user"<user@spark.apache.org>; 
: Re: Why Non-resolvable parent POM for 
org.apache.spark:spark-parent_2.10:1.6.1:Couldnottransfer artifact 
org.apache:apache:pom:14 from/to 
central(https://repo1.maven.org/maven2):repo1.maven.org:unknown error



bq. Caused by: Compile failed via zinc server

Looks like Zinc got in the way of compilation.


Consider stopping Zinc and do a clean build.


On Sun, May 1, 2016 at 8:35 AM, sunday2000 <2314476...@qq.com> wrote:
Error message:
[debug] External API changes: API Changes: Set()
[debug] Modified binary dependencies: Set()
[debug] Initial directly invalidated sources: 
Set(/root/dl/spark-1.6.1/tags/src/main/java/org/apache/spark/tags/DockerTest.java,
 
/root/dl/spark-1.6.1/tags/src/main/java/org/apache/spark/tags/ExtendedHiveTest.java,
 
/root/dl/spark-1.6.1/tags/src/main/java/org/apache/spark/tags/ExtendedYarnTest.java)
[debug] 
[debug] Sources indirectly invalidated by:
[debug] product: Set()
[debug] binary dep: Set()
[debug] external source: Set()
[debug] All initially invalidated sources: 
Set(/root/dl/spark-1.6.1/tags/src/main/java/org/apache/spark/tags/DockerTest.java,
 
/root/dl/spark-1.6.1/tags/src/main/java/org/apache/spark/tags/ExtendedHiveTest.java,
 
/root/dl/spark-1.6.1/tags/src/main/java/org/apache/spark/tags/ExtendedYarnTest.java)
[debug] Recompiling all 3 sources: invalidated sources (3) exceeded 50.0% of 
all sources
[info] Compiling 3 Java sources to 
/root/dl/spark-1.6.1/tags/target/scala-2.10/classes...
[debug] Attempting to call javac directly...
[debug] com.sun.tools.javac.Main not found with appropriate method signature; 
forking javac instead
[debug] Forking javac: javac @/tmp/sbt_e1764914/argfile
[error] javac: invalid source release: 1.7
[error] Usage: javac  
[error] use -help for a list of possible options
[debug] javac returned exit code: 2
[error] Compile failed at May 1, 2016 11:33:06 PM [0.420s]
[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Spark Project Parent POM ... SUCCESS [  6.542 s]
[INFO] Spark Project Test Tags  FAILURE [  1.412 s]
[INFO] Spark Project Launcher . SKIPPED
[INFO] Spark Project Networking ... SKIPPED
[INFO] Spark Project Shuffle Streaming Service  SKIPPED
[INFO] Spark Project Unsafe ... SKIPPED
[INFO] Spark Project Core . SKIPPED
[INFO] Spark Project Bagel  SKIPPED
[INFO] Spark Project GraphX ... SKIPPED
[INFO] Spark Project Streaming  SKIPPED
[INFO] Spark Project Catalyst . SKIPPED
[INFO] Spark Project SQL .. SKIPPED
[INFO] Spark Project ML Library ... SKIPPED
[INFO] Spark Project Tools  SKIPPED
[INFO] Spark Project Hive . SKIPPED
[INFO] Spark Project Docker Integration Tests . SKIPPED
[INFO] Spark Project REPL . SKIPPED
[INFO] Spark Project Assembly . SKIPPED
[INFO] Spark Project External Twitter . SKIPPED
[INFO] Spark Project External Flume Sink .. SKIPPED
[INFO] Spark Project External Flume ... SKIPPED
[INFO] Spark Project External Flume Assembly .. SKIPPED
[INFO] Spark Project Ex

?????? Why Non-resolvable parent POM for org.apache.spark:spark-parent_2.10:1.6.1:Couldnot transfer artifact org.apache:apache:pom:14 from/to central(https://repo1.maven.org/maven2):repo1.maven.org: u

2016-05-01 Thread sunday2000
gt;;
: 2016??5??1??(??) ????9:50
??: "sunday2000"<2314476...@qq.com>; 
: "user"<user@spark.apache.org>; 
: Re: Why Non-resolvable parent POM for 
org.apache.spark:spark-parent_2.10:1.6.1:Couldnot transfer artifact 
org.apache:apache:pom:14 from/to 
central(https://repo1.maven.org/maven2):repo1.maven.org: unknown error



FYI

Accessing the link below gave me 'Page does not exist'


I am in California.


I checked the dependency tree of 1.6.1 - I didn't see such dependence.


Can you pastebin related maven output ?


Thanks


On Sun, May 1, 2016 at 6:32 AM, sunday2000 <2314476...@qq.com> wrote:
Seems it is because fail to download this url:
http://maven.twttr.com/org/apache/apache/14/apache-14.pom




--  --
??: "Ted Yu";<yuzhih...@gmail.com>;
: 2016??5??1??(??) 9:27
??: "sunday2000"<2314476...@qq.com>; 
: "user"<user@spark.apache.org>; 
: Re: Why Non-resolvable parent POM for 
org.apache.spark:spark-parent_2.10:1.6.1:Could not transfer artifact 
org.apache:apache:pom:14 from/to central(https://repo1.maven.org/maven2): 
repo1.maven.org: unknown error



bq. Non-resolvable parent POM for org.apache.spark:spark-parent_2.10:1.6.1

Looks like you were using Spark 1.6.1


Can you check firewall settings ?


I saw similar report from Chinese users.


Consider using proxy.


On Sun, May 1, 2016 at 4:19 AM, sunday2000 <2314476...@qq.com> wrote:
Hi,
  We are compiling spare 1.6.0 in a linux server, while getting this error 
message. Could you tell us how to solve it? thanks.


[INFO] Scanning for projects...
Downloading: https://repo1.maven.org/maven2/org/apache/apache/14/apache-14.pom
Downloading: 
https://repository.apache.org/content/repositories/releases/org/apache/apache/14/apache-14.pom
Downloading: 
https://repository.jboss.org/nexus/content/repositories/releases/org/apache/apache/14/apache-14.pom
Downloading: 
https://repo.eclipse.org/content/repositories/paho-releases/org/apache/apache/14/apache-14.pom
Downloading: 
https://repository.cloudera.com/artifactory/cloudera-repos/org/apache/apache/14/apache-14.pom
Downloading: 
https://oss.sonatype.org/content/repositories/orgspark-project-1113/org/apache/apache/14/apache-14.pom
Downloading: http://repository.mapr.com/maven/org/apache/apache/14/apache-14.pom
Downloading: http://maven.twttr.com/org/apache/apache/14/apache-14.pom
[ERROR] [ERROR] Some problems were encountered while processing the POMs:
[FATAL] Non-resolvable parent POM for org.apache.spark:spark-parent_2.10:1.6.1: 
Could not transfer artifact org.apache:apache:pom:14 from/to central 
(https://repo1.maven.org/maven2): repo1.maven.org: unknown error and 
'parent.relativePath' points at wrong local POM @ line 22, column 11
 @ 
[ERROR] The build could not read 1 project -> [Help 1]
[ERROR]   
[ERROR]   The project org.apache.spark:spark-parent_2.10:1.6.1 
(/data/spark/spark-1.6.1/pom.xml) has 1 error
[ERROR] Non-resolvable parent POM for 
org.apache.spark:spark-parent_2.10:1.6.1: Could not transfer artifact 
org.apache:apache:pom:14 from/to central (https://repo1.maven.org/maven2): 
repo1.maven.org: unknown error and 'parent.relativePath' points at wrong local 
POM @ line 22, column 11: Unknown host repo1.maven.org: unknown error -> [Help 
2]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException
[ERROR] [Help 2] 
http://cwiki.apache.org/confluence/display/MAVEN/UnresolvableModelException

?????? Why Non-resolvable parent POM for org.apache.spark:spark-parent_2.10:1.6.1:Couldnot transfer artifact org.apache:apache:pom:14 from/to central(https://repo1.maven.org/maven2):repo1.maven.org: u

2016-05-01 Thread sunday2000
Downloading: 
https://repository.apache.org/content/repositories/releases/org/apache/apache/14/apache-14.pom
Downloading: 
https://repository.jboss.org/nexus/content/repositories/releases/org/apache/apache/14/apache-14.pom
Downloading: 
https://repo.eclipse.org/content/repositories/paho-releases/org/apache/apache/14/apache-14.pom
Downloading: 
https://repository.cloudera.com/artifactory/cloudera-repos/org/apache/apache/14/apache-14.pom
Downloading: 
https://oss.sonatype.org/content/repositories/orgspark-project-1113/org/apache/apache/14/apache-14.pom
Downloading: http://repository.mapr.com/maven/org/apache/apache/14/apache-14.pom
Downloading: http://maven.twttr.com/org/apache/apache/14/apache-14.pom
[ERROR] [ERROR] Some problems were encountered while processing the POMs:
[FATAL] Non-resolvable parent POM for org.apache.spark:spark-parent_2.10:1.6.1: 
Could not transfer artifact org.apache:apache:pom:14 from/to central 
(https://repo1.maven.org/maven2): Connect to repo1.maven.org:443 
[repo1.maven.org/23.235.47.209] failed: Connection timed out and 
'parent.relativePath' points at wrong local POM @ line 22, column 11
 @ 
[ERROR] The build could not read 1 project -> [Help 1]
[ERROR]   
[ERROR]   The project org.apache.spark:spark-parent_2.10:1.6.1 
(/data/spark/spark-1.6.1/pom.xml) has 1 error
[ERROR] Non-resolvable parent POM for 
org.apache.spark:spark-parent_2.10:1.6.1: Could not transfer artifact 
org.apache:apache:pom:14 from/to central (https://repo1.maven.org/maven2): 
Connect to repo1.maven.org:443 [repo1.maven.org/23.235.47.209] failed: 
Connection timed out and 'parent.relativePath' points at wrong local POM @ line 
22, column 11 -> [Help 2]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException
[ERROR] [Help 2] 
http://cwiki.apache.org/confluence/display/MAVEN/UnresolvableModelException





--  --
??: "Ted Yu";<yuzhih...@gmail.com>;
: 2016??5??1??(??) 9:50
??: "sunday2000"<2314476...@qq.com>; 
: "user"<user@spark.apache.org>; 
: Re: Why Non-resolvable parent POM for 
org.apache.spark:spark-parent_2.10:1.6.1:Couldnot transfer artifact 
org.apache:apache:pom:14 from/to 
central(https://repo1.maven.org/maven2):repo1.maven.org: unknown error



FYI

Accessing the link below gave me 'Page does not exist'


I am in California.


I checked the dependency tree of 1.6.1 - I didn't see such dependence.


Can you pastebin related maven output ?


Thanks


On Sun, May 1, 2016 at 6:32 AM, sunday2000 <2314476...@qq.com> wrote:
Seems it is because fail to download this url:
http://maven.twttr.com/org/apache/apache/14/apache-14.pom




--  --
??: "Ted Yu";<yuzhih...@gmail.com>;
: 2016??5??1??(??) 9:27
??: "sunday2000"<2314476...@qq.com>; 
: "user"<user@spark.apache.org>; 
: Re: Why Non-resolvable parent POM for 
org.apache.spark:spark-parent_2.10:1.6.1:Could not transfer artifact 
org.apache:apache:pom:14 from/to central(https://repo1.maven.org/maven2): 
repo1.maven.org: unknown error



bq. Non-resolvable parent POM for org.apache.spark:spark-parent_2.10:1.6.1

Looks like you were using Spark 1.6.1


Can you check firewall settings ?


I saw similar report from Chinese users.


Consider using proxy.


On Sun, May 1, 2016 at 4:19 AM, sunday2000 <2314476...@qq.com> wrote:
Hi,
  We are compiling spare 1.6.0 in a linux server, while getting this error 
message. Could you tell us how to solve it? thanks.


[INFO] Scanning for projects...
Downloading: https://repo1.maven.org/maven2/org/apache/apache/14/apache-14.pom
Downloading: 
https://repository.apache.org/content/repositories/releases/org/apache/apache/14/apache-14.pom
Downloading: 
https://repository.jboss.org/nexus/content/repositories/releases/org/apache/apache/14/apache-14.pom
Downloading: 
https://repo.eclipse.org/content/repositories/paho-releases/org/apache/apache/14/apache-14.pom
Downloading: 
https://repository.cloudera.com/artifactory/cloudera-repos/org/apache/apache/14/apache-14.pom
Downloading: 
https://oss.sonatype.org/content/repositories/orgspark-project-1113/org/apache/apache/14/apache-14.pom
Downloading: http://repository.mapr.com/maven/org/apache/apache/14/apache-14.pom
Downloading: http://maven.twttr.com/org/apache/apache/14/apache-14.pom
[ERROR] [ERROR] Some problems were encountered while processing the POMs:
[FATAL] Non-resolvable parent POM for org.apache.spark:spark-parent_2.10:1.6.1: 
Could not transfer artifact org.apache:apache:pom:14 from/to central 
(https://repo

?????? Why Non-resolvable parent POM for org.apache.spark:spark-parent_2.10:1.6.1:Could not transfer artifact org.apache:apache:pom:14 from/to central(https://repo1.maven.org/maven2): repo1.maven.org:

2016-05-01 Thread sunday2000
Seems it is because fail to download this url:
http://maven.twttr.com/org/apache/apache/14/apache-14.pom




--  --
??: "Ted Yu";<yuzhih...@gmail.com>;
: 2016??5??1??(??) ????9:27
??????: "sunday2000"<2314476...@qq.com>; 
: "user"<user@spark.apache.org>; 
: Re: Why Non-resolvable parent POM for 
org.apache.spark:spark-parent_2.10:1.6.1:Could not transfer artifact 
org.apache:apache:pom:14 from/to central(https://repo1.maven.org/maven2): 
repo1.maven.org: unknown error



bq. Non-resolvable parent POM for org.apache.spark:spark-parent_2.10:1.6.1

Looks like you were using Spark 1.6.1


Can you check firewall settings ?


I saw similar report from Chinese users.


Consider using proxy.


On Sun, May 1, 2016 at 4:19 AM, sunday2000 <2314476...@qq.com> wrote:
Hi,
  We are compiling spare 1.6.0 in a linux server, while getting this error 
message. Could you tell us how to solve it? thanks.


[INFO] Scanning for projects...
Downloading: https://repo1.maven.org/maven2/org/apache/apache/14/apache-14.pom
Downloading: 
https://repository.apache.org/content/repositories/releases/org/apache/apache/14/apache-14.pom
Downloading: 
https://repository.jboss.org/nexus/content/repositories/releases/org/apache/apache/14/apache-14.pom
Downloading: 
https://repo.eclipse.org/content/repositories/paho-releases/org/apache/apache/14/apache-14.pom
Downloading: 
https://repository.cloudera.com/artifactory/cloudera-repos/org/apache/apache/14/apache-14.pom
Downloading: 
https://oss.sonatype.org/content/repositories/orgspark-project-1113/org/apache/apache/14/apache-14.pom
Downloading: http://repository.mapr.com/maven/org/apache/apache/14/apache-14.pom
Downloading: http://maven.twttr.com/org/apache/apache/14/apache-14.pom
[ERROR] [ERROR] Some problems were encountered while processing the POMs:
[FATAL] Non-resolvable parent POM for org.apache.spark:spark-parent_2.10:1.6.1: 
Could not transfer artifact org.apache:apache:pom:14 from/to central 
(https://repo1.maven.org/maven2): repo1.maven.org: unknown error and 
'parent.relativePath' points at wrong local POM @ line 22, column 11
 @ 
[ERROR] The build could not read 1 project -> [Help 1]
[ERROR]   
[ERROR]   The project org.apache.spark:spark-parent_2.10:1.6.1 
(/data/spark/spark-1.6.1/pom.xml) has 1 error
[ERROR] Non-resolvable parent POM for 
org.apache.spark:spark-parent_2.10:1.6.1: Could not transfer artifact 
org.apache:apache:pom:14 from/to central (https://repo1.maven.org/maven2): 
repo1.maven.org: unknown error and 'parent.relativePath' points at wrong local 
POM @ line 22, column 11: Unknown host repo1.maven.org: unknown error -> [Help 
2]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException
[ERROR] [Help 2] 
http://cwiki.apache.org/confluence/display/MAVEN/UnresolvableModelException

Why Non-resolvable parent POM for org.apache.spark:spark-parent_2.10:1.6.1: Could not transfer artifact org.apache:apache:pom:14 from/to central (https://repo1.maven.org/maven2): repo1.maven.org: unkn

2016-05-01 Thread sunday2000
Hi,
  We are compiling spare 1.6.0 in a linux server, while getting this error 
message. Could you tell us how to solve it? thanks.


[INFO] Scanning for projects...
Downloading: https://repo1.maven.org/maven2/org/apache/apache/14/apache-14.pom
Downloading: 
https://repository.apache.org/content/repositories/releases/org/apache/apache/14/apache-14.pom
Downloading: 
https://repository.jboss.org/nexus/content/repositories/releases/org/apache/apache/14/apache-14.pom
Downloading: 
https://repo.eclipse.org/content/repositories/paho-releases/org/apache/apache/14/apache-14.pom
Downloading: 
https://repository.cloudera.com/artifactory/cloudera-repos/org/apache/apache/14/apache-14.pom
Downloading: 
https://oss.sonatype.org/content/repositories/orgspark-project-1113/org/apache/apache/14/apache-14.pom
Downloading: http://repository.mapr.com/maven/org/apache/apache/14/apache-14.pom
Downloading: http://maven.twttr.com/org/apache/apache/14/apache-14.pom
[ERROR] [ERROR] Some problems were encountered while processing the POMs:
[FATAL] Non-resolvable parent POM for org.apache.spark:spark-parent_2.10:1.6.1: 
Could not transfer artifact org.apache:apache:pom:14 from/to central 
(https://repo1.maven.org/maven2): repo1.maven.org: unknown error and 
'parent.relativePath' points at wrong local POM @ line 22, column 11
 @ 
[ERROR] The build could not read 1 project -> [Help 1]
[ERROR]   
[ERROR]   The project org.apache.spark:spark-parent_2.10:1.6.1 
(/data/spark/spark-1.6.1/pom.xml) has 1 error
[ERROR] Non-resolvable parent POM for 
org.apache.spark:spark-parent_2.10:1.6.1: Could not transfer artifact 
org.apache:apache:pom:14 from/to central (https://repo1.maven.org/maven2): 
repo1.maven.org: unknown error and 'parent.relativePath' points at wrong local 
POM @ line 22, column 11: Unknown host repo1.maven.org: unknown error -> [Help 
2]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException
[ERROR] [Help 2] 
http://cwiki.apache.org/confluence/display/MAVEN/UnresolvableModelException

Why Non-resolvable parent POM for org.apache.spark:spark-parent_2.10:1.6.1: Could not transfer artifact org.apache:apache:pom:14 from/to central (https://repo1.maven.org/maven2): repo1.maven.org: unkn

2016-05-01 Thread sunday2000
Hi,
  We are compiling spare 1.6.0 in a linux server, while getting this error 
message. Could you tell us how to solve it? thanks.


[INFO] Scanning for projects...
Downloading: https://repo1.maven.org/maven2/org/apache/apache/14/apache-14.pom
Downloading: 
https://repository.apache.org/content/repositories/releases/org/apache/apache/14/apache-14.pom
Downloading: 
https://repository.jboss.org/nexus/content/repositories/releases/org/apache/apache/14/apache-14.pom
Downloading: 
https://repo.eclipse.org/content/repositories/paho-releases/org/apache/apache/14/apache-14.pom
Downloading: 
https://repository.cloudera.com/artifactory/cloudera-repos/org/apache/apache/14/apache-14.pom
Downloading: 
https://oss.sonatype.org/content/repositories/orgspark-project-1113/org/apache/apache/14/apache-14.pom
Downloading: http://repository.mapr.com/maven/org/apache/apache/14/apache-14.pom
Downloading: http://maven.twttr.com/org/apache/apache/14/apache-14.pom
[ERROR] [ERROR] Some problems were encountered while processing the POMs:
[FATAL] Non-resolvable parent POM for org.apache.spark:spark-parent_2.10:1.6.1: 
Could not transfer artifact org.apache:apache:pom:14 from/to central 
(https://repo1.maven.org/maven2): repo1.maven.org: unknown error and 
'parent.relativePath' points at wrong local POM @ line 22, column 11
 @ 
[ERROR] The build could not read 1 project -> [Help 1]
[ERROR]   
[ERROR]   The project org.apache.spark:spark-parent_2.10:1.6.1 
(/data/spark/spark-1.6.1/pom.xml) has 1 error
[ERROR] Non-resolvable parent POM for 
org.apache.spark:spark-parent_2.10:1.6.1: Could not transfer artifact 
org.apache:apache:pom:14 from/to central (https://repo1.maven.org/maven2): 
repo1.maven.org: unknown error and 'parent.relativePath' points at wrong local 
POM @ line 22, column 11: Unknown host repo1.maven.org: unknown error -> [Help 
2]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException
[ERROR] [Help 2] 
http://cwiki.apache.org/confluence/display/MAVEN/UnresolvableModelException