Yup -- it looks like we're going to need reapproval when we change our jobs[1].
[1] https://github.com/jenkinsci/job-dsl-plugin/wiki/Script-Security#script-approval On Tue, Apr 18, 2017 at 10:20 AM, Ted Yu <yuzhih...@gmail.com> wrote: > Thanks Jason for the effort. > Looks like we hit this: > > ERROR: script not yet approved for use > > > On Tue, Apr 18, 2017 at 10:16 AM, Jason Kuster < > jasonkus...@google.com.invalid> wrote: > > > I'm looking into this currently as well; that's one of the mitigations > I'm > > considering too but I'm giving the evaluate thing a try[1][2] (once it > > starts running -- executors are full currently). > > > > [1] https://builds.apache.org/view/Beam/job/beam_SeedJob/215/ > > [2] https://github.com/apache/beam/pull/2578 > > > > On Tue, Apr 18, 2017 at 10:12 AM, Ted Yu <yuzhih...@gmail.com> wrote: > > > > > To unblock the builds, how about embedding functions used by respective > > > scripts in the scripts themselves ? > > > > > > e.g. buildPerformanceTest is only used by the following scripts: > > > > > > .test-infra/jenkins/job_beam_PerformanceTests_Dataflow.groovy: > > > common_job_properties.buildPerformanceTest(delegate, argMap) > > > .test-infra/jenkins/job_beam_PerformanceTests_JDBC.groovy: > > > common_job_properties.buildPerformanceTest(delegate, argMap) > > > .test-infra/jenkins/job_beam_PerformanceTests_Spark.groovy: > > > common_job_properties.buildPerformanceTest(delegate, argMap) > > > > > > On Tue, Apr 18, 2017 at 10:05 AM, Davor Bonaci <da...@apache.org> > wrote: > > > > > > > Not so simple, unfortunately [1]. Ideas welcome ;-) > > > > > > > > Davor > > > > > > > > [1] > > > > https://github.com/jenkinsci/job-dsl-plugin/wiki/Migration# > > > > migrating-to-160 > > > > > > > > On Tue, Apr 18, 2017 at 9:57 AM, Ted Yu <yuzhih...@gmail.com> wrote: > > > > > > > > > I wonder if we should adopt the suggestion here (involving > evaluate): > > > > > http://stackoverflow.com/questions/9136328/including-a- > > > > > groovy-script-in-another-groovy > > > > > > > > > > On Tue, Apr 18, 2017 at 9:45 AM, Apache Jenkins Server < > > > > > jenk...@builds.apache.org> wrote: > > > > > > > > > > > See <https://builds.apache.org/job/beam_SeedJob/214/display/ > > > > > > redirect?page=changes> > > > > > > > > > > > > Changes: > > > > > > > > > > > > [jbonofre] [BEAM-59] Register standard FileSystems wherever we > > > register > > > > > > > > > > > > [iemejia] Enable flink dependency enforcement and make > dependencies > > > > > > explicit > > > > > > > > > > > > [iemejia] Fix Javadoc warnings on Flink Runner > > > > > > > > > > > > [iemejia] Remove flink-annotations dependency > > > > > > > > > > > > [iemejia] [BEAM-1993] Remove special unbounded Flink source/sink > > > > > > > > > > > > [tgroh] Translate PTransforms to and from Runner API Protos > > > > > > > > > > > > [altay] Clean up DirectRunner Clock and TransformResult > > > > > > > > > > > > [altay] Remove overloading of __call__ in DirectRunner > > > > > > > > > > > > ------------------------------------------ > > > > > > [...truncated 202.75 KB...] > > > > > > x [deleted] (none) -> origin/pr/902/merge > > > > > > x [deleted] (none) -> origin/pr/903/head > > > > > > x [deleted] (none) -> origin/pr/903/merge > > > > > > x [deleted] (none) -> origin/pr/904/head > > > > > > x [deleted] (none) -> origin/pr/904/merge > > > > > > x [deleted] (none) -> origin/pr/905/head > > > > > > x [deleted] (none) -> origin/pr/905/merge > > > > > > x [deleted] (none) -> origin/pr/906/head > > > > > > x [deleted] (none) -> origin/pr/906/merge > > > > > > x [deleted] (none) -> origin/pr/907/head > > > > > > x [deleted] (none) -> origin/pr/907/merge > > > > > > x [deleted] (none) -> origin/pr/908/head > > > > > > x [deleted] (none) -> origin/pr/909/head > > > > > > x [deleted] (none) -> origin/pr/909/merge > > > > > > x [deleted] (none) -> origin/pr/91/head > > > > > > x [deleted] (none) -> origin/pr/91/merge > > > > > > x [deleted] (none) -> origin/pr/910/head > > > > > > x [deleted] (none) -> origin/pr/911/head > > > > > > x [deleted] (none) -> origin/pr/911/merge > > > > > > x [deleted] (none) -> origin/pr/912/head > > > > > > x [deleted] (none) -> origin/pr/912/merge > > > > > > x [deleted] (none) -> origin/pr/913/head > > > > > > x [deleted] (none) -> origin/pr/913/merge > > > > > > x [deleted] (none) -> origin/pr/914/head > > > > > > x [deleted] (none) -> origin/pr/914/merge > > > > > > x [deleted] (none) -> origin/pr/915/head > > > > > > x [deleted] (none) -> origin/pr/915/merge > > > > > > x [deleted] (none) -> origin/pr/916/head > > > > > > x [deleted] (none) -> origin/pr/916/merge > > > > > > x [deleted] (none) -> origin/pr/917/head > > > > > > x [deleted] (none) -> origin/pr/917/merge > > > > > > x [deleted] (none) -> origin/pr/918/head > > > > > > x [deleted] (none) -> origin/pr/918/merge > > > > > > x [deleted] (none) -> origin/pr/919/head > > > > > > x [deleted] (none) -> origin/pr/919/merge > > > > > > x [deleted] (none) -> origin/pr/92/head > > > > > > x [deleted] (none) -> origin/pr/92/merge > > > > > > x [deleted] (none) -> origin/pr/920/head > > > > > > x [deleted] (none) -> origin/pr/920/merge > > > > > > x [deleted] (none) -> origin/pr/921/head > > > > > > x [deleted] (none) -> origin/pr/921/merge > > > > > > x [deleted] (none) -> origin/pr/922/head > > > > > > x [deleted] (none) -> origin/pr/922/merge > > > > > > x [deleted] (none) -> origin/pr/923/head > > > > > > x [deleted] (none) -> origin/pr/924/head > > > > > > x [deleted] (none) -> origin/pr/925/head > > > > > > x [deleted] (none) -> origin/pr/925/merge > > > > > > x [deleted] (none) -> origin/pr/926/head > > > > > > x [deleted] (none) -> origin/pr/926/merge > > > > > > x [deleted] (none) -> origin/pr/927/head > > > > > > x [deleted] (none) -> origin/pr/927/merge > > > > > > x [deleted] (none) -> origin/pr/928/head > > > > > > x [deleted] (none) -> origin/pr/929/head > > > > > > x [deleted] (none) -> origin/pr/93/head > > > > > > x [deleted] (none) -> origin/pr/930/head > > > > > > x [deleted] (none) -> origin/pr/930/merge > > > > > > x [deleted] (none) -> origin/pr/931/head > > > > > > x [deleted] (none) -> origin/pr/931/merge > > > > > > x [deleted] (none) -> origin/pr/932/head > > > > > > x [deleted] (none) -> origin/pr/932/merge > > > > > > x [deleted] (none) -> origin/pr/933/head > > > > > > x [deleted] (none) -> origin/pr/933/merge > > > > > > x [deleted] (none) -> origin/pr/934/head > > > > > > x [deleted] (none) -> origin/pr/934/merge > > > > > > x [deleted] (none) -> origin/pr/935/head > > > > > > x [deleted] (none) -> origin/pr/936/head > > > > > > x [deleted] (none) -> origin/pr/936/merge > > > > > > x [deleted] (none) -> origin/pr/937/head > > > > > > x [deleted] (none) -> origin/pr/937/merge > > > > > > x [deleted] (none) -> origin/pr/938/head > > > > > > x [deleted] (none) -> origin/pr/939/head > > > > > > x [deleted] (none) -> origin/pr/94/head > > > > > > x [deleted] (none) -> origin/pr/940/head > > > > > > x [deleted] (none) -> origin/pr/940/merge > > > > > > x [deleted] (none) -> origin/pr/941/head > > > > > > x [deleted] (none) -> origin/pr/941/merge > > > > > > x [deleted] (none) -> origin/pr/942/head > > > > > > x [deleted] (none) -> origin/pr/942/merge > > > > > > x [deleted] (none) -> origin/pr/943/head > > > > > > x [deleted] (none) -> origin/pr/943/merge > > > > > > x [deleted] (none) -> origin/pr/944/head > > > > > > x [deleted] (none) -> origin/pr/945/head > > > > > > x [deleted] (none) -> origin/pr/945/merge > > > > > > x [deleted] (none) -> origin/pr/946/head > > > > > > x [deleted] (none) -> origin/pr/946/merge > > > > > > x [deleted] (none) -> origin/pr/947/head > > > > > > x [deleted] (none) -> origin/pr/947/merge > > > > > > x [deleted] (none) -> origin/pr/948/head > > > > > > x [deleted] (none) -> origin/pr/948/merge > > > > > > x [deleted] (none) -> origin/pr/949/head > > > > > > x [deleted] (none) -> origin/pr/949/merge > > > > > > x [deleted] (none) -> origin/pr/95/head > > > > > > x [deleted] (none) -> origin/pr/95/merge > > > > > > x [deleted] (none) -> origin/pr/950/head > > > > > > x [deleted] (none) -> origin/pr/951/head > > > > > > x [deleted] (none) -> origin/pr/951/merge > > > > > > x [deleted] (none) -> origin/pr/952/head > > > > > > x [deleted] (none) -> origin/pr/952/merge > > > > > > x [deleted] (none) -> origin/pr/953/head > > > > > > x [deleted] (none) -> origin/pr/954/head > > > > > > x [deleted] (none) -> origin/pr/954/merge > > > > > > x [deleted] (none) -> origin/pr/955/head > > > > > > x [deleted] (none) -> origin/pr/955/merge > > > > > > x [deleted] (none) -> origin/pr/956/head > > > > > > x [deleted] (none) -> origin/pr/957/head > > > > > > x [deleted] (none) -> origin/pr/958/head > > > > > > x [deleted] (none) -> origin/pr/959/head > > > > > > x [deleted] (none) -> origin/pr/959/merge > > > > > > x [deleted] (none) -> origin/pr/96/head > > > > > > x [deleted] (none) -> origin/pr/96/merge > > > > > > x [deleted] (none) -> origin/pr/960/head > > > > > > x [deleted] (none) -> origin/pr/960/merge > > > > > > x [deleted] (none) -> origin/pr/961/head > > > > > > x [deleted] (none) -> origin/pr/962/head > > > > > > x [deleted] (none) -> origin/pr/962/merge > > > > > > x [deleted] (none) -> origin/pr/963/head > > > > > > x [deleted] (none) -> origin/pr/963/merge > > > > > > x [deleted] (none) -> origin/pr/964/head > > > > > > x [deleted] (none) -> origin/pr/965/head > > > > > > x [deleted] (none) -> origin/pr/965/merge > > > > > > x [deleted] (none) -> origin/pr/966/head > > > > > > x [deleted] (none) -> origin/pr/967/head > > > > > > x [deleted] (none) -> origin/pr/967/merge > > > > > > x [deleted] (none) -> origin/pr/968/head > > > > > > x [deleted] (none) -> origin/pr/968/merge > > > > > > x [deleted] (none) -> origin/pr/969/head > > > > > > x [deleted] (none) -> origin/pr/969/merge > > > > > > x [deleted] (none) -> origin/pr/97/head > > > > > > x [deleted] (none) -> origin/pr/97/merge > > > > > > x [deleted] (none) -> origin/pr/970/head > > > > > > x [deleted] (none) -> origin/pr/970/merge > > > > > > x [deleted] (none) -> origin/pr/971/head > > > > > > x [deleted] (none) -> origin/pr/971/merge > > > > > > x [deleted] (none) -> origin/pr/972/head > > > > > > x [deleted] (none) -> origin/pr/973/head > > > > > > x [deleted] (none) -> origin/pr/974/head > > > > > > x [deleted] (none) -> origin/pr/974/merge > > > > > > x [deleted] (none) -> origin/pr/975/head > > > > > > x [deleted] (none) -> origin/pr/975/merge > > > > > > x [deleted] (none) -> origin/pr/976/head > > > > > > x [deleted] (none) -> origin/pr/976/merge > > > > > > x [deleted] (none) -> origin/pr/977/head > > > > > > x [deleted] (none) -> origin/pr/977/merge > > > > > > x [deleted] (none) -> origin/pr/978/head > > > > > > x [deleted] (none) -> origin/pr/978/merge > > > > > > x [deleted] (none) -> origin/pr/979/head > > > > > > x [deleted] (none) -> origin/pr/979/merge > > > > > > x [deleted] (none) -> origin/pr/98/head > > > > > > x [deleted] (none) -> origin/pr/980/head > > > > > > x [deleted] (none) -> origin/pr/980/merge > > > > > > x [deleted] (none) -> origin/pr/981/head > > > > > > x [deleted] (none) -> origin/pr/982/head > > > > > > x [deleted] (none) -> origin/pr/982/merge > > > > > > x [deleted] (none) -> origin/pr/983/head > > > > > > x [deleted] (none) -> origin/pr/983/merge > > > > > > x [deleted] (none) -> origin/pr/984/head > > > > > > x [deleted] (none) -> origin/pr/984/merge > > > > > > x [deleted] (none) -> origin/pr/985/head > > > > > > x [deleted] (none) -> origin/pr/985/merge > > > > > > x [deleted] (none) -> origin/pr/986/head > > > > > > x [deleted] (none) -> origin/pr/986/merge > > > > > > x [deleted] (none) -> origin/pr/987/head > > > > > > x [deleted] (none) -> origin/pr/988/head > > > > > > x [deleted] (none) -> origin/pr/988/merge > > > > > > x [deleted] (none) -> origin/pr/989/head > > > > > > x [deleted] (none) -> origin/pr/989/merge > > > > > > x [deleted] (none) -> origin/pr/99/head > > > > > > x [deleted] (none) -> origin/pr/99/merge > > > > > > x [deleted] (none) -> origin/pr/990/head > > > > > > x [deleted] (none) -> origin/pr/990/merge > > > > > > x [deleted] (none) -> origin/pr/991/head > > > > > > x [deleted] (none) -> origin/pr/991/merge > > > > > > x [deleted] (none) -> origin/pr/992/head > > > > > > x [deleted] (none) -> origin/pr/992/merge > > > > > > x [deleted] (none) -> origin/pr/993/head > > > > > > x [deleted] (none) -> origin/pr/993/merge > > > > > > x [deleted] (none) -> origin/pr/994/head > > > > > > x [deleted] (none) -> origin/pr/994/merge > > > > > > x [deleted] (none) -> origin/pr/995/head > > > > > > x [deleted] (none) -> origin/pr/995/merge > > > > > > x [deleted] (none) -> origin/pr/996/head > > > > > > x [deleted] (none) -> origin/pr/996/merge > > > > > > x [deleted] (none) -> origin/pr/997/head > > > > > > x [deleted] (none) -> origin/pr/997/merge > > > > > > x [deleted] (none) -> origin/pr/998/head > > > > > > x [deleted] (none) -> origin/pr/999/head > > > > > > x [deleted] (none) -> origin/pr/999/merge > > > > > > error: RPC failed; result=18, HTTP code = 200 > > > > > > fatal: The remote end hung up unexpectedly > > > > > > > > > > > > at org.jenkinsci.plugins.gitclient.CliGitAPIImpl. > > > > > > launchCommandIn(CliGitAPIImpl.java:1799) > > > > > > at org.jenkinsci.plugins.gitclient.CliGitAPIImpl. > > > > > > launchCommandWithCredentials(CliGitAPIImpl.java:1525) > > > > > > at org.jenkinsci.plugins.gitclient.CliGitAPIImpl. > > > > > > access$300(CliGitAPIImpl.java:65) > > > > > > at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1. > > > > > > execute(CliGitAPIImpl.java:316) > > > > > > at org.jenkinsci.plugins.gitclient.RemoteGitImpl$ > > > > > > CommandInvocationHandler$1.call(RemoteGitImpl.java:153) > > > > > > at org.jenkinsci.plugins.gitclient.RemoteGitImpl$ > > > > > > CommandInvocationHandler$1.call(RemoteGitImpl.java:146) > > > > > > at hudson.remoting.UserRequest. > > perform(UserRequest.java:153) > > > > > > at hudson.remoting.UserRequest. > > perform(UserRequest.java:50) > > > > > > at hudson.remoting.Request$2.run(Request.java:336) > > > > > > at hudson.remoting.InterceptingExecutorService$1.call( > > > > > > InterceptingExecutorService.java:68) > > > > > > at java.util.concurrent.FutureTask.run(FutureTask. > > java:262) > > > > > > at java.util.concurrent.ThreadPoolExecutor.runWorker( > > > > > > ThreadPoolExecutor.java:1145) > > > > > > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > > > > > > ThreadPoolExecutor.java:615) > > > > > > at java.lang.Thread.run(Thread.java:745) > > > > > > at ......remote call to beam4(Native Method) > > > > > > at hudson.remoting.Channel.attachCallSiteStackTrace( > > > > > > Channel.java:1537) > > > > > > at hudson.remoting.UserResponse. > > > retrieve(UserRequest.java:253) > > > > > > at hudson.remoting.Channel.call(Channel.java:822) > > > > > > at org.jenkinsci.plugins.gitclient.RemoteGitImpl$ > > > > > > CommandInvocationHandler.execute(RemoteGitImpl.java:146) > > > > > > at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown > > > > Source) > > > > > > at sun.reflect.DelegatingMethodAccessorImpl.invoke( > > > > > > DelegatingMethodAccessorImpl.java:43) > > > > > > at java.lang.reflect.Method.invoke(Method.java:498) > > > > > > at org.jenkinsci.plugins.gitclient.RemoteGitImpl$ > > > > > > CommandInvocationHandler.invoke(RemoteGitImpl.java:132) > > > > > > at com.sun.proxy.$Proxy103.execute(Unknown Source) > > > > > > at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804) > > > > > > ... 11 more > > > > > > ERROR: null > > > > > > Retrying after 10 seconds > > > > > > > git rev-parse --is-inside-work-tree # timeout=10 > > > > > > Fetching changes from the remote Git repository > > > > > > > git config remote.origin.url https://github.com/apache/ > beam.git > > # > > > > > > timeout=10 > > > > > > Pruning obsolete local branches > > > > > > Fetching upstream changes from https://github.com/apache/ > beam.git > > > > > > > git --version # timeout=10 > > > > > > > git fetch --tags --progress https://github.com/apache/ > beam.git > > > > > > +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/ > > > > > origin/pr/* > > > > > > --prune > > > > > > > git rev-parse origin/master^{commit} # timeout=10 > > > > > > Checking out Revision 034bcb4e2a2ee59c1a9bf16690547765064327e2 > > > > > > (origin/master) > > > > > > > git config core.sparsecheckout # timeout=10 > > > > > > > git checkout -f 034bcb4e2a2ee59c1a9bf16690547765064327e2 > > > > > > > git rev-list c52ce7c4bd952d943bccb8acff53b36b40c35428 # > > > timeout=10 > > > > > > Cleaning workspace > > > > > > > git rev-parse --verify HEAD # timeout=10 > > > > > > Resetting working tree > > > > > > > git reset --hard # timeout=10 > > > > > > > git clean -fdx # timeout=10 > > > > > > [EnvInject] - Executing scripts and injecting environment > variables > > > > after > > > > > > the SCM step. > > > > > > [EnvInject] - Injecting as environment variables the properties > > > content > > > > > > SPARK_LOCAL_IP=127.0.0.1 > > > > > > > > > > > > [EnvInject] - Variables injected successfully. > > > > > > Processing DSL script job_beam_PerformanceTests_Dataflow.groovy > > > > > > ERROR: startup failed: > > > > > > <https://builds.apache.org/job/beam_SeedJob/ws/.test- > > > > > > infra/jenkins/job_beam_PerformanceTests_Dataflow.groovy>: 19: > > unable > > > > to > > > > > > resolve class common_job_properties > > > > > > @ line 19, column 1. > > > > > > import common_job_properties > > > > > > ^ > > > > > > > > > > > > 1 error > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > ------- > > Jason Kuster > > Apache Beam / Google Cloud Dataflow > > > -- ------- Jason Kuster Apache Beam / Google Cloud Dataflow
