Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.x/997/
2 tests failed. FAILED: org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload Error Message: expected:<[{indexVersion=1445818330639,generation=2,filelist=[_2d.fdt, _2d.fdx, _2d.fnm, _2d.nvd, _2d.nvm, _2d.si, _2d_Asserting_0.doc, _2d_Asserting_0.tim, _2d_Asserting_0.tip, _4p.fdt, _4p.fdx, _4p.fnm, _4p.nvd, _4p.nvm, _4p.si, _4p_Asserting_0.doc, _4p_Asserting_0.tim, _4p_Asserting_0.tip, _4q.fdt, _4q.fdx, _4q.fnm, _4q.nvd, _4q.nvm, _4q.si, _4q_Asserting_0.doc, _4q_Asserting_0.tim, _4q_Asserting_0.tip, _4r.fdt, _4r.fdx, _4r.fnm, _4r.nvd, _4r.nvm, _4r.si, _4r_Asserting_0.doc, _4r_Asserting_0.tim, _4r_Asserting_0.tip, _4s.fdt, _4s.fdx, _4s.fnm, _4s.nvd, _4s.nvm, _4s.si, _4s_Asserting_0.doc, _4s_Asserting_0.tim, _4s_Asserting_0.tip, _4t.fdt, _4t.fdx, _4t.fnm, _4t.nvd, _4t.nvm, _4t.si, _4t_Asserting_0.doc, _4t_Asserting_0.tim, _4t_Asserting_0.tip, _4u.fdt, _4u.fdx, _4u.fnm, _4u.nvd, _4u.nvm, _4u.si, _4u_Asserting_0.doc, _4u_Asserting_0.tim, _4u_Asserting_0.tip, _4v.fdt, _4v.fdx, _4v.fnm, _4v.nvd, _4v.nvm, _4v.si, _4v_Asserting_0.doc, _4v_Asserting_0.tim, _4v_Asserting_0.tip, _4w.fdt, _4w.fdx, _4w.fnm, _4w.nvd, _4w.nvm, _4w.si, _4w_Asserting_0.doc, _4w_Asserting_0.tim, _4w_Asserting_0.tip, _4x.fdt, _4x.fdx, _4x.fnm, _4x.nvd, _4x.nvm, _4x.si, _4x_Asserting_0.doc, _4x_Asserting_0.tim, _4x_Asserting_0.tip, _4y.fdt, _4y.fdx, _4y.fnm, _4y.nvd, _4y.nvm, _4y.si, _4y_Asserting_0.doc, _4y_Asserting_0.tim, _4y_Asserting_0.tip, _4z.fdt, _4z.fdx, _4z.fnm, _4z.nvd, _4z.nvm, _4z.si, _4z_Asserting_0.doc, _4z_Asserting_0.tim, _4z_Asserting_0.tip, _50.fdt, _50.fdx, _50.fnm, _50.nvd, _50.nvm, _50.si, _50_Asserting_0.doc, _50_Asserting_0.tim, _50_Asserting_0.tip, _51.fdt, _51.fdx, _51.fnm, _51.nvd, _51.nvm, _51.si, _51_Asserting_0.doc, _51_Asserting_0.tim, _51_Asserting_0.tip, _52.fdt, _52.fdx, _52.fnm, _52.nvd, _52.nvm, _52.si, _52_Asserting_0.doc, _52_Asserting_0.tim, _52_Asserting_0.tip, _53.fdt, _53.fdx, _53.fnm, _53.nvd, _53.nvm, _53.si, _53_Asserting_0.doc, _53_Asserting_0.tim, _53_Asserting_0.tip, _54.fdt, _54.fdx, _54.fnm, _54.nvd, _54.nvm, _54.si, _54_Asserting_0.doc, _54_Asserting_0.tim, _54_Asserting_0.tip, _55.fdt, _55.fdx, _55.fnm, _55.nvd, _55.nvm, _55.si, _55_Asserting_0.doc, _55_Asserting_0.tim, _55_Asserting_0.tip, _56.fdt, _56.fdx, _56.fnm, _56.nvd, _56.nvm, _56.si, _56_Asserting_0.doc, _56_Asserting_0.tim, _56_Asserting_0.tip, _57.fdt, _57.fdx, _57.fnm, _57.nvd, _57.nvm, _57.si, _57_Asserting_0.doc, _57_Asserting_0.tim, _57_Asserting_0.tip, _58.fdt, _58.fdx, _58.fnm, _58.nvd, _58.nvm, _58.si, _58_Asserting_0.doc, _58_Asserting_0.tim, _58_Asserting_0.tip, _59.fdt, _59.fdx, _59.fnm, _59.nvd, _59.nvm, _59.si, _59_Asserting_0.doc, _59_Asserting_0.tim, _59_Asserting_0.tip, _5a.fdt, _5a.fdx, _5a.fnm, _5a.nvd, _5a.nvm, _5a.si, _5a_Asserting_0.doc, _5a_Asserting_0.tim, _5a_Asserting_0.tip, _5b.fdt, _5b.fdx, _5b.fnm, _5b.nvd, _5b.nvm, _5b.si, _5b_Asserting_0.doc, _5b_Asserting_0.tim, _5b_Asserting_0.tip, _5c.fdt, _5c.fdx, _5c.fnm, _5c.nvd, _5c.nvm, _5c.si, _5c_Asserting_0.doc, _5c_Asserting_0.tim, _5c_Asserting_0.tip, _5d.fdt, _5d.fdx, _5d.fnm, _5d.nvd, _5d.nvm, _5d.si, _5d_Asserting_0.doc, _5d_Asserting_0.tim, _5d_Asserting_0.tip, _5e.fdt, _5e.fdx, _5e.fnm, _5e.nvd, _5e.nvm, _5e.si, _5e_Asserting_0.doc, _5e_Asserting_0.tim, _5e_Asserting_0.tip, _5f.fdt, _5f.fdx, _5f.fnm, _5f.nvd, _5f.nvm, _5f.si, _5f_Asserting_0.doc, _5f_Asserting_0.tim, _5f_Asserting_0.tip, _5g.fdt, _5g.fdx, _5g.fnm, _5g.nvd, _5g.nvm, _5g.si, _5g_Asserting_0.doc, _5g_Asserting_0.tim, _5g_Asserting_0.tip, _5h.fdt, _5h.fdx, _5h.fnm, _5h.nvd, _5h.nvm, _5h.si, _5h_Asserting_0.doc, _5h_Asserting_0.tim, _5h_Asserting_0.tip, _5i.fdt, _5i.fdx, _5i.fnm, _5i.nvd, _5i.nvm, _5i.si, _5i_Asserting_0.doc, _5i_Asserting_0.tim, _5i_Asserting_0.tip, _5j.fdt, _5j.fdx, _5j.fnm, _5j.nvd, _5j.nvm, _5j.si, _5j_Asserting_0.doc, _5j_Asserting_0.tim, _5j_Asserting_0.tip, _5k.fdt, _5k.fdx, _5k.fnm, _5k.nvd, _5k.nvm, _5k.si, _5k_Asserting_0.doc, _5k_Asserting_0.tim, _5k_Asserting_0.tip, _5l.fdt, _5l.fdx, _5l.fnm, _5l.nvd, _5l.nvm, _5l.si, _5l_Asserting_0.doc, _5l_Asserting_0.tim, _5l_Asserting_0.tip, _5m.fdt, _5m.fdx, _5m.fnm, _5m.nvd, _5m.nvm, _5m.si, _5m_Asserting_0.doc, _5m_Asserting_0.tim, _5m_Asserting_0.tip, _5n.fdt, _5n.fdx, _5n.fnm, _5n.nvd, _5n.nvm, _5n.si, _5n_Asserting_0.doc, _5n_Asserting_0.tim, _5n_Asserting_0.tip, _5o.fdt, _5o.fdx, _5o.fnm, _5o.nvd, _5o.nvm, _5o.si, _5o_Asserting_0.doc, _5o_Asserting_0.tim, _5o_Asserting_0.tip, _5p.fdt, _5p.fdx, _5p.fnm, _5p.nvd, _5p.nvm, _5p.si, _5p_Asserting_0.doc, _5p_Asserting_0.tim, _5p_Asserting_0.tip, _5q.fdt, _5q.fdx, _5q.fnm, _5q.nvd, _5q.nvm, _5q.si, _5q_Asserting_0.doc, _5q_Asserting_0.tim, _5q_Asserting_0.tip, _5r.fdt, _5r.fdx, _5r.fnm, _5r.nvd, _5r.nvm, _5r.si, _5r_Asserting_0.doc, _5r_Asserting_0.tim, _5r_Asserting_0.tip, _5s.fdt, _5s.fdx, _5s.fnm, _5s.nvd, _5s.nvm, _5s.si, _5s_Asserting_0.doc, _5s_Asserting_0.tim, _5s_Asserting_0.tip, _5t.fdt, _5t.fdx, _5t.fnm, _5t.nvd, _5t.nvm, _5t.si, _5t_Asserting_0.doc, _5t_Asserting_0.tim, _5t_Asserting_0.tip, _5u.fdt, _5u.fdx, _5u.fnm, _5u.nvd, _5u.nvm, _5u.si, _5u_Asserting_0.doc, _5u_Asserting_0.tim, _5u_Asserting_0.tip, _5v.fdt, _5v.fdx, _5v.fnm, _5v.nvd, _5v.nvm, _5v.si, _5v_Asserting_0.doc, _5v_Asserting_0.tim, _5v_Asserting_0.tip, segments_2]}]> but was:<[{indexVersion=1445818330639,generation=2,filelist=[_2d.fdt, _2d.fdx, _2d.fnm, _2d.nvd, _2d.nvm, _2d.si, _2d_Asserting_0.doc, _2d_Asserting_0.tim, _2d_Asserting_0.tip, _4p.fdt, _4p.fdx, _4p.fnm, _4p.nvd, _4p.nvm, _4p.si, _4p_Asserting_0.doc, _4p_Asserting_0.tim, _4p_Asserting_0.tip, _4q.fdt, _4q.fdx, _4q.fnm, _4q.nvd, _4q.nvm, _4q.si, _4q_Asserting_0.doc, _4q_Asserting_0.tim, _4q_Asserting_0.tip, _4r.fdt, _4r.fdx, _4r.fnm, _4r.nvd, _4r.nvm, _4r.si, _4r_Asserting_0.doc, _4r_Asserting_0.tim, _4r_Asserting_0.tip, _4s.fdt, _4s.fdx, _4s.fnm, _4s.nvd, _4s.nvm, _4s.si, _4s_Asserting_0.doc, _4s_Asserting_0.tim, _4s_Asserting_0.tip, _4t.fdt, _4t.fdx, _4t.fnm, _4t.nvd, _4t.nvm, _4t.si, _4t_Asserting_0.doc, _4t_Asserting_0.tim, _4t_Asserting_0.tip, _4u.fdt, _4u.fdx, _4u.fnm, _4u.nvd, _4u.nvm, _4u.si, _4u_Asserting_0.doc, _4u_Asserting_0.tim, _4u_Asserting_0.tip, _4v.fdt, _4v.fdx, _4v.fnm, _4v.nvd, _4v.nvm, _4v.si, _4v_Asserting_0.doc, _4v_Asserting_0.tim, _4v_Asserting_0.tip, _4w.fdt, _4w.fdx, _4w.fnm, _4w.nvd, _4w.nvm, _4w.si, _4w_Asserting_0.doc, _4w_Asserting_0.tim, _4w_Asserting_0.tip, _4x.fdt, _4x.fdx, _4x.fnm, _4x.nvd, _4x.nvm, _4x.si, _4x_Asserting_0.doc, _4x_Asserting_0.tim, _4x_Asserting_0.tip, _4y.fdt, _4y.fdx, _4y.fnm, _4y.nvd, _4y.nvm, _4y.si, _4y_Asserting_0.doc, _4y_Asserting_0.tim, _4y_Asserting_0.tip, _4z.fdt, _4z.fdx, _4z.fnm, _4z.nvd, _4z.nvm, _4z.si, _4z_Asserting_0.doc, _4z_Asserting_0.tim, _4z_Asserting_0.tip, _50.fdt, _50.fdx, _50.fnm, _50.nvd, _50.nvm, _50.si, _50_Asserting_0.doc, _50_Asserting_0.tim, _50_Asserting_0.tip, _51.fdt, _51.fdx, _51.fnm, _51.nvd, _51.nvm, _51.si, _51_Asserting_0.doc, _51_Asserting_0.tim, _51_Asserting_0.tip, _52.fdt, _52.fdx, _52.fnm, _52.nvd, _52.nvm, _52.si, _52_Asserting_0.doc, _52_Asserting_0.tim, _52_Asserting_0.tip, _53.fdt, _53.fdx, _53.fnm, _53.nvd, _53.nvm, _53.si, _53_Asserting_0.doc, _53_Asserting_0.tim, _53_Asserting_0.tip, _54.fdt, _54.fdx, _54.fnm, _54.nvd, _54.nvm, _54.si, _54_Asserting_0.doc, _54_Asserting_0.tim, _54_Asserting_0.tip, _55.fdt, _55.fdx, _55.fnm, _55.nvd, _55.nvm, _55.si, _55_Asserting_0.doc, _55_Asserting_0.tim, _55_Asserting_0.tip, _56.fdt, _56.fdx, _56.fnm, _56.nvd, _56.nvm, _56.si, _56_Asserting_0.doc, _56_Asserting_0.tim, _56_Asserting_0.tip, _57.fdt, _57.fdx, _57.fnm, _57.nvd, _57.nvm, _57.si, _57_Asserting_0.doc, _57_Asserting_0.tim, _57_Asserting_0.tip, _58.fdt, _58.fdx, _58.fnm, _58.nvd, _58.nvm, _58.si, _58_Asserting_0.doc, _58_Asserting_0.tim, _58_Asserting_0.tip, _59.fdt, _59.fdx, _59.fnm, _59.nvd, _59.nvm, _59.si, _59_Asserting_0.doc, _59_Asserting_0.tim, _59_Asserting_0.tip, _5a.fdt, _5a.fdx, _5a.fnm, _5a.nvd, _5a.nvm, _5a.si, _5a_Asserting_0.doc, _5a_Asserting_0.tim, _5a_Asserting_0.tip, _5b.fdt, _5b.fdx, _5b.fnm, _5b.nvd, _5b.nvm, _5b.si, _5b_Asserting_0.doc, _5b_Asserting_0.tim, _5b_Asserting_0.tip, _5c.fdt, _5c.fdx, _5c.fnm, _5c.nvd, _5c.nvm, _5c.si, _5c_Asserting_0.doc, _5c_Asserting_0.tim, _5c_Asserting_0.tip, _5d.fdt, _5d.fdx, _5d.fnm, _5d.nvd, _5d.nvm, _5d.si, _5d_Asserting_0.doc, _5d_Asserting_0.tim, _5d_Asserting_0.tip, _5e.fdt, _5e.fdx, _5e.fnm, _5e.nvd, _5e.nvm, _5e.si, _5e_Asserting_0.doc, _5e_Asserting_0.tim, _5e_Asserting_0.tip, _5f.fdt, _5f.fdx, _5f.fnm, _5f.nvd, _5f.nvm, _5f.si, _5f_Asserting_0.doc, _5f_Asserting_0.tim, _5f_Asserting_0.tip, _5g.fdt, _5g.fdx, _5g.fnm, _5g.nvd, _5g.nvm, _5g.si, _5g_Asserting_0.doc, _5g_Asserting_0.tim, _5g_Asserting_0.tip, _5h.fdt, _5h.fdx, _5h.fnm, _5h.nvd, _5h.nvm, _5h.si, _5h_Asserting_0.doc, _5h_Asserting_0.tim, _5h_Asserting_0.tip, _5i.fdt, _5i.fdx, _5i.fnm, _5i.nvd, _5i.nvm, _5i.si, _5i_Asserting_0.doc, _5i_Asserting_0.tim, _5i_Asserting_0.tip, _5j.fdt, _5j.fdx, _5j.fnm, _5j.nvd, _5j.nvm, _5j.si, _5j_Asserting_0.doc, _5j_Asserting_0.tim, _5j_Asserting_0.tip, _5k.fdt, _5k.fdx, _5k.fnm, _5k.nvd, _5k.nvm, _5k.si, _5k_Asserting_0.doc, _5k_Asserting_0.tim, _5k_Asserting_0.tip, _5l.fdt, _5l.fdx, _5l.fnm, _5l.nvd, _5l.nvm, _5l.si, _5l_Asserting_0.doc, _5l_Asserting_0.tim, _5l_Asserting_0.tip, _5m.fdt, _5m.fdx, _5m.fnm, _5m.nvd, _5m.nvm, _5m.si, _5m_Asserting_0.doc, _5m_Asserting_0.tim, _5m_Asserting_0.tip, _5n.fdt, _5n.fdx, _5n.fnm, _5n.nvd, _5n.nvm, _5n.si, _5n_Asserting_0.doc, _5n_Asserting_0.tim, _5n_Asserting_0.tip, _5o.fdt, _5o.fdx, _5o.fnm, _5o.nvd, _5o.nvm, _5o.si, _5o_Asserting_0.doc, _5o_Asserting_0.tim, _5o_Asserting_0.tip, _5p.fdt, _5p.fdx, _5p.fnm, _5p.nvd, _5p.nvm, _5p.si, _5p_Asserting_0.doc, _5p_Asserting_0.tim, _5p_Asserting_0.tip, _5q.fdt, _5q.fdx, _5q.fnm, _5q.nvd, _5q.nvm, _5q.si, _5q_Asserting_0.doc, _5q_Asserting_0.tim, _5q_Asserting_0.tip, _5r.fdt, _5r.fdx, _5r.fnm, _5r.nvd, _5r.nvm, _5r.si, _5r_Asserting_0.doc, _5r_Asserting_0.tim, _5r_Asserting_0.tip, _5s.fdt, _5s.fdx, _5s.fnm, _5s.nvd, _5s.nvm, _5s.si, _5s_Asserting_0.doc, _5s_Asserting_0.tim, _5s_Asserting_0.tip, _5t.fdt, _5t.fdx, _5t.fnm, _5t.nvd, _5t.nvm, _5t.si, _5t_Asserting_0.doc, _5t_Asserting_0.tim, _5t_Asserting_0.tip, _5u.fdt, _5u.fdx, _5u.fnm, _5u.nvd, _5u.nvm, _5u.si, _5u_Asserting_0.doc, _5u_Asserting_0.tim, _5u_Asserting_0.tip, _5v.fdt, _5v.fdx, _5v.fnm, _5v.nvd, _5v.nvm, _5v.si, _5v_Asserting_0.doc, _5v_Asserting_0.tim, _5v_Asserting_0.tip, segments_2]}, {indexVersion=1445818330639,generation=3,filelist=[_2d.fdt, _2d.fdx, _2d.fnm, _2d.nvd, _2d.nvm, _2d.si, _2d_Asserting_0.doc, _2d_Asserting_0.tim, _2d_Asserting_0.tip, _4q.fdt, _4q.fdx, _4q.fnm, _4q.nvd, _4q.nvm, _4q.si, _4q_Asserting_0.doc, _4q_Asserting_0.tim, _4q_Asserting_0.tip, _5w.cfe, _5w.cfs, _5w.si, segments_3]}]> Stack Trace: java.lang.AssertionError: expected:<[{indexVersion=1445818330639,generation=2,filelist=[_2d.fdt, _2d.fdx, _2d.fnm, _2d.nvd, _2d.nvm, _2d.si, _2d_Asserting_0.doc, _2d_Asserting_0.tim, _2d_Asserting_0.tip, _4p.fdt, _4p.fdx, _4p.fnm, _4p.nvd, _4p.nvm, _4p.si, _4p_Asserting_0.doc, _4p_Asserting_0.tim, _4p_Asserting_0.tip, _4q.fdt, _4q.fdx, _4q.fnm, _4q.nvd, _4q.nvm, _4q.si, _4q_Asserting_0.doc, _4q_Asserting_0.tim, _4q_Asserting_0.tip, _4r.fdt, _4r.fdx, _4r.fnm, _4r.nvd, _4r.nvm, _4r.si, _4r_Asserting_0.doc, _4r_Asserting_0.tim, _4r_Asserting_0.tip, _4s.fdt, _4s.fdx, _4s.fnm, _4s.nvd, _4s.nvm, _4s.si, _4s_Asserting_0.doc, _4s_Asserting_0.tim, _4s_Asserting_0.tip, _4t.fdt, _4t.fdx, _4t.fnm, _4t.nvd, _4t.nvm, _4t.si, _4t_Asserting_0.doc, _4t_Asserting_0.tim, _4t_Asserting_0.tip, _4u.fdt, _4u.fdx, _4u.fnm, _4u.nvd, _4u.nvm, _4u.si, _4u_Asserting_0.doc, _4u_Asserting_0.tim, _4u_Asserting_0.tip, _4v.fdt, _4v.fdx, _4v.fnm, _4v.nvd, _4v.nvm, _4v.si, _4v_Asserting_0.doc, _4v_Asserting_0.tim, _4v_Asserting_0.tip, _4w.fdt, _4w.fdx, _4w.fnm, _4w.nvd, _4w.nvm, _4w.si, _4w_Asserting_0.doc, _4w_Asserting_0.tim, _4w_Asserting_0.tip, _4x.fdt, _4x.fdx, _4x.fnm, _4x.nvd, _4x.nvm, _4x.si, _4x_Asserting_0.doc, _4x_Asserting_0.tim, _4x_Asserting_0.tip, _4y.fdt, _4y.fdx, _4y.fnm, _4y.nvd, _4y.nvm, _4y.si, _4y_Asserting_0.doc, _4y_Asserting_0.tim, _4y_Asserting_0.tip, _4z.fdt, _4z.fdx, _4z.fnm, _4z.nvd, _4z.nvm, _4z.si, _4z_Asserting_0.doc, _4z_Asserting_0.tim, _4z_Asserting_0.tip, _50.fdt, _50.fdx, _50.fnm, _50.nvd, _50.nvm, _50.si, _50_Asserting_0.doc, _50_Asserting_0.tim, _50_Asserting_0.tip, _51.fdt, _51.fdx, _51.fnm, _51.nvd, _51.nvm, _51.si, _51_Asserting_0.doc, _51_Asserting_0.tim, _51_Asserting_0.tip, _52.fdt, _52.fdx, _52.fnm, _52.nvd, _52.nvm, _52.si, _52_Asserting_0.doc, _52_Asserting_0.tim, _52_Asserting_0.tip, _53.fdt, _53.fdx, _53.fnm, _53.nvd, _53.nvm, _53.si, _53_Asserting_0.doc, _53_Asserting_0.tim, _53_Asserting_0.tip, _54.fdt, _54.fdx, _54.fnm, _54.nvd, _54.nvm, _54.si, _54_Asserting_0.doc, _54_Asserting_0.tim, _54_Asserting_0.tip, _55.fdt, _55.fdx, _55.fnm, _55.nvd, _55.nvm, _55.si, _55_Asserting_0.doc, _55_Asserting_0.tim, _55_Asserting_0.tip, _56.fdt, _56.fdx, _56.fnm, _56.nvd, _56.nvm, _56.si, _56_Asserting_0.doc, _56_Asserting_0.tim, _56_Asserting_0.tip, _57.fdt, _57.fdx, _57.fnm, _57.nvd, _57.nvm, _57.si, _57_Asserting_0.doc, _57_Asserting_0.tim, _57_Asserting_0.tip, _58.fdt, _58.fdx, _58.fnm, _58.nvd, _58.nvm, _58.si, _58_Asserting_0.doc, _58_Asserting_0.tim, _58_Asserting_0.tip, _59.fdt, _59.fdx, _59.fnm, _59.nvd, _59.nvm, _59.si, _59_Asserting_0.doc, _59_Asserting_0.tim, _59_Asserting_0.tip, _5a.fdt, _5a.fdx, _5a.fnm, _5a.nvd, _5a.nvm, _5a.si, _5a_Asserting_0.doc, _5a_Asserting_0.tim, _5a_Asserting_0.tip, _5b.fdt, _5b.fdx, _5b.fnm, _5b.nvd, _5b.nvm, _5b.si, _5b_Asserting_0.doc, _5b_Asserting_0.tim, _5b_Asserting_0.tip, _5c.fdt, _5c.fdx, _5c.fnm, _5c.nvd, _5c.nvm, _5c.si, _5c_Asserting_0.doc, _5c_Asserting_0.tim, _5c_Asserting_0.tip, _5d.fdt, _5d.fdx, _5d.fnm, _5d.nvd, _5d.nvm, _5d.si, _5d_Asserting_0.doc, _5d_Asserting_0.tim, _5d_Asserting_0.tip, _5e.fdt, _5e.fdx, _5e.fnm, _5e.nvd, _5e.nvm, _5e.si, _5e_Asserting_0.doc, _5e_Asserting_0.tim, _5e_Asserting_0.tip, _5f.fdt, _5f.fdx, _5f.fnm, _5f.nvd, _5f.nvm, _5f.si, _5f_Asserting_0.doc, _5f_Asserting_0.tim, _5f_Asserting_0.tip, _5g.fdt, _5g.fdx, _5g.fnm, _5g.nvd, _5g.nvm, _5g.si, _5g_Asserting_0.doc, _5g_Asserting_0.tim, _5g_Asserting_0.tip, _5h.fdt, _5h.fdx, _5h.fnm, _5h.nvd, _5h.nvm, _5h.si, _5h_Asserting_0.doc, _5h_Asserting_0.tim, _5h_Asserting_0.tip, _5i.fdt, _5i.fdx, _5i.fnm, _5i.nvd, _5i.nvm, _5i.si, _5i_Asserting_0.doc, _5i_Asserting_0.tim, _5i_Asserting_0.tip, _5j.fdt, _5j.fdx, _5j.fnm, _5j.nvd, _5j.nvm, _5j.si, _5j_Asserting_0.doc, _5j_Asserting_0.tim, _5j_Asserting_0.tip, _5k.fdt, _5k.fdx, _5k.fnm, _5k.nvd, _5k.nvm, _5k.si, _5k_Asserting_0.doc, _5k_Asserting_0.tim, _5k_Asserting_0.tip, _5l.fdt, _5l.fdx, _5l.fnm, _5l.nvd, _5l.nvm, _5l.si, _5l_Asserting_0.doc, _5l_Asserting_0.tim, _5l_Asserting_0.tip, _5m.fdt, _5m.fdx, _5m.fnm, _5m.nvd, _5m.nvm, _5m.si, _5m_Asserting_0.doc, _5m_Asserting_0.tim, _5m_Asserting_0.tip, _5n.fdt, _5n.fdx, _5n.fnm, _5n.nvd, _5n.nvm, _5n.si, _5n_Asserting_0.doc, _5n_Asserting_0.tim, _5n_Asserting_0.tip, _5o.fdt, _5o.fdx, _5o.fnm, _5o.nvd, _5o.nvm, _5o.si, _5o_Asserting_0.doc, _5o_Asserting_0.tim, _5o_Asserting_0.tip, _5p.fdt, _5p.fdx, _5p.fnm, _5p.nvd, _5p.nvm, _5p.si, _5p_Asserting_0.doc, _5p_Asserting_0.tim, _5p_Asserting_0.tip, _5q.fdt, _5q.fdx, _5q.fnm, _5q.nvd, _5q.nvm, _5q.si, _5q_Asserting_0.doc, _5q_Asserting_0.tim, _5q_Asserting_0.tip, _5r.fdt, _5r.fdx, _5r.fnm, _5r.nvd, _5r.nvm, _5r.si, _5r_Asserting_0.doc, _5r_Asserting_0.tim, _5r_Asserting_0.tip, _5s.fdt, _5s.fdx, _5s.fnm, _5s.nvd, _5s.nvm, _5s.si, _5s_Asserting_0.doc, _5s_Asserting_0.tim, _5s_Asserting_0.tip, _5t.fdt, _5t.fdx, _5t.fnm, _5t.nvd, _5t.nvm, _5t.si, _5t_Asserting_0.doc, _5t_Asserting_0.tim, _5t_Asserting_0.tip, _5u.fdt, _5u.fdx, _5u.fnm, _5u.nvd, _5u.nvm, _5u.si, _5u_Asserting_0.doc, _5u_Asserting_0.tim, _5u_Asserting_0.tip, _5v.fdt, _5v.fdx, _5v.fnm, _5v.nvd, _5v.nvm, _5v.si, _5v_Asserting_0.doc, _5v_Asserting_0.tim, _5v_Asserting_0.tip, segments_2]}]> but was:<[{indexVersion=1445818330639,generation=2,filelist=[_2d.fdt, _2d.fdx, _2d.fnm, _2d.nvd, _2d.nvm, _2d.si, _2d_Asserting_0.doc, _2d_Asserting_0.tim, _2d_Asserting_0.tip, _4p.fdt, _4p.fdx, _4p.fnm, _4p.nvd, _4p.nvm, _4p.si, _4p_Asserting_0.doc, _4p_Asserting_0.tim, _4p_Asserting_0.tip, _4q.fdt, _4q.fdx, _4q.fnm, _4q.nvd, _4q.nvm, _4q.si, _4q_Asserting_0.doc, _4q_Asserting_0.tim, _4q_Asserting_0.tip, _4r.fdt, _4r.fdx, _4r.fnm, _4r.nvd, _4r.nvm, _4r.si, _4r_Asserting_0.doc, _4r_Asserting_0.tim, _4r_Asserting_0.tip, _4s.fdt, _4s.fdx, _4s.fnm, _4s.nvd, _4s.nvm, _4s.si, _4s_Asserting_0.doc, _4s_Asserting_0.tim, _4s_Asserting_0.tip, _4t.fdt, _4t.fdx, _4t.fnm, _4t.nvd, _4t.nvm, _4t.si, _4t_Asserting_0.doc, _4t_Asserting_0.tim, _4t_Asserting_0.tip, _4u.fdt, _4u.fdx, _4u.fnm, _4u.nvd, _4u.nvm, _4u.si, _4u_Asserting_0.doc, _4u_Asserting_0.tim, _4u_Asserting_0.tip, _4v.fdt, _4v.fdx, _4v.fnm, _4v.nvd, _4v.nvm, _4v.si, _4v_Asserting_0.doc, _4v_Asserting_0.tim, _4v_Asserting_0.tip, _4w.fdt, _4w.fdx, _4w.fnm, _4w.nvd, _4w.nvm, _4w.si, _4w_Asserting_0.doc, _4w_Asserting_0.tim, _4w_Asserting_0.tip, _4x.fdt, _4x.fdx, _4x.fnm, _4x.nvd, _4x.nvm, _4x.si, _4x_Asserting_0.doc, _4x_Asserting_0.tim, _4x_Asserting_0.tip, _4y.fdt, _4y.fdx, _4y.fnm, _4y.nvd, _4y.nvm, _4y.si, _4y_Asserting_0.doc, _4y_Asserting_0.tim, _4y_Asserting_0.tip, _4z.fdt, _4z.fdx, _4z.fnm, _4z.nvd, _4z.nvm, _4z.si, _4z_Asserting_0.doc, _4z_Asserting_0.tim, _4z_Asserting_0.tip, _50.fdt, _50.fdx, _50.fnm, _50.nvd, _50.nvm, _50.si, _50_Asserting_0.doc, _50_Asserting_0.tim, _50_Asserting_0.tip, _51.fdt, _51.fdx, _51.fnm, _51.nvd, _51.nvm, _51.si, _51_Asserting_0.doc, _51_Asserting_0.tim, _51_Asserting_0.tip, _52.fdt, _52.fdx, _52.fnm, _52.nvd, _52.nvm, _52.si, _52_Asserting_0.doc, _52_Asserting_0.tim, _52_Asserting_0.tip, _53.fdt, _53.fdx, _53.fnm, _53.nvd, _53.nvm, _53.si, _53_Asserting_0.doc, _53_Asserting_0.tim, _53_Asserting_0.tip, _54.fdt, _54.fdx, _54.fnm, _54.nvd, _54.nvm, _54.si, _54_Asserting_0.doc, _54_Asserting_0.tim, _54_Asserting_0.tip, _55.fdt, _55.fdx, _55.fnm, _55.nvd, _55.nvm, _55.si, _55_Asserting_0.doc, _55_Asserting_0.tim, _55_Asserting_0.tip, _56.fdt, _56.fdx, _56.fnm, _56.nvd, _56.nvm, _56.si, _56_Asserting_0.doc, _56_Asserting_0.tim, _56_Asserting_0.tip, _57.fdt, _57.fdx, _57.fnm, _57.nvd, _57.nvm, _57.si, _57_Asserting_0.doc, _57_Asserting_0.tim, _57_Asserting_0.tip, _58.fdt, _58.fdx, _58.fnm, _58.nvd, _58.nvm, _58.si, _58_Asserting_0.doc, _58_Asserting_0.tim, _58_Asserting_0.tip, _59.fdt, _59.fdx, _59.fnm, _59.nvd, _59.nvm, _59.si, _59_Asserting_0.doc, _59_Asserting_0.tim, _59_Asserting_0.tip, _5a.fdt, _5a.fdx, _5a.fnm, _5a.nvd, _5a.nvm, _5a.si, _5a_Asserting_0.doc, _5a_Asserting_0.tim, _5a_Asserting_0.tip, _5b.fdt, _5b.fdx, _5b.fnm, _5b.nvd, _5b.nvm, _5b.si, _5b_Asserting_0.doc, _5b_Asserting_0.tim, _5b_Asserting_0.tip, _5c.fdt, _5c.fdx, _5c.fnm, _5c.nvd, _5c.nvm, _5c.si, _5c_Asserting_0.doc, _5c_Asserting_0.tim, _5c_Asserting_0.tip, _5d.fdt, _5d.fdx, _5d.fnm, _5d.nvd, _5d.nvm, _5d.si, _5d_Asserting_0.doc, _5d_Asserting_0.tim, _5d_Asserting_0.tip, _5e.fdt, _5e.fdx, _5e.fnm, _5e.nvd, _5e.nvm, _5e.si, _5e_Asserting_0.doc, _5e_Asserting_0.tim, _5e_Asserting_0.tip, _5f.fdt, _5f.fdx, _5f.fnm, _5f.nvd, _5f.nvm, _5f.si, _5f_Asserting_0.doc, _5f_Asserting_0.tim, _5f_Asserting_0.tip, _5g.fdt, _5g.fdx, _5g.fnm, _5g.nvd, _5g.nvm, _5g.si, _5g_Asserting_0.doc, _5g_Asserting_0.tim, _5g_Asserting_0.tip, _5h.fdt, _5h.fdx, _5h.fnm, _5h.nvd, _5h.nvm, _5h.si, _5h_Asserting_0.doc, _5h_Asserting_0.tim, _5h_Asserting_0.tip, _5i.fdt, _5i.fdx, _5i.fnm, _5i.nvd, _5i.nvm, _5i.si, _5i_Asserting_0.doc, _5i_Asserting_0.tim, _5i_Asserting_0.tip, _5j.fdt, _5j.fdx, _5j.fnm, _5j.nvd, _5j.nvm, _5j.si, _5j_Asserting_0.doc, _5j_Asserting_0.tim, _5j_Asserting_0.tip, _5k.fdt, _5k.fdx, _5k.fnm, _5k.nvd, _5k.nvm, _5k.si, _5k_Asserting_0.doc, _5k_Asserting_0.tim, _5k_Asserting_0.tip, _5l.fdt, _5l.fdx, _5l.fnm, _5l.nvd, _5l.nvm, _5l.si, _5l_Asserting_0.doc, _5l_Asserting_0.tim, _5l_Asserting_0.tip, _5m.fdt, _5m.fdx, _5m.fnm, _5m.nvd, _5m.nvm, _5m.si, _5m_Asserting_0.doc, _5m_Asserting_0.tim, _5m_Asserting_0.tip, _5n.fdt, _5n.fdx, _5n.fnm, _5n.nvd, _5n.nvm, _5n.si, _5n_Asserting_0.doc, _5n_Asserting_0.tim, _5n_Asserting_0.tip, _5o.fdt, _5o.fdx, _5o.fnm, _5o.nvd, _5o.nvm, _5o.si, _5o_Asserting_0.doc, _5o_Asserting_0.tim, _5o_Asserting_0.tip, _5p.fdt, _5p.fdx, _5p.fnm, _5p.nvd, _5p.nvm, _5p.si, _5p_Asserting_0.doc, _5p_Asserting_0.tim, _5p_Asserting_0.tip, _5q.fdt, _5q.fdx, _5q.fnm, _5q.nvd, _5q.nvm, _5q.si, _5q_Asserting_0.doc, _5q_Asserting_0.tim, _5q_Asserting_0.tip, _5r.fdt, _5r.fdx, _5r.fnm, _5r.nvd, _5r.nvm, _5r.si, _5r_Asserting_0.doc, _5r_Asserting_0.tim, _5r_Asserting_0.tip, _5s.fdt, _5s.fdx, _5s.fnm, _5s.nvd, _5s.nvm, _5s.si, _5s_Asserting_0.doc, _5s_Asserting_0.tim, _5s_Asserting_0.tip, _5t.fdt, _5t.fdx, _5t.fnm, _5t.nvd, _5t.nvm, _5t.si, _5t_Asserting_0.doc, _5t_Asserting_0.tim, _5t_Asserting_0.tip, _5u.fdt, _5u.fdx, _5u.fnm, _5u.nvd, _5u.nvm, _5u.si, _5u_Asserting_0.doc, _5u_Asserting_0.tim, _5u_Asserting_0.tip, _5v.fdt, _5v.fdx, _5v.fnm, _5v.nvd, _5v.nvm, _5v.si, _5v_Asserting_0.doc, _5v_Asserting_0.tim, _5v_Asserting_0.tip, segments_2]}, {indexVersion=1445818330639,generation=3,filelist=[_2d.fdt, _2d.fdx, _2d.fnm, _2d.nvd, _2d.nvm, _2d.si, _2d_Asserting_0.doc, _2d_Asserting_0.tim, _2d_Asserting_0.tip, _4q.fdt, _4q.fdx, _4q.fnm, _4q.nvd, _4q.nvm, _4q.si, _4q_Asserting_0.doc, _4q_Asserting_0.tim, _4q_Asserting_0.tip, _5w.cfe, _5w.cfs, _5w.si, segments_3]}]> at __randomizedtesting.SeedInfo.seed([A6D967FEF6F05DCB:830E7CCE86B853C8]:0) at org.junit.Assert.fail(Assert.java:93) at org.junit.Assert.failNotEquals(Assert.java:647) at org.junit.Assert.assertEquals(Assert.java:128) at org.junit.Assert.assertEquals(Assert.java:147) at org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload(TestReplicationHandler.java:1138) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1665) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:864) at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:900) at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:914) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809) at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:873) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:775) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:809) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:820) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367) at java.lang.Thread.run(Thread.java:745) FAILED: org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR Error Message: Captured an uncaught exception in thread: Thread[id=11480, name=coreZkRegister-3481-thread-1, state=RUNNABLE, group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest] Stack Trace: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=11480, name=coreZkRegister-3481-thread-1, state=RUNNABLE, group=TGRP-LeaderInitiatedRecoveryOnShardRestartTest] Caused by: java.lang.AssertionError at __randomizedtesting.SeedInfo.seed([A6D967FEF6F05DCB]:0) at org.apache.solr.cloud.ZkController.updateLeaderInitiatedRecoveryState(ZkController.java:2133) at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:434) at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:197) at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157) at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:346) at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1113) at org.apache.solr.cloud.ZkController.register(ZkController.java:926) at org.apache.solr.cloud.ZkController.register(ZkController.java:881) at org.apache.solr.core.ZkContainer$2.run(ZkContainer.java:183) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Build Log: [...truncated 10787 lines...] [junit4] Suite: org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest [junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A6D967FEF6F05DCB-001/init-core-data-001 [junit4] 2> 1971994 INFO (SUITE-LeaderInitiatedRecoveryOnShardRestartTest-seed#[A6D967FEF6F05DCB]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /j_/ [junit4] 2> 1971998 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER [junit4] 2> 1971999 INFO (Thread-4444) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0 [junit4] 2> 1971999 INFO (Thread-4444) [ ] o.a.s.c.ZkTestServer Starting server [junit4] 2> 1972099 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.ZkTestServer start zk server on port:55034 [junit4] 2> 1972099 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 1972099 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1972102 INFO (zkCallback-1773-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@512a9ce7 name:ZooKeeperConnection Watcher:127.0.0.1:55034 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1972102 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1972103 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 1972103 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr [junit4] 2> 1972105 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 1972106 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1972107 INFO (zkCallback-1774-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6f80947e name:ZooKeeperConnection Watcher:127.0.0.1:55034/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1972107 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1972108 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 1972108 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1 [junit4] 2> 1972109 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards [junit4] 2> 1972111 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection [junit4] 2> 1972112 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards [junit4] 2> 1972114 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml [junit4] 2> 1972114 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml [junit4] 2> 1972117 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml [junit4] 2> 1972117 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml [junit4] 2> 1972119 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 1972120 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 1972122 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt [junit4] 2> 1972122 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt [junit4] 2> 1972124 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt [junit4] 2> 1972124 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt [junit4] 2> 1972126 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml [junit4] 2> 1972126 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml [junit4] 2> 1972129 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml [junit4] 2> 1972130 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml [junit4] 2> 1972131 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json [junit4] 2> 1972132 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json [junit4] 2> 1972139 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt [junit4] 2> 1972139 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt [junit4] 2> 1972141 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt [junit4] 2> 1972141 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt [junit4] 2> 1972142 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt [junit4] 2> 1972143 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt [junit4] 2> 1972431 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A6D967FEF6F05DCB-001/control-001/cores/collection1 [junit4] 2> 1972433 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.e.j.s.Server jetty-9.2.13.v20150730 [junit4] 2> 1972435 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7913eec{/j_,null,AVAILABLE} [junit4] 2> 1972435 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.e.j.s.ServerConnector Started ServerConnector@6244865a{HTTP/1.1}{127.0.0.1:47317} [junit4] 2> 1972435 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.e.j.s.Server Started @1975402ms [junit4] 2> 1972435 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/j_, solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A6D967FEF6F05DCB-001/tempDir-001/control/data, hostPort=47317, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A6D967FEF6F05DCB-001/control-001/cores} [junit4] 2> 1972436 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@6b482747 [junit4] 2> 1972436 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A6D967FEF6F05DCB-001/control-001/' [junit4] 2> 1972436 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 1972436 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI) [junit4] 2> 1972453 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 1972453 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1972455 INFO (zkCallback-1775-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6c83ceb name:ZooKeeperConnection Watcher:127.0.0.1:55034/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1972455 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1972455 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 1972456 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper) [junit4] 2> 1972456 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A6D967FEF6F05DCB-001/control-001/solr.xml [junit4] 2> 1972470 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A6D967FEF6F05DCB-001/control-001/cores [junit4] 2> 1972470 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.CoreContainer New CoreContainer 1243423389 [junit4] 2> 1972470 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A6D967FEF6F05DCB-001/control-001/] [junit4] 2> 1972470 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A6D967FEF6F05DCB-001/control-001/lib [junit4] 2> 1972470 WARN (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A6D967FEF6F05DCB-001/control-001/lib). [junit4] 2> 1972478 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false, [junit4] 2> 1972479 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true [junit4] 2> 1972480 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 1972480 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 1972480 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:55034/solr [junit4] 2> 1972480 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.ZkController zkHost includes chroot [junit4] 2> 1972480 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 1972480 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1972488 INFO (zkCallback-1777-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@f1b0752 name:ZooKeeperConnection Watcher:127.0.0.1:55034 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1972488 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1972489 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 1972491 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [n:127.0.0.1:47317_j_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1972492 INFO (zkCallback-1778-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@543d4d5f name:ZooKeeperConnection Watcher:127.0.0.1:55034/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1972492 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [n:127.0.0.1:47317_j_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1972493 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [n:127.0.0.1:47317_j_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue [junit4] 2> 1972495 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [n:127.0.0.1:47317_j_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work [junit4] 2> 1972500 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [n:127.0.0.1:47317_j_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running [junit4] 2> 1972502 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [n:127.0.0.1:47317_j_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed [junit4] 2> 1972504 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [n:127.0.0.1:47317_j_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure [junit4] 2> 1972506 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [n:127.0.0.1:47317_j_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes [junit4] 2> 1972508 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [n:127.0.0.1:47317_j_ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json [junit4] 2> 1972509 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [n:127.0.0.1:47317_j_ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json [junit4] 2> 1972510 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [n:127.0.0.1:47317_j_ ] o.a.s.c.c.SolrZkClient makePath: /security.json [junit4] 2> 1972511 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [n:127.0.0.1:47317_j_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47317_j_ [junit4] 2> 1972511 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [n:127.0.0.1:47317_j_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:47317_j_ [junit4] 2> 1972513 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [n:127.0.0.1:47317_j_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect [junit4] 2> 1972514 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [n:127.0.0.1:47317_j_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election [junit4] 2> 1972515 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [n:127.0.0.1:47317_j_ ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 1972516 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [n:127.0.0.1:47317_j_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94753102892564484-127.0.0.1:47317_j_-n_0000000000 [junit4] 2> 1972516 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [n:127.0.0.1:47317_j_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:47317_j_ [junit4] 2> 1972516 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [n:127.0.0.1:47317_j_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader [junit4] 2> 1972518 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [n:127.0.0.1:47317_j_ ] o.a.s.c.Overseer Overseer (id=94753102892564484-127.0.0.1:47317_j_-n_0000000000) starting [junit4] 2> 1972519 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [n:127.0.0.1:47317_j_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work [junit4] 2> 1972526 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [n:127.0.0.1:47317_j_ ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000 [junit4] 2> 1972526 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [n:127.0.0.1:47317_j_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... [junit4] 2> 1972526 INFO (OverseerCollectionConfigSetProcessor-94753102892564484-127.0.0.1:47317_j_-n_0000000000) [n:127.0.0.1:47317_j_ ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations [junit4] 2> 1972526 INFO (OverseerStateUpdate-94753102892564484-127.0.0.1:47317_j_-n_0000000000) [n:127.0.0.1:47317_j_ ] o.a.s.c.Overseer Starting to work on the main queue [junit4] 2> 1972547 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [n:127.0.0.1:47317_j_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module. [junit4] 2> 1972547 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [n:127.0.0.1:47317_j_ ] o.a.s.c.CoreContainer No authentication plugin used. [junit4] 2> 1972548 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [n:127.0.0.1:47317_j_ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A6D967FEF6F05DCB-001/control-001/cores [junit4] 2> 1972549 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [n:127.0.0.1:47317_j_ ] o.a.s.c.SolrCore Created CoreDescriptor: {schema=schema.xml, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A6D967FEF6F05DCB-001/control-001/cores/collection1, transient=false, shard=, name=collection1, config=solrconfig.xml, loadOnStartup=true, collection=control_collection, dataDir=data/, coreNodeName=, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A6D967FEF6F05DCB-001/control-001/cores/collection1/, configSetProperties=configsetprops.json} [junit4] 2> 1972549 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [n:127.0.0.1:47317_j_ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A6D967FEF6F05DCB-001/control-001/cores/collection1/ [junit4] 2> 1972549 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [n:127.0.0.1:47317_j_ ] o.a.s.c.CoresLocator Found 1 core definitions [junit4] 2> 1972551 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down [junit4] 2> 1972552 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property [junit4] 2> 1972552 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [n:127.0.0.1:47317_j_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2 [junit4] 2> 1972552 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [n:127.0.0.1:47317_j_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done [junit4] 2> 1972554 INFO (OverseerStateUpdate-94753102892564484-127.0.0.1:47317_j_-n_0000000000) [n:127.0.0.1:47317_j_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "core":"collection1", [junit4] 2> "roles":null, [junit4] 2> "base_url":"http://127.0.0.1:47317/j_", [junit4] 2> "shard":null, [junit4] 2> "numShards":"1", [junit4] 2> "operation":"state", [junit4] 2> "collection":"control_collection", [junit4] 2> "node_name":"127.0.0.1:47317_j_", [junit4] 2> "state":"down"} current state version: 0 [junit4] 2> 1972554 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name [junit4] 2> 1972554 INFO (OverseerStateUpdate-94753102892564484-127.0.0.1:47317_j_-n_0000000000) [n:127.0.0.1:47317_j_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={ [junit4] 2> "core":"collection1", [junit4] 2> "roles":null, [junit4] 2> "base_url":"http://127.0.0.1:47317/j_", [junit4] 2> "shard":null, [junit4] 2> "numShards":"1", [junit4] 2> "operation":"state", [junit4] 2> "collection":"control_collection", [junit4] 2> "node_name":"127.0.0.1:47317_j_", [junit4] 2> "state":"down"} [junit4] 2> 1972555 INFO (OverseerStateUpdate-94753102892564484-127.0.0.1:47317_j_-n_0000000000) [n:127.0.0.1:47317_j_ ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection [junit4] 2> 1972555 INFO (OverseerStateUpdate-94753102892564484-127.0.0.1:47317_j_-n_0000000000) [n:127.0.0.1:47317_j_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1 [junit4] 2> 1972558 INFO (zkCallback-1778-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 1973555 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1 [junit4] 2> 1973555 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection [junit4] 2> 1973557 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists [junit4] 2> 1973557 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection [junit4] 2> 1973557 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper [junit4] 2> 1973557 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A6D967FEF6F05DCB-001/control-001/cores/collection1/' [junit4] 2> 1973558 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 1973558 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI) [junit4] 2> 1973595 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 [junit4] 2> 1973603 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1 [junit4] 2> 1973617 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 5.4.0 [junit4] 2> 1973677 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml [junit4] 2> 1973678 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml [junit4] 2> 1973685 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test [junit4] 2> 1974253 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440. [junit4] 2> 1974262 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text [junit4] 2> 1974267 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id [junit4] 2> 1974281 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml [junit4] 2> 1974284 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml [junit4] 2> 1974294 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json [junit4] 2> 1974295 WARN (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE [junit4] 2> 1974295 WARN (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING [junit4] 2> 1974295 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json [junit4] 2> 1974297 WARN (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE [junit4] 2> 1974298 WARN (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING [junit4] 2> 1974299 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2 [junit4] 2> 1974299 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection [junit4] 2> 1974299 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory [junit4] 2> 1974299 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A6D967FEF6F05DCB-001/control-001/cores/collection1/], dataDir=[null] [junit4] 2> 1974299 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2a147b53 [junit4] 2> 1974300 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A6D967FEF6F05DCB-001/control-001/cores/collection1/data [junit4] 2> 1974308 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A6D967FEF6F05DCB-001/control-001/cores/collection1/data/index/ [junit4] 2> 1974308 WARN (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A6D967FEF6F05DCB-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index... [junit4] 2> 1974308 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A6D967FEF6F05DCB-001/control-001/cores/collection1/data/index [junit4] 2> 1974309 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=18, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=1.2626953125, noCFSRatio=1.0] [junit4] 2> 1974309 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1 [junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@6e942479 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3fe6bca6),segFN=segments_1,generation=1} [junit4] 2> 1974309 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1 [junit4] 2> 1974324 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib" [junit4] 2> 1974324 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe" [junit4] 2> 1974324 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe" [junit4] 2> 1974324 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig" [junit4] 2> 1974324 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig" [junit4] 2> 1974324 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit" [junit4] 2> 1974325 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 1974325 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 1974325 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default [junit4] 2> 1974327 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A6D967FEF6F05DCB-001/control-001/cores/collection1/data/ [junit4] 2> 1974331 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest_A6D967FEF6F05DCB-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories. [junit4] 2> 1974332 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60 [junit4] 2> 1974334 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60 [junit4] 2> 1974335 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60 [junit4] 2> 1974336 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60 [junit4] 2> 1974359 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /update/json,/admin/threads,/replication,/config,/admin/mbeans,/admin/properties,/get,standard,/admin/logging,/admin/ping,/admin/file,/update/json/docs,/admin/segments,/schema,/admin/system,/update/csv,/update,/admin/plugins,/admin/luke [junit4] 2> 1974367 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache [junit4] 2> 1974388 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog [junit4] 2> 1974388 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536 [junit4] 2> 1974389 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled [junit4] 2> 1974389 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled [junit4] 2> 1974389 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@1184a6ad [junit4] 2> 1974399 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1 [junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@6e942479 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3fe6bca6),segFN=segments_1,generation=1} [junit4] 2> 1974399 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1 [junit4] 2> 1974399 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@29ed5726[collection1] main [junit4] 2> 1974400 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection [junit4] 2> 1974423 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper [junit4] 2> 1974423 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1 [junit4] 2> 1974424 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 [junit4] 2> 1974424 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {} [junit4] 2> 1974424 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 1974425 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json [junit4] 2> 1974425 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 1974425 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources [junit4] 2> 1974425 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 [junit4] 2> 1974425 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets [junit4] 2> 1974426 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index [junit4] 2> 1974426 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index [junit4] 2> 1974426 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1516049648824877056 [junit4] 2> 1974432 INFO (searcherExecutor-3444-thread-1-processing-x:collection1 r:core_node1 s:shard1 c:control_collection n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@29ed5726[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 1974433 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 7.0ms to seed version buckets with highest version 1516049648824877056 [junit4] 2> 1974433 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1 [junit4] 2> 1974440 INFO (coreLoadExecutor-3443-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1 [junit4] 2> 1974440 INFO (coreZkRegister-3437-thread-1-processing-x:collection1 r:core_node1 s:shard1 c:control_collection n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:47317/j_ collection:control_collection shard:shard1 [junit4] 2> 1974442 INFO (coreZkRegister-3437-thread-1-processing-x:collection1 r:core_node1 s:shard1 c:control_collection n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election [junit4] 2> 1974446 INFO (coreZkRegister-3437-thread-1-processing-x:collection1 r:core_node1 s:shard1 c:control_collection n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94753102892564484-core_node1-n_0000000000 [junit4] 2> 1974447 INFO (coreZkRegister-3437-thread-1-processing-x:collection1 r:core_node1 s:shard1 c:control_collection n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1 [junit4] 2> 1974449 INFO (coreZkRegister-3437-thread-1-processing-x:collection1 r:core_node1 s:shard1 c:control_collection n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue. [junit4] 2> 1974449 INFO (coreZkRegister-3437-thread-1-processing-x:collection1 r:core_node1 s:shard1 c:control_collection n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync [junit4] 2> 1974449 INFO (coreZkRegister-3437-thread-1-processing-x:collection1 r:core_node1 s:shard1 c:control_collection n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:47317/j_/collection1/ [junit4] 2> 1974449 INFO (OverseerStateUpdate-94753102892564484-127.0.0.1:47317_j_-n_0000000000) [n:127.0.0.1:47317_j_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "operation":"leader", [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"control_collection"} current state version: 1 [junit4] 2> 1974449 INFO (coreZkRegister-3437-thread-1-processing-x:collection1 r:core_node1 s:shard1 c:control_collection n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me [junit4] 2> 1974449 INFO (coreZkRegister-3437-thread-1-processing-x:collection1 r:core_node1 s:shard1 c:control_collection n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:47317/j_/collection1/ has no replicas [junit4] 2> 1974449 INFO (coreZkRegister-3437-thread-1-processing-x:collection1 r:core_node1 s:shard1 c:control_collection n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:47317/j_/collection1/ shard1 [junit4] 2> 1974450 INFO (zkCallback-1778-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 1974453 INFO (coreZkRegister-3437-thread-1-processing-x:collection1 r:core_node1 s:shard1 c:control_collection n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1 [junit4] 2> 1974456 INFO (coreZkRegister-3437-thread-1-processing-x:collection1 r:core_node1 s:shard1 c:control_collection n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node [junit4] 2> 1974458 INFO (OverseerStateUpdate-94753102892564484-127.0.0.1:47317_j_-n_0000000000) [n:127.0.0.1:47317_j_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "operation":"leader", [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"control_collection", [junit4] 2> "base_url":"http://127.0.0.1:47317/j_", [junit4] 2> "core":"collection1", [junit4] 2> "state":"active"} current state version: 2 [junit4] 2> 1974561 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 1974562 INFO (zkCallback-1778-thread-1-processing-n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 1974566 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1974568 INFO (zkCallback-1780-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@77d5e3e1 name:ZooKeeperConnection Watcher:127.0.0.1:55034/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1974568 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1974569 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 1974569 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... [junit4] 2> 1974577 INFO (TEST-LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false [junit4] 2> 1974612 INFO (coreZkRegister-3437-thread-1-processing-x:collection1 r:core_node1 s:shard1 c:control_collection n:127.0.0.1:47317_j_) [n:127.0.0.1:47317_j_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:47317/j_/collection1/ and leader is http://127.0.0.1:47317/j_/collection1/ [junit4] 2> 1974612 INFO (coreZkRegister-3437-thread-1-processing-x:collection1 r:core_node1 s:shard1 c:control_collection n:127.0.0.1:4731 [...truncated too long message...] ndex [junit4] 2> 2700555 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[A6D967FEF6F05DCB]) [ x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_A6D967FEF6F05DCB-001/solr-instance-027/collection1/data [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_A6D967FEF6F05DCB-001/solr-instance-027/collection1/data;done=false>>] [junit4] 2> 2700555 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[A6D967FEF6F05DCB]) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_A6D967FEF6F05DCB-001/solr-instance-027/collection1/data [junit4] 2> 2700555 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[A6D967FEF6F05DCB]) [ x:collection1] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@31b1f6e6{/solr,null,UNAVAILABLE} [junit4] 2> 2700562 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[A6D967FEF6F05DCB]) [ ] o.e.j.s.ServerConnector Stopped ServerConnector@f0c3f60{HTTP/1.1}{127.0.0.1:0} [junit4] 2> 2700563 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[A6D967FEF6F05DCB]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1239272902 [junit4] 2> 2700563 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[A6D967FEF6F05DCB]) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@9e5cb00 [junit4] 2> 2700563 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[A6D967FEF6F05DCB]) [ x:collection1] o.a.s.u.UpdateHandler closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0} [junit4] 2> 2700563 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[A6D967FEF6F05DCB]) [ x:collection1] o.a.s.u.SolrCoreState Closing SolrCoreState [junit4] 2> 2700563 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[A6D967FEF6F05DCB]) [ x:collection1] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 0 - closing IndexWriter [junit4] 2> 2700563 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[A6D967FEF6F05DCB]) [ x:collection1] o.a.s.u.DefaultSolrCoreState closing IndexWriter with IndexWriterCloser [junit4] 2> 2700566 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[A6D967FEF6F05DCB]) [ x:collection1] o.a.s.c.SolrCore [collection1] Closing main searcher on request. [junit4] 2> 2700566 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[A6D967FEF6F05DCB]) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing StandardDirectoryFactory - 2 directories currently being tracked [junit4] 2> 2700566 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[A6D967FEF6F05DCB]) [ x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_A6D967FEF6F05DCB-001/solr-instance-028/collection1/data [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_A6D967FEF6F05DCB-001/solr-instance-028/collection1/data;done=false>>] [junit4] 2> 2700566 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[A6D967FEF6F05DCB]) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_A6D967FEF6F05DCB-001/solr-instance-028/collection1/data [junit4] 2> 2700567 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[A6D967FEF6F05DCB]) [ x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_A6D967FEF6F05DCB-001/solr-instance-028/collection1/data/index [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_A6D967FEF6F05DCB-001/solr-instance-028/collection1/data/index;done=false>>] [junit4] 2> 2700567 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[A6D967FEF6F05DCB]) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_A6D967FEF6F05DCB-001/solr-instance-028/collection1/data/index [junit4] 2> 2700567 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity-seed#[A6D967FEF6F05DCB]) [ x:collection1] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@927b9a2{/solr,null,UNAVAILABLE} [junit4] 2> 2700569 INFO (SUITE-TestReplicationHandler-seed#[A6D967FEF6F05DCB]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore [junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_A6D967FEF6F05DCB-001 [junit4] 2> NOTE: test params are: codec=Asserting(Lucene53), sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=en, timezone=America/Rankin_Inlet [junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.7.0_72 (64-bit)/cpus=4,threads=1,free=233224352,total=457703424 [junit4] 2> NOTE: All tests run in this JVM: [ReplicationFactorTest, IndexSchemaTest, TestPhraseSuggestions, BigEndianAscendingWordDeserializerTest, TestValueSourceCache, CleanupOldIndexTest, HdfsDirectoryFactoryTest, OverriddenZkACLAndCredentialsProvidersTest, TestDistributedStatsComponentCardinality, SynonymTokenizerTest, CollectionReloadTest, TestSolrJ, TestBinaryField, TestFoldingMultitermQuery, EchoParamsTest, TestDistributedSearch, ZkStateReaderTest, TestConfigSetsAPIExclusivity, TestConfigReload, TestOmitPositions, LeaderInitiatedRecoveryOnCommitTest, QueryElevationComponentTest, TestHighFrequencyDictionaryFactory, SignatureUpdateProcessorFactoryTest, PathHierarchyTokenizerFactoryTest, TestRemoteStreaming, TestTolerantSearch, TestIBSimilarityFactory, TestCollectionAPI, JavabinLoaderTest, TestBadConfig, TestRandomFaceting, TestDocumentBuilder, TestSearcherReuse, SolrCoreTest, TestJsonFacets, DistributedFacetPivotSmallAdvancedTest, TestLMDirichletSimilarityFactory, OverseerCollectionConfigSetProcessorTest, TestDistributedMissingSort, ResponseHeaderTest, HdfsBasicDistributedZk2Test, TestExclusionRuleCollectionAccess, HdfsUnloadDistributedZkTest, BasicAuthIntegrationTest, ReturnFieldsTest, TestFieldSortValues, PingRequestHandlerTest, DataDrivenBlockJoinTest, TestCollapseQParserPlugin, CloudExitableDirectoryReaderTest, AnalysisAfterCoreReloadTest, SolrRequestParserTest, TestCollationFieldDocValues, HighlighterMaxOffsetTest, TestMiniSolrCloudClusterBase, TestRandomDVFaceting, MigrateRouteKeyTest, TestRawTransformer, CacheHeaderTest, DisMaxRequestHandlerTest, SSLMigrationTest, ResourceLoaderTest, PrimUtilsTest, TestDocBasedVersionConstraints, TestManagedSynonymFilterFactory, FileUtilsTest, SyncSliceTest, SpellingQueryConverterTest, TestJoin, FullHLLTest, TestCustomSort, TestInitParams, DistributedQueryElevationComponentTest, TestConfig, TestAtomicUpdateErrorCases, OutputWriterTest, JsonLoaderTest, LeaderFailoverAfterPartitionTest, BasicDistributedZkTest, TestCloudSchemaless, StandardRequestHandlerTest, BadCopyFieldTest, TestSchemaSimilarityResource, IndexSchemaRuntimeFieldTest, TestRangeQuery, SolrCloudExampleTest, SolrTestCaseJ4Test, TestReplicationHandler] [junit4] Completed [396/543] on J0 in 660.67s, 13 tests, 1 failure <<< FAILURES! [...truncated 492 lines...] BUILD FAILED /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:792: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:729: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:59: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build.xml:233: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/common-build.xml:526: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1452: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1006: There were test failures: 543 suites (7 ignored), 2144 tests, 1 error, 1 failure, 31 ignored (18 assumptions) [seed: A6D967FEF6F05DCB] Total time: 201 minutes 18 seconds Build step 'Invoke Ant' marked build as failure Archiving artifacts Recording test results Email was triggered for: Failure - Any Sending email for trigger: Failure - Any
--------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org