Hello Oscar, do you have time to look into my problem? Probably Takahiro has a point and gdb behaves differently on Solaris and Linux, so that the differing outputs have no meaning. I tried to debug my Java program, but without success so far, because I wasn't able to get into the Java program to set a breakpoint or to see the code. Have you succeeded to debug a mpiJava program? If so, how must I call gdb (I normally use "gdb mipexec" and then "run -np 1 java ...")? What can I do to get helpful information to track the error down? I have attached the error log file. Perhaps you can see if something is going wrong with the Java interface. Thank you very much for your help and any hints for the usage of gdb with mpiJava in advance. Please let me know if I can provide anything else.
Kind regards Siegmar > > I think that it must have to do with MPI, because everything > > works fine on Linux and my Java program works fine with an older > > MPI version (openmpi-1.8.2a1r31804) as well. > > Yes. I also think it must have to do with MPI. > But java process side, not mpiexec process side. > > When you run Java MPI program via mpiexec, a mpiexec process > process launch a java process. When the java process (your > Java program) calls a MPI method, native part (written in C/C++) > of the MPI library is called. It runs in java process, not in > mpiexec process. I suspect that part. > > > On Solaris things are different. > > Are you saying the following difference? > After this line, > > 881 ORTE_ACTIVATE_JOB_STATE(jdata, ORTE_JOB_STATE_INIT); > Linux shows > > orte_job_state_to_str (state=1) > > at ../../openmpi-dev-124-g91e9686/orte/util/error_strings.c:217 > > 217 switch(state) { > but Solaris shows > > orte_util_print_name_args (name=0x100118380 <orte_process_info+104>) > > at ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:122 > > 122 if (NULL == name) { > > Each macro is defined as: > > #define ORTE_ACTIVATE_JOB_STATE(j, s) \ > do { \ > orte_job_t *shadow=(j); \ > opal_output_verbose(1, orte_state_base_framework.framework_output, \ > "%s ACTIVATE JOB %s STATE %s AT %s:%d", \ > ORTE_NAME_PRINT(ORTE_PROC_MY_NAME), \ > (NULL == shadow) ? "NULL" : \ > ORTE_JOBID_PRINT(shadow->jobid), \ > orte_job_state_to_str((s)), \ > __FILE__, __LINE__); \ > orte_state.activate_job_state(shadow, (s)); \ > } while(0); > > #define ORTE_NAME_PRINT(n) \ > orte_util_print_name_args(n) > > #define ORTE_JOBID_PRINT(n) \ > orte_util_print_jobids(n) > > I'm not sure, but I think the gdb on Solaris steps into > orte_util_print_name_args, but gdb on Linux doesn't step into > orte_util_print_name_args and orte_util_print_jobids for some > reason, or orte_job_state_to_str is evaluated before them. > > So I think it's not an important difference. > > You showed the following lines. > > > > orterun (argc=5, argv=0xffffffff7fffe0d8) > > > > at ../../../../openmpi-dev-124-g91e9686/orte/tools/orterun/orterun.c:1084 > > > > 1084 while (orte_event_base_active) { > > > > (gdb) > > > > 1085 opal_event_loop(orte_event_base, OPAL_EVLOOP_ONCE); > > > > (gdb) > > I'm not familiar with this code but I think this part (in mpiexec > process) is only waiting the java process to terminate (normally > or abnormally). So I think the problem is not in a mpiexec process > but in a java process. > > Regards, > Takahiro > > > Hi Takahiro, > > > > > mpiexec and java run as distinct processes. Your JRE message > > > says java process raises SEGV. So you should trace the java > > > process, not the mpiexec process. And more, your JRE message > > > says the crash happened outside the Java Virtual Machine in > > > native code. So usual Java program debugger is useless. > > > You should trace native code part of the java process. > > > Unfortunately I don't know how to debug such one. > > > > I think that it must have to do with MPI, because everything > > works fine on Linux and my Java program works fine with an older > > MPI version (openmpi-1.8.2a1r31804) as well. > > > > linpc1 x 112 mpiexec -np 1 java InitFinalizeMain > > Hello! > > linpc1 x 113 > > > > Therefore I single stepped through the program on Linux as well > > and found a difference launching the process. On Linux I get the > > following sequence. > > > > Breakpoint 1, rsh_launch (jdata=0x614aa0) > > at ../../../../../openmpi-dev-124-g91e9686/orte/mca/plm/rsh/plm_rsh_module.c:876 > > 876 if (ORTE_FLAG_TEST(jdata, ORTE_JOB_FLAG_RESTART)) { > > (gdb) s > > 881 ORTE_ACTIVATE_JOB_STATE(jdata, ORTE_JOB_STATE_INIT); > > (gdb) s > > orte_job_state_to_str (state=1) > > at ../../openmpi-dev-124-g91e9686/orte/util/error_strings.c:217 > > 217 switch(state) { > > (gdb) > > 221 return "PENDING INIT"; > > (gdb) > > 317 } > > (gdb) > > orte_util_print_jobids (job=4294967295) > > at ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:170 > > 170 ptr = get_print_name_buffer(); > > (gdb) > > > > > > > > On Solaris things are different. > > > > Breakpoint 1, rsh_launch (jdata=0x100125250) > > at ../../../../../openmpi-dev-124-g91e9686/orte/mca/plm/rsh/plm_rsh_module.c:876 > > 876 if (ORTE_FLAG_TEST(jdata, ORTE_JOB_FLAG_RESTART)) { > > (gdb) s > > 881 ORTE_ACTIVATE_JOB_STATE(jdata, ORTE_JOB_STATE_INIT); > > (gdb) s > > orte_util_print_name_args (name=0x100118380 <orte_process_info+104>) > > at ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:122 > > 122 if (NULL == name) { > > (gdb) > > 142 job = orte_util_print_jobids(name->jobid); > > (gdb) > > orte_util_print_jobids (job=2673410048) > > at ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:170 > > 170 ptr = get_print_name_buffer(); > > (gdb) > > > > > > > > Is this normal or is it the reason for the crash on Solaris? > > > > > > Kind regards > > > > Siegmar > > > > > > > > > > > > > > > > > The log file output by JRE may help you. > > > > # An error report file with more information is saved as: > > > > # /home/fd1026/work/skripte/master/parallel/prog/mpi/java/hs_err_pid13080.log > > > > > > Regards, > > > Takahiro > > > > > > > Hi, > > > > > > > > I installed openmpi-dev-124-g91e9686 on Solaris 10 Sparc with > > > > gcc-4.9.1 to track down the error with my small Java program. > > > > I started single stepping in orterun.c at line 1081 and > > > > continued until I got the segmentation fault. I get > > > > "jdata = 0x0" in version openmpi-1.8.2a1r31804, which is the > > > > last one which works with Java in my environment, while I get > > > > "jdata = 0x100125250" in this version. Unfortunately I don't > > > > know which files or variables are important to look at. Perhaps > > > > somebody can look at the following lines of code and tell me, > > > > which information I should provide to solve the problem. I know > > > > that Solaris isn't any longer on your list of supported systems, > > > > but perhaps we can get it working again, if you tell me what > > > > you need and I do the debugging. > > > > > > > > /usr/local/gdb-7.6.1_64_gcc/bin/gdb mpiexec > > > > GNU gdb (GDB) 7.6.1 > > > > ... > > > > (gdb) run -np 1 java InitFinalizeMain > > > > Starting program: /usr/local/openmpi-1.9.0_64_gcc/bin/mpiexec \ > > > > -np 1 java InitFinalizeMain > > > > [Thread debugging using libthread_db enabled] > > > > [New Thread 1 (LWP 1)] > > > > [New LWP 2 ] > > > > # > > > > # A fatal error has been detected by the Java Runtime Environment: > > > > # > > > > # SIGSEGV (0xb) at pc=0xffffffff7ea3c7f0, pid=13064, tid=2 > > > > ... > > > > [LWP 2 exited] > > > > [New Thread 2 ] > > > > [Switching to Thread 1 (LWP 1)] > > > > sol_thread_fetch_registers: td_ta_map_id2thr: no thread can be > > > > found to satisfy query > > > > (gdb) thread 1 > > > > [Switching to thread 1 (LWP 1 )] > > > > #0 0xffffffff7f6173d0 in rtld_db_dlactivity () from /usr/lib/sparcv9/ld.so.1 > > > > (gdb) b orterun.c:1081 > > > > Breakpoint 1 at 0x1000070dc: file > > > > ../../../../openmpi-dev-124-g91e9686/orte/tools/orterun/orterun.c, line 1081. > > > > (gdb) r > > > > The program being debugged has been started already. > > > > Start it from the beginning? (y or n) y > > > > > > > > Starting program: /usr/local/openmpi-1.9.0_64_gcc/bin/mpiexec -np 1 > > > > java > > > > InitFinalizeMain > > > > [Thread debugging using libthread_db enabled] > > > > [New Thread 1 (LWP 1)] > > > > [New LWP 2 ] > > > > [Switching to Thread 1 (LWP 1)] > > > > > > > > Breakpoint 1, orterun (argc=5, argv=0xffffffff7fffe0d8) > > > > at ../../../../openmpi-dev-124-g91e9686/orte/tools/orterun/orterun.c:1081 > > > > 1081 rc = orte_plm.spawn(jdata); > > > > (gdb) print jdata > > > > $1 = (orte_job_t *) 0x100125250 > > > > (gdb) s > > > > rsh_launch (jdata=0x100125250) > > > > at > > > > ../../../../../openmpi-dev-124-g91e9686/orte/mca/plm/rsh/plm_rsh_module.c:876 > > > > 876 if (ORTE_FLAG_TEST(jdata, ORTE_JOB_FLAG_RESTART)) { > > > > (gdb) s > > > > 881 ORTE_ACTIVATE_JOB_STATE(jdata, ORTE_JOB_STATE_INIT); > > > > (gdb) > > > > orte_util_print_name_args (name=0x100118380 <orte_process_info+104>) > > > > at ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:122 > > > > 122 if (NULL == name) { > > > > (gdb) > > > > 142 job = orte_util_print_jobids(name->jobid); > > > > (gdb) > > > > orte_util_print_jobids (job=2502885376) at > > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:170 > > > > 170 ptr = get_print_name_buffer(); > > > > (gdb) > > > > get_print_name_buffer () at > > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:92 > > > > 92 if (!fns_init) { > > > > (gdb) > > > > 101 ret = opal_tsd_getspecific(print_args_tsd_key, (void**)&ptr); > > > > (gdb) > > > > opal_tsd_getspecific (key=1, valuep=0xffffffff7fffd990) > > > > at ../../openmpi-dev-124-g91e9686/opal/threads/tsd.h:163 > > > > 163 *valuep = pthread_getspecific(key); > > > > (gdb) > > > > 164 return OPAL_SUCCESS; > > > > (gdb) > > > > 165 } > > > > (gdb) > > > > get_print_name_buffer () at > > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:102 > > > > 102 if (OPAL_SUCCESS != ret) return NULL; > > > > (gdb) > > > > 104 if (NULL == ptr) { > > > > (gdb) > > > > 113 return (orte_print_args_buffers_t*) ptr; > > > > (gdb) > > > > 114 } > > > > (gdb) > > > > orte_util_print_jobids (job=2502885376) at > > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:172 > > > > 172 if (NULL == ptr) { > > > > (gdb) > > > > 178 if (ORTE_PRINT_NAME_ARG_NUM_BUFS == ptr->cntr) { > > > > (gdb) > > > > 182 if (ORTE_JOBID_INVALID == job) { > > > > (gdb) > > > > 184 } else if (ORTE_JOBID_WILDCARD == job) { > > > > (gdb) > > > > 187 tmp1 = ORTE_JOB_FAMILY((unsigned long)job); > > > > (gdb) > > > > 188 tmp2 = ORTE_LOCAL_JOBID((unsigned long)job); > > > > (gdb) > > > > 189 snprintf(ptr->buffers[ptr->cntr++], > > > > (gdb) > > > > 193 return ptr->buffers[ptr->cntr-1]; > > > > (gdb) > > > > 194 } > > > > (gdb) > > > > orte_util_print_name_args (name=0x100118380 <orte_process_info+104>) > > > > at ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:143 > > > > 143 vpid = orte_util_print_vpids(name->vpid); > > > > (gdb) > > > > orte_util_print_vpids (vpid=0) at > > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:260 > > > > 260 ptr = get_print_name_buffer(); > > > > (gdb) > > > > get_print_name_buffer () at > > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:92 > > > > 92 if (!fns_init) { > > > > (gdb) > > > > 101 ret = opal_tsd_getspecific(print_args_tsd_key, (void**)&ptr); > > > > (gdb) > > > > opal_tsd_getspecific (key=1, valuep=0xffffffff7fffd9a0) > > > > at ../../openmpi-dev-124-g91e9686/opal/threads/tsd.h:163 > > > > 163 *valuep = pthread_getspecific(key); > > > > (gdb) > > > > 164 return OPAL_SUCCESS; > > > > (gdb) > > > > 165 } > > > > (gdb) > > > > get_print_name_buffer () at > > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:102 > > > > 102 if (OPAL_SUCCESS != ret) return NULL; > > > > (gdb) > > > > 104 if (NULL == ptr) { > > > > (gdb) > > > > 113 return (orte_print_args_buffers_t*) ptr; > > > > (gdb) > > > > 114 } > > > > (gdb) > > > > orte_util_print_vpids (vpid=0) at > > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:262 > > > > 262 if (NULL == ptr) { > > > > (gdb) > > > > 268 if (ORTE_PRINT_NAME_ARG_NUM_BUFS == ptr->cntr) { > > > > (gdb) > > > > 272 if (ORTE_VPID_INVALID == vpid) { > > > > (gdb) > > > > 274 } else if (ORTE_VPID_WILDCARD == vpid) { > > > > (gdb) > > > > 277 snprintf(ptr->buffers[ptr->cntr++], > > > > (gdb) > > > > 281 return ptr->buffers[ptr->cntr-1]; > > > > (gdb) > > > > 282 } > > > > (gdb) > > > > orte_util_print_name_args (name=0x100118380 <orte_process_info+104>) > > > > at ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:146 > > > > 146 ptr = get_print_name_buffer(); > > > > (gdb) > > > > get_print_name_buffer () at > > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:92 > > > > 92 if (!fns_init) { > > > > (gdb) > > > > 101 ret = opal_tsd_getspecific(print_args_tsd_key, (void**)&ptr); > > > > (gdb) > > > > opal_tsd_getspecific (key=1, valuep=0xffffffff7fffda60) > > > > at ../../openmpi-dev-124-g91e9686/opal/threads/tsd.h:163 > > > > 163 *valuep = pthread_getspecific(key); > > > > (gdb) > > > > 164 return OPAL_SUCCESS; > > > > (gdb) > > > > 165 } > > > > (gdb) > > > > get_print_name_buffer () at > > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:102 > > > > 102 if (OPAL_SUCCESS != ret) return NULL; > > > > (gdb) > > > > 104 if (NULL == ptr) { > > > > (gdb) > > > > 113 return (orte_print_args_buffers_t*) ptr; > > > > (gdb) > > > > 114 } > > > > (gdb) > > > > orte_util_print_name_args (name=0x100118380 <orte_process_info+104>) > > > > at ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:148 > > > > 148 if (NULL == ptr) { > > > > (gdb) > > > > 154 if (ORTE_PRINT_NAME_ARG_NUM_BUFS == ptr->cntr) { > > > > (gdb) > > > > 158 snprintf(ptr->buffers[ptr->cntr++], > > > > (gdb) > > > > 162 return ptr->buffers[ptr->cntr-1]; > > > > (gdb) > > > > 163 } > > > > (gdb) > > > > orte_util_print_jobids (job=4294967295) at > > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:170 > > > > 170 ptr = get_print_name_buffer(); > > > > (gdb) > > > > get_print_name_buffer () at > > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:92 > > > > 92 if (!fns_init) { > > > > (gdb) > > > > 101 ret = opal_tsd_getspecific(print_args_tsd_key, (void**)&ptr); > > > > (gdb) > > > > opal_tsd_getspecific (key=1, valuep=0xffffffff7fffda60) > > > > at ../../openmpi-dev-124-g91e9686/opal/threads/tsd.h:163 > > > > 163 *valuep = pthread_getspecific(key); > > > > (gdb) > > > > 164 return OPAL_SUCCESS; > > > > (gdb) > > > > 165 } > > > > (gdb) > > > > get_print_name_buffer () at > > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:102 > > > > 102 if (OPAL_SUCCESS != ret) return NULL; > > > > (gdb) > > > > 104 if (NULL == ptr) { > > > > (gdb) > > > > 113 return (orte_print_args_buffers_t*) ptr; > > > > (gdb) > > > > 114 } > > > > (gdb) > > > > orte_util_print_jobids (job=4294967295) at > > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:172 > > > > 172 if (NULL == ptr) { > > > > (gdb) > > > > 178 if (ORTE_PRINT_NAME_ARG_NUM_BUFS == ptr->cntr) { > > > > (gdb) > > > > 182 if (ORTE_JOBID_INVALID == job) { > > > > (gdb) > > > > 183 snprintf(ptr->buffers[ptr->cntr++], > > > > ORTE_PRINT_NAME_ARGS_MAX_SIZE, "[INVALID]"); > > > > (gdb) > > > > 193 return ptr->buffers[ptr->cntr-1]; > > > > (gdb) > > > > 194 } > > > > (gdb) > > > > orte_job_state_to_str (state=1) at > > > > ../../openmpi-dev-124-g91e9686/orte/util/error_strings.c:217 > > > > 217 switch(state) { > > > > (gdb) > > > > 221 return "PENDING INIT"; > > > > (gdb) > > > > 317 } > > > > (gdb) > > > > opal_output_verbose (level=1, output_id=0, > > > > format=0xffffffff7f14dd98 <orte_job_states> > > > > "\336\257\276\355\336\257\276\355") > > > > at ../../../openmpi-dev-124-g91e9686/opal/util/output.c:373 > > > > 373 va_start(arglist, format); > > > > (gdb) > > > > 369 { > > > > (gdb) > > > > 370 if (output_id >= 0 && output_id < OPAL_OUTPUT_MAX_STREAMS && > > > > (gdb) > > > > 377 } > > > > (gdb) > > > > orte_state_base_activate_job_state (jdata=0x100125250, state=1) > > > > at > > > > ../../../../openmpi-dev-124-g91e9686/orte/mca/state/base/state_base_fns.c:33 > > > > 33 opal_list_item_t *itm, *any=NULL, *error=NULL; > > > > (gdb) > > > > 37 for (itm = opal_list_get_first(&orte_job_states); > > > > (gdb) > > > > opal_list_get_first (list=0xffffffff7f14dd98 <orte_job_states>) > > > > at ../../../../openmpi-dev-124-g91e9686/opal/class/opal_list.h:320 > > > > 320 opal_list_item_t* item = > > > > (opal_list_item_t*)list->opal_list_sentinel.opal_list_next; > > > > (gdb) > > > > 324 assert(1 == item->opal_list_item_refcount); > > > > (gdb) > > > > 325 assert( list == item->opal_list_item_belong_to ); > > > > (gdb) > > > > 328 return item; > > > > (gdb) > > > > 329 } > > > > (gdb) > > > > orte_state_base_activate_job_state (jdata=0x100125250, state=1) > > > > at > > > > ../../../../openmpi-dev-124-g91e9686/orte/mca/state/base/state_base_fns.c:38 > > > > 38 itm != opal_list_get_end(&orte_job_states); > > > > (gdb) > > > > opal_list_get_end (list=0xffffffff7f14dd98 <orte_job_states>) > > > > at ../../../../openmpi-dev-124-g91e9686/opal/class/opal_list.h:399 > > > > 399 return &(list->opal_list_sentinel); > > > > (gdb) > > > > 400 } > > > > (gdb) > > > > orte_state_base_activate_job_state (jdata=0x100125250, state=1) > > > > at > > > > ../../../../openmpi-dev-124-g91e9686/orte/mca/state/base/state_base_fns.c:37 > > > > 37 for (itm = opal_list_get_first(&orte_job_states); > > > > (gdb) > > > > 40 s = (orte_state_t*)itm; > > > > (gdb) > > > > 41 if (s->job_state == ORTE_JOB_STATE_ANY) { > > > > (gdb) > > > > 45 if (s->job_state == ORTE_JOB_STATE_ERROR) { > > > > (gdb) > > > > 48 if (s->job_state == state) { > > > > (gdb) > > > > 49 OPAL_OUTPUT_VERBOSE((1, > > > > orte_state_base_framework.framework_output, > > > > (gdb) > > > > orte_util_print_name_args (name=0x100118380 <orte_process_info+104>) > > > > at ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:122 > > > > 122 if (NULL == name) { > > > > (gdb) > > > > 142 job = orte_util_print_jobids(name->jobid); > > > > (gdb) > > > > orte_util_print_jobids (job=2502885376) at > > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:170 > > > > 170 ptr = get_print_name_buffer(); > > > > (gdb) > > > > get_print_name_buffer () at > > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:92 > > > > 92 if (!fns_init) { > > > > (gdb) > > > > 101 ret = opal_tsd_getspecific(print_args_tsd_key, (void**)&ptr); > > > > (gdb) > > > > opal_tsd_getspecific (key=1, valuep=0xffffffff7fffd880) > > > > at ../../openmpi-dev-124-g91e9686/opal/threads/tsd.h:163 > > > > 163 *valuep = pthread_getspecific(key); > > > > (gdb) > > > > 164 return OPAL_SUCCESS; > > > > (gdb) > > > > 165 } > > > > (gdb) > > > > get_print_name_buffer () at > > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:102 > > > > 102 if (OPAL_SUCCESS != ret) return NULL; > > > > (gdb) > > > > 104 if (NULL == ptr) { > > > > (gdb) > > > > 113 return (orte_print_args_buffers_t*) ptr; > > > > (gdb) > > > > 114 } > > > > (gdb) > > > > orte_util_print_jobids (job=2502885376) at > > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:172 > > > > 172 if (NULL == ptr) { > > > > (gdb) > > > > 178 if (ORTE_PRINT_NAME_ARG_NUM_BUFS == ptr->cntr) { > > > > (gdb) > > > > 182 if (ORTE_JOBID_INVALID == job) { > > > > (gdb) > > > > 184 } else if (ORTE_JOBID_WILDCARD == job) { > > > > (gdb) > > > > 187 tmp1 = ORTE_JOB_FAMILY((unsigned long)job); > > > > (gdb) > > > > 188 tmp2 = ORTE_LOCAL_JOBID((unsigned long)job); > > > > (gdb) > > > > 189 snprintf(ptr->buffers[ptr->cntr++], > > > > (gdb) > > > > 193 return ptr->buffers[ptr->cntr-1]; > > > > (gdb) > > > > 194 } > > > > (gdb) > > > > orte_util_print_name_args (name=0x100118380 <orte_process_info+104>) > > > > at ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:143 > > > > 143 vpid = orte_util_print_vpids(name->vpid); > > > > (gdb) > > > > orte_util_print_vpids (vpid=0) at > > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:260 > > > > 260 ptr = get_print_name_buffer(); > > > > (gdb) > > > > get_print_name_buffer () at > > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:92 > > > > 92 if (!fns_init) { > > > > (gdb) > > > > 101 ret = opal_tsd_getspecific(print_args_tsd_key, (void**)&ptr); > > > > (gdb) > > > > opal_tsd_getspecific (key=1, valuep=0xffffffff7fffd890) > > > > at ../../openmpi-dev-124-g91e9686/opal/threads/tsd.h:163 > > > > 163 *valuep = pthread_getspecific(key); > > > > (gdb) > > > > 164 return OPAL_SUCCESS; > > > > (gdb) > > > > 165 } > > > > (gdb) > > > > get_print_name_buffer () at > > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:102 > > > > 102 if (OPAL_SUCCESS != ret) return NULL; > > > > (gdb) > > > > 104 if (NULL == ptr) { > > > > (gdb) > > > > 113 return (orte_print_args_buffers_t*) ptr; > > > > (gdb) > > > > 114 } > > > > (gdb) > > > > orte_util_print_vpids (vpid=0) at > > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:262 > > > > 262 if (NULL == ptr) { > > > > (gdb) > > > > 268 if (ORTE_PRINT_NAME_ARG_NUM_BUFS == ptr->cntr) { > > > > (gdb) > > > > 272 if (ORTE_VPID_INVALID == vpid) { > > > > (gdb) > > > > 274 } else if (ORTE_VPID_WILDCARD == vpid) { > > > > (gdb) > > > > 277 snprintf(ptr->buffers[ptr->cntr++], > > > > (gdb) > > > > 281 return ptr->buffers[ptr->cntr-1]; > > > > (gdb) > > > > 282 } > > > > (gdb) > > > > orte_util_print_name_args (name=0x100118380 <orte_process_info+104>) > > > > at ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:146 > > > > 146 ptr = get_print_name_buffer(); > > > > (gdb) > > > > get_print_name_buffer () at > > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:92 > > > > 92 if (!fns_init) { > > > > (gdb) > > > > 101 ret = opal_tsd_getspecific(print_args_tsd_key, (void**)&ptr); > > > > (gdb) > > > > opal_tsd_getspecific (key=1, valuep=0xffffffff7fffd950) > > > > at ../../openmpi-dev-124-g91e9686/opal/threads/tsd.h:163 > > > > 163 *valuep = pthread_getspecific(key); > > > > (gdb) > > > > 164 return OPAL_SUCCESS; > > > > (gdb) > > > > 165 } > > > > (gdb) > > > > get_print_name_buffer () at > > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:102 > > > > 102 if (OPAL_SUCCESS != ret) return NULL; > > > > (gdb) > > > > 104 if (NULL == ptr) { > > > > (gdb) > > > > 113 return (orte_print_args_buffers_t*) ptr; > > > > (gdb) > > > > 114 } > > > > (gdb) > > > > orte_util_print_name_args (name=0x100118380 <orte_process_info+104>) > > > > at ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:148 > > > > 148 if (NULL == ptr) { > > > > (gdb) > > > > 154 if (ORTE_PRINT_NAME_ARG_NUM_BUFS == ptr->cntr) { > > > > (gdb) > > > > 158 snprintf(ptr->buffers[ptr->cntr++], > > > > (gdb) > > > > 162 return ptr->buffers[ptr->cntr-1]; > > > > (gdb) > > > > 163 } > > > > (gdb) > > > > orte_util_print_jobids (job=4294967295) at > > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:170 > > > > 170 ptr = get_print_name_buffer(); > > > > (gdb) > > > > get_print_name_buffer () at > > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:92 > > > > 92 if (!fns_init) { > > > > (gdb) > > > > 101 ret = opal_tsd_getspecific(print_args_tsd_key, (void**)&ptr); > > > > (gdb) > > > > opal_tsd_getspecific (key=1, valuep=0xffffffff7fffd950) > > > > at ../../openmpi-dev-124-g91e9686/opal/threads/tsd.h:163 > > > > 163 *valuep = pthread_getspecific(key); > > > > (gdb) > > > > 164 return OPAL_SUCCESS; > > > > (gdb) > > > > 165 } > > > > (gdb) > > > > get_print_name_buffer () at > > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:102 > > > > 102 if (OPAL_SUCCESS != ret) return NULL; > > > > (gdb) > > > > 104 if (NULL == ptr) { > > > > (gdb) > > > > 113 return (orte_print_args_buffers_t*) ptr; > > > > (gdb) > > > > 114 } > > > > (gdb) > > > > orte_util_print_jobids (job=4294967295) at > > > > ../../openmpi-dev-124-g91e9686/orte/util/name_fns.c:172 > > > > 172 if (NULL == ptr) { > > > > (gdb) > > > > 178 if (ORTE_PRINT_NAME_ARG_NUM_BUFS == ptr->cntr) { > > > > (gdb) > > > > 182 if (ORTE_JOBID_INVALID == job) { > > > > (gdb) > > > > 183 snprintf(ptr->buffers[ptr->cntr++], > > > > ORTE_PRINT_NAME_ARGS_MAX_SIZE, "[INVALID]"); > > > > (gdb) > > > > 193 return ptr->buffers[ptr->cntr-1]; > > > > (gdb) > > > > 194 } > > > > (gdb) > > > > orte_job_state_to_str (state=1) at > > > > ../../openmpi-dev-124-g91e9686/orte/util/error_strings.c:217 > > > > 217 switch(state) { > > > > (gdb) > > > > 221 return "PENDING INIT"; > > > > (gdb) > > > > 317 } > > > > (gdb) > > > > opal_output_verbose (level=1, output_id=-1, format=0x1 <Address 0x1 out of > > > > bounds>) > > > > at ../../../openmpi-dev-124-g91e9686/opal/util/output.c:373 > > > > 373 va_start(arglist, format); > > > > (gdb) > > > > 369 { > > > > (gdb) > > > > 370 if (output_id >= 0 && output_id < OPAL_OUTPUT_MAX_STREAMS && > > > > (gdb) > > > > 377 } > > > > (gdb) > > > > orte_state_base_activate_job_state (jdata=0x100125250, state=1) > > > > at > > > > ../../../../openmpi-dev-124-g91e9686/orte/mca/state/base/state_base_fns.c:54 > > > > 54 if (NULL == s->cbfunc) { > > > > (gdb) > > > > 62 caddy = OBJ_NEW(orte_state_caddy_t); > > > > (gdb) > > > > opal_obj_new_debug (type=0xffffffff7f14c7d8 <orte_state_caddy_t_class>, > > > > file=0xffffffff7f034c08 > > > > "../../../../openmpi-dev-124-g91e9686/orte/mca/state/base/state_base_fns.c", > > > > line=62) at ../../../../openmpi-dev-124-g91e9686/opal/class/opal_object.h:249 > > > > 249 opal_object_t* object = opal_obj_new(type); > > > > (gdb) > > > > opal_obj_new (cls=0xffffffff7f14c7d8 <orte_state_caddy_t_class>) > > > > at ../../../../openmpi-dev-124-g91e9686/opal/class/opal_object.h:465 > > > > 465 assert(cls->cls_sizeof >= sizeof(opal_object_t)); > > > > (gdb) > > > > 470 object = (opal_object_t *) malloc(cls->cls_sizeof); > > > > (gdb) > > > > 472 if (0 == cls->cls_initialized) { > > > > (gdb) > > > > 473 opal_class_initialize(cls); > > > > (gdb) > > > > opal_class_initialize (cls=0xffffffff7f14c7d8 <orte_state_caddy_t_class>) > > > > at ../../openmpi-dev-124-g91e9686/opal/class/opal_object.c:79 > > > > 79 assert(cls); > > > > (gdb) > > > > 84 if (1 == cls->cls_initialized) { > > > > (gdb) > > > > 87 opal_atomic_lock(&class_lock); > > > > (gdb) > > > > opal_atomic_lock (lock=0xffffffff7ee89bf0 <class_lock>) > > > > at ../../openmpi-dev-124-g91e9686/opal/include/opal/sys/atomic_impl.h:397 > > > > 397 while( !opal_atomic_cmpset_acq_32( &(lock->u.lock), > > > > (gdb) > > > > opal_atomic_cmpset_acq_32 (addr=0xffffffff7ee89bf0 <class_lock>, oldval=0, > > > > newval=1) > > > > at ../../openmpi-dev-124-g91e9686/opal/include/opal/sys/sparcv9/atomic.h:107 > > > > 107 rc = opal_atomic_cmpset_32(addr, oldval, newval); > > > > (gdb) > > > > opal_atomic_cmpset_32 (addr=0xffffffff7ee89bf0 <class_lock>, oldval=0, newval=1) > > > > at ../../openmpi-dev-124-g91e9686/opal/include/opal/sys/sparcv9/atomic.h:93 > > > > 93 int32_t ret = newval; > > > > (gdb) > > > > 95 __asm__ __volatile__("casa [%1] " ASI_P ", %2, %0" > > > > (gdb) > > > > 98 return (ret == oldval); > > > > (gdb) > > > > 99 } > > > > (gdb) > > > > opal_atomic_cmpset_acq_32 (addr=0xffffffff7ee89bf0 <class_lock>, oldval=0, > > > > newval=1) > > > > at ../../openmpi-dev-124-g91e9686/opal/include/opal/sys/sparcv9/atomic.h:108 > > > > 108 opal_atomic_rmb(); > > > > (gdb) > > > > opal_atomic_rmb () at > > > > ../../openmpi-dev-124-g91e9686/opal/include/opal/sys/sparcv9/atomic.h:63 > > > > 63 MEMBAR("#LoadLoad"); > > > > (gdb) > > > > 64 } > > > > (gdb) > > > > opal_atomic_cmpset_acq_32 (addr=0xffffffff7ee89bf0 <class_lock>, oldval=0, > > > > newval=1) > > > > at ../../openmpi-dev-124-g91e9686/opal/include/opal/sys/sparcv9/atomic.h:110 > > > > 110 return rc; > > > > (gdb) > > > > 111 } > > > > (gdb) > > > > opal_atomic_lock (lock=0xffffffff7ee89bf0 <class_lock>) > > > > at ../../openmpi-dev-124-g91e9686/opal/include/opal/sys/atomic_impl.h:403 > > > > 403 } > > > > (gdb) > > > > opal_class_initialize (cls=0xffffffff7f14c7d8 <orte_state_caddy_t_class>) > > > > at ../../openmpi-dev-124-g91e9686/opal/class/opal_object.c:93 > > > > 93 if (1 == cls->cls_initialized) { > > > > (gdb) > > > > 103 cls->cls_depth = 0; > > > > (gdb) > > > > 104 cls_construct_array_count = 0; > > > > (gdb) > > > > 105 cls_destruct_array_count = 0; > > > > (gdb) > > > > 106 for (c = cls; c; c = c->cls_parent) { > > > > (gdb) > > > > 107 if( NULL != c->cls_construct ) { > > > > (gdb) > > > > 108 cls_construct_array_count++; > > > > (gdb) > > > > 110 if( NULL != c->cls_destruct ) { > > > > (gdb) > > > > 111 cls_destruct_array_count++; > > > > (gdb) > > > > 113 cls->cls_depth++; > > > > (gdb) > > > > 106 for (c = cls; c; c = c->cls_parent) { > > > > (gdb) > > > > 107 if( NULL != c->cls_construct ) { > > > > (gdb) > > > > 110 if( NULL != c->cls_destruct ) { > > > > (gdb) > > > > 113 cls->cls_depth++; > > > > (gdb) > > > > 106 for (c = cls; c; c = c->cls_parent) { > > > > (gdb) > > > > 122 (void (**)(opal_object_t*))malloc((cls_construct_array_count + > > > > (gdb) > > > > 123 cls_destruct_array_count + 2) > > > > * > > > > (gdb) > > > > 122 (void (**)(opal_object_t*))malloc((cls_construct_array_count + > > > > (gdb) > > > > 121 cls->cls_construct_array = > > > > (gdb) > > > > 125 if (NULL == cls->cls_construct_array) { > > > > (gdb) > > > > 130 cls->cls_construct_array + cls_construct_array_count + 1; > > > > (gdb) > > > > 129 cls->cls_destruct_array = > > > > (gdb) > > > > 136 cls_construct_array = cls->cls_construct_array + > > > > cls_construct_array_count; > > > > (gdb) > > > > 137 cls_destruct_array = cls->cls_destruct_array; > > > > (gdb) > > > > 139 c = cls; > > > > (gdb) > > > > 140 *cls_construct_array = NULL; /* end marker for the constructors */ > > > > (gdb) > > > > 141 for (i = 0; i < cls->cls_depth; i++) { > > > > (gdb) > > > > 142 if( NULL != c->cls_construct ) { > > > > (gdb) > > > > 143 --cls_construct_array; > > > > (gdb) > > > > 144 *cls_construct_array = c->cls_construct; > > > > (gdb) > > > > 146 if( NULL != c->cls_destruct ) { > > > > (gdb) > > > > 147 *cls_destruct_array = c->cls_destruct; > > > > (gdb) > > > > 148 cls_destruct_array++; > > > > (gdb) > > > > 150 c = c->cls_parent; > > > > (gdb) > > > > 141 for (i = 0; i < cls->cls_depth; i++) { > > > > (gdb) > > > > 142 if( NULL != c->cls_construct ) { > > > > (gdb) > > > > 146 if( NULL != c->cls_destruct ) { > > > > (gdb) > > > > 150 c = c->cls_parent; > > > > (gdb) > > > > 141 for (i = 0; i < cls->cls_depth; i++) { > > > > (gdb) > > > > 152 *cls_destruct_array = NULL; /* end marker for the destructors */ > > > > (gdb) > > > > 154 cls->cls_initialized = 1; > > > > (gdb) > > > > 155 save_class(cls); > > > > (gdb) > > > > save_class (cls=0xffffffff7f14c7d8 <orte_state_caddy_t_class>) > > > > at ../../openmpi-dev-124-g91e9686/opal/class/opal_object.c:188 > > > > 188 if (num_classes >= max_classes) { > > > > (gdb) > > > > 189 expand_array(); > > > > (gdb) > > > > expand_array () at ../../openmpi-dev-124-g91e9686/opal/class/opal_object.c:201 > > > > 201 max_classes += increment; > > > > (gdb) > > > > 202 classes = (void**)realloc(classes, sizeof(opal_class_t*) * > > > > max_classes); > > > > (gdb) > > > > 203 if (NULL == classes) { > > > > (gdb) > > > > 207 for (i = num_classes; i < max_classes; ++i) { > > > > (gdb) > > > > 208 classes[i] = NULL; > > > > (gdb) > > > > 207 for (i = num_classes; i < max_classes; ++i) { > > > > (gdb) > > > > 208 classes[i] = NULL; > > > > (gdb) > > > > 207 for (i = num_classes; i < max_classes; ++i) { > > > > (gdb) > > > > 208 classes[i] = NULL; > > > > (gdb) > > > > 207 for (i = num_classes; i < max_classes; ++i) { > > > > (gdb) > > > > 208 classes[i] = NULL; > > > > (gdb) > > > > 207 for (i = num_classes; i < max_classes; ++i) { > > > > (gdb) > > > > 208 classes[i] = NULL; > > > > (gdb) > > > > 207 for (i = num_classes; i < max_classes; ++i) { > > > > (gdb) > > > > 208 classes[i] = NULL; > > > > (gdb) > > > > 207 for (i = num_classes; i < max_classes; ++i) { > > > > (gdb) > > > > 208 classes[i] = NULL; > > > > (gdb) > > > > 207 for (i = num_classes; i < max_classes; ++i) { > > > > (gdb) > > > > 208 classes[i] = NULL; > > > > (gdb) > > > > 207 for (i = num_classes; i < max_classes; ++i) { > > > > (gdb) > > > > 208 classes[i] = NULL; > > > > (gdb) > > > > 207 for (i = num_classes; i < max_classes; ++i) { > > > > (gdb) > > > > 208 classes[i] = NULL; > > > > (gdb) > > > > 207 for (i = num_classes; i < max_classes; ++i) { > > > > (gdb) > > > > 210 } > > > > (gdb) > > > > save_class (cls=0xffffffff7f14c7d8 <orte_state_caddy_t_class>) > > > > at ../../openmpi-dev-124-g91e9686/opal/class/opal_object.c:192 > > > > 192 classes[num_classes] = cls->cls_construct_array; > > > > (gdb) > > > > 193 ++num_classes; > > > > (gdb) > > > > 194 } > > > > (gdb) > > > > opal_class_initialize (cls=0xffffffff7f14c7d8 <orte_state_caddy_t_class>) > > > > at ../../openmpi-dev-124-g91e9686/opal/class/opal_object.c:159 > > > > 159 opal_atomic_unlock(&class_lock); > > > > (gdb) > > > > opal_atomic_unlock (lock=0xffffffff7ee89bf0 <class_lock>) > > > > at ../../openmpi-dev-124-g91e9686/opal/include/opal/sys/atomic_impl.h:409 > > > > 409 opal_atomic_wmb(); > > > > (gdb) > > > > opal_atomic_wmb () at > > > > ../../openmpi-dev-124-g91e9686/opal/include/opal/sys/sparcv9/atomic.h:69 > > > > 69 MEMBAR("#StoreStore"); > > > > (gdb) > > > > 70 } > > > > (gdb) > > > > opal_atomic_unlock (lock=0xffffffff7ee89bf0 <class_lock>) > > > > at ../../openmpi-dev-124-g91e9686/opal/include/opal/sys/atomic_impl.h:410 > > > > 410 lock->u.lock=OPAL_ATOMIC_UNLOCKED; > > > > (gdb) > > > > 411 } > > > > (gdb) > > > > opal_class_initialize (cls=0xffffffff7f14c7d8 <orte_state_caddy_t_class>) > > > > at ../../openmpi-dev-124-g91e9686/opal/class/opal_object.c:160 > > > > 160 } > > > > (gdb) > > > > opal_obj_new (cls=0xffffffff7f14c7d8 <orte_state_caddy_t_class>) > > > > at ../../../../openmpi-dev-124-g91e9686/opal/class/opal_object.h:475 > > > > 475 if (NULL != object) { > > > > (gdb) > > > > 476 object->obj_class = cls; > > > > (gdb) > > > > 477 object->obj_reference_count = 1; > > > > (gdb) > > > > 478 opal_obj_run_constructors(object); > > > > (gdb) > > > > opal_obj_run_constructors (object=0x1001bfcf0) > > > > at ../../../../openmpi-dev-124-g91e9686/opal/class/opal_object.h:420 > > > > 420 assert(NULL != object->obj_class); > > > > (gdb) > > > > 422 cls_construct = object->obj_class->cls_construct_array; > > > > (gdb) > > > > 423 while( NULL != *cls_construct ) { > > > > (gdb) > > > > 424 (*cls_construct)(object); > > > > (gdb) > > > > orte_state_caddy_construct (caddy=0x1001bfcf0) > > > > at > > > > ../../../../openmpi-dev-124-g91e9686/orte/mca/state/base/state_base_frame.c:84 > > > > 84 memset(&caddy->ev, 0, sizeof(opal_event_t)); > > > > (gdb) > > > > 85 caddy->jdata = NULL; > > > > (gdb) > > > > 86 } > > > > (gdb) > > > > opal_obj_run_constructors (object=0x1001bfcf0) > > > > at ../../../../openmpi-dev-124-g91e9686/opal/class/opal_object.h:425 > > > > 425 cls_construct++; > > > > (gdb) > > > > 423 while( NULL != *cls_construct ) { > > > > (gdb) > > > > 427 } > > > > (gdb) > > > > opal_obj_new (cls=0xffffffff7f14c7d8 <orte_state_caddy_t_class>) > > > > at ../../../../openmpi-dev-124-g91e9686/opal/class/opal_object.h:480 > > > > 480 return object; > > > > (gdb) > > > > 481 } > > > > (gdb) > > > > opal_obj_new_debug (type=0xffffffff7f14c7d8 <orte_state_caddy_t_class>, > > > > file=0xffffffff7f034c08 > > > > "../../../../openmpi-dev-124-g91e9686/orte/mca/state/base/state_base_fns.c", > > > > line=62) at ../../../../openmpi-dev-124-g91e9686/opal/class/opal_object.h:250 > > > > 250 object->obj_magic_id = OPAL_OBJ_MAGIC_ID; > > > > (gdb) > > > > 251 object->cls_init_file_name = file; > > > > (gdb) > > > > 252 object->cls_init_lineno = line; > > > > (gdb) > > > > 253 return object; > > > > (gdb) > > > > 254 } > > > > (gdb) > > > > orte_state_base_activate_job_state (jdata=0x100125250, state=1) > > > > at > > > > ../../../../openmpi-dev-124-g91e9686/orte/mca/state/base/state_base_fns.c:63 > > > > 63 if (NULL != jdata) { > > > > (gdb) > > > > 64 caddy->jdata = jdata; > > > > (gdb) > > > > 65 caddy->job_state = state; > > > > (gdb) > > > > 66 OBJ_RETAIN(jdata); > > > > (gdb) > > > > opal_obj_update (inc=1, object=0x100125250) > > > > at ../../../../openmpi-dev-124-g91e9686/opal/class/opal_object.h:497 > > > > 497 return opal_atomic_add_32(&(object->obj_reference_count), inc); > > > > (gdb) > > > > opal_atomic_add_32 (addr=0x100125260, delta=1) > > > > at > > > > ../../../../openmpi-dev-124-g91e9686/opal/include/opal/sys/atomic_impl.h:63 > > > > 63 oldval = *addr; > > > > (gdb) > > > > 64 } while (0 == opal_atomic_cmpset_32(addr, oldval, oldval + delta)); > > > > (gdb) > > > > opal_atomic_cmpset_32 (addr=0x100125260, oldval=1, newval=2) > > > > at > > > > ../../../../openmpi-dev-124-g91e9686/opal/include/opal/sys/sparcv9/atomic.h:93 > > > > 93 int32_t ret = newval; > > > > (gdb) > > > > 95 __asm__ __volatile__("casa [%1] " ASI_P ", %2, %0" > > > > (gdb) > > > > 98 return (ret == oldval); > > > > (gdb) > > > > 99 } > > > > (gdb) > > > > opal_atomic_add_32 (addr=0x100125260, delta=1) > > > > at > > > > ../../../../openmpi-dev-124-g91e9686/opal/include/opal/sys/atomic_impl.h:65 > > > > 65 return (oldval + delta); > > > > (gdb) > > > > 66 } > > > > (gdb) > > > > orte_state_base_activate_job_state (jdata=0x100125250, state=1) > > > > at > > > > ../../../../openmpi-dev-124-g91e9686/orte/mca/state/base/state_base_fns.c:66 > > > > 66 OBJ_RETAIN(jdata); > > > > (gdb) > > > > 68 opal_event_set(orte_event_base, &caddy->ev, -1, > > > > OPAL_EV_WRITE, s->cbfunc, caddy); > > > > (gdb) > > > > 69 opal_event_set_priority(&caddy->ev, s->priority); > > > > (gdb) > > > > 70 opal_event_active(&caddy->ev, OPAL_EV_WRITE, 1); > > > > (gdb) > > > > 71 return; > > > > (gdb) > > > > 105 } > > > > (gdb) > > > > rsh_launch (jdata=0x100125250) > > > > at > > > > ../../../../../openmpi-dev-124-g91e9686/orte/mca/plm/rsh/plm_rsh_module.c:883 > > > > 883 return ORTE_SUCCESS; > > > > (gdb) > > > > 884 } > > > > (gdb) > > > > orterun (argc=5, argv=0xffffffff7fffe0d8) > > > > at ../../../../openmpi-dev-124-g91e9686/orte/tools/orterun/orterun.c:1084 > > > > 1084 while (orte_event_base_active) { > > > > (gdb) > > > > 1085 opal_event_loop(orte_event_base, OPAL_EVLOOP_ONCE); > > > > (gdb) > > > > 1084 while (orte_event_base_active) { > > > > (gdb) > > > > 1085 opal_event_loop(orte_event_base, OPAL_EVLOOP_ONCE); > > > > (gdb) > > > > 1084 while (orte_event_base_active) { > > > > (gdb) > > > > 1085 opal_event_loop(orte_event_base, OPAL_EVLOOP_ONCE); > > > > (gdb) > > > > # > > > > # A fatal error has been detected by the Java Runtime Environment: > > > > # > > > > # SIGSEGV (0xb) at pc=0xffffffff7ea3c7f0, pid=13080, tid=2 > > > > # > > > > # JRE version: Java(TM) SE Runtime Environment (8.0-b132) (build 1.8.0-b132) > > > > # Java VM: Java HotSpot(TM) 64-Bit Server VM (25.0-b70 mixed mode solaris-sparc > > > > compressed oops) > > > > # Problematic frame: > > > > # 1084 while (orte_event_base_active) { > > > > (gdb) > > > > 1085 opal_event_loop(orte_event_base, OPAL_EVLOOP_ONCE); > > > > (gdb) > > > > C [libc.so.1+0x3c7f0] strlen+0x50 > > > > # > > > > # Failed to write core dump. Core dumps have been disabled. To enable core > > > > dumping, try "ulimit -c unlimited" before starting Java again > > > > # > > > > # An error report file with more information is saved as: > > > > # /home/fd1026/work/skripte/master/parallel/prog/mpi/java/hs_err_pid13080.log > > > > # > > > > # If you would like to submit a bug report, please visit: > > > > # http://bugreport.sun.com/bugreport/crash.jsp > > > > # The crash happened outside the Java Virtual Machine in native code. > > > > # See problematic frame for where to report the bug. > > > > # > > > > -------------------------------------------------------------------------- > > > > mpiexec noticed that process rank 0 with PID 0 on node tyr exited on signal 6 > > > > (Abort). > > > > -------------------------------------------------------------------------- > > > > 1084 while (orte_event_base_active) { > > > > (gdb) > > > > 1089 orte_odls.kill_local_procs(NULL); > > > > (gdb) > > > > > > > > > > > > Thank you very much for any help in advance. > > > > > > > > Kind regards > > > > > > > > Siegmar > _______________________________________________ > users mailing list > us...@open-mpi.org > Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users > Link to this post: http://www.open-mpi.org/community/lists/users/2014/10/25559.php
# # A fatal error has been detected by the Java Runtime Environment: # # SIGSEGV (0xb) at pc=0xffffffff7ea3c7f0, pid=13080, tid=2 # # JRE version: Java(TM) SE Runtime Environment (8.0-b132) (build 1.8.0-b132) # Java VM: Java HotSpot(TM) 64-Bit Server VM (25.0-b70 mixed mode solaris-sparc compressed oops) # Problematic frame: # C [libc.so.1+0x3c7f0] strlen+0x50 # # Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again # # If you would like to submit a bug report, please visit: # http://bugreport.sun.com/bugreport/crash.jsp # The crash happened outside the Java Virtual Machine in native code. # See problematic frame for where to report the bug. # --------------- T H R E A D --------------- Current thread (0x000000010010e800): JavaThread "main" [_thread_in_native, id=2, stack(0xffffffff7b400000,0xffffffff7b500000)] siginfo:si_signo=SIGSEGV: si_errno=0, si_code=1 (SEGV_MAPERR), si_addr=0x0000000000000000 Registers: G1=0xffffffff7b4fd915 G2=0x0000000000000000 G3=0xffffffff7fffe0b9 G4=0xfffffffffffffad8 G5=0x0000000000000000 G6=0xffffffff2affe000 G7=0xffffffff7e900a00 Y=0x0000000000000000 O0=0x0000000000000000 O1=0x0000000000000053 O2=0x0000000000000000 O3=0x0000000000000000 O4=0x0000000000000000 O5=0x0000000000000053 O6=0xffffffff7b4fbf31 O7=0xffffffff7eaacdc8 L0=0x0000000000000000 L1=0x0000000000000073 L2=0x0000000000000000 L3=0x0000000000000000 L4=0x0000000000001000 L5=0x0000000000000000 L6=0x0000000000000000 L7=0xffffffff7ec491f9 I0=0xfffffffee4854037 I1=0xffffffff7b4fdac0 I2=0xffffffff7eaab058 I3=0xffffffff7b4fd1c5 I4=0x0000000000000000 I5=0xfffffffee4854036 I6=0xffffffff7b4fcf01 I7=0xffffffff7eaaf638 PC=0xffffffff7ea3c7f0 nPC=0xffffffff7ea3c7f4 Top of Stack: (sp=0xffffffff7b4fc730) 0xffffffff7b4fc730: 0000000000000000 0000000000000073 0xffffffff7b4fc740: 0000000000000000 0000000000000000 0xffffffff7b4fc750: 0000000000001000 0000000000000000 0xffffffff7b4fc760: 0000000000000000 ffffffff7ec491f9 0xffffffff7b4fc770: fffffffee4854037 ffffffff7b4fdac0 0xffffffff7b4fc780: ffffffff7eaab058 ffffffff7b4fd1c5 0xffffffff7b4fc790: 0000000000000000 fffffffee4854036 0xffffffff7b4fc7a0: ffffffff7b4fcf01 ffffffff7eaaf638 0xffffffff7b4fc7b0: ffffffff7f635b91 000000007b4fd238 0xffffffff7b4fc7c0: ffffffff7b4fcc58 ffffffff7b4fd150 0xffffffff7b4fc7d0: 000000000000000a ffffffff7b4fd050 0xffffffff7b4fc7e0: ffffffff7b4fd7c0 0000000000000000 0xffffffff7b4fc7f0: 0000000000000000 ffffffff7ec3e000 0xffffffff7b4fc800: 0000000000000000 0000000000000000 0xffffffff7b4fc810: 0000000000000000 0000000100000000 0xffffffff7b4fc820: 0000000000000001 0000000000002000 Instructions: (pc=0xffffffff7ea3c7f0) 0xffffffff7ea3c7d0: d2 12 80 00 99 32 60 08 80 90 00 0c 02 40 00 24 0xffffffff7ea3c7e0: 80 8a 60 ff 02 40 00 22 94 02 a0 01 94 02 a0 01 0xffffffff7ea3c7f0: d2 02 80 00 19 00 40 40 1b 20 20 20 98 13 21 01 0xffffffff7ea3c800: 9a 13 60 80 96 2b 40 09 82 22 40 0c 80 8a c0 01 Register to memory mapping: G1=0xffffffff7b4fd915 is pointing into the stack for thread: 0x000000010010e800 G2=0x0000000000000000 is an unknown value G3=0xffffffff7fffe0b9 is an unknown value G4=0xfffffffffffffad8 is an unknown value G5=0x0000000000000000 is an unknown value G6=0xffffffff2affe000 is an unknown value G7=0xffffffff7e900a00 is an unknown value O0=0x0000000000000000 is an unknown value O1=0x0000000000000053 is an unknown value O2=0x0000000000000000 is an unknown value O3=0x0000000000000000 is an unknown value O4=0x0000000000000000 is an unknown value O5=0x0000000000000053 is an unknown value O6=0xffffffff7b4fbf31 is pointing into the stack for thread: 0x000000010010e800 O7=0xffffffff7eaacdc8: _doprnt+0x1d80 in /lib/sparcv9/libc.so.1 at 0xffffffff7ea00000 L0=0x0000000000000000 is an unknown value L1=0x0000000000000073 is an unknown value L2=0x0000000000000000 is an unknown value L3=0x0000000000000000 is an unknown value L4=0x0000000000001000 is an unknown value L5=0x0000000000000000 is an unknown value L6=0x0000000000000000 is an unknown value L7=0xffffffff7ec491f9: _ctype+0x1 in /lib/sparcv9/libc.so.1 at 0xffffffff7ea00000 I0=0xfffffffee4854037: var_type_sizes+0x2df in /export2/prog/SunOS_sparc/openmpi-1.9.0_64_gcc/lib64/libopen-pal.so.0.0.0 at 0xfffffffee4700000 I1=0xffffffff7b4fdac0 is pointing into the stack for thread: 0x000000010010e800 I2=0xffffffff7eaab058: _doprnt+0x10 in /lib/sparcv9/libc.so.1 at 0xffffffff7ea00000 I3=0xffffffff7b4fd1c5 is pointing into the stack for thread: 0x000000010010e800 I4=0x0000000000000000 is an unknown value I5=0xfffffffee4854036: var_type_sizes+0x2de in /export2/prog/SunOS_sparc/openmpi-1.9.0_64_gcc/lib64/libopen-pal.so.0.0.0 at 0xfffffffee4700000 I6=0xffffffff7b4fcf01 is pointing into the stack for thread: 0x000000010010e800 I7=0xffffffff7eaaf638: vsnprintf+0x7c in /lib/sparcv9/libc.so.1 at 0xffffffff7ea00000 Stack: [0xffffffff7b400000,0xffffffff7b500000], sp=0xffffffff7b4fc730, free space=1009k Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code) C [libc.so.1+0x3c7f0] strlen+0x50 C [libc.so.1+0xaf640] vsnprintf+0x84 C [libc.so.1+0xaadb4] vasprintf+0x20 C [libc.so.1+0xaaf04] asprintf+0x28 C [libopen-pal.so.0.0.0+0xaf3cc] mca_base_var_cache_files+0x160 C [libopen-pal.so.0.0.0+0xaed90] mca_base_var_init+0x4e8 C [libopen-pal.so.0.0.0+0xb260c] register_variable+0x214 C [libopen-pal.so.0.0.0+0xb36a0] mca_base_var_register+0x104 C [libmpi_java.so.0.0.0+0x221e8] JNI_OnLoad+0x128 C [libjava.so+0x10860] Java_java_lang_ClassLoader_00024NativeLibrary_load+0xb8 j java.lang.ClassLoader$NativeLibrary.load(Ljava/lang/String;Z)V+-665819 j java.lang.ClassLoader$NativeLibrary.load(Ljava/lang/String;Z)V+0 j java.lang.ClassLoader.loadLibrary0(Ljava/lang/Class;Ljava/io/File;)Z+328 j java.lang.ClassLoader.loadLibrary(Ljava/lang/Class;Ljava/lang/String;Z)V+290 j java.lang.Runtime.loadLibrary0(Ljava/lang/Class;Ljava/lang/String;)V+54 j java.lang.System.loadLibrary(Ljava/lang/String;)V+7 j mpi.MPI.<clinit>()V+28 v ~StubRoutines::call_stub V [libjvm.so+0x6fd4f0] void JavaCalls::call_helper(JavaValue*,methodHandle*,JavaCallArguments*,Thread*)+0xa58 V [libjvm.so+0x690b2c] void InstanceKlass::call_class_initializer_impl(instanceKlassHandle,Thread*)+0xd4 V [libjvm.so+0x68f394] void InstanceKlass::initialize_impl(instanceKlassHandle,Thread*)+0x654 V [libjvm.so+0x68e190] void InstanceKlass::initialize(Thread*)+0x38 V [libjvm.so+0x9ac5ec] void LinkResolver::resolve_static_call(CallInfo&,KlassHandle&,Symbol*,Symbol*,KlassHandle,bool,bool,Thread*)+0xbc V [libjvm.so+0x9b2ff8] void LinkResolver::resolve_invokestatic(CallInfo&,constantPoolHandle,int,Thread*)+0x200 V [libjvm.so+0x9b2b34] void LinkResolver::resolve_invoke(CallInfo&,Handle,constantPoolHandle,int,Bytecodes::Code,Thread*)+0x94c V [libjvm.so+0x6e8af8] void InterpreterRuntime::resolve_invoke(JavaThread*,Bytecodes::Code)+0x938 j InitFinalizeMain.main([Ljava/lang/String;)V+1 v ~StubRoutines::call_stub V [libjvm.so+0x6fd4f0] void JavaCalls::call_helper(JavaValue*,methodHandle*,JavaCallArguments*,Thread*)+0xa58 V [libjvm.so+0x793324] jni_CallStaticVoidMethod+0x910 C [libjli.so+0x7298] JavaMain+0x778 Java frames: (J=compiled Java code, j=interpreted, Vv=VM code) j java.lang.ClassLoader$NativeLibrary.load(Ljava/lang/String;Z)V+0 j java.lang.ClassLoader.loadLibrary0(Ljava/lang/Class;Ljava/io/File;)Z+328 j java.lang.ClassLoader.loadLibrary(Ljava/lang/Class;Ljava/lang/String;Z)V+290 j java.lang.Runtime.loadLibrary0(Ljava/lang/Class;Ljava/lang/String;)V+54 j java.lang.System.loadLibrary(Ljava/lang/String;)V+7 j mpi.MPI.<clinit>()V+28 v ~StubRoutines::call_stub j InitFinalizeMain.main([Ljava/lang/String;)V+1 v ~StubRoutines::call_stub --------------- P R O C E S S --------------- Java Threads: ( => current thread ) 0x000000010035e800 JavaThread "Service Thread" daemon [_thread_blocked, id=11, stack(0xfffffffee5500000,0xfffffffee5600000)] 0x00000001002fa000 JavaThread "C1 CompilerThread1" daemon [_thread_blocked, id=10, stack(0xfffffffee5700000,0xfffffffee5800000)] 0x00000001002f7000 JavaThread "C2 CompilerThread0" daemon [_thread_blocked, id=9, stack(0xfffffffee5900000,0xfffffffee5a00000)] 0x00000001002f5800 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=8, stack(0xfffffffee5b00000,0xfffffffee5c00000)] 0x00000001002c4000 JavaThread "Finalizer" daemon [_thread_blocked, id=7, stack(0xfffffffee5d00000,0xfffffffee5e00000)] 0x00000001002bc800 JavaThread "Reference Handler" daemon [_thread_blocked, id=6, stack(0xfffffffee5f00000,0xfffffffee6000000)] =>0x000000010010e800 JavaThread "main" [_thread_in_native, id=2, stack(0xffffffff7b400000,0xffffffff7b500000)] Other Threads: 0x00000001002b6000 VMThread [stack: 0xfffffffee6100000,0xfffffffee6200000] [id=5] 0x0000000100364000 WatcherThread [stack: 0xfffffffee5300000,0xfffffffee5400000] [id=12] VM state:not at safepoint (normal execution) VM Mutex/Monitor currently owned by a thread: None Heap: PSYoungGen total 8192K, used 933K [0xffffffff55c00000, 0xffffffff56800000, 0xffffffff6b000000) eden space 4096K, 22% used [0xffffffff55c00000,0xffffffff55ce9530,0xffffffff56000000) from space 4096K, 0% used [0xffffffff56400000,0xffffffff56400000,0xffffffff56800000) to space 4096K, 0% used [0xffffffff56000000,0xffffffff56000000,0xffffffff56400000) ParOldGen total 53248K, used 0K [0xffffffff2b000000, 0xffffffff2e400000, 0xffffffff55c00000) object space 53248K, 0% used [0xffffffff2b000000,0xffffffff2b000000,0xffffffff2e400000) Metaspace used 2853K, capacity 4550K, committed 4864K, reserved 1056768K class space used 305K, capacity 386K, committed 512K, reserved 1048576K Card table byte_map: [0xffffffff6b100000,0xffffffff6b302000] byte_map_base: 0xff7fffff6b7a8000 Marking Bits: (ParMarkBitMap*) 0xffffffff7e5daee0 Begin Bits: [0xffffffff28400000, 0xffffffff29400000) End Bits: [0xffffffff29400000, 0xffffffff2a400000) Polling page: 0xffffffff7b100000 CodeCache: size=245760Kb used=1116Kb max_used=1116Kb free=244643Kb bounds [0xffffffff6b800000, 0xffffffff6bc00000, 0xffffffff7a800000] total_blobs=272 nmethods=38 adapters=151 compilation: enabled Compilation events (10 events): Event: 0.308 Thread 0x00000001002fa000 34 3 java.lang.AbstractStringBuilder::append (50 bytes) Event: 0.309 Thread 0x00000001002fa000 nmethod 34 0xffffffff6b9131d0 code [0xffffffff6b9133c0, 0xffffffff6b913978] Event: 0.312 Thread 0x00000001002fa000 35 3 java.lang.System::getSecurityManager (4 bytes) Event: 0.313 Thread 0x00000001002fa000 nmethod 35 0xffffffff6b913b90 code [0xffffffff6b913ce0, 0xffffffff6b913e48] Event: 0.315 Thread 0x00000001002fa000 36 3 java.lang.String::lastIndexOf (52 bytes) Event: 0.316 Thread 0x00000001002fa000 nmethod 36 0xffffffff6b913ed0 code [0xffffffff6b9140a0, 0xffffffff6b9145f0] Event: 0.316 Thread 0x00000001002fa000 38 3 java.util.HashMap::putVal (300 bytes) Event: 0.319 Thread 0x00000001002fa000 nmethod 38 0xffffffff6b914790 code [0xffffffff6b914b40, 0xffffffff6b916670] Event: 0.319 Thread 0x00000001002fa000 37 3 java.util.HashMap::put (13 bytes) Event: 0.320 Thread 0x00000001002fa000 nmethod 37 0xffffffff6b916d50 code [0xffffffff6b916f00, 0xffffffff6b9173d0] GC Heap History (0 events): No events Deoptimization events (0 events): No events Internal exceptions (5 events): Event: 0.107 Thread 0x000000010010e800 Exception <a 'java/lang/NoSuchMethodError': Method sun.misc.Unsafe.defineClass(Ljava/lang/String;[BII)Ljava/lang/Class; name or signature does not match> (0xffffffff55c0bd00) thrown at [/tmp/workspace/8-2-build-solaris-sparcv9/jdk8/2238/hotspot/src/share/ Event: 0.108 Thread 0x000000010010e800 Exception <a 'java/lang/NoSuchMethodError': Method sun.misc.Unsafe.prefetchRead(Ljava/lang/Object;J)V name or signature does not match> (0xffffffff55c0bf90) thrown at [/tmp/workspace/8-2-build-solaris-sparcv9/jdk8/2238/hotspot/src/share/vm/prims/jni.cpp, Event: 0.274 Thread 0x000000010010e800 Exception <a 'java/security/PrivilegedActionException'> (0xffffffff55cb1f60) thrown at [/tmp/workspace/8-2-build-solaris-sparcv9/jdk8/2238/hotspot/src/share/vm/prims/jvm.cpp, line 1248] Event: 0.288 Thread 0x000000010010e800 Exception <a 'java/security/PrivilegedActionException'> (0xffffffff55cb6c78) thrown at [/tmp/workspace/8-2-build-solaris-sparcv9/jdk8/2238/hotspot/src/share/vm/prims/jvm.cpp, line 1248] Event: 0.306 Thread 0x000000010010e800 Exception <a 'java/security/PrivilegedActionException'> (0xffffffff55cc3270) thrown at [/tmp/workspace/8-2-build-solaris-sparcv9/jdk8/2238/hotspot/src/share/vm/prims/jvm.cpp, line 1248] Events (10 events): Event: 0.306 loading class mpi/MPI Event: 0.306 loading class mpi/MPI done Event: 0.312 loading class java/io/IOException Event: 0.312 loading class java/io/IOException done Event: 0.313 loading class java/util/concurrent/ConcurrentHashMap$ForwardingNode Event: 0.313 loading class java/util/concurrent/ConcurrentHashMap$ForwardingNode done Event: 0.314 loading class java/lang/AssertionError Event: 0.314 loading class java/lang/AssertionError done Event: 0.316 loading class java/lang/ClassLoaderHelper Event: 0.316 loading class java/lang/ClassLoaderHelper done Dynamic libraries: 0x0000000100000000 /export2/prog/SunOS_sparc/jdk1.8.0/bin/java 0xffffffff7f000000 /export2/prog/SunOS_sparc/jdk1.8.0/bin/../lib/sparcv9/jli/libjli.so 0xffffffff7f100000 /lib/sparcv9/libthread.so.1 0xffffffff7ed00000 /lib/sparcv9/libdl.so.1 0xffffffff7ea00000 /lib/sparcv9/libc.so.1 0xffffffff7e800000 /platform/SUNW,A70/lib/sparcv9/libc_psr.so.1 0xffffffff7d400000 /export2/prog/SunOS_sparc/jdk1.8.0/jre/lib/sparcv9/server/libjvm.so 0xffffffff7d200000 /lib/sparcv9/libsocket.so.1 0xffffffff7e400000 /usr/lib/sparcv9/libsched.so.1 0xffffffff7cf00000 /lib/sparcv9/libm.so.1 0xffffffff7cd00000 /usr/lib/sparcv9/libCrun.so.1 0xffffffff7cb00000 /lib/sparcv9/libdoor.so.1 0xffffffff7c900000 /usr/lib/sparcv9/libdemangle.so.1 0xffffffff7c700000 /lib/sparcv9/libkstat.so.1 0xffffffff7c500000 /lib/sparcv9/libnsl.so.1 0xffffffff7c300000 /lib/sparcv9/libm.so.2 0xffffffff7c100000 /lib/sparcv9/libmp.so.2 0xffffffff7bf00000 /lib/sparcv9/libmd.so.1 0xffffffff7bd00000 /platform/SUNW,A70/lib/sparcv9/libmd_psr.so.1 0xffffffff7bb00000 /lib/sparcv9/libscf.so.1 0xffffffff7b900000 /lib/sparcv9/libuutil.so.1 0xffffffff7b700000 /lib/sparcv9/libgen.so.1 0xffffffff7b200000 /export2/prog/SunOS_sparc/jdk1.8.0/jre/lib/sparcv9/libverify.so 0xffffffff7b000000 /export2/prog/SunOS_sparc/jdk1.8.0/jre/lib/sparcv9/libjava.so 0xffffffff7ab00000 /export2/prog/SunOS_sparc/jdk1.8.0/jre/lib/sparcv9/libzip.so 0xfffffffee5100000 /export2/prog/SunOS_sparc/openmpi-1.9.0_64_gcc/lib64/libmpi_java.so.0.0.0 0xfffffffee4d00000 /usr/local/openmpi-1.9.0_64_gcc/lib64/libmpi.so.0 0xfffffffee4a00000 /usr/local/openmpi-1.9.0_64_gcc/lib64/libopen-rte.so.0 0xfffffffee4700000 /usr/local/openmpi-1.9.0_64_gcc/lib64/libopen-pal.so.0 0xfffffffee4500000 /lib/sparcv9/libsendfile.so.1 0xfffffffee4300000 /usr/lib/sparcv9/libpicl.so.1 0xfffffffee4100000 /usr/lib/sparcv9/liblgrp.so.1 0xfffffffee3f00000 /lib/sparcv9/librt.so.1 0xfffffffee3d00000 /usr/local/gcc-4.9.1/lib/sparcv9/libgcc_s.so.1 0xfffffffee4c00000 /lib/sparcv9/libpthread.so.1 0xfffffffee3b00000 /lib/sparcv9/libaio.so.1 VM Arguments: jvm_args: -Djava.library.path=/usr/local/openmpi-1.9.0_64_gcc/lib64 java_command: InitFinalizeMain java_class_path (initial): /home/fd1026/work/skripte/master/parallel/prog/mpi/java:/usr/local/junit4.10:/usr/local/junit4.10/junit-4.10.jar:/usr/local/javacc-5.0/javacc.jar:.:/home/fd1026/SunOS/sparc/mpi_classfiles:/usr/local/openmpi-1.9.0_64_gcc/lib64/mpi.jar Launcher Type: SUN_STANDARD Environment Variables: JAVA_HOME=/usr/local/jdk1.8.0 CLASSPATH=/usr/local/junit4.10:/usr/local/junit4.10/junit-4.10.jar:/usr/local/javacc-5.0/javacc.jar:.:/home/fd1026/SunOS/sparc/mpi_classfiles PATH=/usr/local/openmpi-1.9.0_64_gcc/bin:/usr/local/openmpi-1.9.0_64_gcc/bin:/usr/local/openmpi-1.9.0_64_gcc/bin:/usr/local/NetBeans-4.0/bin:/usr/local/jdk1.8.0/bin:/usr/local/apache-ant-1.6.2/bin:/usr/local/gcc-4.9.1/bin:/opt/solstudio12.3/bin:/usr/local/bin:/usr/local/ssl/bin:/usr/local/pgsql/bin:/usr/bin:/usr/openwin/bin:/usr/dt/bin:/usr/ccs/bin:/usr/sfw/bin:/opt/sfw/bin:/usr/ucb:/usr/xpg4/bin:/usr/local/teTeX-1.0.7/bin/sparc-sun-solaris2.10:/usr/local/bluej-2.1.2:/usr/local/hwloc-1.10.0/bin:/home/fd1026/SunOS/sparc/bin:.:/usr/sbin:/usr/sbin LD_LIBRARY_PATH=/usr/local/openmpi-1.9.0_64_gcc/lib:/usr/local/openmpi-1.9.0_64_gcc/lib64:/usr/local/openmpi-1.9.0_64_gcc/lib:/usr/local/jdk1.8.0/jre/lib/sparc:/usr/local/gcc-4.9.1/lib:/usr/local/gcc-4.9.1/lib/gcc/sparc-sun-solaris2.10/4.9.1:/usr/local/lib:/usr/local/ssl/lib:/usr/local/oracle:/usr/local/pgsql/lib:/lib:/usr/lib:/usr/openwin/lib:/usr/dt/lib:/usr/X11R6/lib:/usr/ccs/lib:/usr/sfw/lib:/opt/sfw/lib:/usr/ucblib:/usr/local/hwloc-1.10.0/lib:/usr/lib/gnome-private/lib:/home/fd1026/SunOS/sparc/lib SHELL=/bin/tcsh DISPLAY=localhost:11.0 HOSTTYPE=sun4 OSTYPE=solaris MACHTYPE=sparc Signal Handlers: SIGSEGV: [libjvm.so+0xd98e60], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c SIGBUS: [libjvm.so+0xd98e60], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c SIGFPE: [libjvm.so+0xb44e68], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c SIGPIPE: [libjvm.so+0xb44e68], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c SIGXFSZ: [libjvm.so+0xb44e68], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c SIGILL: [libjvm.so+0xb44e68], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c SIGUSR1: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000 SIGUSR2: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000 SIGQUIT: [libjvm.so+0xb3f148], sa_mask[0]=0xffbffeff, sa_flags=0x00000004 SIGHUP: [libjvm.so+0xb3f148], sa_mask[0]=0xffbffeff, sa_flags=0x00000004 SIGINT: [libjvm.so+0xb3f148], sa_mask[0]=0xffbffeff, sa_flags=0x00000004 SIGTERM: [libjvm.so+0xb3f148], sa_mask[0]=0xffbffeff, sa_flags=0x00000004 SIG39: [libjvm.so+0xb44eb8], sa_mask[0]=0x00000000, sa_flags=0x00000008 SIG40: [libjvm.so+0xb44e68], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c --------------- S Y S T E M --------------- OS: Solaris 10 10/09 s10s_u8wos_08a SPARC Copyright 2009 Sun Microsystems, Inc. All Rights Reserved. Use is subject to license terms. Assembled 16 September 2009 uname:SunOS 5.10 Generic_150400-11 sun4u (T2 libthread) rlimit: STACK 8192k, CORE 0k, NOFILE 65536, AS infinity load average:0.07 0.28 0.23 CPU:total 2 v9, vis1, vis2, ultra3 Memory: 8k page, physical 4194304k(2345768k free) vm_info: Java HotSpot(TM) 64-Bit Server VM (25.0-b70) for solaris-sparc JRE (1.8.0-b132), built on Mar 4 2014 11:22:49 by "" with Sun Studio 12u1 time: Tue Oct 21 13:22:10 2014 elapsed time: 0 seconds