2ndLevel processing stopping after snow package loaded (but not killed)

Hello,

I have a second level script (the spacing is correct in the actual file):


3dMVM -prefix MJ_MVM1 -jobs 64 \
-bsVars 'Use*Age+WRAT' \
-wsVars 'contrasts' \
-qVars 'Age,WRAT' \
-qVarCenters '25.85,97.85' \
-num_glt 2 \
-gltLabel 1 WvsL_hvy_vs_low -gltCode 1 'Use : 1*Heavy -1*Low contrasts : 1*WvsL' \
-gltLabel 2 RvsS_hvy_vs_low -gltCode 2 'Use : 1*Heavy -1*Low contrasts : 1*RvsS' \
-dataTable \
Subj     Use    Age   WRAT      contrasts   InputFile	\
2866_02  Heavy	28    99	WvsL        stats.MJ_2866_02_REML+tlrc'[16]' \
2866_02  Heavy	28    99	RvsS        stats.MJ_2866_02_REML+tlrc'[19]' \
3317_03  Heavy  29    111	WvsL        stats.MJ_3317_03_REML+tlrc'[16]' \
3317_03  Heavy  29    111	RvsS        stats.MJ_3317_03_REML+tlrc'[19]' \
7121_04  Heavy  26    88	WvsL	    stats.MJ_7121_04_REML+tlrc'[16]' \
7121_04  Heavy  26    88	RvsS        stats.MJ_7121_04_REML+tlrc'[19]' \
3589_05  Heavy  27    94	WvsL        stats.MJ_3589_05_REML+tlrc'[16]' \
3589_05  Heavy  27    94	RvsS        stats.MJ_3589_05_REML+tlrc'[19]' \
3604_07  Low    23    89	WvsL        stats.MJ_3604_07_REML+tlrc'[16]' \
3604_07  Low    23    89	RvsS        stats.MJ_3604_07_REML+tlrc'[19]' \
2837_08  Low    30    96	WvsL        stats.MJE_2837_08_REML+tlrc'[16]' \
2837_08  Low    30    96	RvsS        stats.MJE_2837_08_REML+tlrc'[19]' \
7389_10  Low    25    80	WvsL        stats.MJ_7389_10_REML+tlrc'[16]' \
7389_10  Low    25    80	RvsS        stats.MJ_7389_10_REML+tlrc'[19]' \
1060_12  Low    22    71	WvsL        stats.MJ_1060_12_REML+tlrc'[16]' \
1060_12  Low    22    71	RvsS        stats.MJ_1060_12_REML+tlrc'[19]' \
2865_13  Low    25    69	WvsL        stats.MJ_2865_13_REML+tlrc'[16]' \
2865_13  Low    25    69	RvsS        stats.MJ_2865_13_REML+tlrc'[19]' \
1100_14  Heavy  23    85	WvsL        stats.MJ_1100_14_REML+tlrc'[16]' \
1100_14  Heavy  23    85	RvsS        stats.MJ_1100_14_REML+tlrc'[19]' \
1218_15  Heavy  23    73	WvsL        stats.MJ_1218_15_REML+tlrc'[16]' \
1218_15  Heavy  23    73	RvsS        stats.MJ_1218_15_REML+tlrc'[19]' \
1310_16  Low    31    90	WvsL        stats.MJ_1310_16_REML+tlrc'[16]' \
1310_16  Low    31    90	RvsS        stats.MJ_1310_16_REML+tlrc'[19]' \
3200_17  Low    29    96	WvsL        stats.MJ_3200_17_REML+tlrc'[16]' \
3200_17  Low    29    96	RvsS        stats.MJ_3200_17_REML+tlrc'[19]' \
2099_18  Heavy  24    106	WvsL        stats.MJ_2099_18_REML+tlrc'[16]' \
2099_18  Heavy  24    106	RvsS        stats.MJ_2099_18_REML+tlrc'[19]' \
2164_19  Heavy  24    97	WvsL        stats.MJ_2164_19_REML+tlrc'[16]' \
2164_19  Heavy  24    97	RvsS        stats.MJ_2164_19_REML+tlrc'[19]' \
2079_20  Low    23    85	WvsL        stats.MJ_2079_20_REML+tlrc'[16]' \
2079_20  Low    23    85	RvsS        stats.MJ_2079_20_REML+tlrc'[19]' \
021      Low    28    145	WvsL        stats.MJ_021_REML+tlrc'[16]' \
021      Low    28    145	RvsS        stats.MJ_021_REML+tlrc'[19]' \
022      Heavy  27    96	WvsL        stats.MJ_022_REML+tlrc'[16]' \
022      Heavy  27    96	RvsS        stats.MJ_022_REML+tlrc'[19]' \
024      Low    24    84	WvsL        stats.MJ_024_REML+tlrc'[16]' \
024      Low    24    84	RvsS        stats.MJ_024_REML+tlrc'[19]' \
025      Heavy  29    86	WvsL        stats.MJ_025_REML+tlrc'[16]' \
025      Heavy  29    86	RvsS        stats.MJ_025_REML+tlrc'[19]' \
026      Heavy  25    90	WvsL        stats.MJ_026_REML+tlrc'[16]' \
026      Heavy  25    90	RvsS        stats.MJ_026_REML+tlrc'[19]' \
028      Heavy  25    75	WvsL        stats.MJ_028_REML+tlrc'[16]' \
028      Heavy  25    75	RvsS        stats.MJ_028_REML+tlrc'[19]' \
030	 Heavy	23    145  	WvsL        stats.MJ_030_REML+tlrc'[16]' \
030	 Heavy	23    145	RvsS        stats.MJ_030_REML+tlrc'[19]' \
032	 Heavy	22    96	WvsL        stats.MJ_032_REML+tlrc'[16]' \
032	 Heavy	22    96	RvsS        stats.MJ_032_REML+tlrc'[19]' \
033	 Heavy	24    93	WvsL        stats.MJ_033_REML+tlrc'[16]' \
033	 Heavy	24    93	RvsS        stats.MJ_033_REML+tlrc'[19]' \
034	 Low	28    145	WvsL        stats.MJ_034_REML+tlrc'[16]' \
034	 Low	28    145	RvsS        stats.MJ_034_REML+tlrc'[19]' \
035	 Heavy	28    98	WvsL        stats.MJ_035_REML+tlrc'[16]' \
035	 Heavy	28    98	RvsS        stats.MJ_035_REML+tlrc'[19]' \
036	 Low	24    96	WvsL        stats.MJ_036_REML+tlrc'[16]' \
036	 Low	24    96	RvsS        stats.MJ_036_REML+tlrc'[19]' \
037	 Low	26    95	WvsL        stats.MJ_037_REML+tlrc'[19]' \
037	 Low	26    95	RvsS        stats.MJ_037_REML+tlrc'[19]' \
038	 Low	26    132	WvsL        stats.MJ_038_REML+tlrc'[19]' \
038	 Low	26    132	RvsS        stats.MJ_038_REML+tlrc'[19]' \
039	 Low	24    121	WvsL        stats.MJ_039_REML+tlrc'[19]' \
039	 Low	24    121	RvsS        stats.MJ_039_REML+tlrc'[19]' \
040	 Low	29    132	WvsL        stats.MJ_040_REML+tlrc'[19]' \
040	 Low	29    132	RvsS        stats.MJ_040_REML+tlrc'[19]' \
041	 Low	28    121	WvsL        stats.MJ_041_REML+tlrc'[19]' \
041	 Low	28    121	RvsS        stats.MJ_041_REML+tlrc'[19]'

that is pausing right after the snow package is loaded.


Reading input files now...

Reading input files: Done!


Range of input data: [-586.249, 602.529]

If the program hangs here for more than, for example, half an hour,
kill the process because the model specification or the GLT coding
is likely inappropriate.

[1] "Great, test run passed at voxel (21, 38, 32)!"
[1] "Start to compute 64 slices along Z axis. You can monitor the progress"
[1] "and estimate the total run time as shown below."
[1] "04/07/21 15:28:53.134"
Loading required package: snow
Package snow loaded successfully!

This is odd, in my experience usually at this point the script will either continue to run or will be killed. I am using openmpi, and have tried various very large memory configurations, so I don’t believe it is a compute error. Do you have any idea why it might be pausing here? It has been like this for over an hour.

Thank you,
Mikey

Mikey,

That’s indeed very strange. I may have to ask you to share some data for testing if the problem persists.