12:07:13 - 132 files are removed from the queue.
12:07:13 - 105 files are added to the queue.
12:07:13 -- Processing piq_realtime_level1a_neutral_20251019_0002_YM08.tar (1/105)
12:07:44 - Unexpected error occurs.
12:07:44 -- ValueError >> `y` must contain only finite values.
12:07:44 --  line 84 of /data3/tcliu/gps_pod/python/planetiq/process_excess_phase_rt.py
12:07:44 --  line 24 of /data3/tcliu/gps_pod/python/planetiq/step2.py
12:07:44 --  line 742 of /data3/tcliu/gps_pod/python/.exph/lib64/python3.9/site-packages/scipy/interpolate/_cubic.py
12:07:44 --  line 63 of /data3/tcliu/gps_pod/python/.exph/lib64/python3.9/site-packages/scipy/interpolate/_cubic.py
12:08:42 - checking progress...
12:08:42 -- Still progressing.
12:08:51 - checking progress...
12:08:51 -- Old process timeout and was terminated.
12:08:51 -- Processing piq_realtime_level1a_neutral_20251019_0002_YM08.tar (1/105)
12:09:28 - Unexpected error occurs.
12:09:28 -- ValueError >> `y` must contain only finite values.
12:09:28 --  line 84 of /data3/tcliu/gps_pod/python/planetiq/process_excess_phase_rt.py
12:09:28 --  line 24 of /data3/tcliu/gps_pod/python/planetiq/step2.py
12:09:28 --  line 742 of /data3/tcliu/gps_pod/python/planetiq/.venv/lib64/python3.9/site-packages/scipy/interpolate/_cubic.py
12:09:28 --  line 63 of /data3/tcliu/gps_pod/python/planetiq/.venv/lib64/python3.9/site-packages/scipy/interpolate/_cubic.py
12:31:45 - checking progress...
12:31:45 -- Old process timeout and was terminated.
12:31:45 - 3 files are added to the queue.
12:31:45 -- Processing piq_realtime_level1a_neutral_20251019_0002_YM08.tar (1/108)
12:39:46 - Progress completed.
14:31:43 - checking progress...
14:31:43 -- Old process timeout and was terminated.
14:31:43 - 3 files are added to the queue.
14:31:43 -- Processing piq_realtime_level1a_neutral_20251019_0002_YM08.tar (1/111)
14:39:04 - Progress completed.
14:50:56 - checking progress...
14:50:57 -- Old process timeout and was terminated.
14:50:57 -- Processing piq_realtime_level1a_neutral_20251019_0002_YM08.tar (1/111)
14:57:50 - Progress completed.
15:01:09 - checking progress...
15:01:09 -- Processing piq_realtime_level1a_neutral_20251019_0004_GN05.tar (1/110)
15:16:39 - checking progress...
15:16:39 -- Still progressing.
15:17:17 - checking progress...
15:17:17 - 1 files are added to the queue.
15:17:18 -- Processing piq_realtime_level1a_neutral_20251019_0004_GN05.tar (1/111)
15:25:37 - checking progress...
15:25:37 -- Still progressing.
15:26:03 - checking progress...
15:26:03 -- Processing piq_realtime_level1a_neutral_20251019_0002_YM08.tar (1/112)
15:26:42 - checking progress...
15:26:42 -- Processing piq_realtime_level1a_neutral_20251019_0002_YM08.tar (1/112)
15:33:59 -- Processing piq_realtime_level1a_neutral_20251019_0004_GN05.tar (2/112)
15:46:47 -- Processing piq_realtime_level1a_neutral_20251019_0044_GN05.tar (3/112)
15:48:11 - Unexpected error occurs.
15:48:11 -- ValueError >> `x` must be strictly increasing sequence.
15:48:11 --  line 84 of /data3/tcliu/gps_pod/python/planetiq/process_excess_phase_rt.py
15:48:11 --  line 28 of /data3/tcliu/gps_pod/python/planetiq/step2.py
15:48:11 --  line 742 of /data3/tcliu/gps_pod/python/.exph/lib64/python3.9/site-packages/scipy/interpolate/_cubic.py
15:48:11 --  line 70 of /data3/tcliu/gps_pod/python/.exph/lib64/python3.9/site-packages/scipy/interpolate/_cubic.py
16:28:35 - checking progress...
16:28:35 -- Old process timeout and was terminated.
16:28:35 - 1 files are added to the queue.
16:28:35 -- Processing piq_realtime_level1a_neutral_20251019_0044_GN05.tar (1/111)
16:50:34 -- Processing piq_realtime_level1a_neutral_20251019_0051_GN04.tar (2/111)
17:04:10 -- Processing piq_realtime_level1a_neutral_20251019_0139_GN05.tar (3/111)
17:28:31 -- Processing piq_realtime_level1a_neutral_20251019_0149_GN04.tar (4/111)
17:43:45 -- Processing piq_realtime_level1a_neutral_20251019_0226_GN04.tar (5/111)
17:52:32 -- Processing piq_realtime_level1a_neutral_20251019_0238_GN05.tar (6/111)
18:08:02 -- Processing piq_realtime_level1a_neutral_20251019_0308_GN04.tar (7/111)
18:19:36 -- Processing piq_realtime_level1a_neutral_20251019_0313_GN05.tar (8/111)
18:28:01 -- Processing piq_realtime_level1a_neutral_20251019_0400_GN04.tar (9/111)
18:40:07 -- Processing piq_realtime_level1a_neutral_20251019_0443_GN04.tar (10/111)
18:51:28 -- Processing piq_realtime_level1a_neutral_20251019_0448_GN05.tar (11/111)
19:18:38 -- Processing piq_realtime_level1a_neutral_20251019_0531_GN05.tar (12/111)
19:29:55 -- Processing piq_realtime_level1a_neutral_20251019_0534_GN04.tar (13/111)
19:41:38 -- Processing piq_realtime_level1a_neutral_20251019_0621_GN05.tar (14/111)
19:54:52 -- Processing piq_realtime_level1a_neutral_20251019_0626_GN04.tar (15/111)
20:10:27 -- Processing piq_realtime_level1a_neutral_20251019_0708_GN04.tar (16/111)
20:17:27 -- Processing piq_realtime_level1a_neutral_20251019_0714_GN05.tar (17/111)
20:31:47 -- Processing piq_realtime_level1a_neutral_20251019_0756_GN05.tar (18/111)
20:38:20 -- Processing piq_realtime_level1a_neutral_20251019_0803_GN04.tar (19/111)
20:54:01 -- Processing piq_realtime_level1a_neutral_20251019_0829_GN05.tar (20/111)
21:01:55 -- Processing piq_realtime_level1a_neutral_20251019_0843_GN04.tar (21/111)
21:09:05 -- Processing piq_realtime_level1a_neutral_20251019_0851_GN05.tar (22/111)
21:15:06 -- Processing piq_realtime_level1a_neutral_20251019_0931_GN05.tar (23/111)
21:20:33 -- Processing piq_realtime_level1a_neutral_20251019_0939_GN04.tar (24/111)
21:35:23 -- Processing piq_realtime_level1a_neutral_20251019_1019_GN04.tar (25/111)
21:43:42 -- Processing piq_realtime_level1a_neutral_20251019_1027_GN05.tar (26/111)
21:57:35 -- Processing piq_realtime_level1a_neutral_20251019_1107_GN05.tar (27/111)
22:05:22 -- Processing piq_realtime_level1a_neutral_20251019_1115_GN04.tar (28/111)
22:20:02 -- Processing piq_realtime_level1a_neutral_20251019_1153_GN04.tar (29/111)
22:29:15 -- Processing piq_realtime_level1a_neutral_20251019_1202_GN05.tar (30/111)
22:43:42 -- Processing piq_realtime_level1a_neutral_20251019_1211_GN04.tar (31/111)
22:46:33 -- Processing piq_realtime_level1a_neutral_20251019_1240_GN05.tar (32/111)
22:55:31 -- Processing piq_realtime_level1a_neutral_20251019_1250_GN04.tar (33/111)
23:06:23 -- Processing piq_realtime_level1a_neutral_20251019_1259_GN05.tar (34/111)
23:09:56 -- Processing piq_realtime_level1a_neutral_20251019_1327_GN04.tar (35/111)
23:19:46 -- Processing piq_realtime_level1a_neutral_20251019_1338_GN05.tar (36/111)
23:30:02 -- Processing piq_realtime_level1a_neutral_20251019_1415_GN05.tar (37/111)
23:38:59 -- Processing piq_realtime_level1a_neutral_20251019_1425_GN04.tar (38/111)
23:54:53 -- Processing piq_realtime_level1a_neutral_20251019_1502_GN04.tar (39/111)
00:04:16 -- Processing piq_realtime_level1a_neutral_20251019_1512_GN05.tar (40/111)
00:17:50 -- Processing piq_realtime_level1a_neutral_20251019_1550_GN05.tar (41/111)
00:26:23 -- Processing piq_realtime_level1a_neutral_20251019_1600_GN04.tar (42/111)
00:39:35 -- Processing piq_realtime_level1a_neutral_20251019_1647_GN05.tar (43/111)
00:53:19 -- Processing piq_realtime_level1a_neutral_20251019_1735_GN04.tar (44/111)
01:16:23 -- Processing piq_realtime_level1a_neutral_20251019_1827_GN05.tar (45/111)
01:16:23 - Unexpected error occurs.
01:16:23 -- CalledProcessError >> Command 'head /dev/shm/tcliu/opnGns_2025.292.005.24.06_bin_txt -n 12360.0 | tail -n +1.0 > /dev/shm/tcliu/tempfile_all_011623979715.txt' returned non-zero exit status 1.
01:16:23 --  line 83 of /data3/tcliu/gps_pod/python/planetiq/process_excess_phase_rt.py
01:16:23 --  line 44 of /data3/tcliu/gps_pod/python/planetiq/step1.py
01:16:23 --  line 528 of /usr/lib64/python3.9/subprocess.py
11:38:59 - checking progress...
11:38:59 -- Old process timeout and was terminated.
11:38:59 - 64 files are removed from the queue.
11:38:59 - 45 files are added to the queue.
11:38:59 -- Processing piq_realtime_level1a_neutral_20251020_0006_GN05.tar (1/94)
11:46:42 - checking progress...
11:46:42 -- Old process timeout and was terminated.
11:51:22 - checking progress...
11:51:22 - 65 files are added to the queue.
11:51:23 -- Processing piq_realtime_level1a_neutral_20251019_0002_YM08.tar (1/159)
11:56:18 - checking progress...
11:56:18 -- Processing piq_realtime_level1a_neutral_20251019_1827_GN05.tar (1/113)
11:56:50 - Unexpected error occurs.
11:56:50 -- CalledProcessError >> Command 'head /dev/shm/tcliu/opnGns_2025.292.005.24.06_bin_txt -n 12360.0 | tail -n +1.0 > /dev/shm/tcliu/tempfile_all_115650209079.txt' returned non-zero exit status 1.
11:56:50 --  line 83 of /data3/tcliu/gps_pod/python/planetiq/process_excess_phase_rt.py
11:56:50 --  line 44 of /data3/tcliu/gps_pod/python/planetiq/step1.py
11:56:50 --  line 528 of /usr/lib64/python3.9/subprocess.py
12:10:50 - checking progress...
12:10:50 -- Old process timeout and was terminated.
12:10:50 -- Processing piq_realtime_level1a_neutral_20251019_1827_GN05.tar (1/113)
12:11:12 -- Processing piq_realtime_level1a_neutral_20251019_1902_YM08.tar (2/113)
12:36:24 -- Processing piq_realtime_level1a_neutral_20251019_1910_GN04.tar (3/113)
12:58:09 -- Processing piq_realtime_level1a_neutral_20251019_1958_GN05.tar (4/113)
13:18:36 -- Processing piq_realtime_level1a_neutral_20251019_2007_GN04.tar (5/113)
13:33:55 -- Processing piq_realtime_level1a_neutral_20251019_2042_YM08.tar (6/113)
13:54:57 -- Processing piq_realtime_level1a_neutral_20251019_2046_GN04.tar (7/113)
14:02:58 -- Processing piq_realtime_level1a_neutral_20251019_2055_GN05.tar (8/113)
14:32:15 -- Processing piq_realtime_level1a_neutral_20251019_2134_GN05.tar (9/113)
14:38:31 -- Processing piq_realtime_level1a_neutral_20251019_2143_GN04.tar (10/113)
14:53:35 -- Processing piq_realtime_level1a_neutral_20251019_2219_YM08.tar (11/113)
15:09:53 -- Processing piq_realtime_level1a_neutral_20251019_2222_GN04.tar (12/113)
15:21:10 -- Processing piq_realtime_level1a_neutral_20251019_2230_GN05.tar (13/113)
15:34:53 -- Processing piq_realtime_level1a_neutral_20251019_2310_GN05.tar (14/113)
16:00:54 -- Processing piq_realtime_level1a_neutral_20251019_2316_YM08.tar (15/113)
16:11:48 -- Processing piq_realtime_level1a_neutral_20251019_2318_GN04.tar (16/113)
16:26:32 -- Processing piq_realtime_level1a_neutral_20251019_2354_YM08.tar (17/113)
16:34:15 -- Processing piq_realtime_level1a_neutral_20251019_2359_GN04.tar (18/113)
16:44:53 -- Processing piq_realtime_level1a_neutral_20251020_0006_GN05.tar (19/113)
16:56:55 -- Processing piq_realtime_level1a_neutral_20251020_0053_GN04.tar (20/113)
17:09:35 -- Processing piq_realtime_level1a_neutral_20251020_0141_GN05.tar (21/113)
17:09:38 -- Processing piq_realtime_level1a_neutral_20251020_0152_GN04.tar (22/113)
17:25:46 -- Processing piq_realtime_level1a_neutral_20251020_0206_YM08.tar (23/113)
17:59:13 -- Processing piq_realtime_level1a_neutral_20251020_0228_GN04.tar (24/113)
18:07:34 -- Processing piq_realtime_level1a_neutral_20251020_0240_GN05.tar (25/113)
18:17:36 -- Processing piq_realtime_level1a_neutral_20251020_0303_YM08.tar (26/113)
18:30:01 -- Processing piq_realtime_level1a_neutral_20251020_0311_GN04.tar (27/113)
18:41:51 -- Processing piq_realtime_level1a_neutral_20251020_0316_GN05.tar (28/113)
18:50:52 -- Processing piq_realtime_level1a_neutral_20251020_0402_GN04.tar (29/113)
19:03:40 -- Processing piq_realtime_level1a_neutral_20251020_0445_GN04.tar (30/113)
19:15:12 -- Processing piq_realtime_level1a_neutral_20251020_0450_GN05.tar (31/113)
19:38:37 -- Processing piq_realtime_level1a_neutral_20251020_0533_GN05.tar (32/113)
19:49:18 -- Processing piq_realtime_level1a_neutral_20251020_0536_GN04.tar (33/113)
20:01:40 -- Processing piq_realtime_level1a_neutral_20251020_0612_YM08.tar (34/113)
20:30:30 -- Processing piq_realtime_level1a_neutral_20251020_0624_GN05.tar (35/113)
20:43:09 -- Processing piq_realtime_level1a_neutral_20251020_0629_GN04.tar (36/113)
20:57:45 -- Processing piq_realtime_level1a_neutral_20251020_0710_GN04.tar (37/113)
21:04:58 -- Processing piq_realtime_level1a_neutral_20251020_0716_GN05.tar (38/113)
21:18:17 -- Processing piq_realtime_level1a_neutral_20251020_0733_YM08.tar (39/113)
21:24:12 -- Processing piq_realtime_level1a_neutral_20251020_0941_GN04.tar (40/113)
21:38:43 -- Processing piq_realtime_level1a_neutral_20251020_1001_YM08.tar (41/113)
22:07:40 -- Processing piq_realtime_level1a_neutral_20251020_1022_GN04.tar (42/113)
22:16:26 -- Processing piq_realtime_level1a_neutral_20251020_1029_GN05.tar (43/113)
22:29:41 -- Processing piq_realtime_level1a_neutral_20251020_1057_YM08.tar (44/113)
22:43:30 -- Processing piq_realtime_level1a_neutral_20251020_1109_GN05.tar (45/113)
22:51:47 -- Processing piq_realtime_level1a_neutral_20251020_1117_GN04.tar (46/113)
23:04:54 -- Processing piq_realtime_level1a_neutral_20251020_1136_YM08.tar (47/113)
23:15:40 -- Processing piq_realtime_level1a_neutral_20251020_1155_GN04.tar (48/113)
23:24:56 -- Processing piq_realtime_level1a_neutral_20251020_1205_GN05.tar (49/113)
23:39:48 -- Processing piq_realtime_level1a_neutral_20251020_1213_GN04.tar (50/113)
23:43:24 -- Processing piq_realtime_level1a_neutral_20251020_1232_YM08.tar (51/113)
23:57:25 -- Processing piq_realtime_level1a_neutral_20251020_1243_GN05.tar (52/113)
00:19:07 -- Processing piq_realtime_level1a_neutral_20251020_1252_GN04.tar (53/113)
00:29:43 -- Processing piq_realtime_level1a_neutral_20251020_1301_GN05.tar (54/113)
00:32:46 -- Processing piq_realtime_level1a_neutral_20251020_1329_GN04.tar (55/113)
00:42:26 -- Processing piq_realtime_level1a_neutral_20251020_1340_GN05.tar (56/113)
00:52:25 -- Processing piq_realtime_level1a_neutral_20251020_1417_GN05.tar (57/113)
01:01:19 -- Processing piq_realtime_level1a_neutral_20251020_1427_GN04.tar (58/113)
01:16:02 -- Processing piq_realtime_level1a_neutral_20251020_1505_GN04.tar (59/113)
01:24:53 -- Processing piq_realtime_level1a_neutral_20251020_1509_YM08.tar (60/113)
02:00:06 -- Processing piq_realtime_level1a_neutral_20251020_1515_GN05.tar (61/113)
02:14:27 -- Processing piq_realtime_level1a_neutral_20251020_1552_GN05.tar (62/113)
02:23:04 -- Processing piq_realtime_level1a_neutral_20251020_1602_GN04.tar (63/113)
02:36:50 -- Processing piq_realtime_level1a_neutral_20251020_1650_GN05.tar (64/113)
02:51:21 -- Processing piq_realtime_level1a_neutral_20251020_1738_GN04.tar (65/113)
03:14:02 -- Processing piq_realtime_level1a_neutral_20251020_1825_GN05.tar (66/113)
03:35:44 -- Processing piq_realtime_level1a_neutral_20251020_1859_YM08.tar (67/113)
04:00:26 -- Processing piq_realtime_level1a_neutral_20251020_1913_GN04.tar (68/113)
04:22:03 -- Processing piq_realtime_level1a_neutral_20251020_2000_GN05.tar (69/113)
04:43:00 -- Processing piq_realtime_level1a_neutral_20251020_2022_GN05.tar (70/113)
04:46:35 -- Processing piq_realtime_level1a_neutral_20251020_2035_YM08.tar (71/113)
05:07:55 -- Processing piq_realtime_level1a_neutral_20251020_2048_GN04.tar (72/113)
05:08:08 -- Processing piq_realtime_level1a_neutral_20251020_2057_GN05.tar (73/113)
05:20:41 -- Processing piq_realtime_level1a_neutral_20251020_2136_GN05.tar (74/113)
05:29:05 -- Processing piq_realtime_level1a_neutral_20251020_2157_GN05.tar (75/113)
05:32:44 -- Processing piq_realtime_level1a_neutral_20251020_2233_GN05.tar (76/113)
05:41:07 -- Processing piq_realtime_level1a_neutral_20251020_2308_YM08.tar (77/113)
06:13:04 -- Processing piq_realtime_level1a_neutral_20251020_2312_GN05.tar (78/113)
06:23:32 -- Processing piq_realtime_level1a_neutral_20251020_2320_GN04.tar (79/113)
06:23:34 - Unexpected error occurs.
06:23:34 -- IndexError >> list index out of range
06:23:34 --  line 85 of /data3/tcliu/gps_pod/python/planetiq/process_excess_phase_rt.py
06:23:34 --  line 20 of /data3/tcliu/gps_pod/python/planetiq/step3.py
12:12:02 - checking progress...
12:12:02 -- Old process timeout and was terminated.
12:12:02 - 64 files are removed from the queue.
12:12:02 - 63 files are added to the queue.
12:12:02 -- Processing piq_realtime_level1a_neutral_20251020_2320_GN04.tar (1/98)
12:12:07 -- Processing piq_realtime_level1a_neutral_20251020_2347_YM08.tar (2/98)
12:21:02 -- Processing piq_realtime_level1a_neutral_20251021_0008_GN05.tar (3/98)
12:33:10 -- Processing piq_realtime_level1a_neutral_20251021_0049_GN05.tar (4/98)
12:42:50 -- Processing piq_realtime_level1a_neutral_20251021_0122_YM08.tar (5/98)
13:05:29 -- Processing piq_realtime_level1a_neutral_20251021_0143_GN05.tar (6/98)
13:19:10 -- Processing piq_realtime_level1a_neutral_20251021_0158_YM08.tar (7/98)
13:29:01 -- Processing piq_realtime_level1a_neutral_20251021_0242_GN05.tar (8/98)
13:44:33 -- Processing piq_realtime_level1a_neutral_20251021_0256_YM08.tar (9/98)
13:58:48 -- Processing piq_realtime_level1a_neutral_20251021_0259_GN05.tar (10/98)
14:01:15 -- Processing piq_realtime_level1a_neutral_20251021_0318_GN05.tar (11/98)
14:06:20 -- Processing piq_realtime_level1a_neutral_20251021_0333_YM08.tar (12/98)
14:15:19 -- Processing piq_realtime_level1a_neutral_20251021_0430_YM08.tar (13/98)
14:25:42 - checking progress...
14:25:42 -- Old process timeout and was terminated.
14:25:42 - 3 files are added to the queue.
14:25:42 -- Processing piq_realtime_level1a_neutral_20251021_0430_YM08.tar (1/89)
14:26:24 - Unexpected error occurs.
14:26:24 -- ValueError >> setting an array element with a sequence. The requested array has an inhomogeneous shape after 1 dimensions. The detected shape was (53,) + inhomogeneous part.
14:26:24 --  line 83 of /data3/tcliu/gps_pod/python/planetiq/process_excess_phase_rt.py
14:26:24 --  line 117 of /data3/tcliu/gps_pod/python/planetiq/step1.py
14:26:24 --  line 639 of /data3/tcliu/gps_pod/python/planetiq/.venv/lib64/python3.9/site-packages/numpy/lib/npyio.py
14:26:24 --  line 740 of /data3/tcliu/gps_pod/python/planetiq/.venv/lib64/python3.9/site-packages/numpy/lib/npyio.py
14:54:01 - checking progress...
14:54:01 -- Old process timeout and was terminated.
14:54:01 -- Processing piq_realtime_level1a_neutral_20251021_0430_YM08.tar (1/89)
14:54:51 - Progress completed.
15:31:03 - checking progress...
15:31:03 - 1 files are added to the queue.
15:31:03 -- Processing piq_realtime_level1a_neutral_20251020_0006_GN05.tar (1/162)
15:32:29 - checking progress...
15:32:29 -- Old process timeout and was terminated.
15:32:29 -- Processing piq_realtime_level1a_neutral_20251020_0006_GN05.tar (1/162)
15:44:55 -- Processing piq_realtime_level1a_neutral_20251020_0053_GN04.tar (2/162)
15:58:34 - checking progress...
15:58:34 -- Old process timeout and was terminated.
15:58:34 - 162 files are removed from the queue.
15:58:34 - 77 files are added to the queue.
15:58:34 -- Processing piq_realtime_level1a_neutral_20251014_2347_GN04.tar (1/77)
16:08:52 -- Processing piq_realtime_level1a_neutral_20251014_2352_YM08.tar (2/77)
16:36:53 -- Processing piq_realtime_level1a_neutral_20251014_2356_GN05.tar (3/77)
16:50:34 -- Processing piq_realtime_level1a_neutral_20251015_0031_YM08.tar (4/77)
16:51:05 - Unexpected error occurs.
16:51:05 -- AttributeError >> 'numpy.ndarray' object has no attribute 'index'
16:51:05 --  line 84 of /data3/tcliu/gps_pod/python/planetiq/process_excess_phase_rt.py
16:51:05 --  line 133 of /data3/tcliu/gps_pod/python/planetiq/step1.py
17:05:11 - checking progress...
17:05:11 -- Old process timeout and was terminated.
17:05:11 -- Processing piq_realtime_level1a_neutral_20251015_0031_YM08.tar (1/74)
17:05:41 - Unexpected error occurs.
17:05:41 -- AttributeError >> 'numpy.ndarray' object has no attribute 'index'
17:05:41 --  line 84 of /data3/tcliu/gps_pod/python/planetiq/process_excess_phase_rt.py
17:05:41 --  line 133 of /data3/tcliu/gps_pod/python/planetiq/step1.py
17:06:42 - checking progress...
17:06:42 -- Old process timeout and was terminated.
17:06:42 -- Processing piq_realtime_level1a_neutral_20251015_0031_YM08.tar (1/74)
17:14:30 -- Processing piq_realtime_level1a_neutral_20251015_0036_GN05.tar (2/74)
17:25:18 -- Processing piq_realtime_level1a_neutral_20251015_0043_GN04.tar (3/74)
17:39:13 -- Processing piq_realtime_level1a_neutral_20251015_0131_GN05.tar (4/74)
17:55:11 -- Processing piq_realtime_level1a_neutral_20251015_0141_GN04.tar (5/74)
18:12:55 -- Processing piq_realtime_level1a_neutral_20251015_0206_YM08.tar (6/74)
18:39:18 -- Processing piq_realtime_level1a_neutral_20251015_0217_GN04.tar (7/74)
18:39:47 - Unexpected error occurs.
18:39:47 -- IndexError >> index 0 is out of bounds for axis 0 with size 0
18:39:47 --  line 84 of /data3/tcliu/gps_pod/python/planetiq/process_excess_phase_rt.py
18:39:47 --  line 133 of /data3/tcliu/gps_pod/python/planetiq/step1.py
11:31:47 - checking progress...
11:31:47 -- Old process timeout and was terminated.
11:31:47 -- Processing piq_realtime_level1a_neutral_20251015_0217_GN04.tar (1/68)
11:32:19 - Unexpected error occurs.
11:32:19 -- IndexError >> index 0 is out of bounds for axis 0 with size 0
11:32:19 --  line 84 of /data3/tcliu/gps_pod/python/planetiq/process_excess_phase_rt.py
11:32:19 --  line 133 of /data3/tcliu/gps_pod/python/planetiq/step1.py
11:51:29 - checking progress...
11:51:29 -- Old process timeout and was terminated.
11:51:29 -- Processing piq_realtime_level1a_neutral_20251015_0217_GN04.tar (1/68)
12:02:39 -- Processing piq_realtime_level1a_neutral_20251015_0230_GN05.tar (2/68)
12:19:36 -- Processing piq_realtime_level1a_neutral_20251015_0241_YM08.tar (3/68)
12:30:35 -- Processing piq_realtime_level1a_neutral_20251015_0306_GN05.tar (4/68)
12:40:49 -- Processing piq_realtime_level1a_neutral_20251015_0340_YM08.tar (5/68)
12:53:02 -- Processing piq_realtime_level1a_neutral_20251015_0352_GN04.tar (6/68)
13:21:01 -- Processing piq_realtime_level1a_neutral_20251015_0440_GN05.tar (7/68)
13:49:20 -- Processing piq_realtime_level1a_neutral_20251015_0514_YM08.tar (8/68)
14:13:45 -- Processing piq_realtime_level1a_neutral_20251015_0523_GN05.tar (9/68)
14:26:59 -- Processing piq_realtime_level1a_neutral_20251015_0526_GN04.tar (10/68)
14:53:30 -- Processing piq_realtime_level1a_neutral_20251015_0614_GN05.tar (11/68)
15:07:22 -- Processing piq_realtime_level1a_neutral_20251015_0618_GN04.tar (12/68)
15:23:00 -- Processing piq_realtime_level1a_neutral_20251015_0649_YM08.tar (13/68)
15:45:29 -- Processing piq_realtime_level1a_neutral_20251015_0700_GN04.tar (14/68)
15:53:43 -- Processing piq_realtime_level1a_neutral_20251015_0705_GN05.tar (15/68)
16:16:53 -- Processing piq_realtime_level1a_neutral_20251015_0748_GN05.tar (16/68)
16:41:12 -- Processing piq_realtime_level1a_neutral_20251015_0755_GN04.tar (17/68)
16:57:09 -- Processing piq_realtime_level1a_neutral_20251015_0818_YM08.tar (18/68)
17:14:40 -- Processing piq_realtime_level1a_neutral_20251015_0835_GN04.tar (19/68)
17:22:08 -- Processing piq_realtime_level1a_neutral_20251015_0843_GN05.tar (20/68)
17:38:56 -- Processing piq_realtime_level1a_neutral_20251015_0923_GN05.tar (21/68)
17:44:29 -- Processing piq_realtime_level1a_neutral_20251015_0931_GN04.tar (22/68)
18:00:28 -- Processing piq_realtime_level1a_neutral_20251015_0959_YM08.tar (23/68)
18:24:36 -- Processing piq_realtime_level1a_neutral_20251015_1011_GN04.tar (24/68)
18:33:32 -- Processing piq_realtime_level1a_neutral_20251015_1019_GN05.tar (25/68)
18:50:21 -- Processing piq_realtime_level1a_neutral_20251015_1059_GN05.tar (26/68)
18:57:19 -- Processing piq_realtime_level1a_neutral_20251015_1106_GN04.tar (27/68)
19:14:35 -- Processing piq_realtime_level1a_neutral_20251015_1134_YM08.tar (28/68)
19:43:01 -- Processing piq_realtime_level1a_neutral_20251015_1143_GN04.tar (29/68)
19:50:09 -- Processing piq_realtime_level1a_neutral_20251015_1155_GN05.tar (30/68)
20:07:02 -- Processing piq_realtime_level1a_neutral_20251015_1212_YM08.tar (31/68)
20:18:38 -- Processing piq_realtime_level1a_neutral_20251015_1235_GN05.tar (32/68)
20:28:00 -- Processing piq_realtime_level1a_neutral_20251015_1242_GN04.tar (33/68)
20:55:37 -- Processing piq_realtime_level1a_neutral_20251015_1319_GN04.tar (34/68)
21:27:06 -- Processing piq_realtime_level1a_neutral_20251015_1330_GN05.tar (35/68)
21:52:00 -- Processing piq_realtime_level1a_neutral_20251015_1345_GN04.tar (36/68)
21:59:33 -- Processing piq_realtime_level1a_neutral_20251015_1407_GN05.tar (37/68)
22:09:12 -- Processing piq_realtime_level1a_neutral_20251015_1417_GN04.tar (38/68)
22:19:13 -- Processing piq_realtime_level1a_neutral_20251015_1433_GN05.tar (39/68)
22:26:59 -- Processing piq_realtime_level1a_neutral_20251015_1454_GN04.tar (40/68)
22:36:36 -- Processing piq_realtime_level1a_neutral_20251015_1505_GN05.tar (41/68)
22:47:06 -- Processing piq_realtime_level1a_neutral_20251015_1543_GN05.tar (42/68)
22:57:23 -- Processing piq_realtime_level1a_neutral_20251015_1546_YM08.tar (43/68)
23:29:41 -- Processing piq_realtime_level1a_neutral_20251015_1551_GN04.tar (44/68)
23:45:18 -- Processing piq_realtime_level1a_neutral_20251015_1640_GN05.tar (45/68)
00:04:33 -- Processing piq_realtime_level1a_neutral_20251015_1720_YM08.tar (46/68)
00:05:40 - Unexpected error occurs.
00:05:40 -- ValueError >> all the input array dimensions except for the concatenation axis must match exactly, but along dimension 1, the array at index 0 has size 0 and the array at index 1 has size 1
00:05:40 --  line 84 of /data3/tcliu/gps_pod/python/planetiq/process_excess_phase_rt.py
00:05:40 --  line 38 of /data3/tcliu/gps_pod/python/planetiq/step1.py
00:05:40 --  line 289 of /data3/tcliu/gps_pod/python/.exph/lib64/python3.9/site-packages/numpy/core/shape_base.py
11:48:39 - checking progress...
11:48:39 -- Old process timeout and was terminated.
11:48:39 - 68 files are removed from the queue.
11:48:39 - 69 files are added to the queue.
11:48:39 -- Processing piq_realtime_level1a_neutral_20251015_2310_GN04.tar (1/78)
11:57:07 - checking progress...
11:57:07 -- Old process timeout and was terminated.
11:57:07 -- Processing piq_realtime_level1a_neutral_20251015_1720_YM08.tar (1/23)
12:25:20 -- Processing piq_realtime_level1a_neutral_20251015_1726_GN04.tar (2/23)
12:49:29 -- Processing piq_realtime_level1a_neutral_20251015_1815_GN05.tar (3/23)
13:13:25 -- Processing piq_realtime_level1a_neutral_20251015_1902_GN04.tar (4/23)
13:38:07 -- Processing piq_realtime_level1a_neutral_20251015_1936_YM08.tar (5/23)
14:14:23 -- Processing piq_realtime_level1a_neutral_20251015_1950_GN05.tar (6/23)
14:38:07 -- Processing piq_realtime_level1a_neutral_20251015_1958_GN04.tar (7/23)
15:16:37 -- Processing piq_realtime_level1a_neutral_20251015_2038_GN04.tar (8/23)
15:25:10 -- Processing piq_realtime_level1a_neutral_20251015_2058_GN05.tar (9/23)
15:43:56 -- Processing piq_realtime_level1a_neutral_20251015_2126_GN05.tar (10/23)
15:50:30 -- Processing piq_realtime_level1a_neutral_20251015_2135_GN04.tar (11/23)
16:06:57 -- Processing piq_realtime_level1a_neutral_20251015_2215_GN04.tar (12/23)
16:19:39 -- Processing piq_realtime_level1a_neutral_20251015_2223_GN05.tar (13/23)
16:36:04 -- Processing piq_realtime_level1a_neutral_20251015_2302_GN05.tar (14/23)
16:49:59 -- Processing piq_realtime_level1a_neutral_20251015_2310_GN04.tar (15/23)
17:06:17 - checking progress...
17:06:17 -- Old process timeout and was terminated.
17:06:17 -- Processing piq_realtime_level1a_neutral_20251015_2310_GN04.tar (1/9)
17:24:33 -- Processing piq_realtime_level1a_neutral_20251015_2350_GN04.tar (2/9)
17:36:28 -- Processing piq_realtime_level1a_neutral_20251015_2358_GN05.tar (3/9)
17:52:24 -- Processing piq_realtime_level1a_neutral_20251016_0024_YM08.tar (4/9)
18:22:41 -- Processing piq_realtime_level1a_neutral_20251016_0037_GN05.tar (5/9)
18:35:13 -- Processing piq_realtime_level1a_neutral_20251016_0046_GN04.tar (6/9)
18:48:30 -- Processing piq_realtime_level1a_neutral_20251016_0132_GN05.tar (7/9)
19:03:53 -- Processing piq_realtime_level1a_neutral_20251016_0142_GN04.tar (8/9)
19:20:09 -- Processing piq_realtime_level1a_neutral_20251016_0159_YM08.tar (9/9)
19:46:02 - Progress completed.
12:22:12 - checking progress...
12:22:12 -- Processing piq_realtime_level1a_neutral_20251015_2038_GN04.tar (1/1)
12:23:39 - Unexpected error occurs.
12:23:39 -- ValueError >> 
12:23:39 --  line 87 of /data3/tcliu/gps_pod/python/planetiq/process_excess_phase_rt.py
13:10:49 - checking progress...
13:10:49 -- Old process timeout and was terminated.
13:10:49 -- Processing piq_realtime_level1a_neutral_20251015_2038_GN04.tar (1/1)
15:40:34 - checking progress...
15:40:34 -- Old process timeout and was terminated.
15:40:34 - 77 files are removed from the queue.
15:40:34 - 201 files are added to the queue.
15:40:34 -- Processing piq_realtime_level1a_neutral_20251029_0114_GN04.tar (1/201)
15:40:44 - Unexpected error occurs.
15:40:44 -- ValueError >> pause here
15:40:44 --  line 94 of /data3/tcliu/gps_pod/python/planetiq/process_excess_phase_rt.py
15:46:46 - checking progress...
15:46:46 -- Old process timeout and was terminated.
15:46:46 - 1 files are added to the queue.
15:46:46 -- Processing piq_realtime_level1a_neutral_20251029_0114_GN04.tar (1/202)
15:47:19 - Unexpected error occurs.
15:47:19 -- ValueError >> pause here
15:47:19 --  line 94 of /data3/tcliu/gps_pod/python/planetiq/process_excess_phase_rt.py
16:05:03 - checking progress...
16:05:04 -- Old process timeout and was terminated.
16:05:04 -- Processing piq_realtime_level1a_neutral_20251029_0114_GN04.tar (1/202)
16:05:38 - Unexpected error occurs.
16:05:38 -- ValueError >> pause here
16:05:38 --  line 94 of /data3/tcliu/gps_pod/python/planetiq/process_excess_phase_rt.py
16:07:07 - checking progress...
16:07:07 -- Old process timeout and was terminated.
16:07:07 -- Processing piq_realtime_level1a_neutral_20251029_0114_GN04.tar (1/202)
16:07:41 - Unexpected error occurs.
16:07:41 -- ValueError >> pause here
16:07:41 --  line 94 of /data3/tcliu/gps_pod/python/planetiq/process_excess_phase_rt.py
16:12:22 - checking progress...
16:12:22 -- Old process timeout and was terminated.
16:12:22 - 3 files are added to the queue.
16:12:22 -- Processing piq_realtime_level1a_neutral_20251029_0114_GN04.tar (1/205)
16:12:54 - Unexpected error occurs.
16:12:54 -- ValueError >> pause here
16:12:54 --  line 94 of /data3/tcliu/gps_pod/python/planetiq/process_excess_phase_rt.py
16:18:55 - checking progress...
16:18:55 -- Old process timeout and was terminated.
16:18:55 -- Processing piq_realtime_level1a_neutral_20251029_0114_GN04.tar (1/205)
16:19:28 - Unexpected error occurs.
16:19:28 -- ValueError >> pause here
16:19:28 --  line 94 of /data3/tcliu/gps_pod/python/planetiq/process_excess_phase_rt.py
16:20:01 - checking progress...
16:20:02 -- Old process timeout and was terminated.
16:20:02 -- Processing piq_realtime_level1a_neutral_20251029_0114_GN04.tar (1/205)
16:22:00 - Unexpected error occurs.
16:22:00 -- ValueError >> pause here
16:22:00 --  line 94 of /data3/tcliu/gps_pod/python/planetiq/process_excess_phase_rt.py
16:24:09 - checking progress...
16:24:09 -- Old process timeout and was terminated.
16:24:09 -- Processing piq_realtime_level1a_neutral_20251029_0114_GN04.tar (1/205)
16:24:42 - Unexpected error occurs.
16:24:42 -- ValueError >> pause here
16:24:42 --  line 94 of /data3/tcliu/gps_pod/python/planetiq/process_excess_phase_rt.py
16:54:45 - checking progress...
16:54:45 -- Old process timeout and was terminated.
16:54:45 - 1 files are added to the queue.
16:54:45 -- Processing piq_realtime_level1a_neutral_20251029_0114_GN04.tar (1/206)
11:36:25 - checking progress...
11:36:25 -- Old process timeout and was terminated.
11:36:25 - 206 files are removed from the queue.
11:36:25 - 199 files are added to the queue.
11:36:25 -- Processing piq_realtime_level1a_neutral_20251101_0032_GN05.tar (1/199)
11:36:38 - Unexpected error occurs.
11:36:38 -- ValueError >> stop here
11:36:38 --  line 92 of /data3/tcliu/gps_pod/python/planetiq/process_excess_phase_rt.py
11:39:41 - checking progress...
11:39:41 -- Old process timeout and was terminated.
11:39:41 -- Processing piq_realtime_level1a_neutral_20251101_0032_GN05.tar (1/199)
11:39:59 - Unexpected error occurs.
11:39:59 -- ValueError >> stop here
11:39:59 --  line 92 of /data3/tcliu/gps_pod/python/planetiq/process_excess_phase_rt.py
11:41:15 - checking progress...
11:41:15 -- Old process timeout and was terminated.
11:41:15 - 199 files are removed from the queue.
11:41:15 - 137 files are added to the queue.
11:41:15 -- Processing piq_realtime_level1a_neutral_20251015_0031_YM08.tar (1/137)
11:42:12 - Unexpected error occurs.
11:42:12 -- ValueError >> stop here
11:42:12 --  line 92 of /data3/tcliu/gps_pod/python/planetiq/process_excess_phase_rt.py