![[OAT][ERROR]subtask_precheck](http://pic.xiahunao.cn/yaotu/[OAT][ERROR]subtask_precheck)
ERROR 清单 1. CPU4核 要求32核 → FAIL 2. 内存14GB 要求120GB → FAIL 3. 目录缺失/data/1 不存在 4. 目录缺失/data/log1 不存在 5. 时间同步chronyd 无可用时钟源 → FAIL 6. /data/1 /data/log1 未独立磁盘挂载 → FAIL 7. AVX指令检测失败可忽略日志提示4.4.1版本不受影响 ### SUMMARY OF ERROR ISSUES IN PRE-CHECK ### check CPU count: 4 32 ... EXPECT 32 ... FAIL check total MEM: 14 GB 120 GB ... EXPECT 120 GB ... FAIL check /data/1, NOT exist ... EXPECT mounted as individual disk ... FAIL check /data/log1, NOT exist ... EXPECT mounted as individual disk ... FAIL check clock sync service: chronyd, chrony server NOT found ... EXPECT chrony server ... FAIL check /data/1 and /data/log1 filesystem type, /data/1 or /data/log1 NOT exist ... EXPECT mounted as individual disk ... FAIL avx instruction set check on x86 architecture CPU fail ... FAIL [2026-08-03T09:46:37.6440800] ERROR - [2026-08-03T09:46:37.6440800] ERROR - [2026-08-03T09:46:37.6440800] ERROR - ### SUMMARY OF ERROR ISSUES IN PRE-CHECK ### [2026-08-03T09:46:37.6440800] ERROR - check CPU count: 4 32 ... EXPECT 32 ... FAIL [2026-08-03T09:46:37.6440800] ERROR - TIPS: replace another machine with more CPU [2026-08-03T09:46:37.6450800] ERROR - check total MEM: 14 GB 120 GB ... EXPECT 120 GB ... FAIL [2026-08-03T09:46:37.6450800] ERROR - TIPS: replace another machine with more MEM [2026-08-03T09:46:37.6450800] ERROR - check /data/1, NOT exist ... EXPECT mounted as individual disk ... FAIL [2026-08-03T09:46:37.6450800] ERROR - TIPS: create the /data/1 folder and re-part disk to mount /data/1 [2026-08-03T09:46:37.6450800] ERROR - check /data/log1, NOT exist ... EXPECT mounted as individual disk ... FAIL [2026-08-03T09:46:37.6450800] ERROR - TIPS: create the /data/log1 folder and re-part disk to mount /data/log1 [2026-08-03T09:46:37.6450800] ERROR - check clock sync service: chronyd, chrony server NOT found ... EXPECT chrony server ... FAIL [2026-08-03T09:46:37.6460800] ERROR - TIPS: check chronyd service [2026-08-03T09:46:37.6460800] ERROR - systemctl status chronyd [2026-08-03T09:46:37.6460800] ERROR - chronyc sources [2026-08-03T09:46:37.6460800] ERROR - check /data/1 and /data/log1 filesystem type, /data/1 or /data/log1 NOT exist ... EXPECT mounted as individual disk ... FAIL [2026-08-03T09:46:37.6460800] ERROR - TIPS: create the /data/1 or /data/log1 folder and re-part disk to mount /data/1 or /data/log1 with suitable filesystem [2026-08-03T09:46:37.6460800] ERROR - avx instruction set check on x86 architecture CPU fail ... FAIL [2026-08-03T09:46:37.6470800] ERROR - TIPS: Installing observer requires an x86 architecture CPU that supports the avx instruction set. If the observer version to be installed is 4.2.5 BP6 (for 4.2.x branch), 4.3.5 BP4 (for 4.3.x branch), 4.4.1 or later, you can ignore this avx error [2026-08-03T09:46:37.6550800] ERROR - Task failed with exception############{1}{2026-08-03T09:46:3208:00}############ [2026-08-03T09:46:32.0910800] INFO - ::group::Pre task execution logs [2026-08-03T09:46:32.1140800] INFO - Dependencies all met for dep_contextnon-requeueable deps tiTaskInstance: init_server_with_tag.precheck manual__2026-08-02T03:41:42.64993800:00 [queued] [2026-08-03T09:46:32.1290800] INFO - Dependencies all met for dep_contextrequeueable deps tiTaskInstance: init_server_with_tag.precheck manual__2026-08-02T03:41:42.64993800:00 [queued] [2026-08-03T09:46:32.1300800] INFO - Starting attempt 1 of 1 [2026-08-03T09:46:32.1450800] INFO - Executing Task(_PythonDecoratedOperator): precheck on 2026-08-02 03:41:42.64993800:00 [2026-08-03T09:46:32.1500800] INFO - Started process 1256 to run task [2026-08-03T09:46:32.1530800] INFO - Running: [airflow, tasks, run, init_server_with_tag, precheck, manual__2026-08-02T03:41:42.64993800:00, --job-id, 122, --raw, --subdir, DAGS_FOLDER/init_server_with_tag.py, --cfg-path, /tmp/tmp4yclfab0] [2026-08-03T09:46:32.1560800] INFO - Job 122: Subtask precheck [2026-08-03T09:46:32.2100800] INFO - Running TaskInstance: init_server_with_tag.precheck manual__2026-08-02T03:41:42.64993800:00 [running] on host 04a902c3c38b [2026-08-03T09:46:32.2960800] INFO - Exporting env vars: AIRFLOW_CTX_DAG_OWNERairflow AIRFLOW_CTX_DAG_IDinit_server_with_tag AIRFLOW_CTX_TASK_IDprecheck AIRFLOW_CTX_EXECUTION_DATE2026-08-02T03:41:42.64993800:00 AIRFLOW_CTX_TRY_NUMBER1 AIRFLOW_CTX_DAG_RUN_IDmanual__2026-08-02T03:41:42.64993800:00 [2026-08-03T09:46:32.2970800] INFO - ::endgroup:: [2026-08-03T09:46:32.3110800] INFO - Running statement: select oat_server.id, oat_credential.id as credential_id, ip, ssh_port, username, password, auth_type, key_data, passphrase from oat_server, oat_credential where oat_server.credential_idoat_credential.id and oat_server.id%s, parameters: [2] [2026-08-03T09:46:32.3120800] INFO - Rows affected: 1 [2026-08-03T09:46:32.3660800] INFO - Running statement: select oat_server.id, oat_credential.id as credential_id, ip, ssh_port, username, password, auth_type, key_data, passphrase from oat_server, oat_credential where oat_server.credential_idoat_credential.id and oat_server.id%s, parameters: [2] [2026-08-03T09:46:32.3670800] INFO - Rows affected: 1 [2026-08-03T09:46:32.3690800] INFO - Running statement: select value from oat_configproperty where keyoat.remote_working_dir, parameters: None [2026-08-03T09:46:32.3690800] INFO - Rows affected: 1 [2026-08-03T09:46:32.3700800] INFO - Running statement: select value from oat_configproperty where keyoat.remote_working_dir, parameters: None [2026-08-03T09:46:32.3700800] INFO - Rows affected: 1 [2026-08-03T09:46:32.4000800] INFO - execute command on 10.3.4.17: sudo -s OAT_EOF export LC_ALLen_US.UTF-8 OB_IP10.3.4.17 OAT_RUN_MODEstrict MIN_CPU32 MIN_MEMORY120 IP_PROTOCOLIPv4 NEED_CMDmysql python tar strings dig curl nc ip gdb sar top zstd asar NEED_RPM WARNING_WHEN_INTEL_NUMA_OFFtrue OB_OS_USERadmin OB_SOFTWARE_DIR/home/admin OB_DATA_DIR/data/1 OB_LOG_DIR/data/log1 /tmp/precheck.shhAmmdPMn -m both; ret$?; rm -f /tmp/precheck.shhAmmdPMn; exit $ret; OAT_EOF [2026-08-03T09:46:32.6150800] INFO - Machine Role: both [2026-08-03T09:46:32.6160800] INFO - Peer IP List: [2026-08-03T09:46:32.6180800] INFO - check CPU count: 4 32 ... EXPECT 32 ... FAIL [2026-08-03T09:46:32.6190800] INFO - TIPS: replace another machine with more CPU [2026-08-03T09:46:32.6240800] INFO - check total MEM: 14 GB 120 GB ... EXPECT 120 GB ... FAIL [2026-08-03T09:46:32.6260800] INFO - TIPS: replace another machine with more MEM [2026-08-03T09:46:32.6280800] INFO - check SELinux status: Disabled ... PASS [2026-08-03T09:46:32.6290800] INFO - check /data/1, NOT exist ... EXPECT mounted as individual disk ... FAIL [2026-08-03T09:46:32.6300800] INFO - TIPS: create the /data/1 folder and re-part disk to mount /data/1 [2026-08-03T09:46:32.6320800] INFO - check /data/log1, NOT exist ... EXPECT mounted as individual disk ... FAIL [2026-08-03T09:46:32.6330800] INFO - TIPS: create the /data/log1 folder and re-part disk to mount /data/log1 [2026-08-03T09:46:32.6340800] INFO - check /home/admin, exist ... PASS [2026-08-03T09:46:32.6380800] INFO - check /home/admin owner: admin ... PASS [2026-08-03T09:46:32.6460800] INFO - check /home/admin disk usage, total: 541G, used: 33G, use%: 7% 50% ... PASS [2026-08-03T09:46:32.6540800] INFO - check account [admin] and home dir, exist ... PASS [2026-08-03T09:46:32.6790800] INFO - check clock sync service: chronyd, chrony server NOT found ... EXPECT chrony server ... FAIL [2026-08-03T09:46:32.6800800] INFO - TIPS: check chronyd service [2026-08-03T09:46:32.6810800] INFO - systemctl status chronyd [2026-08-03T09:46:32.6810800] INFO - chronyc sources [2026-08-03T09:46:32.6950800] INFO - sysctl /proc/sys/net/core/somaxconn 2048, correct ... PASS [2026-08-03T09:46:32.7060800] INFO - sysctl /proc/sys/net/core/netdev_max_backlog 10000, correct ... PASS [2026-08-03T09:46:32.7180800] INFO - sysctl /proc/sys/net/core/rmem_default 16777216, correct ... PASS [2026-08-03T09:46:32.7310800] INFO - sysctl /proc/sys/net/core/wmem_default 16777216, correct ... PASS [2026-08-03T09:46:32.7420800] INFO - sysctl /proc/sys/net/core/rmem_max 16777216, correct ... PASS [2026-08-03T09:46:32.7520800] INFO - sysctl /proc/sys/net/core/wmem_max 16777216, correct ... PASS [2026-08-03T09:46:32.7620800] INFO - sysctl /proc/sys/net/ipv4/conf/default/rp_filter 1, correct ... PASS [2026-08-03T09:46:32.7720800] INFO - sysctl /proc/sys/net/ipv4/conf/default/accept_source_route 0, correct ... PASS [2026-08-03T09:46:32.7820800] INFO - sysctl /proc/sys/net/ipv4/tcp_syncookies 1, correct ... PASS [2026-08-03T09:46:32.7920800] INFO - sysctl /proc/sys/net/ipv4/tcp_rmem 4096 87380 16777216, correct ... PASS [2026-08-03T09:46:32.8020800] INFO - sysctl /proc/sys/net/ipv4/tcp_wmem 4096 65536 16777216, correct ... PASS [2026-08-03T09:46:32.8120800] INFO - sysctl /proc/sys/net/ipv4/tcp_max_syn_backlog 16384, correct ... PASS [2026-08-03T09:46:32.8220800] INFO - sysctl /proc/sys/net/ipv4/tcp_fin_timeout 15, correct ... PASS [2026-08-03T09:46:32.8330800] INFO - sysctl /proc/sys/net/ipv4/tcp_max_syn_backlog 16384, correct ... PASS [2026-08-03T09:46:32.8440800] INFO - sysctl /proc/sys/net/ipv4/tcp_tw_reuse 1, correct ... PASS [2026-08-03T09:46:32.8560800] INFO - sysctl /proc/sys/net/ipv4/tcp_slow_start_after_idle 0, correct ... PASS [2026-08-03T09:46:32.8680800] INFO - sysctl /proc/sys/vm/swappiness 0, correct ... PASS [2026-08-03T09:46:32.8780800] INFO - sysctl /proc/sys/kernel/core_pattern |/bin/bash -c $ -- eval zstd -T4 -o /data/1/core-%e-%p-%t.zst, correct ... PASS [2026-08-03T09:46:32.8870800] INFO - sysctl /proc/sys/vm/max_map_count 655360, correct ... PASS [2026-08-03T09:46:32.8960800] INFO - sysctl /proc/sys/fs/aio-max-nr 1048576, correct ... PASS [2026-08-03T09:46:32.9060800] INFO - sysctl /proc/sys/vm/overcommit_memory 0, correct ... PASS [2026-08-03T09:46:32.9150800] INFO - sysctl /proc/sys/vm/nr_hugepages 0, correct ... PASS [2026-08-03T09:46:32.9240800] INFO - sysctl /proc/sys/net/ipv4/ip_forward 1, correct ... PASS [2026-08-03T09:46:32.9330800] INFO - sysctl /proc/sys/net/ipv4/ip_local_port_range 10000 65535, correct ... PASS [2026-08-03T09:46:33.5400800] INFO - check service [crond]: enabled ... PASS [2026-08-03T09:46:34.1560800] INFO - check service [cron]: enabled ... PASS [2026-08-03T09:46:35.9940800] INFO - check service [sshd]: enabled ... PASS [2026-08-03T09:46:36.6090800] INFO - check service [firewalld]: inactive ... PASS [2026-08-03T09:46:36.6190800] INFO - check service [firewalld]: disabled ... PASS [2026-08-03T09:46:36.6230800] INFO - check sshd_config PubkeyAuthentication: yes ... PASS [2026-08-03T09:46:36.6260800] INFO - check sshd_config UseDNS: no ... PASS [2026-08-03T09:46:36.6310800] INFO - check sshd_config ClientAliveInterval: 60 ... PASS [2026-08-03T09:46:36.6340800] INFO - check sshd_config ClientAliveCountMax: 10 ... PASS [2026-08-03T09:46:36.6360800] INFO - check hugepage: disabled ... PASS [2026-08-03T09:46:36.6360800] INFO - check oceanbase_limits.conf, exist ... PASS [2026-08-03T09:46:36.7690800] INFO - check hard limit of new session open_files (ulimit -H -n): 655360 ... PASS [2026-08-03T09:46:36.7690800] INFO - check hard limit of open_files (ulimit -H -n): 655360 ... PASS [2026-08-03T09:46:36.8410800] INFO - check soft limit of new session open_files (ulimit -S -n): 655360 ... PASS [2026-08-03T09:46:36.8420800] INFO - check soft limit of open_files (ulimit -S -n): 655360 ... PASS [2026-08-03T09:46:36.9210800] INFO - check hard limit of new session max_user_processes (ulimit -H -u): 655360 ... PASS [2026-08-03T09:46:36.9210800] INFO - check hard limit of max_user_processes (ulimit -H -u): 655360 ... PASS [2026-08-03T09:46:36.9880800] INFO - check soft limit of new session max_user_processes (ulimit -S -u): 655360 ... PASS [2026-08-03T09:46:36.9880800] INFO - check soft limit of max_user_processes (ulimit -S -u): 655360 ... PASS [2026-08-03T09:46:37.0640800] INFO - check hard limit of new session stack_size (ulimit -H -s): 10240 ... PASS [2026-08-03T09:46:37.0650800] INFO - check hard limit of stack_size (ulimit -H -s): 10240 ... PASS [2026-08-03T09:46:37.1320800] INFO - check soft limit of new session stack_size (ulimit -S -s): 10240 ... PASS [2026-08-03T09:46:37.1330800] INFO - check soft limit of stack_size (ulimit -S -s): 10240 ... PASS [2026-08-03T09:46:37.2160800] INFO - check hard limit of new session core_file_size (ulimit -H -c): unlimited ... PASS [2026-08-03T09:46:37.2160800] INFO - check hard limit of core_file_size (ulimit -H -c): unlimited ... PASS [2026-08-03T09:46:37.2880800] INFO - check soft limit of new session core_file_size (ulimit -S -c): unlimited ... PASS [2026-08-03T09:46:37.2890800] INFO - check soft limit of core_file_size (ulimit -S -c): unlimited ... PASS [2026-08-03T09:46:37.3700800] INFO - check hard limit of new session cpu_time (ulimit -H -t): unlimited ... PASS [2026-08-03T09:46:37.3710800] INFO - check hard limit of cpu_time (ulimit -H -t): unlimited ... PASS [2026-08-03T09:46:37.4390800] INFO - check soft limit of new session cpu_time (ulimit -S -t): unlimited ... PASS [2026-08-03T09:46:37.4400800] INFO - check soft limit of cpu_time (ulimit -S -t): unlimited ... PASS [2026-08-03T09:46:37.4460800] INFO - not phy machine or in loose mode, skip check numa stat, pass ... PASS [2026-08-03T09:46:37.4520800] INFO - not phy machine or in loose mode, skip check smmu/iommu stat, pass ... PASS [2026-08-03T09:46:37.4530800] INFO - check elevator policy: deadline or mq-deadline ... PASS [2026-08-03T09:46:37.4550800] INFO - check current_clocksource: kvm-clock ... PASS [2026-08-03T09:46:37.4610800] INFO - check logical sector size of /dev/vda: 512 ... PASS [2026-08-03T09:46:37.4690800] INFO - need check command is mysql python tar strings dig curl nc ip gdb sar top zstd asar [2026-08-03T09:46:37.5030800] INFO - check mysql client, working ... PASS [2026-08-03T09:46:37.5210800] INFO - checking irq affinity ... [2026-08-03T09:46:37.5270800] INFO - not phy machine, skip check irq affinity, pass ... PASS [2026-08-03T09:46:37.5280800] INFO - check /data/1 and /data/log1 filesystem type, /data/1 or /data/log1 NOT exist ... EXPECT mounted as individual disk ... FAIL [2026-08-03T09:46:37.5290800] INFO - TIPS: create the /data/1 or /data/log1 folder and re-part disk to mount /data/1 or /data/log1 with suitable filesystem [2026-08-03T09:46:37.6350800] INFO - NIC speed of ens18 check pass ... PASS [2026-08-03T09:46:37.6420800] INFO - avx instruction set check on x86 architecture CPU fail ... FAIL [2026-08-03T09:46:37.6430800] INFO - TIPS: Installing observer requires an x86 architecture CPU that supports the avx instruction set. If the observer version to be installed is 4.2.5 BP6 (for 4.2.x branch), 4.3.5 BP4 (for 4.3.x branch), 4.4.1 or later, you can ignore this avx error [2026-08-03T09:46:37.6440800] ERROR - [2026-08-03T09:46:37.6440800] ERROR - [2026-08-03T09:46:37.6440800] ERROR - ### SUMMARY OF ERROR ISSUES IN PRE-CHECK ### [2026-08-03T09:46:37.6440800] ERROR - check CPU count: 4 32 ... EXPECT 32 ... FAIL [2026-08-03T09:46:37.6440800] ERROR - TIPS: replace another machine with more CPU [2026-08-03T09:46:37.6450800] ERROR - check total MEM: 14 GB 120 GB ... EXPECT 120 GB ... FAIL [2026-08-03T09:46:37.6450800] ERROR - TIPS: replace another machine with more MEM [2026-08-03T09:46:37.6450800] ERROR - check /data/1, NOT exist ... EXPECT mounted as individual disk ... FAIL [2026-08-03T09:46:37.6450800] ERROR - TIPS: create the /data/1 folder and re-part disk to mount /data/1 [2026-08-03T09:46:37.6450800] ERROR - check /data/log1, NOT exist ... EXPECT mounted as individual disk ... FAIL [2026-08-03T09:46:37.6450800] ERROR - TIPS: create the /data/log1 folder and re-part disk to mount /data/log1 [2026-08-03T09:46:37.6450800] ERROR - check clock sync service: chronyd, chrony server NOT found ... EXPECT chrony server ... FAIL [2026-08-03T09:46:37.6460800] ERROR - TIPS: check chronyd service [2026-08-03T09:46:37.6460800] ERROR - systemctl status chronyd [2026-08-03T09:46:37.6460800] ERROR - chronyc sources [2026-08-03T09:46:37.6460800] ERROR - check /data/1 and /data/log1 filesystem type, /data/1 or /data/log1 NOT exist ... EXPECT mounted as individual disk ... FAIL [2026-08-03T09:46:37.6460800] ERROR - TIPS: create the /data/1 or /data/log1 folder and re-part disk to mount /data/1 or /data/log1 with suitable filesystem [2026-08-03T09:46:37.6460800] ERROR - avx instruction set check on x86 architecture CPU fail ... FAIL [2026-08-03T09:46:37.6470800] ERROR - TIPS: Installing observer requires an x86 architecture CPU that supports the avx instruction set. If the observer version to be installed is 4.2.5 BP6 (for 4.2.x branch), 4.3.5 BP4 (for 4.3.x branch), 4.4.1 or later, you can ignore this avx error [2026-08-03T09:46:37.6550800] ERROR - Task failed with exception Traceback (most recent call last): File /usr/local/lib/python3.9/site-packages/airflow/models/taskinstance.py, line 768, in _execute_task result _execute_callable(contextcontext, **execute_callable_kwargs) File /usr/local/lib/python3.9/site-packages/airflow/models/taskinstance.py, line 734, in _execute_callable return ExecutionCallableRunner( File /usr/local/lib/python3.9/site-packages/airflow/utils/operator_helpers.py, line 252, in run return self.func(*args, **kwargs) File /usr/local/lib/python3.9/site-packages/airflow/models/baseoperator.py, line 424, in wrapper return func(self, *args, **kwargs) File /usr/local/lib/python3.9/site-packages/airflow/decorators/base.py, line 266, in execute return_value super().execute(context) File /usr/local/lib/python3.9/site-packages/airflow/models/baseoperator.py, line 424, in wrapper return func(self, *args, **kwargs) File /usr/local/lib/python3.9/site-packages/airflow/operators/python.py, line 238, in execute return_value self.execute_callable() File /usr/local/lib/python3.9/site-packages/airflow/operators/python.py, line 256, in execute_callable return runner.run(*self.op_args, **self.op_kwargs) File /usr/local/lib/python3.9/site-packages/airflow/utils/operator_helpers.py, line 252, in run return self.func(*args, **kwargs) File /oat/task_engine/dags/init_server_with_tag.py, line 129, in precheck common.server_precheck(ctx, loggerlogger) File /oat/task_engine/plugins/common.py, line 2789, in server_precheck raise RuntimeError(server precheck failed, please see the summary info above for details) RuntimeError: server precheck failed, please see the summary info above for details [2026-08-03T09:46:37.6660800] INFO - Marking task as FAILED. dag_idinit_server_with_tag, task_idprecheck, run_idmanual__2026-08-02T03:41:42.64993800:00, execution_date20260802T034142, start_date20260803T014632, end_date20260803T014637 [2026-08-03T09:46:37.6660800] INFO - Executing callback at index 0: task_failure_status [2026-08-03T09:46:37.6950800] INFO - ::group::Post task execution logs [2026-08-03T09:46:37.6950800] ERROR - Failed to execute job 122 for task precheck (server precheck failed, please see the summary info above for details; 1256) [2026-08-03T09:46:37.7400800] INFO - Task exited with return code 1 [2026-08-03T09:46:37.7660800] INFO - 0 downstream tasks scheduled from follow-on schedule check [2026-08-03T09:46:37.7720800] INFO - ::endgroup::