No request delivery notification has been received from LSAPI application, possible dead lock.

K

kydtf

New Member
#1
#1
The site has been using OpenLiteSpeed, recently the site suddenly could not be accessed, and then found that the memory and CPU all high load, can only reboot, restart all processes, but after a few days or so the problem still occurs. I've been looking for a solution for a long time on the internet, but none of them have solved it.

Just now this problem appeared again, I could only reboot the host again, and then tried this method (https://pcx3.com/cyberpanel/no-request-delivery-notification-has-been-received-from-lsapi-) application-possible-dead-lock/), I don't know if I will get this error again.
 
Cold-Egg

Cold-Egg

Administrator
#2
#2
If the duplicate socket causes it, remove it with the following command, then restarting LSWS.
Code: 
rm -rf /tmp/lshttpd/*
systemctl restart lsws
If it does not work, the issue is something else. Maybe hit the PHP maximum limit, PHP code looping ..etc/ Let us know how it goes.
 
Last edited:
K

kydtf

New Member
#3
#3
The problem reappeared and I had to go through a reboot of the machine. Checked the error log and it showed the following:


2024-01-16 19:59:07.741539 [NOTICE] [421072] [218.98.44.150:53231#abc.com] No request delivery notification has been received from LSAPI application, possible dead lock.
2024-01-16 19:59:07.741559 [NOTICE] [421072] sendKillCmdToWatchdog: 'extappkill:640685:-3:0'.
2024-01-16 19:59:07.741577 [NOTICE] [421072] [LocalWorker::workerExec] VHost:abc.com suExec check uid 99 gid 99 setuidmode 0.
2024-01-16 19:59:07.741583 [NOTICE] [421072] [LocalWorker::workerExec] Config[bb7475.990]: suExec uid 2003 gid 2003 cmd /usr/local/lsws/lsphp74/bin/lsphp, final uid 2003 gid 2003, flags: 0.
2024-01-16 19:59:07.741616 [NOTICE] [421070] Cmd from child: [extappkill:640685:-3:0]
2024-01-16 19:59:07.741653 [INFO] [421070] [CLEANUP] Send signal: 15 to process: 640685
....
2024-01-16 19:59:08.617579 [INFO] [421070] [CLEANUP] Send signal: 15 to process: 640663
2024-01-16 19:59:08.617585 [NOTICE] [421070] Cmd from child: [extappkill:640664:-3:0]
2024-01-16 19:59:08.617597 [INFO] [421070] [CLEANUP] Send signal: 15 to process: 640664
2024-01-16 19:59:08.617602 [NOTICE] [421070] Cmd from child: [extappkill:640665:-3:0]
2024-01-16 19:59:08.617616 [INFO] [421070] [CLEANUP] Send signal: 15 to process: 640665
....
2024-01-16 19:59:10.025613 [NOTICE] [421072] sendKillCmdToWatchdog: 'extappkill:640851:-3:0'.
2024-01-16 19:59:10.200246 [NOTICE] [421070] Cmd from child: [extappkill:640851:-3:0]
2024-01-16 19:59:10.200293 [INFO] [421070] Failed to get process [640851] start time, not running, skip killing.
2024-01-16 19:59:12.095986 [NOTICE] [421072] [218.98.44.146:16965-4#abc.com] [STDERR] Connection refused
2024-01-16 19:59:12.163220 [NOTICE] [421073] [218.98.44.146:16882-9#abc.com] [STDERR] Connection refused
2024-01-16 19:59:12.366339 [NOTICE] [421072] [218.98.44.146:17020-8#abc.com] [STDERR] Connection refused
2024-01-16 19:59:14.081657 [NOTICE] [421072] [218.98.44.146:19467-1#abc.com] [STDERR] Connection refused
2024-01-16 19:59:21.722636 [NOTICE] [421072] [124.237.212.128:17867#abc.com] [STDERR] Connection refused




Then the error log comes up with tons of‘[STDERR] Connection refused’ ,then I couldn't log into WordPress and only got back to normal by rebooting the machine. How can I solve this problem, please.
 
Cold-Egg

Cold-Egg

Administrator
#4
#4
When the issue happens again, please share the output with this command "ps aux | grep php", if you hit the PHP maximum/children limit, try "killall lsphp" and you should be able to log in to WordPress. You can also empty the value of Memory Soft Limit/Memory Hard Limit /Process Soft Limit /Process Hard Limit from the LiteSpeed SAPI App, it helps in some cases.
 
K

kydtf

New Member
#5
#5
When I use the command 'ps aux | grep php', it shows:

Code: 
[root@VM-111-centos ~]# ps aux | grep php
bb2+  26487  3.5  1.9 932696 79004 ?        R    10:21   0:00 lsphp:/home/abc.com/public_html/index.php
bb2+  26675  3.4  1.8 932696 75924 ?        R    10:21   0:00 lsphp:/home/abc.com/public_html/index.php
bb2+  26679  3.4  1.8 932696 75112 ?        R    10:21   0:00 lsphp:/home/abc.com/public_html/index.php
bb2+  26715  3.4  1.8 932696 74540 ?        R    10:21   0:00 lsphp:/home/abc.com/public_html/index.php
bb2+  26716  3.4  1.8 932696 74808 ?        R    10:21   0:00 lsphp:/home/abc.com/public_html/index.php
bb2+  26717  3.3  1.8 932696 74448 ?        R    10:21   0:00 lsphp:/home/abc.com/public_html/index.php
bb2+  26718  3.2  1.8 932696 73568 ?        R    10:21   0:00 lsphp:/home/abc.com/public_html/index.php
bb2+  26719  3.5  1.8 932696 74872 ?        R    10:21   0:00 lsphp:/home/abc.com/public_html/index.php
bb2+  26720  3.6  1.8 932696 74836 ?        R    10:21   0:00 lsphp:/home/abc.com/public_html/index.php
bb2+  26721  3.8  1.8 932696 75548 ?        R    10:21   0:00 lsphp:/home/abc.com/public_html/index.php
bb2+  26775  3.5  1.8 932696 72688 ?        R    10:21   0:00 lsphp:/home/abc.com/public_html/index.php
bb2+  26779  3.6  1.8 932696 73516 ?        R    10:21   0:00 lsphp:/home/abc.com/public_html/index.php
bb2+  26781  3.6  1.8 932696 73824 ?        R    10:21   0:00 lsphp:/home/abc.com/public_html/index.php
bb2+  26782  3.4  1.8 932696 72980 ?        R    10:21   0:00 lsphp:/home/abc.com/public_html/index.php
bb2+  26784  3.3  1.7 932696 71904 ?        R    10:21   0:00 lsphp:/home/abc.com/public_html/index.php
bb2+  26785  3.6  1.8 932696 72968 ?        R    10:21   0:00 lsphp:/home/abc.com/public_html/index.php
bb2+  26786  3.5  1.8 932696 72816 ?        R    10:21   0:00 lsphp:/home/abc.com/public_html/index.php
bb2+  26788  3.5  1.7 932696 72488 ?        R    10:21   0:00 lsphp:/home/abc.com/public_html/index.php
bb2+  26789  3.4  1.7 932696 72396 ?        R    10:21   0:00 lsphp:/home/abc.com/public_html/index.php
bb2+  26910  3.3  1.7 932696 72044 ?        R    10:21   0:00 lsphp:/home/abc.com/public_html/index.php
bb2+  26948  3.4  1.7 932696 70076 ?        R    10:21   0:00 lsphp:/home/abc.com/public_html/index.php
bb2+  27077  3.4  1.7 932696 68960 ?        R    10:21   0:00 lsphp:/home/abc.com/public_html/index.php
bb2+  27276  3.8  1.6 932540 66072 ?        R    10:21   0:00 lsphp:/home/abc.com/public_html/index.php
bb2+  27278  4.0  1.6 932540 64924 ?        R    10:21   0:00 lsphp:/home/abc.com/public_html/index.php
bb2+  27351  3.6  1.5 930492 61116 ?        R    10:21   0:00 lsphp:/home/abc.com/public_html/index.php
bb2+  27352  3.2  1.5 930492 60596 ?        R    10:21   0:00 lsphp:/home/abc.com/public_html/index.php
bb2+  27353  3.2  1.5 930492 60440 ?        R    10:21   0:00 lsphp:/home/abc.com/public_html/index.php
bb2+  27354  3.4  1.5 930492 60580 ?        R    10:21   0:00 lsphp:/home/abc.com/public_html/index.php
bb2+  27355  3.0  1.4 930492 60148 ?        R    10:21   0:00 lsphp:/home/abc.com/public_html/index.php
bb2+  27356  3.0  1.4 930492 60100 ?        R    10:21   0:00 lsphp:/home/abc.com/public_html/index.php
bb2+  27357  3.0  1.4 930492 59596 ?        R    10:21   0:00 lsphp:/home/abc.com/public_html/index.php
bb2+  27358  3.0  1.4 930492 59588 ?        R    10:21   0:00 lsphp:/home/abc.com/public_html/index.php
bb2+  27359  3.7  1.4 930492 60228 ?        R    10:21   0:00 lsphp:/home/abc.com/public_html/index.php
bb2+  27360  3.7  1.4 930492 59640 ?        R    10:21   0:00 lsphp:/home/abc.com/public_html/index.php
bb2+  27361  3.5  1.4 930492 59952 ?        R    10:21   0:00 lsphp:/home/abc.com/public_html/index.php
bb2+  27362  3.7  1.4 930492 59984 ?        R    10:21   0:00 lsphp:/home/abc.com/public_html/index.php
bb2+  27363  3.7  1.4 930492 60016 ?        R    10:21   0:00 lsphp:/home/abc.com/public_html/index.php
bb2+  27364  3.7  1.4 930492 59716 ?        R    10:21   0:00 lsphp:/home/abc.com/public_html/index.php
bb2+  27365  3.7  1.4 930492 59580 ?        R    10:21   0:00 lsphp:/home/abc.com/public_html/index.php
bb2+  27522  3.3  1.4 930348 57864 ?        R    10:21   0:00 lsphp:/home/abc.com/public_html/index.php
bb2+  27523  2.5  1.3 928300 53424 ?        S    10:21   0:00 lsphp
bb2+  27524  4.0  1.4 930348 56736 ?        R    10:21   0:00 lsphp:/home/abc.com/public_html/index.php
bb2+  27561  3.5  1.3 928300 54300 ?        R    10:21   0:00 lsphp:/home/abc.com/public_html/index.php
bb2+  27562  3.5  1.4 930348 56572 ?        R    10:21   0:00 lsphp:/home/abc.com/public_html/index.php
bb2+  27563  5.0  1.3 928300 53312 ?        R    10:21   0:00 lsphp:/home/abc.com/public_html/index.php
 
Cold-Egg

Cold-Egg

Administrator
#6
#6
Was it under some kind of attack or PHP loop, or simply it's a high-traffic site? For high-traffic site, maybe you can implement LSCache to reduce the PHP load and process number.
 
K

kydtf

New Member
#7
#7
There were no attacks and the site had little traffic. After rebooting the machine a couple times, it was back to normal again. Not sure what went wrong.
 
K

kydtf

New Member
#9
#9
The problem occurred again today and the site crashed. abc.com.error_log shows the following

Code: 
2024-01-19 01:12:49.253140 [NOTICE] [103110] [218.98.44.150:15102#abc.com] No request delivery notification has been received from LSAPI application, possible dead lock.                   
2024-01-19 03:58:06.008370 [NOTICE] [103109] [218.98.44.146:16389#abc.com] No request delivery notification has been received from LSAPI application, possible dead lock.                   
2024-01-19 03:58:06.128050 [NOTICE] [103109] [218.98.44.146:16390#abc.com] No request delivery notification has been received from LSAPI application, possible dead lock.                   
2024-01-19 03:58:06.191427 [NOTICE] [103109] [218.98.44.146:16391#abc.com] No request delivery notification has been received from LSAPI application, possible dead lock.                   
2024-01-19 03:58:06.262422 [NOTICE] [103109] [218.98.44.146:16392#abc.com] No request delivery notification has been received from LSAPI application, possible dead lock.                   
2024-01-19 03:58:06.339430 [NOTICE] [103109] [218.98.44.146:16435#abc.com] No request delivery notification has been received from LSAPI application, possible dead lock.                   
2024-01-19 03:58:06.699373 [NOTICE] [103110] [218.98.44.150:45872#abc.com] No request delivery notification has been received from LSAPI application, possible dead lock.                   
2024-01-19 03:58:06.777868 [NOTICE] [103110] [218.98.44.146:16349-1#abc.com] No request delivery notification has been received from LSAPI application, possible dead lock.                   
2024-01-19 03:58:06.810984 [NOTICE] [103110] [218.98.44.146:16407#abc.com] No request delivery notification has been received from LSAPI application, possible dead lock.                   
2024-01-19 03:58:06.838156 [NOTICE] [103110] [218.98.44.146:16434#abc.com] No request delivery notification has been received from LSAPI application, possible dead lock.                   
2024-01-19 03:58:06.857399 [NOTICE] [103110] [218.98.44.146:16455#abc.com] No request delivery notification has been received from LSAPI application, possible dead lock.                   
2024-01-19 03:58:06.906431 [NOTICE] [103110] [218.98.44.217:32204#abc.com] No request delivery notification has been received from LSAPI application, possible dead lock.                   
2024-01-19 03:59:04.717726 [NOTICE] [103110] [218.98.44.146:19975#abc.com] No request delivery notification has been received from LSAPI application, possible dead lock.                   
2024-01-19 03:59:04.915055 [NOTICE] [103109] [162.158.119.22:36114:HTTP2-1#abc.com] No request delivery notification has been received from LSAPI application, possible dead lock.                   
2024-01-19 04:00:00.421413 [NOTICE] [103110] [218.98.44.146:19975#abc.com] No request delivery notification has been received from LSAPI application, possible dead lock.                   
2024-01-19 04:00:00.476783 [NOTICE] [103109] [162.158.119.22:36114:HTTP2-1#abc.com] No request delivery notification has been received from LSAPI application, possible dead lock.
stderr.log shows

Code: 
2024-01-18 22:34:34.226 [STDERR] 2024-01-18 22:34:34.226461 Cgid: Child process with pid: 151107 was killed by signal: 9, core dump: 0
2024-01-19 01:12:49.393 [STDERR] [UID:2004][0] packetLen < 0
2024-01-19 01:12:49.394 [STDERR] [UID:2003][0] packetLen < 0
2024-01-19 03:57:28.345 [STDERR] 2024-01-19 03:57:28.000058 Cgid: Child process with pid: 249805 was killed by signal: 9, core dump: 0
2024-01-19 03:58:05.715 [STDERR] 2024-01-19 03:58:05.531344 Cgid: Child process with pid: 249022 was killed by signal: 9, core dump: 0
2024-01-19 03:58:05.554827 Cgid: Child process with pid: 248789 was killed by signal: 9, core dump: 0
2024-01-19 03:58:07.253 [STDERR] [UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
2024-01-19 03:58:07.269 [STDERR] [UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
2024-01-19 03:58:07.270 [STDERR] [UID:2003][0] packetLen < 0
2024-01-19 03:58:07.271 [STDERR] [UID:2003][0] packetLen < 0
2024-01-19 03:58:07.271 [STDERR] [UID:2003][0] packetLen < 0
2024-01-19 03:58:07.271 [STDERR] [UID:2003][0] packetLen < 0
2024-01-19 03:58:07.272 [STDERR] [UID:2003][0] packetLen < 0
2024-01-19 03:58:07.273 [STDERR] [UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
2024-01-19 03:58:07.273 [STDERR] [UID:2003][0] packetLen < 0
2024-01-19 03:58:07.273 [STDERR] [UID:2003][0] packetLen < 0
2024-01-19 03:58:07.274 [STDERR] [UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
2024-01-19 03:58:07.274 [STDERR] [UID:2003][0] packetLen < 0
2024-01-19 03:58:28.429 [STDERR] 2024-01-19 03:58:27.950535 Cgid: Child process with pid: 250323 was killed by signal: 9, core dump: 0
2024-01-19 03:58:41.630 [STDERR] [UID:2003][0] packetLen < 0
2024-01-19 03:59:00.475 [STDERR] 2024-01-19 03:58:59.966427 Cgid: Child process with pid: 250345 was killed by signal: 9, core dump: 0
[UID:2003][0] packetLen < 0
2024-01-19 03:59:04.412 [STDERR] [UID:2003][0] packetLen < 0
2024-01-19 03:59:04.717 [STDERR] [UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
2024-01-19 03:59:04.718 [STDERR] [UID:2003][0] packetLen < 0
2024-01-19 03:59:04.798 [STDERR] [UID:2003][0] packetLen < 0
2024-01-19 03:59:04.827 [STDERR] [UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
2024-01-19 03:59:04.845 [STDERR] [UID:2003][0] packetLen < 0
2024-01-19 03:59:04.846 [STDERR] [UID:2003][0] packetLen < 0
2024-01-19 03:59:13.307 [STDERR] [UID:2003][0] packetLen < 0
2024-01-19 04:00:00.607 [STDERR] [UID:2003][0] packetLen < 0
2024-01-19 04:00:00.644 [STDERR] [UID:2003][0] packetLen < 0
[UID:2003][0] [UID:2003][0] packetLen < 0
packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2004][0] packetLen < 0
2024-01-19 04:00:00.650 [STDERR] [UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
2024-01-19 04:00:00.650 [STDERR] [UID:2003][0] packetLen < 0
2024-01-19 04:00:00.651 [STDERR] [UID:2003][0] packetLen < 0
2024-01-19 04:00:00.651 [STDERR] [UID:2003][0] packetLen < 0
2024-01-19 04:00:00.652 [STDERR] [UID:2003][0] packetLen < 0
2024-01-19 04:00:00.653 [STDERR] [UID:2003][0] packetLen < 0
2024-01-19 04:00:00.705 [STDERR] [UID:2003][0] packetLen < 0
2024-01-19 04:00:00.708 [STDERR] [UID:2003][0] packetLen < 0
2024-01-19 04:00:00.711 [STDERR] [UID:2003][0] packetLen < 0
2024-01-19 04:00:00.714 [STDERR] [UID:2003][0] packetLen < 0
2024-01-19 04:00:00.714 [STDERR] [UID:2003][0] packetLen < 0
2024-01-19 04:00:00.717 [STDERR] [UID:2003][0] packetLen < 0
2024-01-19 04:00:00.746 [STDERR] [UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
[UID:2003][0] packetLen < 0
2024-01-19 04:00:00.752 [STDERR] [UID:2003][0] packetLen < 0
2024-01-19 04:00:00.755 [STDERR] [UID:2003][0] packetLen < 0
2024-01-19 04:00:00.770 [STDERR] [UID:2003][0] packetLen < 0
2024-01-19 04:00:00.774 [STDERR] [UID:2003][0] packetLen < 0
2024-01-19 04:00:00.820 [STDERR] [UID:2003][0] packetLen < 0
2024-01-19 04:00:00.829 [STDERR] [UID:2004][0] packetLen < 0
2024-01-19 04:00:00.836 [STDERR] [UID:2003][0] packetLen < 0
2024-01-19 04:00:00.845 [STDERR] [UID:2003][0] packetLen < 0
2024-01-19 04:00:00.853 [STDERR] [UID:2004][0] packetLen < 0
2024-01-19 04:00:00.853 [STDERR] [UID:2003][0] packetLen < 0
2024-01-19 04:00:00.861 [STDERR] [UID:2004][0] packetLen < 0
2024-01-19 04:00:00.868 [STDERR] [UID:2003][0] packetLen < 0
2024-01-19 04:00:00.875 [STDERR] [UID:2003][0] packetLen < 0
2024-01-19 04:00:00.875 [STDERR] [UID:2003][0] packetLen < 0
2024-01-19 04:00:00.882 [STDERR] [UID:2003][0] packetLen < 0
2024-01-19 04:00:00.889 [STDERR] [UID:2003][0] packetLen < 0
2024-01-19 04:00:00.896 [STDERR] [UID:2003][0] packetLen < 0
2024-01-19 04:00:00.896 [STDERR] [UID:2003][0] packetLen < 0
2024-01-19 04:00:00.902 [STDERR] [UID:2003][0] packetLen < 0
sh: usermod: command not found
sh: usermod: command not found
sh: usermod: command not found
I don't know what to do anymore.
 
You must log in or register to reply here.
Top