I have been having exactly the same problem: The protected directory does not accept credentials, e.g., user:test password:test. Can anyone suggest a solution? Please.
The thing is, realm security had worked OK a few versions ago (2019?). Then it stopped working in recent versions (now, 1.7.16) of openlitespeed.