HI,
ESI is disabled always.
"And will it make any difference if you visit the URL with a query string, e.g. example.com?123"
When I added example.com?123 it well redirected to example.com/?123 and wpadminbar shown.
In litespeed cache plugin I enable main "Enable Cache" only. Other is disabled.