No that doesn't work, I can still see web admin console on domain.com:7080 with those settings:
I have two listeners:
One for port 443 and one for port 80
On both I have added your suggestion, so they have domain.com, localhost, 127.0.0.1
adminListener is set at 127.0.0.1 on WebAdmin Settings - Listeners > Summary