server: Hold read lock while iterating on Shutdown

Prevents a panic when a different goroutine untracks a listener or
connection while the server is being shutdown/closed.