Trusted hosts for Loopback interface

Have configured a loopback interface and would like to restrict sources to known IP's. However I'm not seeing trusted hosts setting under that interface's full-configuration.

How can I restrict the access to this loopback only to a specific source IP's.