Disable automatic start of Server Manager

Server Manager > Manage > Server Manager Properties > Do not start Server Manager automatically at logon

server_manager_disable