There is no point in making the server socket non-blocking.  We call
accept() only after select() has notified us about a new connection.