Don't explicitly check is_ipv6_enabled(), just try calling
listen_add_port_ipv6(), but check its error code.