Only call setup after they are found; otherwise
we are left with orphan directories that are never
cleaned up.