Create the json file with metadata as the last item, when everything
else is ready, so we don't need to clean up the file in all error cases
in this function.