Guidance acceleration: Another benefit of
guidanceprograms is speed — incremental generation is actually faster than a single generation of the entire list, because the LLM does not have to generate the syntax tokens for the list itself, only the actual command names (this makes more of a difference when the output structure is richer).One common fix to this problem is asking for parallel completions (so that prior generated commands do not influence the next command generation):
