What I Read: Structured Generation, Constrained Decoding

https://www.aidancooper.co.uk/constrained-decoding

A Guide to Structured Generation Using Constrained Decoding
Apr 8, 2024


“…there are techniques that ensure language models only return outputs that conform to your requirements. This article serves as a practitioner’s guide for perhaps the most powerful of these techniques: constrained decoding.”