Q&A Text Grad Trace Graph

This demonstrates the Text Grad trace graph using the fit method of the Trainer class when debug is set to True. Compared with the computation graph, this trace graph traces (1) batch-wise gradients, (2) the loss, (3) and the proposed new value for the prompt parameters. This example in particular shows a batch size of 2.