Optimization#
Base Classes and Data Structures#
The GradComponent and LossComponent are a subclass from Component to serve the purpose to differentiate the gradient and loss components in the optimization process.
And it will be used if users want to implement their own with more customization.