OptoPrime
Trace2's flagship optimizer using full computation graphs
OptoPrime
OptoPrime is Trace2's proposed optimization algorithm that leverages the entire computation graph for efficient optimization.
Overview
Basic Usage
from opto.optimizers import OptoPrime
optimizer = OptoPrime(model.parameters())
for epoch in range(num_epochs):
output = model(input_data)
feedback = evaluate(output)
optimizer.zero_feedback()
optimizer.backward(output, feedback)
optimizer.step()