jettify / pytorch-optimizer

if statements can be merged PTC-W0048
Anti-pattern
Major
3 years ago3 years old
Consider merging collapsible if statements
137                g_norm = torch.norm(p.grad.data)
138
139                # lars scaling + weight decay part
140                if weight_decay != 0:141                    if p_norm != 0 and g_norm != 0:
142                        lars_lr = p_norm / (
143                            g_norm + p_norm * weight_decay + group["eps"]