You can easily test a gradient using only the forward pass by doing f(x+h) ~ f(x...

		antoine-levitt 6 months ago \| parent \| context \| favorite \| on: A bug that taught me more about PyTorch than years... You can easily test a gradient using only the forward pass by doing f(x+h) ~ f(x) + dot(g, h) for a random h