0
0.2
0.4
0.6
0.8
1
1
1.5
2
2.5
3
3.5
SGD
KFAC
DIAG
Step size
Predictive entropy