All Questions
2 questions
17
votes
1
answer
28k
views
How to select half precision (BFLOAT16 vs FLOAT16) for your trained model?
how will you decide what precision works best for your inference model? Both BF16 and F16 takes two bytes but they use different number of bits for fraction and exponent.
Range will be different but I ...
- 1,386
1
vote
0
answers
618
views
Falling to use TensorCore from Tensorflow Mixed Precision Tutorial
I have followed the Mixed precision tutorial from Tensorflow: https://www.tensorflow.org/guide/keras/mixed_precision but apparently I fail to use TensorCore.
My setup:
Windows 10
Nvidia driver: 441....
