...And a story about AI race dynamics
Good luck with the Substack adventure. I hope it goes great!
Fwiw, we tried Lion to do some RLHF (because it's a little more memory efficient, could be useful to push the limits of non-distributed RLHF. Docs here: https://huggingface.co/docs/trl/customization#use-lion-optimizer
"TSMC is the Iron Bank" agree...
Good luck with the Substack adventure. I hope it goes great!
Fwiw, we tried Lion to do some RLHF (because it's a little more memory efficient, could be useful to push the limits of non-distributed RLHF. Docs here: https://huggingface.co/docs/trl/customization#use-lion-optimizer
"TSMC is the Iron Bank" agree...