Hi David, ๐ great summary as always! Why do you prefer DALi over FFCV https://docs.ffcv.io . Have you used it before? What are your arguments or the benefits you see in using DALi instead of FFCV? In their docs they report much better performance.
Wow, I'm bad at reading comments. Sorry about the slow response.
But anyway, FFCV requires you to transcode your data and is only sort-of maintained. DALI is a mature library from NVIDIA with much more functionality that doesn't require you to transcode your data.
Thanks for your comment. I agree. I have been trying to use ffcv in a recsys and converting large item numbers to int8 doesn't makes sense for that use case. Thank youuu ๐
Hi David, ๐ great summary as always! Why do you prefer DALi over FFCV https://docs.ffcv.io . Have you used it before? What are your arguments or the benefits you see in using DALi instead of FFCV? In their docs they report much better performance.
Wow, I'm bad at reading comments. Sorry about the slow response.
But anyway, FFCV requires you to transcode your data and is only sort-of maintained. DALI is a mature library from NVIDIA with much more functionality that doesn't require you to transcode your data.
Thanks for your comment. I agree. I have been trying to use ffcv in a recsys and converting large item numbers to int8 doesn't makes sense for that use case. Thank youuu ๐