AI & ML interests

The AI community building the future.

Recent Activity

systemย  updated a bucket about 10 hours ago
huggingface/sbx-server
nielsrย  updated a Space about 12 hours ago
huggingface/paperswithcode
sayakpaulย  updated a dataset about 18 hours ago
huggingface/diffusers-metadata
View all activity

Articles

systemย 
updated a bucket about 10 hours ago
tarekziadeย 
updated a bucket about 22 hours ago
julien-cย 
posted an update about 2 months ago
view post
Post
5389
who's working on an NVFP4 version of Kimi-K3?
  • 4 replies
ยท
badaouiย 
posted an update about 2 months ago
view post
Post
2421
432 GB of ultra-fast HBM4 and up to 23.3 TB/s of memory bandwidth on a single GPU ๐Ÿคฏ.

Two weeks ago, we got early access to AMD's new Instinct MI455X, and our first goal was simple: make sure ๐Ÿค— Transformers works on day one.

Over the past few weeks, we worked closely with the AMD team to validate the platform, enable Flash Attention, add torchcodec support for multimodal models, and resolve issues uncovered during testing.

The result:
โœ… 99.5% success rate across our 24 core Transformers model architectures - already on par with our daily CI on previous AMD and NVIDIA platforms.

The hardware is just as exciting. With 432 GB of HBM per GPU, our early capacity experiments showed more than 3ร— the concurrent long-context requests compared to MI300, thanks to the much larger KV cache capacity.

A huge thanks to the AMD team for the early access and the great collaboration!

Read the full blog ๐Ÿ‘‡
https://huggingface.co/blog/badaoui/transformers-on-amd-mi455
  • 1 reply
ยท