LLM-Foundry uses flash_attn_varlen_func by default. BinPackCollator does naive sequence packing.

9 views

vishal

4 days ago

LLM-Foundry uses flash_attn_varlen_func by default. BinPackCollator does naive sequence packing.

LLM-Foundry uses flash_attn_varlen_func by default. BinPackCollator does naive sequence packing.