SPViT: Enabling Faster Vision Transformers via Soft Token Pruning. Token pruning for transformers. Results didn’t sound especially compelling but who knows. Resource-Efficient Deep Learning: A Survey on Model-, Arithmetic-, and Implementation-Level Techniques
2022-1-4: Two sparsities, Vision reservoir
2022-1-4: Two sparsities, Vision reservoir
2022-1-4: Two sparsities, Vision reservoir
SPViT: Enabling Faster Vision Transformers via Soft Token Pruning. Token pruning for transformers. Results didn’t sound especially compelling but who knows. Resource-Efficient Deep Learning: A Survey on Model-, Arithmetic-, and Implementation-Level Techniques