Skip to content

Activity

add the proposed jumbo vit from Fuller et al. of Carleton University

Force push
lucidrainsforce pushed to main • 1de866d…db05a14 • 
29 days ago

add the proposed jumbo vit from Fuller et al. of Carleton University

Force push
lucidrainsforce pushed to main • 26a6eeb…1de866d • 
29 days ago

add the proposed jumbo vit from Fuller et al. of Carleton University

lucidrainspushed 1 commit to main • 9f49a31…26a6eeb • 
29 days ago

1.9.2

lucidrainspushed 1 commit to main • ab63fc9…9f49a31 • 
on Jan 19

remove duplicated qkv computation in na_vit_nested_tensor_3d.py (#341)

Pull request merge
lucidrainspushed 1 commit to main • c3018d1…ab63fc9 • 
on Jan 19

1.9.1

lucidrainspushed 1 commit to main • b7ed6ba…c3018d1 • 
on Jan 4

add option to set frame padding for 3D CCT (#339)

Pull request merge
lucidrainspushed 1 commit to main • e7cba9b…b7ed6ba • 
on Jan 4

add a simple vit flavor for a new bytedance paper that proposes to br…

Force push
lucidrainsforce pushed to main • 13b313b…e7cba9b • 
on Dec 21, 2024

add a simple vit flavor for a new bytedance paper that proposes to br…

lucidrainspushed 1 commit to main • 56373c0…13b313b • 
on Dec 21, 2024

make value residual learned

lucidrainspushed 1 commit to main • 24196a3…56373c0 • 
on Nov 24, 2024

allow for qk norm to be turned off for na vit nested tensor

lucidrainspushed 1 commit to main • f6d7287…24196a3 • 
on Nov 20, 2024

readme

lucidrainspushed 1 commit to main • d47c57e…f6d7287 • 
on Nov 19, 2024

Deleted branch

lucidrainsdeleted fix-tests • 
on Nov 13, 2024

fix tests

lucidrainspushed 1 commit to main • 0449865…d47c57e • 
on Nov 10, 2024

try again

lucidrainscreated fix-tests • 07a4af3 • 
on Nov 10, 2024

update minimum version for nested tensor of NaViT

lucidrainspushed 1 commit to main • 6693d47…0449865 • 
on Nov 10, 2024

update comment for navit 3d

lucidrainspushed 1 commit to main • 141239c…6693d47 • 
on Nov 8, 2024

fix value residual

lucidrainspushed 1 commit to main • 0b5c9b4…141239c • 
on Oct 31, 2024

add value residual based simple vit

lucidrainspushed 1 commit to main • e300cdd…0b5c9b4 • 
on Oct 28, 2024

fix multiheaded qk rmsnorm in nViT

lucidrainspushed 1 commit to main • 36ddc7a…e300cdd • 
on Oct 11, 2024

go all the way with the normalized vit, fix some scales

Force push
lucidrainsforce pushed to main • 5f85d7b…36ddc7a • 
on Oct 10, 2024

go all the way with the normalized vit, fix some scales

lucidrainspushed 1 commit to main • 1d1a63f…5f85d7b • 
on Oct 10, 2024

cite for hypersphere vit adapted from ngpt

lucidrainspushed 1 commit to main • 74b6200…1d1a63f • 
on Oct 10, 2024

go for multi-headed rmsnorm for the qknorm on hypersphere vit

lucidrainspushed 1 commit to main • f50d7d1…74b6200 • 
on Oct 10, 2024

add a hypersphere vit, adapted from https://arxiv.org/abs/2410.01131

Force push
lucidrainsforce pushed to main • 43cbcad…f50d7d1 • 
on Oct 9, 2024

add a hypersphere vit, adapted from https://arxiv.org/abs/2410.01131

Force push
lucidrainsforce pushed to main • cc17cf0…43cbcad • 
on Oct 9, 2024

add a hypersphere vit, adapted from https://arxiv.org/abs/2410.01131

lucidrainspushed 1 commit to main • 82f2fa7…cc17cf0 • 
on Oct 9, 2024

address #330

lucidrainspushed 1 commit to main • fcb9501…82f2fa7 • 
on Oct 4, 2024

add register tokens to the nested tensor 3d na vit example for resear…

lucidrainspushed 1 commit to main • c4651a3…fcb9501 • 
on Aug 28, 2024

Deleted branch

lucidrainsdeleted pytest-torch-2.4 • 
on Aug 23, 2024