10 Commits

Author	SHA1	Message	Date
Wentao Ye	ffb2cd6b54	[Perf] Optimize `moe_align_block_size` CUDA kernel (#19572) ... Signed-off-by: yewentao256 <zhyanwentao@126.com> Co-authored-by: mgoin <mgoin64@gmail.com>	2025-06-17 11:49:26 -07:00
Chiyue Wei	61059bee40	[Hardware][NVIDIA] FP4 MoE kernel optimization (#19110) ... Signed-off-by: Chiyue Wei <chiyuew@nvidia.com> Co-authored-by: Chiyue Wei <chiyuew@nvidia.com>	2025-06-05 09:48:26 -07:00
Tyler Michael Smith	6e588da0f4	[Build/CI] Fix CUDA 11.8 build (#17679) ... Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com> Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com> Signed-off-by: Tyler Michael Smith <tysmith@redhat.com> Co-authored-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>	2025-05-22 12:13:54 -07:00
Sage Moore	45f3f3f59e	[ROCm][Bugfix] Ensure that the moe_wna16_gemm kernel is not built on ROCm platforms. (#14629) ... Signed-off-by: Sage Moore <sage@neuralmagic.com>	2025-03-12 08:00:28 -04:00
Jinzhen Lin	90e88ab756	[Kernel] moe wna16 cuda kernel (#13321) ... Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com> Co-authored-by: mgoin <mgoin64@gmail.com>	2025-03-10 20:12:40 -04:00
Yang Chen	95460fc513	[Kernel] port sgl moe_align_block_size kernels (#12574) ... sgl_moe_align_block_size is based on: ded9fcd09a moe_align_block_size is based on: ba5112ff69 Signed-off-by: Yang Chen <yangche@fb.com>	2025-02-03 13:09:50 +08:00
Charlie Fu	59449095ab	[Performance][Kernel] Fused_moe Performance Improvement (#9384) ... Signed-off-by: charlifu <charlifu@amd.com>	2024-10-24 15:37:52 -07:00
bnellnm	5467ac3196	[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047)	2024-06-09 16:23:30 -04:00
Michael Goin	5f6d10c14c	[CI/Build] Enforce style for C++ and CUDA code with `clang-format` (#4722)	2024-05-22 07:18:41 +00:00
Woosuk Kwon	f0d4e14557	Add fused top-K softmax kernel for MoE (#2769)	2024-02-05 17:38:02 -08:00