11 Commits

Author	SHA1	Message	Date
Wentao Ye	783921d889	[Perf] Optimize Vectorization Utils for Int 8 Quantization Kernels (#20331) ... Signed-off-by: yewentao256 <zhyanwentao@126.com>	2025-07-04 15:06:24 +08:00
Wentao Ye	b6efafd9e4	[Perf] Vectorize static / dynamic INT8 quant kernels (#19233) ... Signed-off-by: yewentao256 <zhyanwentao@126.com>	2025-06-12 06:51:41 -07:00
Arjun Kathuria	d8487ef557	[ROCm]: Fix build from source failure with gcc14 and ROCm 6.3 (#13779) ... Signed-off-by: Arjun Kathuria <arjun.kathuria8@gmail.com>	2025-05-12 20:36:33 -07:00
Lu Fang	4068f4b5b5	[MISC] Replace c10::optional with std::optional (#11730) ... Signed-off-by: Lu Fang <lufang@fb.com>	2025-01-05 10:20:34 +09:00
rasmith	92d86da217	[BugFix] [Kernel] Fix GPU SEGV occurring in int8 kernels (#9391)	2024-10-17 01:34:06 +00:00
Luka Govedič	5d73ae49d6	[Kernel] AQ AZP 3/4: Asymmetric quantization kernels (#7270)	2024-09-16 11:52:40 -07:00
Luka Govedič	7937009a7e	[Kernel] Replaced `blockReduce[...]` functions with `cub::BlockReduce` (#7233) ... Co-authored-by: Michael Goin <michael@neuralmagic.com>	2024-08-21 20:18:00 -04:00
bnellnm	5467ac3196	[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047)	2024-06-09 16:23:30 -04:00
Dipika Sikka	ca3ea51bde	[Kernel] Dynamic Per-Token Activation Quantization (#5037) ... Co-authored-by: Varun Sundar Rabindranath <varunsundar08@gmail.com> Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>	2024-06-07 09:36:26 -07:00
Tyler Michael Smith	cbb2f59cc8	[Kernel] Pass a device pointer into the quantize kernel for the scales (#5159)	2024-06-03 09:52:30 -07:00
Dipika Sikka	a1242324c9	[Kernel] Initial Activation Quantization Support (#4525) ... Co-authored-by: Varun Sundar Rabindranath <varunsundar08@gmail.com> Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>	2024-05-23 21:29:18 +00:00