- BaseM/BaseN: UnitFlag 单缓冲方形 256x256 (L0C/4B=65536 元素用满, 替代双缓冲 176x176); M/N < 256 被迫跟随 M/N (另一侧按 L0C 余量放大, 且收敛 L0A/L0B baseK>=16 单边上限); baseK = min(L0A/(2*BaseM*dt), L0B/(2*BaseN*dt)) 向下16对齐 (64KB 两侧双缓冲) - SingleCoreM/N: 有界枚举取代旧"仅 sqrt(P)+2 范围按面积取最大"(恒退回176兜底): P=1 (B>=C) 先试不切分 tile 跟随 M/N; 否则枚举 mCnt<=ceil(M/BaseM) x nCnt<=ceil(N/BaseN) 且 B*mCnt*nCnt>=C, sM/sN 为 Base 整数倍, 约束2 L1 双缓冲反推 k_L1, 约束3 dValue>=256B 转置感知 + minTile 16KB; 目标 = 每batch搬入 K*dt*(nCnt*M+mCnt*N) 最小 (v1.5 修正: 稳态下 k_L1 约掉, 只进约束); 并列取 r 最大 - 兜底: 约束4无解时放开到 16 对齐网格按硬下限(dValue>=128B)再搜; 极端形状 (如 N=8 int8 大K)仍无解时退回 Base tile 并自检标注违规 (不静默产伪方案) - constraints: ASW 双分支 L0C 口径改 UnitFlag 单缓冲 (factor 1) - docs/06 Step0/Step1/Step6 重写为 v1.91 口径, 头部标注 2026-09 更新与 issue#33 - 回归: v1.91 §5.2 完整实例 (B=8 M=N=2048 K=1024 -> (4,4) 512x512, k_l1=128, r=0); 方形例外 (M=128 -> 128x512); 单缓冲约束通过; 极端形状违规标注; 60->61 测试全过; 压力 seed7/6000 + seed2024/4000: 0 崩溃/0 NaN/0 GM<V_in, 违规仅剩极端形状如实标注; examples 重生成可复现 0 diff (L2 重复读降 2-3x, 如 b128_m8192_n8192_k7168 1.38TB->451GB)
43 KiB
43 KiB
| 1 | case_id | batch_a | batch_b | m | n | k | dtype_a | dtype_b | dtype_c | trans_a | trans_b | has_bias | out_nd | deterministic_level | plan_case_id | plan_branch | plan_npu | plan_op | plan_used_core_num | plan_split_b | plan_m_cnt | plan_n_cnt | plan_grid_k | plan_core_map | plan_b_core | plan_merge_b0 | plan_single_core_m | plan_single_core_n | plan_single_core_k | plan_k_l1 | plan_b_l1 | plan_l1_form | plan_base_m | plan_base_n | plan_base_k | plan_l2_policy_in | plan_l2_policy_out | plan_swizzle_w | plan_workspace_bytes | plan_tail_strategy | plan_tail_m_cnt | plan_tail_n_cnt | plan_tail_k_cnt | plan_tail_m_main | plan_tail_n_main | plan_tail_block_cnt | plan_tail_wave_num | plan_fixpipe_unitflag | plan_out_dtype_bytes | plan_note | gm_read_bytes | l2_read_bytes | t_mte2_gm | t_mte2_l2 | t_mte2 | dma_cmd_count | t_dma_cmd | cube_flops | t_mmad | fixpipe_bytes | t_fixpipe | t_reduce | t_steady | t_drain | t_total | bottleneck | feasible | violations | bound_type | advice |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2 | to_matmul_demo | 1 | 1 | 2048 | 2048 | 2048 | bf16 | bf16 | bf16 | False | False | False | True | 0 | to_matmul_demo | 转Matmul | Ascend950PR | batch_mat_mul_v3 | 32 | 1 | 0 | 0 | 1 | 折叠为 Matmul [2048,2048]x[2048,2048], 复用 Matmul 切分体系 | 0 | 1 | 0 | 0 | 2048 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 转Matmul后由 Matmul 体系决定 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | True | 2 | BatchB=1免费折叠: 左矩阵 [1,2048,2048] 视图折叠为 [2048,2048], 零重排零 split | 16777216 | 0.0 | 1.048576e-05 | 0.0 | 1.048576e-05 | 0.0 | 0.0 | 17179869184.0 | 3.534952506995885e-05 | 8388608 | 1.6131938461538462e-06 | 0.0 | 3.534952506995885e-05 | 0.0 | 3.534952506995885e-05 | MMAD | True | 计算Bound | BatchA=1或BatchB=1, 折叠转普通Matmul | ||||
| 3 | special_k0_demo | 128 | 128 | 256 | 256 | 0 | bf16 | bf16 | bf16 | False | False | False | True | 0 | special_k0_demo | 特殊分支 | Ascend950PR | batch_mat_mul_v3 | 64 | 1 | 1 | 1 | 1 | AIV 核间按行均分 (无 Cube tile 概念) | 0 | 1 | 0 | 0 | 0 | 0 | 1 | UB驻留(AIV) | 0 | 0 | 0 | allocate | direct_gm | 0 | 0 | 不涉及(AIV逐元素) | 1 | 1 | 1 | 0 | 0 | 0 | 0 | False | 2 | K=0纯写值: 无任何计算, C=bias 或 0, 纯 AIV 写值; 按行均分到 AIV 核 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 16777216 | 3.2263876923076923e-06 | 0.0 | 3.2263876923076923e-06 | 0.0 | 3.2263876923076923e-06 | FIXPIPE | True | 写出Bound(L2写口) | K=0纯写值 | |
| 4 | special_k1_demo | 128 | 128 | 256 | 256 | 1 | bf16 | bf16 | bf16 | False | False | False | True | 0 | special_k1_demo | 特殊分支 | Ascend950PR | batch_mat_mul_v3 | 64 | 1 | 1 | 1 | 1 | AIV 核间按行均分 (无 Cube tile 概念) | 0 | 1 | 0 | 0 | 1 | 0 | 1 | UB驻留(AIV) UB乒乓 | 0 | 0 | 0 | allocate | direct_gm | 0 | 0 | 不涉及(AIV逐元素) | 1 | 1 | 1 | 0 | 0 | 0 | 0 | False | 2 | K=1逐元素乘: 退化为 C=A⊙B 无累加深度, Cube 16x16x16 粒度浪费 15/16; 走 AIV 通路 GM->UB->Mul->GM, UB乒乓 (B>=2*AIV 双batch乒乓流水) | 131072 | 0.0 | 8.192e-08 | 0.0 | 8.192e-08 | 0.0 | 0.0 | 8388608.0 | 3.103030303030303e-07 | 16777216 | 3.2263876923076923e-06 | 0.0 | 3.2263876923076923e-06 | 0.0 | 3.2263876923076923e-06 | FIXPIPE | True | 写出Bound(L2写口) | K=1逐元素乘, 走AIV向量通路 | |
| 5 | merge_demo_k_trunc | 2048 | 2048 | 32 | 32 | 256 | bf16 | bf16 | bf16 | False | False | False | True | 0 | merge_demo_k_trunc | MergeBatch | Ascend950PR | batch_mat_mul_v3 | 32 | 32 | 1 | 1 | 1 | 切B均分(核间零重复读零依赖) | 64 | 4 | 128 | 128 | 256 | 256 | 8 | 合并驻留 | 128 | 128 | 128 | allocate(GM->L1随路驻留L2) | resident(整case输入+输出<=L2: 输出驻留L2异步回写, GM写=0) | 0 | 0 | 不涉及(核内不切M/N) | 1 | 1 | 1 | 0 | 0 | 0 | 0 | True | 2 | b0=4 (L0C上限5.7/算存比上限19.0/b_core=64); K截断; 合并后单次DMA搬入 A'[128,256]+B'[256,128]; 输出落点: L2驻留 (整case V_in+V_out=64.0MB vs L2=128MB) | 67108864 | 0.0 | 4.194304e-05 | 0.0 | 4.2743039999999997e-05 | 16.0 | 8.000000000000001e-07 | 4294967296.0 | 8.837381267489712e-06 | 4194304 | 8.065969230769231e-07 | 0.0 | 4.2743039999999997e-05 | 1.8849638999683443e-07 | 4.293153638999683e-05 | MTE2 | True | 访存Bound(GM读写共享+L2重复读) | 两分支均合法, 仲裁: [分界条件] MergeBatch最优=True (k_L1=K(截断); b_core=64 vs 阈值 b0*(T_comp+T_write)/T_cmd=6.0; drain惩罚=(b0-1)*(T_comp+T_write)=0.23us, 搬移节省=b_core*(1-1/b0)*T_cmd=2.40us); [时延模型] T_MergeBatch=42.93us vs T_IterBatch=45.19us -> MergeBatch更优; [裁决] MergeBatch | |
| 6 | merge_iter_arbitrate | 128 | 128 | 64 | 64 | 512 | bf16 | bf16 | bf16 | False | False | False | True | 0 | merge_iter_arbitrate | IterBatch | Ascend950PR | batch_mat_mul_v3 | 32 | 32 | 1 | 1 | 1 | 切B轮转分配(核间零重复读零依赖) | 4 | 1 | 64 | 64 | 512 | 512 | 2 | b_双batch乒乓 | 64 | 64 | 256 | allocate(GM->L1随路驻留L2) | resident(整case输入+输出<=L2: 输出驻留L2异步回写, GM写=0) | 0 | 0 | 不涉及(核内不切M/N) | 1 | 1 | 1 | 0 | 0 | 0 | 0 | True | 2 | 双batch乒乓: 2*(MK+KN)*dtype=256KB <= L1; 输出落点: L2驻留 | 16777216 | 0.0 | 1.048576e-05 | 0.0 | 1.0685759999999999e-05 | 4 | 2.0000000000000002e-07 | 536870912.0 | 1.104672658436214e-06 | 1048576 | 2.0164923076923077e-07 | 0.0 | 1.0685759999999999e-05 | 3.265804723013612e-07 | 1.101234047230136e-05 | MTE2 | True | 访存Bound(GM读写共享+L2重复读) | 两分支均合法, 仲裁: [分界条件] MergeBatch最优=False (k_L1=K(截断); b_core=4 vs 阈值 b0*(T_comp+T_write)/T_cmd=17.6; drain惩罚=(b0-1)*(T_comp+T_write)=0.44us, 搬移节省=b_core*(1-1/b0)*T_cmd=0.10us); [时延模型] T_MergeBatch=11.26us vs T_IterBatch=11.01us -> IterBatch更优; [裁决] IterBatch | |
| 7 | iter_demo_form_b | 128 | 128 | 64 | 64 | 256 | bf16 | bf16 | bf16 | False | False | False | True | 0 | iter_demo_form_b | IterBatch | Ascend950PR | batch_mat_mul_v3 | 32 | 32 | 1 | 1 | 1 | 切B轮转分配(核间零重复读零依赖) | 4 | 1 | 64 | 64 | 256 | 256 | 2 | b_双batch乒乓 | 64 | 64 | 256 | allocate(GM->L1随路驻留L2) | resident(整case输入+输出<=L2: 输出驻留L2异步回写, GM写=0) | 0 | 0 | 不涉及(核内不切M/N) | 1 | 1 | 1 | 0 | 0 | 0 | 0 | True | 2 | 双batch乒乓: 2*(MK+KN)*dtype=128KB <= L1; 输出落点: L2驻留 | 8388608 | 0.0 | 5.24288e-06 | 0.0 | 5.4428799999999995e-06 | 4 | 2.0000000000000002e-07 | 268435456.0 | 5.52336329218107e-07 | 1048576 | 2.0164923076923077e-07 | 0.0 | 5.4428799999999995e-06 | 1.8849638999683443e-07 | 5.631376389996834e-06 | MTE2 | True | 访存Bound(GM读写共享+L2重复读) | 仅 IterBatch 条件满足 | |
| 8 | iter_demo_form_d | 64 | 64 | 64 | 64 | 8192 | bf16 | bf16 | bf16 | False | False | False | True | 0 | iter_demo_form_d | IterBatch | Ascend950PR | batch_mat_mul_v3 | 32 | 32 | 1 | 1 | 1 | 切B轮转分配(核间零重复读零依赖) | 2 | 1 | 64 | 64 | 8192 | 1024 | 1 | d_两侧都切K | 64 | 64 | 256 | allocate(GM->L1随路驻留L2) | direct_gm(整case超L2: 输入优先驻留L2, 输出直写GM不占L2) | 0 | 0 | 不涉及(核内不切M/N) | 1 | 1 | 1 | 0 | 0 | 0 | 0 | True | 2 | 两侧都切K: k_L1=1024, K段成对流水, batch边界天然无缝; dValueA=2048B/dValueB=128B; 输出落点: 直写GM | 134217728 | 0.0 | 8.388608e-05 | 0.0 | 8.468608e-05 | 16 | 8.000000000000001e-07 | 4294967296.0 | 8.837381267489712e-06 | 524288 | 3.2768e-07 | 0.0 | 8.501376e-05 | 7.16176329218107e-07 | 8.572993632921812e-05 | MTE2 | True | 访存Bound(GM读写共享+L2重复读) | 仅 IterBatch 条件满足 | |
| 9 | streamk_demo | 4 | 4 | 128 | 128 | 10240 | bf16 | bf16 | bf16 | False | False | False | True | 0 | streamk_demo | StreamK | Ascend950PR | batch_mat_mul_v3 | 32 | 1 | 1 | 1 | 32 | B/M/N切出4块, 每块32核切K归约 (归约组内核c负责K段[c*K/32,(c+1)*K/32)) | 1 | 1 | 128 | 128 | 320 | 256 | 1 | K段标准分块流水 | 128 | 128 | 64 | allocate(部分和驻留L2) | resident(部分和4B驻留L2, 防精度丢失不随C的fp16/fp8转换) | 0 | 8388608 | grid_K=32路切K+归约 | 1 | 1 | 32 | 0 | 0 | 0 | 0 | True | 4 | P=1.00, grid_K=32, 部分和驻留L2按4B写出, AIV归约后按C dtype=2B写最终 | 20971520 | 0 | 1.31072e-05 | 0.0 | 1.31072e-05 | 0.0 | 0.0 | 1342177280.0 | 2.761681646090535e-06 | 0.0 | 0.0 | 3.4067453613053613e-06 | 1.31072e-05 | 3.4067453613053613e-06 | 1.651394536130536e-05 | MTE2 | True | 访存Bound(GM读写共享+L2重复读) | P<=C/2, B/M/N并行度买不满, 切K (grid_K=32) | |
| 10 | asw_demo_full | 2 | 2 | 8192 | 8192 | 1024 | bf16 | bf16 | bf16 | False | False | False | True | 0 | asw_demo_full | ASW_Basic | Ascend950PR | batch_mat_mul_v3 | 32 | 1 | 16 | 16 | 1 | B->M->N线性映射+ASW滑窗蛇形(W=4) | 0 | 1 | 512 | 512 | 1024 | 128 | 1 | 双缓冲驻留当前tile输入 | 256 | 256 | 64 | allocate(输入驻留L2吸收重复读) | direct_gm(输出直写GM, 输入优先驻留L2) | 4 | 0 | A0 | 1 | 1 | 1 | 0 | 0 | 0 | 16 | True | 2 | tile枚举: P=16, 有界枚举最优 mCnt=16 x nCnt=16 (tile 512x512, 每batch搬入512.0MB, r=0); Base tile 256x256 (L0C 单缓冲方形用满); L2场景: B_单batch可驻留(全驻留或单侧驻留+对侧滑窗) (V_in=64.0MB, V_out=256.0MB, L2=128MB); 尾轮: r=0 无尾轮 | 67108864 | 1006632960 | 4.194304e-05 | 0.00019358326153846154 | 0.00023552630153846153 | 0.0 | 0.0 | 274877906944.0 | 0.0005655924011193416 | 268435456 | 0.00016777216 | 0.0 | 0.0005655924011193416 | 0.0 | 0.0005655924011193416 | MMAD | True | 计算Bound | ASW_Basic兜底 (StreamK未过: 1_并行缺口: P=B*MN*4B/L0C <= C/2; 2_单核K段下限: K/grid_K >= 256B/dtype 且 grid_K>=2; 3_归约代价可接受) | |
| 11 | asw_demo_reduce_core | 16 | 16 | 256 | 256 | 128 | bf16 | bf16 | bf16 | False | False | False | True | 0 | asw_demo_reduce_core | ASW_Basic_降核 | Ascend950PR | batch_mat_mul_v3 | 16 | 1 | 1 | 1 | 1 | 降核: 只用16核, 每核一个L0C满载输出块, 其余核闲置 | 0 | 1 | 256 | 256 | 128 | 128 | 1 | 标准核内流水 | 256 | 256 | 64 | allocate | resident(整case全驻留S_A) | 0 | 0 | 不涉及(每核一块无尾轮) | 1 | 1 | 1 | 0 | 0 | 0 | 0 | True | 2 | P=16.00<C, 降核是理性选择 (强切则 tile 跌破搬移效率下限反而更慢) | 2097152 | 0 | 2.62144e-06 | 0.0 | 2.62144e-06 | 0.0 | 0.0 | 268435456.0 | 1.104672658436214e-06 | 2097152 | 8.065969230769231e-07 | 0.0 | 2.62144e-06 | 0.0 | 2.62144e-06 | MTE2 | True | 访存Bound(GM读写共享+L2重复读) | ASW_Basic兜底 (StreamK未过: 2_单核K段下限: K/grid_K >= 256B/dtype 且 grid_K>=2) | |
| 12 | b4_m1_n128_k256 | 4 | 4 | 1 | 128 | 256 | bf16 | bf16 | bf16 | False | False | False | True | 0 | b4_m1_n128_k256 | ASW_Basic_降核 | Ascend950PR | batch_mat_mul_v3 | 1 | 1 | 1 | 1 | 1 | 降核: 只用1核, 每核一个L0C满载输出块, 其余核闲置 | 0 | 1 | 1 | 128 | 256 | 256 | 1 | 标准核内流水 | 1 | 128 | 128 | allocate | resident(整case全驻留S_A) | 0 | 0 | 不涉及(每核一块无尾轮) | 1 | 1 | 1 | 0 | 0 | 0 | 0 | True | 2 | P=0.01<C, 降核是理性选择 (强切则 tile 跌破搬移效率下限反而更慢) | 264192 | 0 | 5.28384e-06 | 0.0 | 5.28384e-06 | 0.0 | 0.0 | 262144.0 | 1.7260510288065844e-08 | 1024 | 6.3015384615384615e-09 | 0.0 | 5.28384e-06 | 0.0 | 5.28384e-06 | MTE2 | True | 访存Bound(GM读写共享+L2重复读) | ASW_Basic兜底 (StreamK未过: 2_单核K段下限: K/grid_K >= 256B/dtype 且 grid_K>=2; 3_归约代价可接受: K > grid_K^2/(grid_K-1)*theta_c) | |
| 13 | b8_m2_n192_k128 | 8 | 8 | 2 | 192 | 128 | bf16 | bf16 | bf16 | False | False | False | True | 0 | b8_m2_n192_k128 | ASW_Basic_降核 | Ascend950PR | batch_mat_mul_v3 | 1 | 1 | 1 | 1 | 1 | 降核: 只用1核, 每核一个L0C满载输出块, 其余核闲置 | 0 | 1 | 2 | 192 | 128 | 128 | 1 | 标准核内流水 | 2 | 192 | 80 | allocate | resident(整case全驻留S_A) | 0 | 0 | 不涉及(每核一块无尾轮) | 1 | 1 | 1 | 0 | 0 | 0 | 0 | True | 2 | P=0.05<C, 降核是理性选择 (强切则 tile 跌破搬移效率下限反而更慢) | 397312 | 0 | 7.94624e-06 | 0.0 | 7.94624e-06 | 0.0 | 0.0 | 786432.0 | 5.178153086419753e-08 | 6144 | 3.7809230769230766e-08 | 0.0 | 7.94624e-06 | 0.0 | 7.94624e-06 | MTE2 | True | 访存Bound(GM读写共享+L2重复读) | ASW_Basic兜底 (StreamK未过: 2_单核K段下限: K/grid_K >= 256B/dtype 且 grid_K>=2; 3_归约代价可接受: K > grid_K^2/(grid_K-1)*theta_c) | |
| 14 | b16_m4_n256_k192 | 16 | 16 | 4 | 256 | 192 | bf16 | bf16 | bf16 | False | False | False | True | 0 | b16_m4_n256_k192 | ASW_Basic_降核 | Ascend950PR | batch_mat_mul_v3 | 1 | 1 | 1 | 1 | 1 | 降核: 只用1核, 每核一个L0C满载输出块, 其余核闲置 | 0 | 1 | 4 | 256 | 192 | 192 | 1 | 标准核内流水 | 4 | 256 | 64 | allocate | resident(整case全驻留S_A) | 0 | 0 | 不涉及(每核一块无尾轮) | 1 | 1 | 1 | 0 | 0 | 0 | 0 | True | 2 | P=0.25<C, 降核是理性选择 (强切则 tile 跌破搬移效率下限反而更慢) | 1597440 | 0 | 3.19488e-05 | 0.0 | 3.19488e-05 | 0.0 | 0.0 | 6291456.0 | 4.1425224691358024e-07 | 32768 | 2.0164923076923077e-07 | 0.0 | 3.19488e-05 | 0.0 | 3.19488e-05 | MTE2 | True | 访存Bound(GM读写共享+L2重复读) | ASW_Basic兜底 (StreamK未过: 2_单核K段下限: K/grid_K >= 256B/dtype 且 grid_K>=2; 3_归约代价可接受: K > grid_K^2/(grid_K-1)*theta_c) | |
| 15 | b32_m8_n128_k256 | 32 | 32 | 8 | 128 | 256 | bf16 | bf16 | bf16 | False | False | False | True | 0 | b32_m8_n128_k256 | IterBatch | Ascend950PR | batch_mat_mul_v3 | 32 | 32 | 1 | 1 | 1 | 切B轮转分配(核间零重复读零依赖) | 1 | 1 | 8 | 128 | 256 | 256 | 1 | a_单batch全驻留 | 8 | 128 | 128 | allocate(GM->L1随路驻留L2) | resident(整case输入+输出<=L2: 输出驻留L2异步回写, GM写=0) | 0 | 0 | 不涉及(核内不切M/N) | 1 | 1 | 1 | 0 | 0 | 0 | 0 | True | 2 | 单batch全驻留: (MK+KN)*dtype=68KB <= L1; 输出落点: L2驻留 | 2228224 | 0.0 | 1.39264e-06 | 0.0 | 1.44264e-06 | 1 | 5.0000000000000004e-08 | 16777216.0 | 3.452102057613169e-08 | 65536 | 1.2603076923076923e-08 | 0.0 | 1.44264e-06 | 4.712409749920861e-08 | 1.4897640974992086e-06 | MTE2 | True | 访存Bound(GM读写共享+L2重复读) | 仅 IterBatch 条件满足 | |
| 16 | b64_m16_n256_k512 | 64 | 64 | 16 | 256 | 512 | bf16 | bf16 | bf16 | False | False | False | True | 0 | b64_m16_n256_k512 | IterBatch | Ascend950PR | batch_mat_mul_v3 | 32 | 32 | 1 | 1 | 1 | 切B轮转分配(核间零重复读零依赖) | 2 | 1 | 16 | 256 | 512 | 240 | 1 | c_一侧驻留+对侧切K | 16 | 256 | 64 | allocate(GM->L1随路驻留L2) | resident(整case输入+输出<=L2: 输出驻留L2异步回写, GM写=0) | 0 | 0 | 不涉及(核内不切M/N) | 1 | 1 | 1 | 0 | 0 | 0 | 0 | True | 2 | 一侧驻留(A)+对侧切K: A驻留16KB, 预算L1/2, k_L1=240, dValueA=480B/dValueB=512B; 输出落点: L2驻留 | 17825792 | 0.0 | 1.114112e-05 | 0.0 | 1.1441120000000001e-05 | 6 | 3.0000000000000004e-07 | 268435456.0 | 5.52336329218107e-07 | 524288 | 1.0082461538461538e-07 | 0.0 | 1.1441120000000001e-05 | 1.798661348528015e-07 | 1.1620986134852803e-05 | MTE2 | True | 访存Bound(GM读写共享+L2重复读) | 仅 IterBatch 条件满足 | |
| 17 | b128_m8_n192_k256 | 128 | 128 | 8 | 192 | 256 | bf16 | bf16 | bf16 | False | False | False | True | 0 | b128_m8_n192_k256 | IterBatch | Ascend950PR | batch_mat_mul_v3 | 32 | 32 | 1 | 1 | 1 | 切B轮转分配(核间零重复读零依赖) | 4 | 1 | 8 | 192 | 256 | 256 | 2 | b_双batch乒乓 | 8 | 192 | 80 | allocate(GM->L1随路驻留L2) | resident(整case输入+输出<=L2: 输出驻留L2异步回写, GM写=0) | 0 | 0 | 不涉及(核内不切M/N) | 1 | 1 | 1 | 0 | 0 | 0 | 0 | True | 2 | 双batch乒乓: 2*(MK+KN)*dtype=200KB <= L1; 输出落点: L2驻留 | 13107200 | 0.0 | 8.192e-06 | 0.0 | 8.392e-06 | 4 | 2.0000000000000002e-07 | 100663296.0 | 2.0712612345679012e-07 | 393216 | 7.561846153846153e-08 | 0.0 | 8.392e-06 | 7.068614624881291e-08 | 8.462686146248813e-06 | MTE2 | True | 访存Bound(GM读写共享+L2重复读) | 仅 IterBatch 条件满足 | |
| 18 | b32_m16_n8192_k7168 | 32 | 32 | 16 | 8192 | 7168 | bf16 | bf16 | bf16 | False | False | False | True | 0 | b32_m16_n8192_k7168 | ASW_Basic | Ascend950PR | batch_mat_mul_v3 | 32 | 1 | 1 | 8 | 1 | B->M->N线性映射+ASW滑窗蛇形(W=4) | 0 | 1 | 16 | 1024 | 7168 | 112 | 1 | 双缓冲驻留当前tile输入 | 16 | 1024 | 16 | allocate(输入驻留L2吸收重复读) | direct_gm(输出直写GM, 输入优先驻留L2) | 4 | 0 | A0 | 1 | 1 | 1 | 0 | 0 | 0 | 8 | True | 2 | tile枚举: P=1, 有界枚举最优 mCnt=1 x nCnt=8 (tile 16x1024, 每batch搬入113.8MB, r=0); Base tile 16x1024 (L0C 单缓冲方形用满); L2场景: B_单batch可驻留(全驻留或单侧驻留+对侧滑窗) (V_in=3591.0MB, V_out=8.0MB, L2=128MB); 尾轮: r=0 无尾轮 | 3765436416 | 51380224 | 0.00235339776 | 9.880812307692307e-06 | 0.0023632785723076925 | 0.0 | 0.0 | 60129542144.0 | 0.00012372333774485596 | 8388608 | 5.24288e-06 | 0.0 | 0.0023685214523076923 | 0.0 | 0.0023685214523076923 | MTE2 | True | 访存Bound(GM读写共享+L2重复读) | IterBatch/MergeBatch 进入条件均不满足, 回落 ASW_Basic; IterBatch未过: 3_L1驻留形态(四选一, 核心要求: 单batch核内零重复读); MergeBatch未过: 1_batch关系与每核份额: BatchA==BatchB 且 b_core=B/C>=2*b0; 2_L0C容量: 2*(b0*M)*(b0*N)*4B <= L0C; 2b_L0AB容量: 合并后 b0*M/b0*N 在最小K粒度下可驻留 L0A/L0B | |
| 19 | b4_m1_n8192_k8192 | 4 | 4 | 1 | 8192 | 8192 | bf16 | bf16 | bf16 | False | False | False | True | 0 | b4_m1_n8192_k8192 | StreamK | Ascend950PR | batch_mat_mul_v3 | 32 | 1 | 1 | 1 | 32 | B/M/N切出4块, 每块32核切K归约 (归约组内核c负责K段[c*K/32,(c+1)*K/32)) | 1 | 1 | 1 | 8192 | 256 | 256 | 1 | K段标准分块流水 | 1 | 128 | 64 | allocate(部分和驻留L2) | resident(部分和4B驻留L2, 防精度丢失不随C的fp16/fp8转换) | 0 | 4194304 | grid_K=32路切K+归约 | 1 | 1 | 32 | 0 | 0 | 0 | 0 | True | 4 | P=0.50, grid_K=32, 部分和驻留L2按4B写出, AIV归约后按C dtype=2B写最终 | 536936448 | 0.0 | 0.00033558528 | 0.0 | 0.00033558528 | 0.0 | 0.0 | 536870912.0 | 1.104672658436214e-06 | 0.0 | 0.0 | 1.731729603729604e-06 | 0.00033558528 | 1.731729603729604e-06 | 0.0003373170096037296 | MTE2 | True | 访存Bound(GM读写共享+L2重复读) | P<=C/2, B/M/N并行度买不满, 切K (grid_K=32) | |
| 20 | b16_m2_n4096_k7168 | 16 | 16 | 2 | 4096 | 7168 | bf16 | bf16 | bf16 | False | False | False | True | 0 | b16_m2_n4096_k7168 | StreamK | Ascend950PR | batch_mat_mul_v3 | 32 | 1 | 1 | 1 | 16 | B/M/N切出16块, 每块16核切K归约 (归约组内核c负责K段[c*K/16,(c+1)*K/16)) | 1 | 1 | 2 | 4096 | 448 | 256 | 1 | K段标准分块流水 | 2 | 128 | 64 | allocate(部分和驻留L2) | resident(部分和4B驻留L2, 防精度丢失不随C的fp16/fp8转换) | 0 | 8388608 | grid_K=16路切K+归约 | 1 | 1 | 16 | 0 | 0 | 0 | 0 | True | 4 | P=2.00, grid_K=16, 部分和驻留L2按4B写出, AIV归约后按C dtype=2B写最终 | 939982848 | 0 | 0.00058748928 | 0.0 | 0.00058748928 | 0.0 | 0.0 | 1879048192.0 | 3.866354304526749e-06 | 0.0 | 0.0 | 1.7726896037296038e-06 | 0.00058748928 | 1.7726896037296038e-06 | 0.0005892619696037297 | MTE2 | True | 访存Bound(GM读写共享+L2重复读) | P<=C/2, B/M/N并行度买不满, 切K (grid_K=16) | |
| 21 | b32_m64_n64_k7168 | 32 | 32 | 64 | 64 | 7168 | bf16 | bf16 | bf16 | False | False | False | True | 0 | b32_m64_n64_k7168 | IterBatch | Ascend950PR | batch_mat_mul_v3 | 32 | 32 | 1 | 1 | 1 | 切B轮转分配(核间零重复读零依赖) | 1 | 1 | 64 | 64 | 7168 | 1024 | 1 | d_两侧都切K | 64 | 64 | 256 | allocate(GM->L1随路驻留L2) | resident(整case输入+输出<=L2: 输出驻留L2异步回写, GM写=0) | 0 | 0 | 不涉及(核内不切M/N) | 1 | 1 | 1 | 0 | 0 | 0 | 0 | True | 2 | 两侧都切K: k_L1=1024, K段成对流水, batch边界天然无缝; dValueA=2048B/dValueB=128B; 输出落点: L2驻留 | 58720256 | 0.0 | 3.670016e-05 | 0.0 | 3.7050160000000004e-05 | 7 | 3.5000000000000004e-07 | 1879048192.0 | 3.866354304526749e-06 | 262144 | 5.041230769230769e-08 | 0.0 | 3.7050160000000004e-05 | 6.027486369104147e-07 | 3.765290863691042e-05 | MTE2 | True | 访存Bound(GM读写共享+L2重复读) | 仅 IterBatch 条件满足 | |
| 22 | b64_m1024_n1024_k7168 | 64 | 64 | 1024 | 1024 | 7168 | bf16 | bf16 | bf16 | False | False | False | True | 0 | b64_m1024_n1024_k7168 | IterBatch | Ascend950PR | batch_mat_mul_v3 | 32 | 32 | 1 | 1 | 1 | 切B轮转分配(核间零重复读零依赖) | 2 | 1 | 1024 | 1024 | 7168 | 64 | 1 | d_两侧都切K | 176 | 176 | 64 | allocate(GM->L1随路驻留L2) | direct_gm(整case超L2: 输入优先驻留L2, 输出直写GM不占L2) | 0 | 0 | 不涉及(核内不切M/N) | 1 | 1 | 1 | 0 | 0 | 0 | 0 | True | 2 | 两侧都切K: k_L1=64, K段成对流水, batch边界天然无缝; dValueA=128B/dValueB=2048B; 输出落点: 直写GM | 1879048192 | 0.0 | 0.00117440512 | 0.0 | 0.0011856051200000001 | 224 | 1.1200000000000001e-05 | 962072674304.0 | 0.0019795734039176954 | 134217728 | 8.388608e-05 | 0.0 | 0.0019795734039176954 | 5.078042126748971e-05 | 0.0020303538251851853 | MMAD | True | 计算Bound | 仅 IterBatch 条件满足 | |
| 23 | b128_m2048_n2048_k1536 | 128 | 128 | 2048 | 2048 | 1536 | bf16 | bf16 | bf16 | False | False | False | True | 0 | b128_m2048_n2048_k1536 | ASW_Basic | Ascend950PR | batch_mat_mul_v3 | 32 | 1 | 4 | 4 | 1 | B->M->N线性映射+ASW滑窗蛇形(W=4) | 0 | 1 | 512 | 512 | 1536 | 128 | 1 | 双缓冲驻留当前tile输入 | 256 | 256 | 64 | allocate(输入驻留L2吸收重复读) | direct_gm(输出直写GM, 输入优先驻留L2) | 4 | 0 | A0 | 1 | 1 | 1 | 0 | 0 | 0 | 64 | True | 2 | tile枚举: P=1, 有界枚举最优 mCnt=4 x nCnt=4 (tile 512x512, 每batch搬入48.0MB, r=0); Base tile 256x256 (L0C 单缓冲方形用满); L2场景: B_单batch可驻留(全驻留或单侧驻留+对侧滑窗) (V_in=1536.0MB, V_out=1024.0MB, L2=128MB); 尾轮: r=0 无尾轮 | 1610612736 | 4831838208 | 0.00100663296 | 0.0009291996553846154 | 0.0019358326153846154 | 0.0 | 0.0 | 1649267441664.0 | 0.0033935544067160493 | 1073741824 | 0.00067108864 | 0.0 | 0.0033935544067160493 | 0.0 | 0.0033935544067160493 | MMAD | True | 计算Bound | IterBatch/MergeBatch 进入条件均不满足, 回落 ASW_Basic; IterBatch未过: 3_L1驻留形态(四选一, 核心要求: 单batch核内零重复读); MergeBatch未过: 2_L0C容量: 2*(b0*M)*(b0*N)*4B <= L0C; 2b_L0AB容量: 合并后 b0*M/b0*N 在最小K粒度下可驻留 L0A/L0B; 5_访存Bound: 2MN/(M+N) < R16/b0 | |
| 24 | b64_m1024_n8192_k2048 | 64 | 64 | 1024 | 8192 | 2048 | bf16 | bf16 | bf16 | False | False | False | True | 0 | b64_m1024_n8192_k2048 | ASW_Basic | Ascend950PR | batch_mat_mul_v3 | 32 | 1 | 2 | 16 | 1 | B->M->N线性映射+ASW滑窗蛇形(W=4) | 0 | 1 | 512 | 512 | 2048 | 128 | 1 | 双缓冲驻留当前tile输入 | 256 | 256 | 64 | allocate(输入驻留L2吸收重复读) | direct_gm(输出直写GM, 输入优先驻留L2) | 4 | 0 | A0 | 1 | 1 | 1 | 0 | 0 | 0 | 64 | True | 2 | tile枚举: P=1, 有界枚举最优 mCnt=2 x nCnt=16 (tile 512x512, 每batch搬入128.0MB, r=0); Base tile 256x256 (L0C 单缓冲方形用满); L2场景: B_单batch可驻留(全驻留或单侧驻留+对侧滑窗) (V_in=2304.0MB, V_out=1024.0MB, L2=128MB); 尾轮: r=0 无尾轮 | 2415919104 | 6174015488 | 0.00150994944 | 0.0011873106707692308 | 0.0026972601107692305 | 0.0 | 0.0 | 2199023255552.0 | 0.004524739208954733 | 1073741824 | 0.00067108864 | 0.0 | 0.004524739208954733 | 0.0 | 0.004524739208954733 | MMAD | True | 计算Bound | IterBatch/MergeBatch 进入条件均不满足, 回落 ASW_Basic; IterBatch未过: 3_L1驻留形态(四选一, 核心要求: 单batch核内零重复读); MergeBatch未过: 1_batch关系与每核份额: BatchA==BatchB 且 b_core=B/C>=2*b0; 2_L0C容量: 2*(b0*M)*(b0*N)*4B <= L0C; 2b_L0AB容量: 合并后 b0*M/b0*N 在最小K粒度下可驻留 L0A/L0B; 5_访存Bound: 2MN/(M+N) < R16/b0 | |
| 25 | b32_m1024_n1024_k512 | 32 | 32 | 1024 | 1024 | 512 | bf16 | bf16 | bf16 | False | False | False | True | 0 | b32_m1024_n1024_k512 | IterBatch | Ascend950PR | batch_mat_mul_v3 | 32 | 32 | 1 | 1 | 1 | 切B轮转分配(核间零重复读零依赖) | 1 | 1 | 1024 | 1024 | 512 | 64 | 1 | d_两侧都切K | 176 | 176 | 64 | allocate(GM->L1随路驻留L2) | resident(整case输入+输出<=L2: 输出驻留L2异步回写, GM写=0) | 0 | 0 | 不涉及(核内不切M/N) | 1 | 1 | 1 | 0 | 0 | 0 | 0 | True | 2 | 两侧都切K: k_L1=64, K段成对流水, batch边界天然无缝; dValueA=128B/dValueB=2048B; 输出落点: L2驻留 | 67108864 | 0.0 | 4.194304e-05 | 0.0 | 4.234304e-05 | 8 | 4.0000000000000003e-07 | 34359738368.0 | 7.06990501399177e-05 | 67108864 | 1.290555076923077e-05 | 0.0 | 7.06990501399177e-05 | 2.1742932036720483e-05 | 9.244198217663819e-05 | MMAD | True | 计算Bound | 仅 IterBatch 条件满足 | |
| 26 | b128_m4096_n4096_k8192 | 128 | 128 | 4096 | 4096 | 8192 | bf16 | bf16 | bf16 | False | False | False | True | 0 | b128_m4096_n4096_k8192 | ASW_Basic | Ascend950PR | batch_mat_mul_v3 | 32 | 1 | 8 | 8 | 1 | B->M->N线性映射+ASW滑窗蛇形(W=4) | 0 | 1 | 512 | 512 | 8192 | 128 | 1 | 双缓冲驻留当前tile输入 | 256 | 256 | 64 | allocate(输入驻留L2吸收重复读) | direct_gm(输出直写GM, 输入优先驻留L2) | 4 | 0 | A0 | 1 | 1 | 1 | 0 | 0 | 0 | 256 | True | 2 | tile枚举: P=1, 有界枚举最优 mCnt=8 x nCnt=8 (tile 512x512, 每batch搬入1024.0MB, r=0); Base tile 256x256 (L0C 单缓冲方形用满); L2场景: B_单batch可驻留(全驻留或单侧驻留+对侧滑窗) (V_in=16384.0MB, V_out=4096.0MB, L2=128MB); 尾轮: r=0 无尾轮 | 17179869184 | 120259084288 | 0.01073741824 | 0.023126746978461538 | 0.033864165218461535 | 0.0 | 0.0 | 35184372088832.0 | 0.07239582734327572 | 4294967296 | 0.00268435456 | 0.0 | 0.07239582734327572 | 0.0 | 0.07239582734327572 | MMAD | True | 计算Bound | IterBatch/MergeBatch 进入条件均不满足, 回落 ASW_Basic; IterBatch未过: 3_L1驻留形态(四选一, 核心要求: 单batch核内零重复读); MergeBatch未过: 2_L0C容量: 2*(b0*M)*(b0*N)*4B <= L0C; 2b_L0AB容量: 合并后 b0*M/b0*N 在最小K粒度下可驻留 L0A/L0B; 5_访存Bound: 2MN/(M+N) < R16/b0 | |
| 27 | b32_m8192_n4096_k7168 | 32 | 32 | 8192 | 4096 | 7168 | bf16 | bf16 | bf16 | False | False | False | True | 0 | b32_m8192_n4096_k7168 | ASW_Basic | Ascend950PR | batch_mat_mul_v3 | 32 | 1 | 16 | 8 | 1 | B->M->N线性映射+ASW滑窗蛇形(W=4) | 0 | 1 | 512 | 512 | 7168 | 128 | 1 | 双缓冲驻留当前tile输入 | 256 | 256 | 64 | allocate(输入驻留L2吸收重复读) | direct_gm(输出直写GM, 输入优先驻留L2) | 4 | 0 | A0 | 1 | 1 | 1 | 0 | 0 | 0 | 128 | True | 2 | tile枚举: P=1, 有界枚举最优 mCnt=16 x nCnt=8 (tile 512x512, 每batch搬入1792.0MB, r=0); Base tile 256x256 (L0C 单缓冲方形用满); L2场景: B_单batch可驻留(全驻留或单侧驻留+对侧滑窗) (V_in=5376.0MB, V_out=2048.0MB, L2=128MB); 尾轮: r=0 无尾轮 | 5637144576 | 54492397568 | 0.00352321536 | 0.010479307224615384 | 0.014002522584615384 | 0.0 | 0.0 | 15393162788864.0 | 0.031673174462683126 | 2147483648 | 0.00134217728 | 0.0 | 0.031673174462683126 | 0.0 | 0.031673174462683126 | MMAD | True | 计算Bound | IterBatch/MergeBatch 进入条件均不满足, 回落 ASW_Basic; IterBatch未过: 3_L1驻留形态(四选一, 核心要求: 单batch核内零重复读); MergeBatch未过: 1_batch关系与每核份额: BatchA==BatchB 且 b_core=B/C>=2*b0; 2_L0C容量: 2*(b0*M)*(b0*N)*4B <= L0C; 2b_L0AB容量: 合并后 b0*M/b0*N 在最小K粒度下可驻留 L0A/L0B; 5_访存Bound: 2MN/(M+N) < R16/b0 | |
| 28 | b32_m2048_n2048_k8192 | 32 | 32 | 2048 | 2048 | 8192 | bf16 | bf16 | bf16 | False | False | False | True | 0 | b32_m2048_n2048_k8192 | ASW_Basic | Ascend950PR | batch_mat_mul_v3 | 32 | 1 | 4 | 4 | 1 | B->M->N线性映射+ASW滑窗蛇形(W=4) | 0 | 1 | 512 | 512 | 8192 | 128 | 1 | 双缓冲驻留当前tile输入 | 256 | 256 | 64 | allocate(输入驻留L2吸收重复读) | direct_gm(输出直写GM, 输入优先驻留L2) | 4 | 0 | A0 | 1 | 1 | 1 | 0 | 0 | 0 | 16 | True | 2 | tile枚举: P=1, 有界枚举最优 mCnt=4 x nCnt=4 (tile 512x512, 每batch搬入256.0MB, r=0); Base tile 256x256 (L0C 单缓冲方形用满); L2场景: B_单batch可驻留(全驻留或单侧驻留+对侧滑窗) (V_in=2048.0MB, V_out=256.0MB, L2=128MB); 尾轮: r=0 无尾轮 | 2147483648 | 6442450944 | 0.00134217728 | 0.0012389328738461537 | 0.002581110153846154 | 0.0 | 0.0 | 2199023255552.0 | 0.004524739208954733 | 268435456 | 0.00016777216 | 0.0 | 0.004524739208954733 | 0.0 | 0.004524739208954733 | MMAD | True | 计算Bound | IterBatch/MergeBatch 进入条件均不满足, 回落 ASW_Basic; IterBatch未过: 3_L1驻留形态(四选一, 核心要求: 单batch核内零重复读); MergeBatch未过: 1_batch关系与每核份额: BatchA==BatchB 且 b_core=B/C>=2*b0; 2_L0C容量: 2*(b0*M)*(b0*N)*4B <= L0C; 2b_L0AB容量: 合并后 b0*M/b0*N 在最小K粒度下可驻留 L0A/L0B; 5_访存Bound: 2MN/(M+N) < R16/b0 | |
| 29 | b64_m4096_n2048_k128 | 64 | 64 | 4096 | 2048 | 128 | bf16 | bf16 | bf16 | False | False | False | True | 0 | b64_m4096_n2048_k128 | ASW_Basic | Ascend950PR | batch_mat_mul_v3 | 32 | 1 | 8 | 4 | 1 | B->M->N线性映射+ASW滑窗蛇形(W=4) | 0 | 1 | 512 | 512 | 128 | 128 | 1 | 双缓冲驻留当前tile输入 | 256 | 256 | 64 | allocate(输入驻留L2吸收重复读) | direct_gm(输出直写GM, 输入优先驻留L2) | 4 | 0 | A0 | 1 | 1 | 1 | 0 | 0 | 0 | 64 | True | 2 | tile枚举: P=1, 有界枚举最优 mCnt=8 x nCnt=4 (tile 512x512, 每batch搬入8.0MB, r=0); Base tile 256x256 (L0C 单缓冲方形用满); L2场景: B_单batch可驻留(全驻留或单侧驻留+对侧滑窗) (V_in=96.0MB, V_out=1024.0MB, L2=128MB); 尾轮: r=0 无尾轮 | 100663296 | 436207616 | 6.291456e-05 | 8.388608e-05 | 0.00014680063999999998 | 0.0 | 0.0 | 137438953472.0 | 0.0002827962005596708 | 1073741824 | 0.00067108864 | 0.0 | 0.00081788928 | 0.0 | 0.00081788928 | MTE2 | True | 访存Bound(GM读写共享+L2重复读) | IterBatch/MergeBatch 进入条件均不满足, 回落 ASW_Basic; IterBatch未过: 3_L1驻留形态(四选一, 核心要求: 单batch核内零重复读); MergeBatch未过: 1_batch关系与每核份额: BatchA==BatchB 且 b_core=B/C>=2*b0; 2_L0C容量: 2*(b0*M)*(b0*N)*4B <= L0C; 2b_L0AB容量: 合并后 b0*M/b0*N 在最小K粒度下可驻留 L0A/L0B; 5_访存Bound: 2MN/(M+N) < R16/b0 | |
| 30 | b16_m1024_n1024_k8192 | 16 | 16 | 1024 | 1024 | 8192 | bf16 | bf16 | bf16 | False | False | False | True | 0 | b16_m1024_n1024_k8192 | ASW_Basic | Ascend950PR | batch_mat_mul_v3 | 32 | 1 | 2 | 2 | 1 | B->M->N线性映射+ASW滑窗蛇形(W=4) | 0 | 1 | 512 | 512 | 8192 | 128 | 1 | 双缓冲驻留当前tile输入 | 256 | 256 | 64 | allocate(输入驻留L2吸收重复读) | direct_gm(输出直写GM, 输入优先驻留L2) | 4 | 0 | A0 | 1 | 1 | 1 | 0 | 0 | 0 | 2 | True | 2 | tile枚举: P=2, 有界枚举最优 mCnt=2 x nCnt=2 (tile 512x512, 每batch搬入64.0MB, r=0); Base tile 256x256 (L0C 单缓冲方形用满); L2场景: B_单batch可驻留(全驻留或单侧驻留+对侧滑窗) (V_in=512.0MB, V_out=32.0MB, L2=128MB); 尾轮: r=0 无尾轮 | 536870912 | 536870912 | 0.00033554432 | 0.00010324440615384615 | 0.0004387887261538461 | 0.0 | 0.0 | 274877906944.0 | 0.0005655924011193416 | 33554432 | 2.097152e-05 | 0.0 | 0.0005655924011193416 | 0.0 | 0.0005655924011193416 | MMAD | True | 计算Bound | ASW_Basic兜底 (StreamK未过: 1_并行缺口: P=B*MN*4B/L0C <= C/2; 2_单核K段下限: K/grid_K >= 256B/dtype 且 grid_K>=2; 3_归约代价可接受) | |
| 31 | b4_m32768_n128_k128 | 4 | 4 | 32768 | 128 | 128 | bf16 | bf16 | bf16 | False | False | False | True | 0 | b4_m32768_n128_k128 | ASW_Basic | Ascend950PR | batch_mat_mul_v3 | 32 | 1 | 64 | 1 | 1 | B->M->N线性映射+ASW滑窗蛇形(W=4) | 0 | 1 | 512 | 128 | 128 | 128 | 1 | 双缓冲驻留当前tile输入 | 512 | 128 | 32 | allocate(输入驻留L2吸收重复读) | resident(整case全驻留S_A: 输出驻留L2异步回写, GM写=0) | 4 | 0 | A0 | 1 | 1 | 1 | 0 | 0 | 0 | 8 | True | 2 | tile枚举: P=8, 有界枚举最优 mCnt=64 x nCnt=1 (tile 512x128, 每batch搬入10.0MB, r=0); Base tile 512x128 (L0C 单缓冲方形用满); L2场景: A_整case全驻留(输入+输出<=L2) (V_in=32.1MB, V_out=32.0MB, L2=128MB); 尾轮: r=0 无尾轮 | 33685504 | 8257536 | 2.105344e-05 | 1.5879876923076922e-06 | 2.2641427692307692e-05 | 0.0 | 0.0 | 4294967296.0 | 8.837381267489712e-06 | 33554432 | 6.452775384615385e-06 | 0.0 | 2.2641427692307692e-05 | 0.0 | 2.2641427692307692e-05 | MTE2 | True | 访存Bound(GM读写共享+L2重复读) | ASW_Basic兜底 (StreamK未过: 1_并行缺口: P=B*MN*4B/L0C <= C/2; 2_单核K段下限: K/grid_K >= 256B/dtype 且 grid_K>=2; 3_归约代价可接受) | |
| 32 | b8_m32768_n2048_k512 | 8 | 8 | 32768 | 2048 | 512 | bf16 | bf16 | bf16 | False | False | False | True | 0 | b8_m32768_n2048_k512 | ASW_Basic | Ascend950PR | batch_mat_mul_v3 | 32 | 1 | 64 | 4 | 1 | B->M->N线性映射+ASW滑窗蛇形(W=4) | 0 | 1 | 512 | 512 | 512 | 128 | 1 | 双缓冲驻留当前tile输入 | 256 | 256 | 64 | allocate(输入驻留L2吸收重复读) | direct_gm(输出直写GM, 输入优先驻留L2) | 4 | 0 | A0 | 1 | 1 | 1 | 0 | 0 | 0 | 64 | True | 2 | tile枚举: P=4, 有界枚举最优 mCnt=64 x nCnt=4 (tile 512x512, 每batch搬入256.0MB, r=0); Base tile 256x256 (L0C 单缓冲方形用满); L2场景: B_单batch可驻留(全驻留或单侧驻留+对侧滑窗) (V_in=272.0MB, V_out=1024.0MB, L2=128MB); 尾轮: r=0 无尾轮 | 285212672 | 1862270976 | 0.00017825792 | 0.00035812903384615385 | 0.0005363869538461539 | 0.0 | 0.0 | 549755813888.0 | 0.0011311848022386832 | 1073741824 | 0.00067108864 | 0.0 | 0.0012074755938461538 | 0.0 | 0.0012074755938461538 | MTE2 | True | 访存Bound(GM读写共享+L2重复读) | ASW_Basic兜底 (StreamK未过: 1_并行缺口: P=B*MN*4B/L0C <= C/2; 2_单核K段下限: K/grid_K >= 256B/dtype 且 grid_K>=2; 3_归约代价可接受) | |
| 33 | b4_m131072_n128_k128 | 4 | 4 | 131072 | 128 | 128 | bf16 | bf16 | bf16 | False | False | False | True | 0 | b4_m131072_n128_k128 | ASW_Basic | Ascend950PR | batch_mat_mul_v3 | 32 | 1 | 256 | 1 | 1 | B->M->N线性映射+ASW滑窗蛇形(W=4) | 0 | 1 | 512 | 128 | 128 | 128 | 1 | 双缓冲驻留当前tile输入 | 512 | 128 | 32 | allocate(输入驻留L2吸收重复读) | direct_gm(输出直写GM, 输入优先驻留L2) | 4 | 0 | A0 | 1 | 1 | 1 | 0 | 0 | 0 | 32 | True | 2 | tile枚举: P=8, 有界枚举最优 mCnt=256 x nCnt=1 (tile 512x128, 每batch搬入40.0MB, r=0); Base tile 512x128 (L0C 单缓冲方形用满); L2场景: B_单batch可驻留(全驻留或单侧驻留+对侧滑窗) (V_in=128.1MB, V_out=128.0MB, L2=128MB); 尾轮: r=0 无尾轮 | 134348800 | 33423360 | 8.3968e-05 | 6.427569230769231e-06 | 9.039556923076924e-05 | 0.0 | 0.0 | 17179869184.0 | 3.534952506995885e-05 | 134217728 | 8.388608e-05 | 0.0 | 0.00017428164923076922 | 0.0 | 0.00017428164923076922 | MTE2 | True | 访存Bound(GM读写共享+L2重复读) | ASW_Basic兜底 (StreamK未过: 1_并行缺口: P=B*MN*4B/L0C <= C/2; 2_单核K段下限: K/grid_K >= 256B/dtype 且 grid_K>=2; 3_归约代价可接受) | |
| 34 | b8_m131072_n1024_k256 | 8 | 8 | 131072 | 1024 | 256 | bf16 | bf16 | bf16 | False | False | False | True | 0 | b8_m131072_n1024_k256 | ASW_Basic | Ascend950PR | batch_mat_mul_v3 | 32 | 1 | 256 | 2 | 1 | B->M->N线性映射+ASW滑窗蛇形(W=4) | 0 | 1 | 512 | 512 | 256 | 128 | 1 | 双缓冲驻留当前tile输入 | 256 | 256 | 64 | allocate(输入驻留L2吸收重复读) | direct_gm(输出直写GM, 输入优先驻留L2) | 4 | 0 | A0 | 1 | 1 | 1 | 0 | 0 | 0 | 128 | True | 2 | tile枚举: P=4, 有界枚举最优 mCnt=256 x nCnt=2 (tile 512x512, 每batch搬入256.0MB, r=0); Base tile 256x256 (L0C 单缓冲方形用满); L2场景: B_单batch可驻留(全驻留或单侧驻留+对侧滑窗) (V_in=516.0MB, V_out=2048.0MB, L2=128MB); 尾轮: r=0 无尾轮 | 541065216 | 1606418432 | 0.00033816576 | 0.00030892662153846154 | 0.0006470923815384616 | 0.0 | 0.0 | 549755813888.0 | 0.0011311848022386832 | 2147483648 | 0.00134217728 | 0.0 | 0.0019892696615384617 | 0.0 | 0.0019892696615384617 | MTE2 | True | 访存Bound(GM读写共享+L2重复读) | ASW_Basic兜底 (StreamK未过: 1_并行缺口: P=B*MN*4B/L0C <= C/2; 2_单核K段下限: K/grid_K >= 256B/dtype 且 grid_K>=2; 3_归约代价可接受) | |
| 35 | b16_m32768_n8192_k7168 | 16 | 16 | 32768 | 8192 | 7168 | bf16 | bf16 | bf16 | False | False | False | True | 0 | b16_m32768_n8192_k7168 | ASW_Basic | Ascend950PR | batch_mat_mul_v3 | 32 | 1 | 64 | 16 | 1 | B->M->N线性映射+ASW滑窗蛇形(W=4) | 0 | 1 | 512 | 512 | 7168 | 128 | 1 | 双缓冲驻留当前tile输入 | 256 | 256 | 64 | allocate(输入驻留L2吸收重复读) | direct_gm(输出直写GM, 输入优先驻留L2) | 4 | 0 | A0 | 1 | 1 | 1 | 0 | 0 | 0 | 512 | True | 2 | tile枚举: P=2, 有界枚举最优 mCnt=64 x nCnt=16 (tile 512x512, 每batch搬入14336.0MB, r=0); Base tile 256x256 (L0C 单缓冲方形用满); L2场景: B_单batch可驻留(全驻留或单侧驻留+对侧滑窗) (V_in=8960.0MB, V_out=8192.0MB, L2=128MB); 尾轮: r=0 无尾轮 | 9395240960 | 231122927616 | 0.0058720256 | 0.044446716849230766 | 0.05031874244923076 | 0.0 | 0.0 | 61572651155456.0 | 0.1266926978507325 | 8589934592 | 0.00536870912 | 0.0 | 0.1266926978507325 | 0.0 | 0.1266926978507325 | MMAD | True | 计算Bound | ASW_Basic兜底 (StreamK未过: 1_并行缺口: P=B*MN*4B/L0C <= C/2; 2_单核K段下限: K/grid_K >= 256B/dtype 且 grid_K>=2; 3_归约代价可接受) | |
| 36 | b4_m32768_n128_k8192 | 4 | 4 | 32768 | 128 | 8192 | bf16 | bf16 | bf16 | False | False | False | True | 0 | b4_m32768_n128_k8192 | ASW_Basic | Ascend950PR | batch_mat_mul_v3 | 32 | 1 | 64 | 1 | 1 | B->M->N线性映射+ASW滑窗蛇形(W=4) | 0 | 1 | 512 | 128 | 8192 | 192 | 1 | 双缓冲驻留当前tile输入 | 512 | 128 | 32 | allocate(输入驻留L2吸收重复读) | direct_gm(输出直写GM, 输入优先驻留L2) | 4 | 0 | A0 | 1 | 1 | 1 | 0 | 0 | 0 | 8 | True | 2 | tile枚举: P=8, 有界枚举最优 mCnt=64 x nCnt=1 (tile 512x128, 每batch搬入640.0MB, r=0); Base tile 512x128 (L0C 单缓冲方形用满); L2场景: B_单batch可驻留(全驻留或单侧驻留+对侧滑窗) (V_in=2056.0MB, V_out=32.0MB, L2=128MB); 尾轮: r=0 无尾轮 | 2155872256 | 528482304 | 0.00134742016 | 0.0001016312123076923 | 0.0014490513723076923 | 0.0 | 0.0 | 274877906944.0 | 0.0005655924011193416 | 33554432 | 2.097152e-05 | 0.0 | 0.0014700228923076922 | 0.0 | 0.0014700228923076922 | MTE2 | True | 访存Bound(GM读写共享+L2重复读) | ASW_Basic兜底 (StreamK未过: 1_并行缺口: P=B*MN*4B/L0C <= C/2; 2_单核K段下限: K/grid_K >= 256B/dtype 且 grid_K>=2; 3_归约代价可接受) | |
| 37 | b32_m131072_n8192_k128 | 32 | 32 | 131072 | 8192 | 128 | bf16 | bf16 | bf16 | False | False | False | True | 0 | b32_m131072_n8192_k128 | ASW_Basic | Ascend950PR | batch_mat_mul_v3 | 32 | 1 | 256 | 16 | 1 | B->M->N线性映射+ASW滑窗蛇形(W=4) | 0 | 1 | 512 | 512 | 128 | 128 | 1 | 双缓冲驻留当前tile输入 | 256 | 256 | 64 | allocate(输入驻留L2吸收重复读) | direct_gm(输出直写GM, 输入优先驻留L2) | 4 | 0 | A0 | 1 | 1 | 1 | 0 | 0 | 0 | 4096 | True | 2 | tile枚举: P=1, 有界枚举最优 mCnt=256 x nCnt=16 (tile 512x512, 每batch搬入1024.0MB, r=0); Base tile 256x256 (L0C 单缓冲方形用满); L2场景: B_单batch可驻留(全驻留或单侧驻留+对侧滑窗) (V_in=1088.0MB, V_out=65536.0MB, L2=128MB); 尾轮: r=0 无尾轮 | 1140850688 | 33218887680 | 0.00071303168 | 0.006388247630769231 | 0.007101279310769231 | 0.0 | 0.0 | 8796093022208.0 | 0.01809895683581893 | 68719476736 | 0.04294967296 | 0.0 | 0.05005095227076922 | 0.0 | 0.05005095227076922 | MTE2 | True | 访存Bound(GM读写共享+L2重复读) | IterBatch/MergeBatch 进入条件均不满足, 回落 ASW_Basic; IterBatch未过: 3_L1驻留形态(四选一, 核心要求: 单batch核内零重复读); MergeBatch未过: 1_batch关系与每核份额: BatchA==BatchB 且 b_core=B/C>=2*b0; 2_L0C容量: 2*(b0*M)*(b0*N)*4B <= L0C; 2b_L0AB容量: 合并后 b0*M/b0*N 在最小K粒度下可驻留 L0A/L0B; 5_访存Bound: 2MN/(M+N) < R16/b0 | |
| 38 | b64_m32768_n8192_k1536 | 64 | 64 | 32768 | 8192 | 1536 | bf16 | bf16 | bf16 | False | False | False | True | 0 | b64_m32768_n8192_k1536 | ASW_Basic | Ascend950PR | batch_mat_mul_v3 | 32 | 1 | 64 | 16 | 1 | B->M->N线性映射+ASW滑窗蛇形(W=4) | 0 | 1 | 512 | 512 | 1536 | 128 | 1 | 双缓冲驻留当前tile输入 | 256 | 256 | 64 | allocate(输入驻留L2吸收重复读) | direct_gm(输出直写GM, 输入优先驻留L2) | 4 | 0 | A0 | 1 | 1 | 1 | 0 | 0 | 0 | 2048 | True | 2 | tile枚举: P=1, 有界枚举最优 mCnt=64 x nCnt=16 (tile 512x512, 每batch搬入3072.0MB, r=0); Base tile 256x256 (L0C 单缓冲方形用满); L2场景: B_单batch可驻留(全驻留或单侧驻留+对侧滑窗) (V_in=7680.0MB, V_out=32768.0MB, L2=128MB); 尾轮: r=0 无尾轮 | 8053063680 | 198105366528 | 0.0050331648 | 0.03809718587076923 | 0.04313035067076923 | 0.0 | 0.0 | 52776558133248.0 | 0.10859374101491358 | 34359738368 | 0.02147483648 | 0.0 | 0.10859374101491358 | 0.0 | 0.10859374101491358 | MMAD | True | 计算Bound | IterBatch/MergeBatch 进入条件均不满足, 回落 ASW_Basic; IterBatch未过: 3_L1驻留形态(四选一, 核心要求: 单batch核内零重复读); MergeBatch未过: 1_batch关系与每核份额: BatchA==BatchB 且 b_core=B/C>=2*b0; 2_L0C容量: 2*(b0*M)*(b0*N)*4B <= L0C; 2b_L0AB容量: 合并后 b0*M/b0*N 在最小K粒度下可驻留 L0A/L0B; 5_访存Bound: 2MN/(M+N) < R16/b0 | |
| 39 | b8_m131072_n8192_k8192 | 8 | 8 | 131072 | 8192 | 8192 | bf16 | bf16 | bf16 | False | False | False | True | 0 | b8_m131072_n8192_k8192 | ASW_Basic | Ascend950PR | batch_mat_mul_v3 | 32 | 1 | 256 | 16 | 1 | B->M->N线性映射+ASW滑窗蛇形(W=4) | 0 | 1 | 512 | 512 | 8192 | 128 | 1 | 双缓冲驻留当前tile输入 | 256 | 256 | 64 | allocate(输入驻留L2吸收重复读) | direct_gm(输出直写GM, 输入优先驻留L2) | 4 | 0 | A0 | 1 | 1 | 1 | 0 | 0 | 0 | 1024 | True | 2 | tile枚举: P=4, 有界枚举最优 mCnt=256 x nCnt=16 (tile 512x512, 每batch搬入65536.0MB, r=0); Base tile 256x256 (L0C 单缓冲方形用满); L2场景: C_双侧超L2: 最小替换2D分组(组间落空GM, 窗口L2) (V_in=17408.0MB, V_out=16384.0MB, L2=128MB); 最小替换分组 m_grp=8x n_grp=8 (GM倍率3.76, 窗口L2/batch=57344.0MB); 尾轮: r=0 无尾轮 | 68719476736 | 481036337152 | 0.04294967296 | 0.09250698791384615 | 0.13545666087384614 | 0.0 | 0.0 | 140737488355328.0 | 0.2895833093731029 | 17179869184 | 0.01073741824 | 0.0 | 0.2895833093731029 | 0.0 | 0.2895833093731029 | MMAD | True | 计算Bound | ASW_Basic兜底 (StreamK未过: 1_并行缺口: P=B*MN*4B/L0C <= C/2; 2_单核K段下限: K/grid_K >= 256B/dtype 且 grid_K>=2; 3_归约代价可接受) | |
| 40 | b8_m16_n7168_k1536 | 8 | 8 | 16 | 7168 | 1536 | bf16 | bf16 | bf16 | False | False | False | True | 0 | b8_m16_n7168_k1536 | StreamK | Ascend950PR | batch_mat_mul_v3 | 32 | 1 | 1 | 2 | 2 | B/M/N切出16块, 每块2核切K归约 (归约组内核c负责K段[c*K/2,(c+1)*K/2)) | 1 | 1 | 16 | 3584 | 768 | 256 | 1 | K段标准分块流水 | 16 | 128 | 64 | allocate(部分和驻留L2) | resident(部分和4B驻留L2, 防精度丢失不随C的fp16/fp8转换) | 0 | 3670016 | grid_K=2路切K+归约 | 1 | 1 | 2 | 0 | 0 | 0 | 0 | True | 4 | P=14.00, grid_K=2, 部分和驻留L2按4B写出, AIV归约后按C dtype=2B写最终 | 176553984 | 393216 | 0.00011034624 | 7.561846153846153e-08 | 0.00011042185846153846 | 0.0 | 0.0 | 2818572288.0 | 5.799531456790123e-06 | 0.0 | 0.0 | 2.566079254079254e-07 | 0.00011042185846153846 | 2.566079254079254e-07 | 0.00011067846638694638 | MTE2 | True | 访存Bound(GM读写共享+L2重复读) | P<=C/2, B/M/N并行度买不满, 切K (grid_K=2) | |
| 41 | b64_m1024_n7168_k7168 | 64 | 64 | 1024 | 7168 | 7168 | bf16 | bf16 | bf16 | False | False | False | True | 0 | b64_m1024_n7168_k7168 | ASW_Basic | Ascend950PR | batch_mat_mul_v3 | 32 | 1 | 2 | 14 | 1 | B->M->N线性映射+ASW滑窗蛇形(W=4) | 0 | 1 | 512 | 512 | 7168 | 128 | 1 | 双缓冲驻留当前tile输入 | 256 | 256 | 64 | allocate(输入驻留L2吸收重复读) | direct_gm(输出直写GM, 输入优先驻留L2) | 4 | 0 | A0 | 1 | 1 | 1 | 0 | 0 | 0 | 56 | True | 2 | tile枚举: P=1, 有界枚举最优 mCnt=2 x nCnt=14 (tile 512x512, 每batch搬入392.0MB, r=0); Base tile 256x256 (L0C 单缓冲方形用满); L2场景: B_单batch可驻留(全驻留或单侧驻留+对侧滑窗) (V_in=7168.0MB, V_out=896.0MB, L2=128MB); 尾轮: r=0 无尾轮 | 7516192768 | 18790481920 | 0.00469762048 | 0.0036135542153846152 | 0.008311174695384616 | 0.0 | 0.0 | 6734508720128.0 | 0.013857013827423869 | 939524096 | 0.00058720256 | 0.0 | 0.013857013827423869 | 0.0 | 0.013857013827423869 | MMAD | True | 计算Bound | IterBatch/MergeBatch 进入条件均不满足, 回落 ASW_Basic; IterBatch未过: 3_L1驻留形态(四选一, 核心要求: 单batch核内零重复读); MergeBatch未过: 1_batch关系与每核份额: BatchA==BatchB 且 b_core=B/C>=2*b0; 2_L0C容量: 2*(b0*M)*(b0*N)*4B <= L0C; 2b_L0AB容量: 合并后 b0*M/b0*N 在最小K粒度下可驻留 L0A/L0B; 5_访存Bound: 2MN/(M+N) < R16/b0 | |
| 42 | b32_m8192_n8192_k7168 | 32 | 32 | 8192 | 8192 | 7168 | bf16 | bf16 | bf16 | False | False | False | True | 0 | b32_m8192_n8192_k7168 | ASW_Basic | Ascend950PR | batch_mat_mul_v3 | 32 | 1 | 16 | 16 | 1 | B->M->N线性映射+ASW滑窗蛇形(W=4) | 0 | 1 | 512 | 512 | 7168 | 128 | 1 | 双缓冲驻留当前tile输入 | 256 | 256 | 64 | allocate(输入驻留L2吸收重复读) | direct_gm(输出直写GM, 输入优先驻留L2) | 4 | 0 | A0 | 1 | 1 | 1 | 0 | 0 | 0 | 256 | True | 2 | tile枚举: P=1, 有界枚举最优 mCnt=16 x nCnt=16 (tile 512x512, 每batch搬入3584.0MB, r=0); Base tile 256x256 (L0C 单缓冲方形用满); L2场景: B_单batch可驻留(全驻留或单侧驻留+对侧滑窗) (V_in=7168.0MB, V_out=4096.0MB, L2=128MB); 尾轮: r=0 无尾轮 | 7516192768 | 112742891520 | 0.00469762048 | 0.021681325292307693 | 0.026378945772307694 | 0.0 | 0.0 | 30786325577728.0 | 0.06334634892536625 | 4294967296 | 0.00268435456 | 0.0 | 0.06334634892536625 | 0.0 | 0.06334634892536625 | MMAD | True | 计算Bound | IterBatch/MergeBatch 进入条件均不满足, 回落 ASW_Basic; IterBatch未过: 3_L1驻留形态(四选一, 核心要求: 单batch核内零重复读); MergeBatch未过: 1_batch关系与每核份额: BatchA==BatchB 且 b_core=B/C>=2*b0; 2_L0C容量: 2*(b0*M)*(b0*N)*4B <= L0C; 2b_L0AB容量: 合并后 b0*M/b0*N 在最小K粒度下可驻留 L0A/L0B; 5_访存Bound: 2MN/(M+N) < R16/b0 | |
| 43 | b8_m4096_n4096_k128 | 8 | 8 | 4096 | 4096 | 128 | bf16 | bf16 | bf16 | False | False | False | True | 0 | b8_m4096_n4096_k128 | ASW_Basic | Ascend950PR | batch_mat_mul_v3 | 32 | 1 | 8 | 8 | 1 | B->M->N线性映射+ASW滑窗蛇形(W=4) | 0 | 1 | 512 | 512 | 128 | 128 | 1 | 双缓冲驻留当前tile输入 | 256 | 256 | 64 | allocate(输入驻留L2吸收重复读) | direct_gm(输出直写GM, 输入优先驻留L2) | 4 | 0 | A0 | 1 | 1 | 1 | 0 | 0 | 0 | 16 | True | 2 | tile枚举: P=4, 有界枚举最优 mCnt=8 x nCnt=8 (tile 512x512, 每batch搬入16.0MB, r=0); Base tile 256x256 (L0C 单缓冲方形用满); L2场景: B_单batch可驻留(全驻留或单侧驻留+对侧滑窗) (V_in=16.0MB, V_out=256.0MB, L2=128MB); 尾轮: r=0 无尾轮 | 16777216 | 117440512 | 1.048576e-05 | 2.2584713846153845e-05 | 3.307047384615384e-05 | 0.0 | 0.0 | 34359738368.0 | 7.06990501399177e-05 | 268435456 | 0.00016777216 | 0.0 | 0.00020084263384615383 | 0.0 | 0.00020084263384615383 | MTE2 | True | 访存Bound(GM读写共享+L2重复读) | ASW_Basic兜底 (StreamK未过: 1_并行缺口: P=B*MN*4B/L0C <= C/2; 2_单核K段下限: K/grid_K >= 256B/dtype 且 grid_K>=2; 3_归约代价可接受) | |
| 44 | b128_m8192_n8192_k7168 | 128 | 128 | 8192 | 8192 | 7168 | bf16 | bf16 | bf16 | False | False | False | True | 0 | b128_m8192_n8192_k7168 | ASW_Basic | Ascend950PR | batch_mat_mul_v3 | 32 | 1 | 16 | 16 | 1 | B->M->N线性映射+ASW滑窗蛇形(W=4) | 0 | 1 | 512 | 512 | 7168 | 128 | 1 | 双缓冲驻留当前tile输入 | 256 | 256 | 64 | allocate(输入驻留L2吸收重复读) | direct_gm(输出直写GM, 输入优先驻留L2) | 4 | 0 | A0 | 1 | 1 | 1 | 0 | 0 | 0 | 1024 | True | 2 | tile枚举: P=1, 有界枚举最优 mCnt=16 x nCnt=16 (tile 512x512, 每batch搬入3584.0MB, r=0); Base tile 256x256 (L0C 单缓冲方形用满); L2场景: B_单batch可驻留(全驻留或单侧驻留+对侧滑窗) (V_in=28672.0MB, V_out=16384.0MB, L2=128MB); 尾轮: r=0 无尾轮 | 30064771072 | 450971566080 | 0.01879048192 | 0.08672530116923077 | 0.10551578308923078 | 0.0 | 0.0 | 123145302310912.0 | 0.253385395701465 | 17179869184 | 0.01073741824 | 0.0 | 0.253385395701465 | 0.0 | 0.253385395701465 | MMAD | True | 计算Bound | IterBatch/MergeBatch 进入条件均不满足, 回落 ASW_Basic; IterBatch未过: 3_L1驻留形态(四选一, 核心要求: 单batch核内零重复读); MergeBatch未过: 2_L0C容量: 2*(b0*M)*(b0*N)*4B <= L0C; 2b_L0AB容量: 合并后 b0*M/b0*N 在最小K粒度下可驻留 L0A/L0B; 5_访存Bound: 2MN/(M+N) < R16/b0 | |
| 45 | special_k1_b64 | 64 | 64 | 8192 | 512 | 1 | bf16 | bf16 | bf16 | False | False | False | True | 0 | special_k1_b64 | 特殊分支 | Ascend950PR | batch_mat_mul_v3 | 64 | 1 | 1 | 1 | 1 | AIV 核间按行均分 (无 Cube tile 概念) | 0 | 1 | 0 | 0 | 1 | 0 | 1 | UB驻留(AIV) AIV单缓冲 | 0 | 0 | 0 | allocate | direct_gm | 0 | 0 | 不涉及(AIV逐元素) | 1 | 1 | 1 | 0 | 0 | 0 | 0 | False | 2 | K=1逐元素乘: 退化为 C=A⊙B 无累加深度, Cube 16x16x16 粒度浪费 15/16; 走 AIV 通路 GM->UB->Mul->GM, AIV单缓冲 (B<2*AIV 逐batch单缓冲串行) | 1114112 | 0.0 | 6.9632e-07 | 0.0 | 6.9632e-07 | 0.0 | 0.0 | 268435456.0 | 9.92969696969697e-06 | 536870912 | 0.00033554432 | 0.0 | 0.00033624063999999996 | 0.0 | 0.00033624063999999996 | MTE2 | True | 访存Bound(GM读写共享+L2重复读) | K=1逐元素乘, 走AIV向量通路 |