QuantGroupedGemmHostArgs Struct Reference

QuantGroupedGemmHostArgs Struct Reference#

Composable Kernel: ck_tile::QuantGroupedGemmHostArgs Struct Reference
Public Member Functions | Public Attributes | List of all members
ck_tile::QuantGroupedGemmHostArgs Struct Reference

The Grouped GEMM kernel host arguments. More...

#include <grouped_gemm_quant_kernel.hpp>

Public Member Functions

CK_TILE_HOST QuantGroupedGemmHostArgs (const void *a_ptr_, const void *b_ptr_, void *e_ptr_, const void *aq_ptr_, const void *bq_ptr_, index_t k_batch_, index_t M_, index_t N_, index_t K_, index_t QK_A_, index_t QK_B_, index_t stride_A_, index_t stride_B_, index_t stride_E_, index_t stride_AQ_, index_t stride_BQ_)

Public Attributes

const void * a_ptr
const void * b_ptr
const void * aq_ptr
const void * bq_ptr
union { 
   void *   e_ptr 
   void *   c_ptr 
}; 
index_t M
index_t N
index_t K
index_t QK_A
index_t QK_B
index_t stride_A
index_t stride_B
index_t stride_AQ
index_t stride_BQ
union { 
   index_t   stride_E 
   index_t   stride_C 
}; 
index_t k_batch

Detailed Description

The Grouped GEMM kernel host arguments.

Overview
This structure is passed to GroupedGemmKernel when creating kernel arguments object. It contain all necessary information required to build proper kernel argument and launch kernel on GPU. This structure defines the GEMM problem configuration by stating all required information like M,N,K sizes and respective strides.

Constructor & Destructor Documentation

◆ QuantGroupedGemmHostArgs()

CK_TILE_HOST ck_tile::QuantGroupedGemmHostArgs::QuantGroupedGemmHostArgs ( const void * a_ptr_,
const void * b_ptr_,
void * e_ptr_,
const void * aq_ptr_,
const void * bq_ptr_,
index_t k_batch_,
index_t M_,
index_t N_,
index_t K_,
index_t QK_A_,
index_t QK_B_,
index_t stride_A_,
index_t stride_B_,
index_t stride_E_,
index_t stride_AQ_,
index_t stride_BQ_ )
inline

Member Data Documentation

◆ [union]

union { ... } ck_tile::QuantGroupedGemmHostArgs

◆ [union]

union { ... } ck_tile::QuantGroupedGemmHostArgs

◆ a_ptr

const void* ck_tile::QuantGroupedGemmHostArgs::a_ptr

◆ aq_ptr

const void* ck_tile::QuantGroupedGemmHostArgs::aq_ptr

◆ b_ptr

const void* ck_tile::QuantGroupedGemmHostArgs::b_ptr

◆ bq_ptr

const void* ck_tile::QuantGroupedGemmHostArgs::bq_ptr

◆ c_ptr

void* ck_tile::QuantGroupedGemmHostArgs::c_ptr

◆ e_ptr

void* ck_tile::QuantGroupedGemmHostArgs::e_ptr

◆ K

index_t ck_tile::QuantGroupedGemmHostArgs::K

◆ k_batch

index_t ck_tile::QuantGroupedGemmHostArgs::k_batch

◆ M

index_t ck_tile::QuantGroupedGemmHostArgs::M

◆ N

index_t ck_tile::QuantGroupedGemmHostArgs::N

◆ QK_A

index_t ck_tile::QuantGroupedGemmHostArgs::QK_A

◆ QK_B

index_t ck_tile::QuantGroupedGemmHostArgs::QK_B

◆ stride_A

index_t ck_tile::QuantGroupedGemmHostArgs::stride_A

◆ stride_AQ

index_t ck_tile::QuantGroupedGemmHostArgs::stride_AQ

◆ stride_B

index_t ck_tile::QuantGroupedGemmHostArgs::stride_B

◆ stride_BQ

index_t ck_tile::QuantGroupedGemmHostArgs::stride_BQ

◆ stride_C

index_t ck_tile::QuantGroupedGemmHostArgs::stride_C

◆ stride_E

index_t ck_tile::QuantGroupedGemmHostArgs::stride_E
The documentation for this struct was generated from the following file: