Abstract: Generalized low-density parity-check (GLDPC) codes, where single parity-check constraints on the code bits are replaced with generalized constraints (an arbitrary linear code), are a ...

Abstract: Artificial intelligence (AI) provides an alternative way to design channel coding with affordable complexity. However, most existing studies can only learn codes for a given size and rate, ...

Implementation of "Breaking the Low-Rank Dilemma of Linear Attention" The Softmax attention mechanism in Transformer models is notoriously computationally expensive, particularly due to its quadratic ...

Don't be Dense, SLiCE the Cost! Structured Linear Controlled Differential Equations (SLiCEs) are a new class of sequence models that combine the maximal expressivity (i.e., universality) of dense, ...