IEEE

Efficient Precision-Adjustable Architecture for Softmax Function in Deep Learning

Abstract: The softmax function has been widely used in deep neural networks (DNNs), and studies on efficient hardware accelerators for DNN have also attracted tremendous attention. However, it is very ...
IEEE

Dual Balanced Class-Incremental Learning With im-Softmax and Angular Rectification

Abstract: Owing to the superior performances, exemplar-based methods with knowledge distillation (KD) are widely applied in class incremental learning (CIL). However, it suffers from two drawbacks: 1) ...
GitHub

Simple Softmax-free Attention for Vision Transformer (SimA)

@misc{https://doi.org/10.48550/arxiv.2206.08898, doi = {10.48550/ARXIV.2206.08898}, url = {https://arxiv.org/abs/2206.08898}, author = {Koohpayegani, Soroush Abbasi ...
GitHub

TFLearn: Deep learning library featuring a higher-level API for TensorFlow.

TFlearn is a modular and transparent deep learning library built on top of Tensorflow. It was designed to provide a higher-level API to TensorFlow in order to facilitate and speed-up experimentations, ...