Projects
SSE: Stable Static Embedding Model series
A lightweight and high-speed sentence embedding model.
While traditional static embedding models have faced challenges regarding the trade-off between parameter count and inference speed, this model utilizes Separable Dynamic Tanh (DyT) to control gradient flow and achieve regularization of the representation space.
Regularization of Representation Space and Performance Improvement via Hyperparameter Optimization
SEA Model series
The goal is to develop high-accuracy, high-speed language models through original improvements to projection representations and model architectures.
Saint Iberis
Saint Lupinus
