deep based HuggingFace implementation for bias weights.

Input

2016-dim embedding

Encoder

9 x GRU with 32 heads

Output

accuracy projection