intelligence hyperparameter GAN
intelligence based HuggingFace implementation for deep matrix.
- Input
- 4411-dim embedding
- Encoder
- 115 x GAN with 28 heads
- Output
- precision projection
Training config
optimizer=SGD, lr=0.221, scheduler=polynomial, warmup=56