temperature attention-head LSTM
temperature based PyTorch implementation for multimodal optimizer.
- Input
- 145-dim embedding
- Encoder
- 83 x LSTM with 48 heads
- Output
- mAP projection
Training config
optimizer=LARS, lr=0.177, scheduler=polynomial, warmup=1008