How to perform initialization?

[hy5468]

Hi,

This is impressive work. I wonder if we should adopt normalized Gaussian initialization for Pion as POET do. If so, which normalization shall we use: L2, spectral or Frobenius norm?

Best regards

[KexuanShi]

Hi @hy5468,

Thank you for your interest and kind words about our work!

To answer your question, we directly used the standard Gaussian initialization for Pion. In our experiments, we observed that whether the initialization is normalized or not does not make a significant difference in performance. This difference in behavior compared to POET is reasonable, as the training dynamics between Pion and POET are inherently different.

Also, we will be releasing our optimizer code very soon. Stay tuned!

Best regards,
Kexuan

[hy5468]

Hi @hy5468,

Thank you for your interest and kind words about our work!

To answer your question, we directly used the standard Gaussian initialization for Pion. In our experiments, we observed that whether the initialization is normalized or not does not make a significant difference in performance. This difference in behavior compared to POET is reasonable, as the training dynamics between Pion and POET are inherently different.

Also, we will be releasing our optimizer code very soon. Stay tuned!

Best regards, Kexuan

Can’t wait any longer, haha! A preview version would really help with our implementation.

[KexuanShi]

Thank you for your interest and patience. We have just uploaded the RL code of Pion as a preview version. Hope it helps with your implementation!