Photonic neural networks (PNNs) are promising to replace conventional deep learning hardware due their potentially higher energy efficiency and computational speed. Other than the fast progress on optical linear transformer, nonlinear activators much less mature. Usually, employ mapping from input amplitude output amplitude, which is limited by high threshold loss, or rely additional bias volta...