Laser-induced breakdown spectroscopy (LIBS) models are extensively utilized for rapid elemental measurements in various scientific and industrial applications. However, elemental differences in different matrices can cause huge deviations in the captured spectra, constituting a major bottleneck for the wide application of LIBS technique. Therefore, we proposed an innovative fusion method named acoustic-optical spectra fusion laser induced breakdown spectroscopy (AOSF-LIBS) to compensate the spectral deviations due to LIBS matrix effects. Based on the standard spectral intensity calculation model, five main factors affected by the spectral difference of the matrix were analyzed, and the deviation between the ideal spectrum and the actual spectrum was calculated. Subsequently, the acoustic signals were transformed from the time domain (LIPA) to the time-frequency domain (acoustic spectrogram) to fully characterize the time-frequency evolution of the rapidly varying pressure wave generated by the plasma. Extract energy and area information from the acoustic spectrogram to characterize the total number density and plasma acquisition direction length. Fusing them with the plasma temperature, electron number density, and elemental interference calculated from the LIBS spectra, a spectral deviation mapping model was established to compensate the spectral deviation caused by matrix effect. To verify the wide adaptability of AOSF-LIBS, the spectral deviations of four matrices, including aluminum, iron, titanium, and nickel matrices, is corrected. After being compensated by AOSF-LIBS, the R2 were all improved to more than 0.98, and the root mean square error (RMSE), mean absolute percentage error (MAPE), and relative standard deviation (RSD) of the training set decreased dramatically by 11.42 %, 42.33 % and 3.22 % on average, and those of the test set decreased by 11.40 %, 41.13 and 2.84 % on average. And the ablation study was conducted to verify the contribution of the acoustic signal in the deviation compensation model. The experimental results show that AOSF-LIBS can effectively compensate the spectral deviations of different matrices and realize high-precision elemental quantitative measurement. Therefore, AOSF-LIBS is expected to further promote the application of LIBS for elemental quantification.