Bayesian Semi-structured Subspace Inference. (arXiv:2401.12950v1 [cs.LG])

0
33


Semi-structured regression fashions allow the joint modeling of interpretable
structured and complicated unstructured characteristic results. The structured mannequin half
is impressed by statistical fashions and can be utilized to deduce the input-output
relationship for options of explicit significance. The advanced unstructured
half defines an arbitrary deep neural community and thereby supplies sufficient
flexibility to attain aggressive prediction efficiency. Whereas these fashions
may account for aleatoric uncertainty, there’s nonetheless a scarcity of labor on
accounting for epistemic uncertainty. On this paper, we handle this drawback by
presenting a Bayesian approximation for semi-structured regression fashions utilizing
subspace inference. To this finish, we lengthen subspace inference for joint
posterior sampling from a full parameter house for structured results and a
subspace for unstructured results. Other than this hybrid sampling scheme, our
technique permits for tunable complexity of the subspace and might seize a number of
minima within the loss panorama. Numerical experiments validate our method’s
efficacy in recovering structured impact parameter posteriors in
semi-structured fashions and approaching the full-space posterior distribution of
MCMC for growing subspace dimension. Additional, our method displays
aggressive predictive efficiency throughout simulated and real-world datasets.



Supply hyperlink

LEAVE A REPLY

Please enter your comment!
Please enter your name here