Place Paper: Generalized grammar guidelines and structure-based generalization past classical equivariance for lexical duties and transduction


Compositional generalization is among the essential properties which differentiates lexical studying in people from state-of-art neural networks. We suggest a normal framework for constructing fashions that may generalize compositionally utilizing the idea of Generalized Grammar Guidelines (GGRs), a category of symmetry-based compositional constraints for transduction duties, which we view as a transduction analogue of equivariance constraints in physics-inspired duties. Moreover formalizing generalized notions of symmetry for language transduction, our framework is normal sufficient to comprise many current works as particular circumstances. We current concepts on how GGRs is perhaps applied, and within the course of draw connections to reinforcement studying and different areas of analysis.

Supply hyperlink


Please enter your comment!
Please enter your name here