Discover and read the best of Twitter Threads about #compositionality
Most recents (4)
"Compositionality in Vector Space Models of Meaning"
Today's SFI Seminar by @marthaflinders, streaming:
Follow this 🧵 for highlights!
Today's SFI Seminar by @marthaflinders, streaming:
Follow this 🧵 for highlights!
"Scientists gather here
Santa Fe Institute, oh so near
Inquiring minds seek truth"
#haiku about SFI c/o @marthaflinders & #ChatGPT
...but still, #AI fails at simple tasks:
Santa Fe Institute, oh so near
Inquiring minds seek truth"
#haiku about SFI c/o @marthaflinders & #ChatGPT
...but still, #AI fails at simple tasks:
"One way to represent the kind of #compositionality we want to do is with this kind of breakdown...eventually a kind of representation of a sentence. On the other hand, vector space models of #meaning or set-theoretical models put into a space have been very successful..."
This is an important point about construction grammar and #compositionality. (And a very nice paper!)
To add to this, I find that a nice illustration of the way constructions and composition go hand in hand is child language acquisition. Acquisition mixes memorisation of constructions with abstraction processes, in a way that eventually accounts for productive syntax.
I personally got a lot from Tomasello's "Construction Grammar For Kids" (2006): it describes how kids learn context-dependent schemas and how distributional analysis over such schemas progressively contributes to more complex production of novel utterances.
Here's a thread surveying some 'classic' work on #compositionality. Lots of people seem to be discussing this right now, but with partial references to the whole story. My aim is to highlight some of the philosophical and psychological issues in the history of the concept. 1/
Small recap first... There are two principles usually associated with #compositionality, both (possibly incorrectly) attributed to Frege. See Pelletier's "Did Frege believe in Frege's principle?" (2001). 2/
1) Bottom-up, the 'compositionality principle': "... an important general principle which we shall discuss later under the name Frege's Principle, that the meaning of the whole sentence is a function of the meanings of its parts.'" Cresswell (1973) 3/
Slides done! 106 slides does seem a tad excessive for 30 mins though. I can't bear to drop anything! #appliedcategorytheory #compositionality
There's some solid tech content here: compositionality, monoids, categories, operads, monoidal categories, + the graphical language of string & wiring diagrams.
But the whole talk is pretty diagrams! #act is a lot of fun.
But the whole talk is pretty diagrams! #act is a lot of fun.
I actually think there's a reasonably chance that people who don't know any category theory will get a lot out of this talk. I hope so.
