My first question to you is about your definition/operationalization of "understanding": "Is it possible for language models to achieve truly robust and general capabilities to answer questions, reason with language, and translate between languages?" >>
Why do you find this a satisfying definition of "understanding"? Also, how do you detect "reason[ing] with language" as distinct from manipulating form, but without doing any reasoning?
My second question is: Do you think that calling the above "understanding" is perhaps an overclaim? How would you reply to someone who thinks it feeds into AI hype?
Finally, regarding "we would be hard-pressed to define necessary and sufficient inputs for successful human language learning", I think there is a clear necessary and sufficient input: Joint attention. (Which can be achieved with different modalities.)
You can follow @emilymbender.
Tip: mention @twtextapp on a Twitter thread with the keyword “unroll” to get a link to it.

Latest Threads Unrolled: