Stephen Downes

Knowledge, Learning, Community

One of the key questions in learning and technology, from my perspective, is whether a neural network needs domain knowledge in order to function effectively. This article summarizes a paper describing an effort to create an effective conversational tool that operates without domain knowledge, "a bot that is trained on conversational data, and only conversational data: no programmed understanding of the domain at all, just lots and lots of sample conversations." As we see from the examples, "The surprising thing is just how well it works." It's far enough from reliable, though, that the author concludes "any real service is going to need to some more complex logic wrapped around it."

You might be asking, why is this question so important? The answer is complex, but in a nutshell, if we require domain knowledge in order to learn, then we require memorization; by contrast, if learning can be accomplished without domain knowledge, then it can be accomplished by practice alone, without memorization. You might say "so who cares? Just memorize some stuff." You could do this, but this makes it a lot harder for the learner to correct memorized stuff that is wrong, and makes them less able to learn on their own or think critically. The learner's knowledge becomes based more on their pre-constructed model or representation of the world, not experience or evidence. So if you can get to the same place without rote memorization, that would be preferable.

Today: 1064 Total: 1075 [Direct link] [Share]

Image from the website
View full size


Stephen Downes Stephen Downes, Casselman, Canada
stephen@downes.ca

Copyright 2024
Last Updated: Mar 29, 2024 11:48 a.m.

Canadian Flag Creative Commons License.

Force:yes