I guess math is uniquely suited for this kind of strategy, but would you say it translates to learning concepts in other domains too?
I was thinking about whether something like "what is X?" -> "What field is X used in?", which seems to form a hierarchy for me, would benefit of this technique? Personally, I found that for something like the preceding example, I could answer the second question without thinking about what X is at all, just by rote memorization of the wording. Happened to me quite a lot when I was using Anki. And actually, I guess this is even acceptable in some way, since the question is not about activating "what X is", but "what X is used in". What I am trying to express: I feel like I would not necessarily activate a parent concept by answering a child concept, and I think that might be true for a lot of questions outside math problems, although they form a hierarchy. So I am wondering what you think about the general applicability of this technique...
Please don't take all of this questioning wrong, I think you are doing pretty cool stuff, and I am grateful for everyone trying to push the boundaries of current SRS approaches :-)!
Yeah, you're right that the power of this strategy comes from leveraging the hierarchical / highly-encompassed nature of the structure of mathematical knowledge. If you have a knowledge domain that lacks a serious density of encompassings, there's just a hard limit to how much review you can "knock out" implicitly.
> I feel like I would not necessarily activate a parent concept by answering a child concept, and I think that might be true for a lot of questions outside math problems, although they form a hierarchy.
This is where it's really important to distinguish between "prerequisite" vs "encompassing." Admittedly I probably should have explained this better in the article, but you are right, prerequisites are not necessarily activated. If you do FIRe on a prerequisite graph, pretending prerequisites are the same as encompassings, then you're going to get a lot of incorrect repetition credit trickling down.
We actually faced that issue early on, and the solution was that I just had to go through and manually construct an "encompassing graph" by encoding my domain-expert knowledge, which was a ton of work, just like manually constructing the prerequisite graph. You can kind of think of the prerequisite graph as a "forwards" graph, showing what you're ready to learn next, and the encompassing graph as a "backwards" graph, showing you how your work on later topics should trickle back to award credit to earlier topics.
Manually constructing the encompassing graph was a real pain in the butt and I spent lots of time just looking at topics asking myself "if a student solves problems in the 'post'-requisite topic, does that mean we can be reasonably sure they truly know the prerequisite topic? Like, sure, it makes sense that a student needs to learn the prerequisite beforehand in order for the learning experience to be smooth, but is the prerequisite really a component skill here that we're sure the student is practicing?" Turns out there are many cases where the answer is "no" -- but there are also many cases where the answer is "yes," and there are enough of those cases to make a huge impact on learning efficiency if you leverage them.
I still have to make updates to the encompassing graph every time we roll out a new topic, or tweak an existing topic. Having domain expertise about the knowledge represented in the graph is absolutely vital to pull this off. (In general, our curriculum director manages the prerequisite graph, and I manage the encompassing graph.)
Happy to answer any more questions if you've got any! :)
I guess math is uniquely suited for this kind of strategy, but would you say it translates to learning concepts in other domains too?
I was thinking about whether something like "what is X?" -> "What field is X used in?", which seems to form a hierarchy for me, would benefit of this technique? Personally, I found that for something like the preceding example, I could answer the second question without thinking about what X is at all, just by rote memorization of the wording. Happened to me quite a lot when I was using Anki. And actually, I guess this is even acceptable in some way, since the question is not about activating "what X is", but "what X is used in". What I am trying to express: I feel like I would not necessarily activate a parent concept by answering a child concept, and I think that might be true for a lot of questions outside math problems, although they form a hierarchy. So I am wondering what you think about the general applicability of this technique...
Please don't take all of this questioning wrong, I think you are doing pretty cool stuff, and I am grateful for everyone trying to push the boundaries of current SRS approaches :-)!