ABC Hints&Tips Overviews Reference Glossary Support Contents : Overviews
 Forgetting index

You can choose the speed of learning

Forgetting index is the proportion of elements that are not remembered at repetitions. It is usually expressed as percentage. For example, if you choose the forgetting index equal 10%, SuperMemo will try to make sure that you remember 90% of elements during repetitions. The higher the forgetting index the faster you learn but ... the less you remember! You can choose the default forgetting index with Tools : Options : Learning : Forgetting index.

Extreme values of the forgetting index can be frustrating

SuperMemo makes it possible to choose a forgetting index in the range from 3% to 20%. Very often users of SuperMemo ask why there is a limitation on this range. We are aware that many of you would be tempted to set the forgetting index to 1% or even 0%. This would only result in unnecessary waste of time. Forgetting index equal 0% would mean that the intervals between repetitions should equal 0. If you decided to choose the forgetting index equal 1%, the repetitions would be so frequent that you would probably be discouraged to ever come back to SuperMemo without ever discovering its power. In addition, the spacing effect would make your memories very weak.

If you do not have much experience with SuperMemo, you should set the forgetting index to 10%. This is a value that is also important for psychological reasons. If the forgetting index is too high, your repetitions will be stressful due to constant problems with recall. Your material will seem very difficult to remember. This is quite frustrating. On the other hand, if the forgetting index is too low, your repetitions will be annoyingly frequent. You will experience a sense of wasting your time on needless repetition.

 If you feel you remember too little, reduce the forgetting index. If you feel you repeat too often, increase the forgetting index. In most cases the value of 8%-12% would be best

Changing the forgetting index

1. You change the default forgetting index for your collection with Tools : Options : Learning : Forgetting index
2. You can also change the forgetting index of individual elements with Element parameters dialog box (Ctrl+Shift+P). This way you can reduce the forgetting index of elements that you consider very important
3. You can change the default forgetting index of a given category by setting its Forgetting index field (e.g. in Search : Categories). Use zero for the category forgetting index to equal the default forgetting index

Forgetting indexes used in SuperMemo

It is easy to confuse some terminology related to the forgetting index. Here is a short glossary:

• requested forgetting index - forgetting index that you want to achieve in learning. You ask SuperMemo to plan repetitions in such a way that your requested forgetting index reaches a given value. The requested forgetting index may be set for individual items (see: individual forgetting index) or for many items at once. To change the forgetting index for many elements, you can use the default forgetting index (see below) or branch operations in the contents window (Contents : Process branch : Forgetting index)
• measured forgetting index - forgetting index that is actually detected at repetitions. It is displayed in the statistics window as Measured FI. Measured forgetting index is usually higher than the requested forgetting index, esp. if the forgetting index is less than 5%. This comes from the fact that SuperMemo imposes some limitations on the length of intervals that are to prevent excessively frequent repetitions. Secondly, if you delay repetitions, skip repetitions on a given day or use Mercy, you step away from the optimum learning process and inevitably increase the measured forgetting index. You can start measuring your forgetting index anew with File : Reset : Forgetting index record
• default forgetting index - requested forgetting index set for all items with the default individual forgetting index by means of Tools : Options : Learning : Forgetting index
• category forgetting index - requested forgetting index used in a given category. If it is set to zero, it is assumed to be the same as the default forgetting index
• individual forgetting index - requested forgetting index set for individual items. It can be seen in the Element data window. It can be set with Element parameters dialog box (Ctrl+Shift+P). You can also set forgetting indexes for the entire branch in the contents window with Process branch : Forgetting index
• (optional) expected forgetting index - expected probability of forgetting for a given element at a given moment of time. Used internally by SupeMemo Algorithm
• (optional) estimated forgetting index - value of the forgetting index derived from the grade on the base of the correlation graph showing the relationship between an expected forgetting index and the average grade obtained at repetitions (G-FI graph). Used internally by the SuperMemo Algorithm

Your actual retention is higher than indicated by the forgetting index

If you set your forgetting index to 10%, you will remember 90% of the material at repetitions but it does not mean your knowledge retention will stay at 90%. Your average retention will be nearly 95%! This comes from the fact that 90% refers to the retention at repetition while the original retention right after the repetition is theoretically 100%. During the inter-repetition interval, retention is decreasing from 100% to 90% on average you remember 95% of the material. The exact formula linking the forgetting index with the retention has the following shape (source):

retention = -(forgetting index)/ln(1-(forgetting index))

 Forgetting index Retention 3% 98.49% 5% 97.47% 10% 94.91% 15% 92.29% 20% 89.62%

The reason that the retention is not equal to 1-0.5*(forgetting index) is that forgetting is exponential in nature, i.e. immediately after the repetition, forgetting proceeds at the highest speed

Do you know that?

• you can sort elements for the forgetting index by clicking the FI column in the element browser (browsers are available from the View menu)
• you can search for elements with a given requested forgetting index by means of View : Special : Filter
• you can see how SuperMemo plots the forgetting curve graphs and determines the length of the interval using the forgetting index. Try Tools : Statistics : Analysis : Curves
• you can see correlations between the forgetting index and other learning parameters that have been measured in a group of 30 students
• the concept of the forgetting index was only introduced in SuperMemo 6 for DOS in 1991
• individual forgetting indexes are kept in the file elinfo.dat, the default forgetting index is kept in <collection name>.kno file, and category forgetting indices are kept in the category registry (see: files used by SuperMemo)

(Tomasz Szynalski, Poland, Oct 18, 1998)
Question:
What value of the forgetting index ensures the optimum ratio of (retention)/(time spent per day)?

Paradoxically, the highest speed of learning can be accomplished ... without SuperMemo! In our daily life we pick up lots of facts that stay in our memory for long with few repetitions in lifetime! The problem is that these are usually not exactly the facts or rules that are critical to our goals. In other words, not the speed of acquiring new items counts but the speed of acquiring new items bearing a given content.

It is difficult to determine exactly what forgetting index brings the highest acquisition rate. Simulation experiments have consistently pointed to the value of 25-30%. You can even plot speed-vs.-forgetting graph using your own actual learning material in SuperMemo 98 using Tools : Statistics : Simulation. You will probably also arrive to similar results

As you perhaps know, SuperMemo disallows of the forgetting index above 20%. This comes from the fact that you should aim at achieving high speed of learning combined with high retention of the learned material. Setting the forgetting index above 20% would be like giving up SuperMemo altogether and coming back to remembering only that what is easy to remember. In highly interlinked material where new knowledge depends on the previously acquired knowledge, high forgetting rate can even be more harmful

Nevertheless, if you want to maximize the speed of learning with little control over what actually stays in your memory, set the forgetting index to 20%

(Tomasz Szynalski, Poland, Oct 18, 1998)
Question:
What retention can I obtain with the forgetting index set to 9%? What if I then change it to 12%?

If you accomplish the forgetting index of 9%, the retention will equal 95.4% (see the formula above). For 12%, the same figure will be 93.9%. Note that if your material is very difficult, your measured forgetting index may be higher than the requested forgetting index. This comes from the fact that SuperMemo imposes some boundary conditions on the increase of intervals. Elements that have been forgotten more than five times should be reformulated with a view to reducing their difficulty or increasing their mnemonic component.

If you initially set the forgetting index to 9% and later on increase it to 12%, you will probably start with retention of 94-95% which will later gradually decrease to 92-93% (after the change)

(Peter Cool, The Netherlands, Nov 6, 1998)
Question:
I started with SuperMemo 70 days ago (your French plus some words added by me; total 1000 words). In the first weeks I made a lot of mistakes so my measured forgetting index was 20%. Although I make very few mistakes now during repetitions the forgetting index decreases very slowly. Is this normal?
The measured forgetting index includes the record of all repetitions made since you started learning. That is why it changes at an ever decreasing rate. If your performance is good and you would like to more accurately check your current forgetting index, you might reset the forgetting index measurements with File : Tools : Reset parameters : Forgetting index record. It will not affect the learning process per se

(Manfred Kremer, Germany, Sep 7, 1998)
Question:
I noticed that frequently I get Optimum Interval in the element data window shorter than the last interval displayed as Interval. Is it a bug in SuperMemo?
No. If your forgetting index is very low, e.g. 3%, SuperMemo will often conclude that you will stand 97% chance of remembering a given element only if your next interval is shorter than the presently used one. In such cases, it will not accept the new value and the new interval will be at least 5% longer than the previous interval. Please note that the forgetting index equal 3% should only be used for selected high-priority items. Keeping the forgetting index at this level throughout the collection will make repetitions annoying frequent and ineffective

(David Mckenzie, New Zealand, Apr 8, 1998)
Question:
Why does not the first repetition after forgetting occur the next day after the unsuccessful repetition (this is advised by Tony Buzan and others)?

In SuperMemo, the length of the first interval is computed from the forgetting curve plotted in the course of repetitions. This is to make sure that a defined proportion of items is remembered (usually 80-97%). This proportion is programmed by means of the forgetting index. Depending on the forgetting index, the length of the first interval may range from 1 to 20 days, and is not set arbitrarily. It is computed from the record of repetitions and determined by the desired forgetting index (requested forgetting index is the proportion of items that are not remembered at repetitions). While Buzan�s recommendation is valid in many cases, you should not forget that SuperMemo computes intervals with a high degree of accuracy that cannot otherwise be easily achieved

(David Mckenzie, New Zealand, Apr 8, 1998)
Question:
Is there any point in keeping collections separate?

No. Once you master contents categories and templates, there is no point. You gain global search, global registries, global repetitions, global optimization, etc. This would not be advisable in SuperMemo 7 as item difficulty measure (E-factor) was dependent on the average difficulty of items in the collection. Presently, the item difficulty measure (A-Factor, or absolute difficulty factor) is absolute and does not depend on the context in which an item is placed. Only the length of the first interval will significantly be affected by the average difficulty of items in the collection. However, this shall not bear dramatically on the speed of learning. Especially that variable forgetting index for individual items makes it possible to set different first intervals for whole contents categories or branches of the knowledge tree

(Noel Clary, USA, Aug 17, 1998)
Question:
I have created my own database on plumbing and air conditioning. My forgetting index is quite high. Are there any tools in SuperMemo which could help me remedy this situation?

You might want to use View : Other browsers : Leeches and locate the elements that cause most problems in learning. You must then go into your own mind to answer the question why these elements are hard to recall. Usually these are too complex, too long, too boring or too similar to other elements in the same collection. You can also send 3-4 most difficult items to us for review to receive some suggestions. Read more: Leeches, and 20 Rules of Formulating Knowledge

(Matt Cassidy, New Zealand, Sep 11, 1997)
Question:
Is it possible that with forgetting index equal to 3% I get the first interval equal to 6 days?
Yes. Especially if the material you work with is relatively easy. You should also remember about the random dispersion of intervals. In isolated cases, dispersion might produce intervals substantially longer (or shorter) than the optimum interval. For more read about SuperMemo Algorithm

Question:
Tony Buzan claims that 75% of information is lost if not reviewed in 24 hours. Does it not defeat the validity of SuperMemo in which the first interval is often longer than a week?

No. Buzan's claim may refer to textbook knowledge or complex knowledge structures (e.g. large mind maps). However, it does not seem accurate in reference to simple well-structured material in the light of results obtained with SuperMemo. In SuperMemo, if the student chooses the retention of 95%, the typical value of the first interval falls in the range 2-5 days depending on the student and the difficulty of the learned material. For retention 25%, the same interval might be as long as one month, though it cannot be verified experimentally with SuperMemo which limits the range of the forgetting index from 3-20%, which implies the overall retention in the range of 89-99%. For more see: Theoretical background of SuperMemo

Question:
I used SuperMemo 2 shareware, and was accustomed to repeating forgotten items on the next day. It is very irritating that in new SuperMemo, I do not have this possibility

SuperMemo will schedule forgotten items in intervals that are determined by the forgetting index. The greatest increase in the speed of learning in newer versions of SuperMemo as compared with SuperMemo 2 resulted from substantially increasing the length of the first interval. The student may be left with the feeling that he is likely to forget the item again if it is not repeated on the next day. Statistically, however, he will forget no more than the proportion defined by the forgetting index. By reducing the forgetting index to less than 5%, the length of the first interval is likely to drop to 1-2 days in most cases. Moreover, if you are particular about repeating a given item on the next day, you can choose Ctrl+M to memorize or rememorize an item with a selected first interval

Question:
I have an exam for a driver's license in 2 weeks. How can I best memorize the Traffic Regulations collection for SuperMemo? How can I increase the frequency of repetitions?

Although SuperMemo is not a cramming tool, and it would be much safer to start 2-3 months before the exam, the following shall work pretty well: (1) Set Tools : Options : Learning : Forgetting index at 3%. (2) When memorizing difficult items, choose Ctrl+M and provide the first interval value equal to one day. (3) Memorize the collection in equal portions in the period spanning from today to 2-4 days before the exam. Use Tools : Random review intensely over the last 2-4 days

You can easily change the forgetting index from the keyboard (#5737)
(Jiri Pik, Czech Republic, Sat, Jun 16, 2001 16:59)
Question:
I find that changing the forgetting index of an element is pretty time-consuming without any keyboard shortcut
You can use Ctrl+Shift+P to open Element Parameters dialog box and Alt+F to get to the forgetting index field

Retention statistic assumes regular repetitions and well-structured learning material (#6918)
(dansujp, Sun, Sep 16, 2001 3:07 PM)
Question:
When I returned from vacation, I expected the retention to be something like 80% because I have not done any repetitions for two weeks. But it was exactly the same as before I left
The Retention statistic is derived directly from the measured forgetting index on the assumption of a negatively exponential forgetting curve. This curve is only representative of well-structured learning material. In addition, the forgetting index measurements are averaged over all recorded cases. A break in repetitions will invalidate the statistic. Resuming repetitions is not a guarantee of accuracy as the large number of earlier repetitions will result in overestimating the retention on a small-sample measurement. The only valid estimation of retention after a break in learning is the one that follows resetting the past forgetting index record (File : Tools : Reset parameters : Forgetting index record). This will result in gathering new data that will approach true retention for the sample tested with accuracy proportional to the number of repetitions done

Wrong recall may indicate memory interference (#6986)
(Mike Condron, Tuesday, September 18, 2001 2:39 AM)
Question:
Why no recall is scored less than a wrong recall? Suppose I'm trying to remember "What's the capital of Canada?" and I answer "Warsaw." This seemed to me to be a much worse state of affairs than "I don't know"