A computer-implemented method, a computer program product, and a system are provided. A plurality of multi-level cognitive exercises are provided to an individual. Each of the multi-level cognitive exercises includes at least one task to perform. The individual is requested to respond to a cognitive exercise in the plurality of cognitive exercises by performing the at least one task contained in the cognitive exercise. A response provided by the individual to the cognitive exercise is monitored. Based on the monitoring, a determination is made whether the individual performed the at least one task at a predetermined performance level, wherein the performance level is defined by the at least one task contained in the cognitive exercise. Based on the determining, the individual is requested to perform at least another task. At least one activity for the individual to perform is generated. The at least one activity is based on responses to the multi-level cognitive exercises by the individual.
|
11. A computer-implemented method of providing individualized brain training to an individual using an computer-implemented multi-level cognitive exercise, wherein each level above a first level of the multi-level cognitive exercise has a task configuration of increased cognitive complexity compared to an immediately preceding level, the method comprising:
storing, on at least one storage device, computer-executable instructions for the multi-level cognitive exercise;
providing in the first level of the multi-level cognitive exercise, a task for the individual to perform by displaying on a graphical user interface, a plurality of objects with which the individual is instructed to interact to perform the task;
receiving a plurality of responses from the individual via the graphical user interface as the individual performs the task within the first level by interacting with the plurality of objects displayed on the graphical user interface;
continuously tracking a performance of the task by the individual within the first level by adjusting a difficulty setting of a component of the task within the first level based, at least in part, on an accuracy of the plurality of received responses;
determining during the continuous tracking of the performance of the task by the individual in the first level whether the performance of the task by the individual in the first level satisfies a graduation criterion or a plateau criterion for the multi-level cognitive exercise,
wherein the graduation criterion specifies a number of correct responses received when the component of the task is set to a highest difficulty setting within a current level of the multi-level cognitive exercise, and
wherein the plateau criterion specifies a metric by which it is determined that performance of the task by the individual within the current level is not continuing to improve prior to satisfying the graduation criterion; and
advancing the multi-level cognitive exercise from the first level to a second level of the multi-level cognitive exercise when it is determined that the performance of the task by the individual in the first level satisfies the graduation criterion or the plateau criterion,
wherein advancing the multi-level cognitive exercise from the first level to the second level comprises providing, via the graphical user interface, a modified task for the individual to perform,
wherein the modified task has increased cognitive complexity, increased cognitive difficulty, or challenges a different cognitive component compared to the task performed in the first level, and
wherein providing, via the graphical user interface, the modified task for the individual to perform comprises, compared to providing the task in the first level, one or more of displaying additional objects on the graphical user interface, changing a manner in which the plurality of objects are displayed, and increasing a complexity of a rule for performing the task.
17. A non-transitory computer readable medium encoded with a plurality of instructions that, when executed by at least one computer processor, perform a method of providing individualized brain training to an individual using an computer-implemented multi-level cognitive exercise, wherein each level above a first level of the multi-level cognitive exercise has a task configuration of increased cognitive complexity, increased cognitive difficulty, or challenges a different cognitive component compared to an immediately preceding level, the method comprising:
storing, on at least one storage device, computer-executable instructions for the multi-level cognitive exercise;
providing in the first level of the multi-level cognitive exercise, a task for the individual to perform by displaying on a graphical user interface, a plurality of objects with which the individual is instructed to interact to perform the task;
receiving a plurality of responses from the individual via the graphical user interface as the individual performs the task within the first level by interacting with the plurality of objects displayed on the graphical user interface;
continuously tracking a performance of the task by the individual within the first level by adjusting a difficulty setting of a component of the task within the first level based, at least in part, on an accuracy of the plurality of received responses;
determining during the continuous tracking of the performance of the task by the individual in the first level whether the performance of the task by the individual in the first level satisfies a graduation criterion or a plateau criterion for the multi-level cognitive exercise,
wherein the graduation criterion specifies a number of correct responses received when the component of the task is set to a highest difficulty setting within a current level of the multi-level cognitive exercise, and
wherein the plateau criterion specifies a metric by which it is determined that performance of the task by the individual within the current level is not continuing to improve prior to satisfying the graduation criterion; and
advancing the multi-level cognitive exercise from the first level to a second level of the multi-level cognitive exercise when it is determined that the performance of the task by the individual in the first level satisfies the graduation criterion or the plateau criterion,
wherein advancing the multi-level cognitive exercise from the first level to the second level comprises providing, via the graphical user interface, a modified task for the individual to perform,
wherein the modified task has increased cognitive complexity, increased cognitive difficulty, or challenges a different cognitive component compared to the task performed in the first level, and
wherein providing, via the graphical user interface, the modified task for the individual to perform comprises, compared to providing the task in the first level, one or more of displaying additional objects on the graphical user interface, changing a manner in which the plurality of objects are displayed, and increasing a complexity of a rule for performing the task.
1. A computerized system for providing individualized brain training to an individual using a computer-implemented multi-level cognitive exercise, wherein each level above a first level of the multi-level cognitive exercise has a task configuration of increased cognitive complexity, increased cognitive difficulty, or challenges a different cognitive component compared to an immediately preceding level, the system comprising:
at least one storage device configured to store computer-executable instructions for the multi-level cognitive exercise;
a display configured to display a graphical user interface, wherein the graphical user interface is configured to display a visualization associated with the multi-level cognitive exercise; and
at least one computer processor programmed to:
provide in the first level of the multi-level cognitive exercise, a task for the individual to perform by displaying on the graphical user interface a plurality of objects with which the individual is instructed to interact to perform the task;
receive a plurality of responses from the individual via the graphical user interface as the individual performs the task within the first level by interacting with the plurality of objects displayed on the graphical user interface;
continuously track a performance of the task by the individual within the first level by adjusting a difficulty setting of a component of the task within the first level based, at least in part, on an accuracy of the plurality of received responses;
determine during the continuous tracking of the performance of the task by the individual within the first level, whether the performance of the task by the individual in the first level satisfies a graduation criterion or a plateau criterion for the multi-level cognitive exercise,
wherein the graduation criterion specifies a number of correct responses received when the component of the task is set to a highest difficulty setting within a current level of the multi-level cognitive exercise, and
wherein the plateau criterion specifies a metric by which it is determined that performance of the task by the individual within the current level is not continuing to improve prior to satisfying the graduation criterion; and
advance the multi-level cognitive exercise from the first level to a second level of the multi-level cognitive exercise when it is determined that the performance of the task by the individual in the first level satisfies the graduation criterion or the plateau criterion,
wherein advancing the multi-level cognitive exercise from the first level to the second level comprises providing, via the graphical user interface, a modified task for the individual to perform,
wherein the modified task has increased cognitive complexity, increased cognitive difficulty, or challenges a different cognitive component compared to the task performed in the first level, and
wherein providing, via the graphical user interface, the modified task for the individual to perform comprises, compared to providing the task in the first level, one or more of displaying additional objects on the graphical user interface, changing a manner in which the plurality of objects are displayed, and increasing a complexity of a rule for performing the task.
2. The computer system of
continuously track a performance of the modified task by the individual within the second level by adjusting a difficulty of a component of the modified task within the second level based, at least in part, on an accuracy of a plurality of responses received from the individual as the individual performs the modified task within the second level;
determine during continuous tracking of the performance of the modified task by the individual within the second level, whether the performance of the modified task by the individual in the second level satisfies the graduation criterion or the plateau criterion; and
advance the multi-level cognitive exercise from the second level to a third level of the multi-level cognitive exercise when it is determined that the performance of the modified task by the individual in the second level satisfies the graduation criterion or the plateau criterion for the multi-level cognitive exercise.
3. The computer system of
4. The computer system of
5. The computer system of
6. The computer system of
7. The computer system of
8. The computer system of
10. The computer system of
12. The computer-implemented method of
(i) increasing a number of objects displayed on the graphical user interface during performance of the modified task;
(ii) increasing a complexity of a rule for performing the task;
(iii) changing a manner in which the plurality of objects are displayed on the graphical user interface during performance of the modified task;
(iv) introducing additional distractor components provided via the graphical user interface, that the individual is instructed to ignore during performance of the modified task; or
(v) any combination of one or more of (i)-(iv).
13. The computer-implemented method of
14. The computer-implemented method of
15. The computer-implemented method of
16. The computer-implemented method of
18. The computer readable medium of
(i) increasing a number of objects displayed on the graphical user interface during performance of the modified task;
(ii) increasing a complexity of a rule for performing the task;
(iii) changing a manner in which the plurality of objects are displayed on the graphical user interface during performance of the modified task;
(iv) introducing additional distractor components provided via the graphical user interface, that the individual is instructed to ignore during performance of the modified task; or
(v) any combination of one or more of (i)-(iv).
19. The computer readable medium of
20. The computer readable medium of
|
The present application is a continuation of and claims the benefit under 35 U.S.C. 120 of U.S. patent application Ser. No. 13/086,598, which was filed in the U.S. Patent and Trademark Office on Apr. 14, 2011, which claims priority to U.S. Provisional Patent Application No. 61/421,417 to Wexler, filed Dec. 9, 2010, and entitled “INTEGRATED BRAIN/BODY EDUCATIONAL ENHANCEMENT PROGRAM”, and incorporates disclosure of this application herein by reference in its entirety. The present application also claims priority to U.S. Provisional Patent Application No. 61/390,238 to Wexler, filed Oct. 6, 2010, and entitled “Integrated Brain, Behavior and Social Program to Enhance Cognitive Development,” and incorporates disclosure of this application herein by reference in its entirety.
This invention was made with government support under R01 DA019039, R01 MH061493, R25 MH071240, R01 MH080048, R01 MH084079 awarded by the National Institute of Health. The government has certain rights in the invention.
The subject matter described herein relates to data processing and in particular, to evaluating an individual and developing programs and treatments based on individual's abilities.
Education has two main components. One is teaching information (e.g., facts). The other is improving the individual's thinking abilities, things like memory, problem solving, and creative thinking School pedagogy has focused primarily on the first of the two—teaching information. The effort to improve thinking has almost exclusively been through learning the information. For example, attention and memory were strengthened by having students memorize list of facts and recite poems from memory. The focus on conveying information has been necessary because very little was known about how to directly strengthen thinking itself. Recent advances in cognitive science and neuroscience, along with modern computer technology, make possible a change in education. Computer-based brain exercises and specific physical exercises synergistically and powerfully promote development of the neurocognitive foundations of thought. This means that education can move from a primary focus on learning facts to a balanced curriculum that equally and directly promotes development of thinking itself.
Attention deficit hyperactivity disorder (“ADHD”) is a neurodevelopmental disorder marked by a failure to develop age-appropriate executive functions to sustain and direct attention, inhibit response to task-irrelevant stimuli and contain and down regulate internally generated urges for action. A variety of other cognitive functions are compromised, perhaps in part secondary to the aforementioned deficits and perhaps as part of the primary pathology. These include a group of cognitive operations often labeled “executive functions” that depend heavily on activity in the frontal and parietal lobes, areas of the brain actively developing when the full array of functions compromised in ADHD are themselves developing and when symptoms of ADHD often lead to clinical diagnosis. This complex of dysfunctions exacerbates one another and alters interactions with the social environment so as to limit opportunities that promote normal development and create experiences that promote deviant development. By the time individuals with ADHD are teenagers and young adults they over represented among drug users, criminals and the un- and under-employed. With an estimated prevalence world wide of 5%, ADHD is a significant public health problem associated with high individual, family and social costs. Similar knowledge from cognitive and neuroscience and computer technology can also be used to treat childhood neurodevelopmental disorders such as ADHD, as well as the cognitive deficits associated with neuropsychiatric disorders. These treatment programs are neuroscience and brain based, but non-pharmacologic.
Thus, there is a need to incorporate physical activity and cognitive exercises to generate educational programs and/or to treat psychiatric disorders, which include exercises designed specifically to engage and promote development of specific neurocognitive systems implicated by the disorder, and to integrate such exercises with computer exercises that engage those same neurocognitive systems.
In some implementations, the current subject matter relates to a computer-implemented method. The method includes providing a plurality of multi-level cognitive exercises to an individual. Each of the multi-level cognitive exercises includes at least one task to perform. The individual is requested to respond to a cognitive exercise in the plurality of cognitive exercises by performing the at least one task contained in the cognitive exercise. A response provided by the individual to the at least one task contained in the cognitive exercise is monitored. Based on the monitoring, it is determined whether the individual performed the at least one task at a predetermined performance level. The predetermined performance level is defined by the at least one task contained in the cognitive exercise. Based on the determining, the individual is requested to perform at least another task. At least one activity for the individual to perform is generated. At least one activity is based on responses to the multi-level cognitive exercises by the individual.
In some implementations, the current subject matter can include at least one of the following optional features. At least another task can include at least one of the following: at least another task in the cognitive exercise, at least one task in another cognitive exercise in the plurality of multi-level cognitive exercises, and the at least one task that has been altered. At least one activity can include at least one of the following: at least one cognitive exercise and at least one physical activity. Based on the generated activity, an individual development plan for the individual can be generated. Each level in the multi-level cognitive exercises contains a different task to perform, wherein each next level in the multi-level cognitive exercises contains a more difficult task to perform than a task in a preceding level in the multi-level cognitive exercises. The individual is not allowed to perform a task contained in the next level until the individual correctly performs a task contained in the preceding level. The monitoring further includes determining that the individual incorrectly performed the at least one task; generating an error message indicating that the individual incorrectly performed the task, analyzing a performance of the at least one task by the individual, providing, based on the analyzing, a suggestion to the individual on how to correctly perform the at least one task, and allowing the individual to perform the at least one task again. The analyzing further includes determining an error type corresponding to the incorrect performance of the at least one task by the individual. The generating the error message further includes generating an alert to the individual indicating the error message, wherein the alert includes at least one of the following: an audio message, a video message, and a combination of an audio message and a video message. The at least another task can include the at least one task that has been altered based on the error type. The monitoring further includes defining, based on the predetermined performance level, at least one plateau performance criterion to indicate performance of the at least one task by the individual at a first performance level, at least one graduation performance criterion to indicate performance of the at least one task by the individual at a second performance level, wherein the second performance level is higher than the first performance level, determining a performance level at which the individual performed the at least one task and whether the individual correctly performed the at least one task, and comparing, based on the determining, the performance level at which the individual performed the at least one task with the at least one of the first performance level and the second performance level. The method can also include allowing the individual to perform at least another task included in the multi-level cognitive exercises based on the individual performing the at least one task at least one of the first performance level and the second performance level. At least one performance level, the first performance level, the second performance level can include at least one of the following: a predetermined time allotted for performance of the at least one task, a predetermined speed for performing the at least one task, and a predetermined accuracy of performing the at least one task. The method can also include determining whether the individual correctly and at at least one of the first predetermined level and the second predetermined level predetermined for each task performed all tasks in the plurality of multi-level cognitive exercises, allowing, based on the determination, the individual to perform at least another task contained within at least another plurality of multi-level cognitive exercises.
Articles are also described that comprise a tangibly embodied machine-readable medium embodying instructions that, when performed, cause one or more machines (e.g., computers, etc.) to result in operations described herein. Similarly, computer systems are also described that can include a processor and a memory coupled to the processor. The memory can include one or more programs that cause the processor to perform one or more of the operations described herein.
The details of one or more variations of the subject matter described herein are set forth in the accompanying drawings and the description below. Other features and advantages of the subject matter described herein will be apparent from the description and drawings, and from the claims.
Articles are also described that comprise a tangibly embodied machine-readable medium embodying instructions that, when performed, cause one or more machines (e.g., computers, etc.) to result in operations described herein. Similarly, computer systems are also described that can include a processor and a memory coupled to the processor. The memory can include one or more programs that cause the processor to perform one or more of the operations described herein.
The details of one or more variations of the subject matter described herein are set forth in the accompanying drawings and the description below. Other features and advantages of the subject matter described herein will be apparent from the description and drawings, and from the claims.
The accompanying drawings, which are incorporated in and constitute a part of this specification, show certain aspects of the subject matter disclosed herein and, together with the description, help explain some of the principles associated with the disclosed implementations. In the drawings,
In some implementations, the current subject matter can be configured to be implemented in a system 100, as shown in
Components 202, 204, and 206 may also include sub-components 212 (a, b, c), 214 (a, b, c), and 216, respectively. Components 212 may be used for analyzing and targeting particular individual's psychological abilities (e.g., cognitive functions). As shown in
Some implementations of the current subject matter may be configured to allow usage of brain and cognitive exercises in computer games and/or other computer-related/computer-based operations, activities, functions, programs, etc. that allow for a more intensive and continuous activation of targeted neural processes in an individual. In some implementations, the targeted exercises may be directed to or otherwise address specific cognitive, mental, etc. areas and/or needs of an individual (for example, tracking movement of an object on a computer screen may be designed to address individual's cognitive processes that are responsible for reaction/response time). While the individual is performing such computer game exercises, the individual may be monitored periodically (e.g., every 5 seconds, 10 seconds, etc.) to determine individual's responsiveness posed by the challenges of these exercises. Based on such responses, difficulty of the exercises may be adjusted appropriately to provide an optimal difficulty for that particular individual. Current subject matter may be configured to provide individualized difficulty levels for each individual performing the same exercises.
In some implementations, the component 202 may be configured to provide multiple different exercises, exercise variations, and/or difficulties of exercises each being designed to focus on different aspects of cognition that are actively developing in the individual. Because each individual may have his/her own profile of cognitive strengths and weaknesses, each individual may benefit from special attention in areas that are more difficult for them. The current subject matter may be configured to use graduation and plateau criteria for each exercise and automatically move the individual at an appropriate speed through areas of individual strength and spend more time exercising areas of relative weakness. At the same time, proper setting of the graduation and plateau criteria may avoid frustration and inefficiency of keeping individuals working too long in areas where they have achieved their maximum capability at that particular time. The current subject matter may be configured to later return to areas of relative weakness to determine whether the individual is then capable of performing such exercises. In some implementations, the plateau criterion or criteria may be configured to define a predetermined level of performance by the individual performing particular exercise(s) or task(s) or problem(s) in exercises for which the plateau criterion/criteria are defined. Such predetermined level may include at least one of the following: speed, time, accuracy, etc. with which the individual completes the entire exercise, a portion or portions of an exercise, etc. Each exercise may contain at least one difficulty level and the individual may advance to the next level by reaching the plateau criterion/criteria. In some implementations, the plateau criterion/criteria may indicate that the individual is performing the exercise/exercises at a particular predetermined level (e.g., performing exercises at a particular speed without changing the speed, or performing the exercises during a particular time period without reducing the time period). The graduation criterion/criteria may be defined by an individual correctly performing particular exercises or tasks at a predetermined level defined by the exercise (e.g., consecutively performing tasks defined by an exercises at a fastest speed in a correct manner (see, examples discussed below)). Upon reaching the graduation criterion/criteria, the individual may be advanced to the next difficulty level of an exercise or a group of exercises. In some implementations, the plateau and/or graduation criteria may be referred to as a predetermined performance level, where the plateau criterion/criteria may define a first performance level and the graduation criterion/criteria may a second performance level such that the second performance level is more difficult than the first performance level (e.g., second performance level may correspond to performing the task/problem/exercise at a fastest possible speed, whereas the first performance level may correspond to performing the task/problem/exercise at a low speed and without changing the speed).
System 200 may be also configured to record and evaluate thousands of individual's responses during each training session, and many tens of thousands of responses during the course of the program that may be developed for that individual. The program may recognize various different types of errors (e.g., 40 different types) and generate reports that characterize types of errors that an individual may make. The system 200 may be also configured to generate error messages and provide corrective strategy messages to individuals during exercises being performed by the individual. When the individual makes a specific type of error or makes an error more often than a predetermined number of times, the system 200 may automatically provide a corrective strategy message to the individual (or someone observing the individual) and an example of how to perform the exercise correctly. Further, for some errors, the system 200 may also make a temporary change in the way the exercise is presented to the individual so as to, for example, make it easier to see, understand and/or perform correctly. When the individual responds correctly to the same type of problems over a few trials after the corrective strategy message, the system 200 may provide a reward. In some implementations, the system 200 may be configured to provide an intelligent detection of errors made by the individual by detecting the error and the error type made by the individual, analyzing it, and then providing a corrective strategy to the individual (e.g., advising the individual of the error committed and showing how to perform the exercise correctly, or changing the exercise to reduce difficulty level of an exercise, etc.). The system 200 may also generate an indication of specific error type messages in substantially real time (e.g., as the exercise is being done) and provide immediate feedback to the individual to allow the individual to self-correct the error.
The system 200 may be also configured to generate an attention alert. One specific type of error of particular relevance to some individuals is a loss of focus on a task at hand (e.g., presented by a particular exercise) with an associated loss of essential task-relevant information. This may lead to missed or incorrect responses. It may also lead to frustration and negative feedback for poor performance, often compounding the initial inattention. It also means that the higher level processing that depends on the task-relevant sensory input is compromised or aborted, leading to under activation of those neural systems and lost opportunity to strengthen functional links between lower and higher level processes that can strengthen and stabilize the focusing of attention and associated initial sensory information intake. To address this, system 200 may include an attention alert function that may be enabled as needed (e.g., by a third party or by system 200's online error diagnostics). The attention alert function may use a variety of methods to provide general pre-target alerts and to increase target salience.
System 200 may be configured to integrate cognitive exercises with physical activities. The system 200 may incorporate specific physical activities selected to work synergistically with the classroom computer exercises. The system 200's physical activity component may be configured to allow selection of particular physical activities to address neurocognitive developmental processes. Such exercises may include sports, games, dances, gymnastics, martial arts, etc. The physical activities can be specifically tailored to the individual.
In some implementations, the system 200 can be used in a classroom social intervention to limit classroom behaviors that disrupt a teaching environment, such as out of seat behavior and blurting out by students. The system 200 may use a “good behavior game” to increase participation in the computer and physical activities by the students. Further, because both the computer and sports activities aim to activate and strengthen neural systems of self-control and the system 200 may activate and strengthen these same systems through social level reward and peer pressure.
In educational setting, the system 200 online error diagnostics may provide information for the classroom teacher about overall and specific strengths and weaknesses of each student as an aid to an individualized education. For school principals, the reports may identify students with special talents or special needs from each class as an aide to supervision of teachers with regard to identifying and working appropriately with these special students. At a district level, the information may help identify possible curricular needs to address specific aspects of thinking, some of which might be addressed through further development of system 200 itself. At the state and national levels, performance information on the system 200's computer programs may help identify unusually gifted students for further evaluation and consideration for special educational programs and settings.
In some implementations, system 200 may provide treatment options for attention deficit hyperactivity disorder (“ADHD”) in children. ADHD is a neurodevelopmental disorder characterized by deficits in multiple aspects of attention and other self-regulatory executive functions. Children with ADHD may show delayed and incomplete development of these processes and associated brain functional systems. The system 200 may be designed to enhance development of these systems in healthy children.
System 200 may be configured to use computer technology to direct neuroplastic processes, synergistically integrate brain, body and social interventions, and maintain intensity of intervention. The system 200 may continuously adjust task difficulty to optimally engage targeted neurocognitive systems of attention, response inhibition and executive function, categorize types of errors, provide specific corrective strategy messages, and fold-in or phase out target alert and attention focusing cues as the individual's own competence requires. Physical exercises may activate same neurocognitive systems in the context of whole body and inter-personal activity.
System 200 may be configured to continuously monitor performance and increase task difficulty to maintain optimal challenge and also use graduation and performance plateau algorithms so that the individual spends less time doing exercises in areas of strength and more in areas of weakness. System 200 may further individualize treatment. System 200 may be configured to deal with the problem of inter-individual differences in specific areas of strengths and weaknesses. Further, system 200 may examine responses of thousands of training trials to generate online error diagnostics and corrective strategy messaging. The system 200 may provide pre-target alerts and visual target enhancements to engage the relevant neural systems, and gradually phase out these features as internal competence develops. System 200 also may produce reports for clinicians, teachers, and/or any other third parties to help inform other aspects of the individual's treatment and/or education.
The following is a discussion of each of the components 202 and 204 of the system 200 shown in
Computerized Cognitive Remediation Component
As stated above, the computerized cognitive remediation component 202 may include three or more sub-components 212a, 212b, and 212c. The sub-component 212a or the “catch-the-ball” game component. The game may be presented to an individual on a computer monitor. The game may require individuals to follow one or more balls bouncing randomly across the screen and to click on them using a computer mouse when the ball turns a color that matches current target criterion. At the most basic level, the sub-component 212a may be a simple continuous performance task and the individual has to click on the ball whenever it changes from the default color (e.g., yellow) to a target color (e.g. red). At successive levels of greater difficulty, a third color (e.g., blue) balls may be introduced first as foils to be always ignored and then as targets when the target switches randomly between red and blue as indicated on the screen (e.g., the computer screen may have a section that provides instructions, messages, etc. to the user). In some implementations, a fourth color (e.g., green) balls may be added but not as targets. The sub-component 212a may include a working memory based target criterion that may identify a particular target that the individual should reach during the game. Such criterion may be introduced so that the ball is a target when it has the same color as the one before. After the individual progresses through all variations with one ball bouncing across the screen, the variations may be repeated using two balls, then three balls, and so on. With multiple balls on the screen, the memory based criterion may separately apply to a history of each ball that bounced across the computer monitor. Thus, the current target may be red for one of the bouncing balls and blue for another. In some implementations, the task's structure may provide a framework and an opportunity to activate and, thereby, further the development of multiple neurocognitive systems by engaging individual's frontal brain regions and/or distributed functional brain system components of the multiple neurocognitive systems. The above discussion is provided here for exemplary and illustrative purposes only and is not intended to limit the scope of the subject matter described herein. For example, in some implementations, the individual may be requested to “catch” any objects that may be moving across individual's computer screen (e.g., animals, fruits, vegetables, cars, trains, planes, etc.). Also, such objects can change from one object to another throughout the exercise at any time. Additionally, the individual's cursor, the movement of which corresponds to the movement of the computer mouse by the individual, can be represented by any object, e.g., an arrow, a clock, or any other object. In some implementations, the cursor can be tailored to a particular exercise that the individual is asked to perform. For example, the cursor can be a net and the object moving across the screen can be a ball; or, the cursor can be a cat and the object is a mouse. The objects and the cursors can change periodically, automatically, and/or at random times. In some implementations, the individual may be provided with an instruction to catch a particular object (e.g., “catch a mouse”, or “catch a mouse when cursor turns into a cat”, etc.). The following discussion is provided in terms of the described “catch-the-ball” exercise, but can be applicable to any type of exercise discussed above.
The game may have different levels and/or sub-levels of difficulty that may correspond to the number of balls bouncing across the screen and/or colors of the balls. Within each level there may be multiple sub-levels of increasing difficulty. Such difficulty may be based on a progressively shorter duration of the color change that may indicate possible targets. In some implementations, the time that the individual is provided to respond to the color change of the target may remain fixed throughout the game or may vary according to the level of the game. Also, this time may be longer than the duration of the color change. At each of the sublevels, the speed with which the ball(s) move across the screen may become faster or slower as the individual's errors decrease or increase. This allows the system 200 to perform an adaptive tracking of the individual's performance. Each sub-level and/or level may include predetermined graduation criteria corresponding to the speed with which the individual responds to the color change of the target and an accuracy with which the individual identifies the target. When the individual reaches such predetermined graduation criteria of speed and accuracy, he/she may proceed to the next sub-level and/or level. Once all sub-levels of a level are satisfactorily completed (i.e., for each sub-level, the individual met the respective predetermined graduation criteria), the individual may proceed to the next level, where each level may be defined by a different target criterion and sub-levels, e.g., by duration of color changes defining a target.
Since some individuals might not be able to function at faster speeds necessary to challenge other individuals, the system 200 may also include “plateau criteria” to detect performance asymptotes or individual ceilings. Individuals may proceed to the next sublevel and level, when plateau criteria and/or graduation criteria are met. The different levels of “catch-the-ball”game may require a sustained attention, a response inhibition, an executive or a working memory directed attention, and/or divided and switching attention.
Another sub-component 212b, called “butterflies,” may be used to add further complexity to the individual's tasks. This sub-component may also be implemented on the computer monitor. Using this sub-component, butterflies (or any other objects) may appear on and move across the screen carrying signs with pictures, words or numbers on them. In this sub-component, target criteria may also be identified. The individual may be asked to click on butterflies that are carrying things that are members of a target category before the butterfly carries the sign off the screen. One of the target categories may be numbers. The individual may be asked to click on every butterfly carrying a number (e.g., “1”, “2”, etc.) or the name of a number (e.g., “one”, “two”, etc.). Other categories may be “natural” or “basic” categories such as animals, plants, furniture, etc. Lower level categories may include small animals. Further categories may be “functional” or “temporary” categories (e.g., things found in a house, things that may be taken on a vacation, modes of transportation, etc.). Further examples of categories may include finding two things on the screen at the same time that go together in some way, e.g. “two things where one is used to make the other.” As with sub-component 212a, within each of these levels there are sublevels based on the number of butterflies present on the screen at the same time. Within each of the sublevels, performance may be tracked and the speed at which the butterflies fly across the screen may be adjusted accordingly. Similar to the sub-component 212a, there exist predetermined graduation and plateau criteria that may govern movement from one sub-level and/or level to the next. This exercise may involve individual's sustained attention, response inhibition, visual searching and executive rule based direction of attention, as well as different aspects of category formation and use.
The sub-component 212c or “what comes next/what came before?” exercise, can be also presented on the computer screen. In this exercise, there may be four boxes for stimuli on one row and three more on a second row beneath the first. Stimuli may be presented in three of the four boxes on the first row and in all three boxes on the second row. The individual may be asked to determine a relationship among the stimuli in the first row and select the stimulus in the second row that fits the empty spot in the sequence evident on the first row. For example, if all three stimuli in the first row are green circles, then the correct choice from the second row is the green circle. If, the first row shows a green circle, a red triangle and another green circle, the correct choice is a red triangle. If the first row contains the numbers 9-7-5, the correct choice from the second row is “3.” In different levels of this exercise, different types of rules may define relationships among the items in the first row. These include category principles like color, shape, numeric sequencing rules, visual rotations, etc. Individual's performance may be tracked and within each level stimuli may be presented for progressively shorter periods of time to require faster information processing and increase difficulty. Graduation and plateau criteria may be used again to allow the individual to proceed from one level to the next. This exercise may involve sustained attention, response inhibition, use of categories and very active storage and manipulation of information in working memory.
In some implementations, the component 202 may be configured to provide an automatic individualization of treatment for the individual. Using graduation and plateau criteria, the system 200 may be configured to advance individuals through exercises quickly, such as, in areas of their strength, keep the individuals working longer in areas of their weaknesses, and avoid keeping the individuals from working on exercises for too long after their maximum gain has been reached. In this way, the treatment may be tailored to specific capabilities of the individual. As stated above, the system 200 may be configured to provide online error diagnostics of individual's performance and online corrective strategy messaging. When an individual makes a specific type of error above a criterion frequency, the system 200 may be configured to automatically provide a corrective strategy message and an example of how to do the problem correctly. For some errors, the system 200 may make a temporary change in the way the stimulus or problem is presented to the individual so that the individual may be better able to understand the problem and what is required of the individual to solve this particular problem. When the individual responds correctly to the same type of problems over a few trials after the corrective strategy message, the system 200 may be configured to provide a reward. The system 200 may be further configured to provide an attention alert. For example, such alerts may be useful for individuals suffering from ADHD, which may entail a loss of focus on the task at hand with an associated loss of essential task-relevant information. The system 200 may be configured to generate an attention alert, such as an auditory alert, a visual alert, and/or a combination of both.
2. Physical Exercise Component
The physical exercise component 204 may be used in combination with the component 202 to develop an appropriate educational program or a treatment plan for a particular individual. The component 204 can include a variety of physical exercises that may activate same neurocognitive systems targeted by the computer-based cognition training programs, discussed above. Such exercises may be programmed systemically from a single task to multiple tasks, from a simple movement to more complicated exercises and with different requirement for reaction time, speed of processing, and/or hand-eye-body coordination. In some implementations, the individuals may be instructed and monitored by well-trained coaches and be under peer pressure in both individual and team competitions for all the activities, and as such may not feel too exhausted and, instead, may have to make effort to focus on their performances.
The physical activities specifically may require sustained attention both internally and externally focused, response inhibition to multiple internal and external distractions, motor inhibition in games that require delayed action, multiple simultaneous attention, working memory directed attention and pattern generated motor activity. Although most of the body activities involve several of these cognitive functions, each more heavily draws on some rather than other cognitive operations as indicated below. Some physical exercises include at least one of the following in at least one of the categories listed below:
In some implementations, the use of physical exercises in conjunction with the cognitive exercises may have an effect of having individuals spend more time activating target processes of neurocognitive systems. Such combination of exercises also may extend the exercise from the computer environment to a context of whole body movement and from one of individual activity to a social context. This may promote generalization of training gains from a narrow context specific one to broader impact on function. Further, in some implementations, an exercise program may be developed based on the neurocognitive development of the individual and may target specific development of neurocognitive processes to choose specific activities from a wide variety of sports, gymnastics, dance, martial arts, etc.
In some implementations, the current subject matter can include at least one of the following optional features. At least another task can include at least one of the following: at least another task in the cognitive exercise, at least one task in another cognitive exercise in the plurality of multi-level cognitive exercises, and the at least one task that has been altered. At least one activity can include at least one of the following: at least one cognitive exercise and at least one physical activity. Based on the generated activity, an individual development plan for the individual can be generated. Each level in the multi-level cognitive exercises contains a different task to perform, wherein each next level in the multi-level cognitive exercises contains a more difficult task to perform than a task in a preceding level in the multi-level cognitive exercises. The individual is not allowed to perform a task contained in the next level until the individual correctly performs a task contained in the preceding level. The monitoring further includes determining that the individual incorrectly performed the at least one task; generating an error message indicating that the individual incorrectly performed the task, analyzing a performance of the at least one task by the individual, providing, based on the analyzing, a suggestion to the individual on how to correctly perform the at least one task, and allowing the individual to perform the at least one task again. The analyzing further includes determining an error type corresponding to the incorrect performance of the at least one task by the individual. The generating the error message further includes generating an alert to the individual indicating the error message, wherein the alert includes at least one of the following: an audio message, a video message, and a combination of an audio message and a video message. The at least another task can include the at least one task that has been altered based on the error type. The monitoring further includes defining, based on the predetermined performance level, at least one plateau performance criterion to indicate performance of the at least one task by the individual at a first performance level, at least one graduation performance criterion to indicate performance of the at least one task by the individual at a second performance level, wherein the second performance level is higher than the first performance level, determining a performance level at which the individual performed the at least one task and whether the individual correctly performed the at least one task, and comparing, based on the determining, the performance level at which the individual performed the at least one task with the at least one of the first performance level and the second performance level. The method can also include allowing the individual to perform at least another task included in the multi-level cognitive exercises based on the individual performing the at least one task at least one of the first performance level and the second performance level. At least one performance level, the first performance level, the second performance level can include at least one of the following: a predetermined time allotted for performance of the at least one task, a predetermined speed for performing the at least one task, and a predetermined accuracy of performing the at least one task. The method can also include determining whether the individual correctly and at at least one of the first predetermined level and the second predetermined level predetermined for each task performed all tasks in the plurality of multi-level cognitive exercises, allowing, based on the determination, the individual to perform at least another task contained within at least another plurality of multi-level cognitive exercises.
The following is a discussion of experimental game examples conducted using system 200 discussed above. The discussion identifies various levels, associated error types, message criteria, feedback, auditory and/or visual messages, and training aids for each of the experimental games.
As illustrated below, each error type may be determined based on a number of hits/misses that the individual had and/or any other criteria. The messages/feedback may be generated based on the error. Further, upon completion of one level, the individual is permitted to proceed to the next higher level. The following is a description of the “catch-the-ball” exercise, difficulty dimensions, design, speed adjustments and difficulty levels.
General Task Description:
Balls appear and bounce around on the screen. The individual has to move a cursor (which may look like a hand) to “catch” balls of specified colors before they bounce off the screen. Balls collect in vertical container on the side of the screen as the individual catches them to indicate success. In some difficulty levels, the color of the balls to catch (the “target”) changes, as described below. When this is the case, the correct target color is indicated in one of the corners of the screen.
Difficulty Dimensions:
1. Number of balls on the screen
2. Balls move in different directions
3. Complexity of rules for collecting balls
4. Speed at which balls move—adaptively tracked.
The design of the “catch-the-ball” exercise may be as follows:
1. As individuals play it, the exercise changes in two different ways: Speed and Difficulty Level.
2. The exercise begins at the easiest difficulty level and the slowest speed.
3. The difficulty level remains the same, and speed is adjusted based on the individual's performance as indicated below.
4. When the individual reaches a certain level of speed and accuracy (i.e., a graduation criterion, as described below), or becomes “stuck” at the same speed and accuracy level (i.e., a plateau criterion, as described below) the game moves to the next difficulty level. Play at the new difficulty level begins at half the speed achieved at the previous level.
5. There may be 630 difficulty levels as defined below (other number of difficulty levels is possible).
Speed can be adjusted as follows:
1. Speeds:
a. Initial and slowest speed: 10 seconds to traverse the screen in a straight line
b. Fastest speed: 2 seconds to traverse the screen in a straight line
2. Algorithm for adjusting speed:
a. 3 consecutive correct, then increase speed by 10%
b. 2 consecutive errors, then decrease speed by 10%
3. Graduation criterion: 5 consecutive correct at fastest speed
4. Plateau criterion: 10 alternations between two speeds without advancing to a faster speed.
5. Subjects move to the next difficulty level by reaching either graduation or plateau criterion.
Catch—the ball game can include the following difficulty levels:
1. Balls are initially a light yellow color and change to the colors of targets or foils for periods of time as indicated in the table below. Changes take place at random intervals ranging from 1.5 to 3.5 seconds.
2. The target color is indicated in a stationary ball on the top of the screen.
3. The Table A below indicates the first 54 difficulty levels in order of least to more difficult.
4. For these first 63 levels, only one ball moves across the screen at a time. The difficulty levels are a function of 3 parameters: 1) the number of different colors the ball can become; 2) the length of time a particular color remains; and 3) the rule defining targets.
5. These 54 levels are to be repeated with more than one ball moving across the screen as follows:
a. Levels 64-126: 2 balls moving in the same direction
b. Levels 127-189: 2 balls moving in opposite directions
c. Levels 190-252: 3 balls moving in the same direction
d. Levels 253-315: 3 balls, 2 moving in one direction
6. These 315 levels (except for the trials with only red color balls) are to be repeated again with the screen divided in half and the target different colors on the two sides of the screen. One side of the screen will begin with the target blue and the other red, and each will change according to the same rule being applied to both sides. Balls will move across the whole screen (i.e., across the divide in the middle of the screen) just as in the first 315 trials, but now the target color may change when the ball crosses from one side to the next.
TABLE A
DIFFICULTY LEVELS
#of
Target or Foil
Stimuli
Colors
Duration
Rule
1
Red
1.5
sec
Catch Red Balls
Red
1.25
sec
Red
1.0
sec
Red
0.8
sec
Red
0.6
sec
Red
0.5
sec
Red
0.4
sec
Red
350
msec
Red
300
msec
1
Blue, Red
1.5
sec
Catch Red Balls
Blue, Red
1.25
sec
Blue, Red
1.0
sec
Blue, Red
0.8
sec
Blue, Red
0.6
sec
Blue, Red
0.5
sec
Blue, Red
0.4
sec
Blue, Red
350
msec
Blue, Red
300
msec
1
Blue, Red
1.5
sec
Catch Red or Blue as
Blue, Red
1.25
sec
Target Indicates
Blue, Red
(Target shifts at random
Blue, Red
intervals from
Blue, Red
3 to 6 targets with chime
Blue, Red
signaling change)
Blue, Red
Blue, Red
Blue, Red
300
ms
1
Blue, Red, Green
1.5
sec
Catch Red or Blue as
Blue, Red, Green
1.25
sec
Target Indicates
Blue, Red, Green
(Target shifts at random
Blue, Red, Green
intervals from
Blue, Red, Green
3 to 6 targets with chime
Blue, Red, Green
signaling change)
Blue, Red, Green
Blue, Red, Green
Blue, Red, Green
300
ms
1
Blue, Red
1.5
sec
Catch Red or Blue as
Blue, Red
1.25
sec
Target Indicates (Target
Blue, Red
switches after every
Blue, Red
trial)
Blue, Red
Blue, Red
Blue, Red
Blue, Red
Blue, Red
300
ms
1
Blue, Red, Green
1.5
sec
Catch Red or Blue as
Blue, Red, Green
1.25
sec
Target Indicates (Target
Blue, Red, Green
switches after every
Blue, Red, Green
trial)
Blue, Red, Green
Blue, Red, Green
Blue, Red, Green
Blue, Red, Green
Blue, Red, Green
300
ms
1
Blue, Red, Green
1.5
sec
Catch any ball that
Blue, Red, Green
1.25
sec
turns the same color
Blue, Red, Green
twice in a row (use all
Blue, Red, Green
three colors as targets)
Blue, Red, Green
Blue, Red, Green
Blue, Red, Green
Blue, Red, Green
Blue, Red, Green
300
ms
The following Tables 1-8 indicate various error types and corresponding messages that may be generated for the catch-the-ball exercise.
TABLE 1
Level 1
Error
Miss the balls with no click
type 1:
Message criterion
miss two out of five targets
Auditory Message:
“Remember, try and catch all
the balls that turn red”
Visual message:
Have the ball stop moving and
flash red on and off
Positive feedback
Give a big smiley face when
they first correctly click on the
target after the corrective
messages.
Error
Miss the balls with click
type 2:
outside of the ball
Message criterion
miss two out of five targets
Auditory Message:
“You are doing a good job
seeing the red balls to catch,
but you are not moving the
little hand (or cursor) onto the
balls before you click the
mouse. You have to get the
little hand onto the balls
before you click the mouse.
We will make the balls bigger
for a little while you get better
at clicking on them.”
Visual message:
Have the ball stop moving and
show the cursor moving onto
it before there are the words
“click now” and the sound of a
successful on-target click is
played.
Training Aid
Make the target balls 33%
bigger for the next 10 targets.
Positive feedback:
Give a big smiley face when
they first correctly click on the
target after the corrective
messages.
Error
Miss the balls with late click
type 3:
Message criterion:
miss two out of five targets
Auditory Message:
“You are doing a good job
seeing the red balls to catch,
but you are not catching them
fast enough. You have to get
the little hand onto the balls
more quickly before you click
the mouse. There are two
strategies that might help you.
One, you can try to keep
moving the little hand along
with the ball so you will be
ready to catch it when it turns
red. Two, look where they
balls are going, move the little
hand to there and let the ball
come to you. That way you do
not have to chase after them so
much. We will give you some
extra time to click on the balls
for a little while you get better
at catching them.”
Visual message:
Illustrate the cursor moving
along with the ball and call it
strategy one. Illustrate moving
the cursor to where the ball is
headed and call it strategy
two.
Training Aid:
Make the response window
200 msec. longer for the next
10 targets.
Positive feedback
Give a big smiley face when
they first correctly click on the
target after the corrective
messages.
TABLE 2
Level 2
Error
Miss the balls with no click -
type 1:
same messages and actions as
for Level 1
Error
Miss the balls with click
type 2:
outside of the ball - same
messages and actions as for
Level 1.
Error
Miss the balls with late click -
type 3:
same messages and actions as
for Level 1.
Error
Click on Blue balls
type 4:
Message criterion:
click on two out of five blue
balls
Auditory Message:
“Remember, you are only
trying to catch the balls that
turn red.”
Visual message:
Show a blue ball and write in
big letters “Do not catch the
blue balls”.
Positive feedback:
Give big smiley face when the
first two times they correctly
ignore a blue ball after the
corrective messages.
TABLE 3
Level 3 (target switches between red and blue)
Error
Fail to switch target as
type 1:
indicated either by failing to
click on the new target OR
clicking on the old target
after the switch.
Message criterion:
Errors on the first two stimuli
after the target switches.
Auditory Message:
“Whoops the target color
changed and you did not start
catching the new color!”
Visual message:
Show an illustration of the
target color changing the
stimuli that follow on two
parallel lines, and indicate the
correct responses after the
switch on one line and the
incorrect ones on the other
line.
Positive feedback:
Give big smiley face when the
next two times they correctly
switch targets.
Error
Miss the balls with click
type 2:
outside of the ball - same
messages and actions as for
Level 1.
Error
Miss the balls with late click -
type 3:
same messages and actions
as for Level 1.
Error
Click on wrong color ball
type 4:
after having made one
correct click on the current
correct target.
Message criterion:
Two of these types of errors
out of five clicks
Auditory Message:
“Whoops did you forget what
the target color is? Try your
best to remember what the
target is. You can check on the
side of the screen if you are
not sure.”
Visual message:
Show an illustration of the
game background and circle
where the current target color
is indicated.
Positive feedback:
Give big smiley face when
they next correctly identify
two targets in a row.
TABLE 4
Level 4 (target switches between red and
blue and there are also green balls):
Error
Fail to switch target as
type 1:
indicated either by failing to
click on the new target OR
clicking on the old target
after the switch.
Message criterion:
Errors on the first two stimuli
after the target switches.
Auditory Message:
“Whoops the target color
changed and you did not start
catching the new color!”
Visual message:
Show an illustration of the
target color changing the
stimuli that follow on two
parallel lines, and indicate the
correct responses after the
switch on one line and the
incorrect ones on the other
line.
Positive feedback:
Give big smiley face when the
next two times they correctly
switch targets.
Error
Miss the balls with click
type 2:
outside of the ball - no
messaging.
Error
Miss the balls with late click -
type 3:
no messaging.
Error
Click on wrong color ball
type 4:
after having made one
correct click on the current
correct target.
Message criterion:
Two of these types of errors
out of five clicks (This might
mean errors in a span of trials
that includes a target color
switch in the middle. In this
case this type of error does not
register until the first correct
response after the target
switch.)
Auditory Message:
“Whoops did you forget what
the target color is? Try your
best to remember what the
target is. You can check on the
side of the screen if you are
not sure.”
Visual message:
Show an illustration of two
sequences of balls in parallel
lines one with green balls and
one without. Indicate the
correct responses on the line
without green balls and the
fact that the balls following
green ones on the other line
are not correct.
Positive feedback:
Give big smiley face when
they next correctly ignore a
blue following a red or a red
following a blue with a green
in between them.
Error
Click on green ball at any
type 5:
time.
Message Criterion:
click on two out of ten green
balls.
Auditory Message:
“Whoops green balls are never
a target.”
Visual Message:
Show green ball with an X on
it.
TABLE 5
Level 5 (target is red after red or blue after blue; no green balls):
Error
Miss a target with no click
type 1:
Message criterion:
Miss two out of five targets.
Auditory Message:
Remember, every time the ball
is the same color as the one
before, you need to catch it.
Keep the color of the ball you
just saw in your mind so you
will know what balls to catch.
Visual message:
Show sequence of 5 balls with
two targets and arrows
pointing to the targets.
Positive feedback:
Give smiley face or other
congratulations after they
correctly click on two
successive targets.
Error
Miss a target with click
type 2:
outside of the ball- no
messaging.
Error
Miss a target with late click-
type 3:
no messaging.
Error
False click on a red or blue
type 4:
ball
Message criterion:
Clicks on 2/5 foils.
Auditory message:
“Remember, it is only a target
when it is the same color as
the ball before. Do your best
to remember the color of the
last ball you saw so that you
know whether or not to catch
the next one.”
Visual message:
Show the same sequence of 5
balls as for Error message # 1
but indicate “not a target” and
“do not catch” for the foils.
TABLE 6
Level 6 (target is red after red or blue after blue; with green balls):
Error
Miss target with no click
type 1
Message criterion
Miss 2/5 targets.
Auditory Message
Remember, every time the ball
is the same color as the one
before, you need to catch it.
Keep the color of the ball you
just saw in your mind so you
will know what balls to catch.
Visual message
Show sequence of 5 balls with
two targets and arrows
pointing to the targets.
Positive feedback
Give smiley face or other
congratulations after they
correctly click on two
successive targets.
Error
Miss a target with click
type 2
outside of the ball- no
messaging.
Error
Miss a target with late click-
type 3
no messaging.
Error
False click on a red or blue
type 4
ball
Message criterion
Clicks on 2/5 foils.
Auditory message
“Remember, it is only a target
when it is the same color as
the ball before. Do your best
to remember the color of the
last ball you saw so that you
know whether or not to catch
the next one.”
Visual message
Show the same sequence of 5
balls as for Error message # 1
but indicate “not a target” and
“do not catch” for the foils.
Error
False click on a red or blue
type 5
ball after a green ball
Message criterion
Two of this type of error out
of five times when there is a
sequence R-G-R or B-G-B.
Auditory Message
“Whoops, there was a green
ball just before the ball you
clicked on. If there is a green
ball it means that the next red
of blue ball is coming after a
green ball and not after a red
or blue ball. There can never
be a correct response after a
green ball.”
Visual message
Show a sequence of 6 balls
with two correct targets
indicated by arrows and then
two that would have been
targets except that the green
ball between them means they
are not targets. Indicate these
“non-targets” with the green in
between as “not a target” and
“do not catch”.
Error
False click on a green ball
type 6
Message Criterion
click on 2/10 green balls.
Auditory Message
“Whoops, green balls are
never a target.”
Visual Message
Show green ball with an X on
it.
TABLE 7
Level 7 (target is red after blue or blue after red; no green balls):
Error
Miss a target with no click
type 1
Message criterion
Miss 2/5 targets.
Auditory Message
Remember, now every time
the ball is a different color
than the one before, you need
to catch it. Keep the color of
the ball you just saw in your
mind so you will know what
balls to catch.
Visual message
Show sequence of 5 balls with
two targets and arrows
pointing to the targets.
Positive feedback
Give smiley face or other
congratulations after they
correctly click on two
successive targets.
Error
Miss a target with click
type 2
outside of the ball - no
messaging
Error
Miss a target with late click -
type 3
no messaging
Error
False click on a red or blue
type 4
ball
Message criterion
Clicks on 2/5 foils.
Auditory message
“Remember, it is only a target
when it is a different color
from the ball before. Do your
best to remember the color of
the last ball you saw so that
you know whether or not to
catch the next one.”
Visual message
Show the same sequence of 5
balls as for Error message # 1
but indicate “not a target” and
“do not catch” for the foils.
Level 8 (target is red after blue or blue after red; with green balls):
Error
Miss a target with no click
type 1
Message criterion
Miss 2/5 of targets.
Auditory Message
Remember, every time the ball
is a different color than the
one before, you need to catch
it. Keep the color of the ball
you just saw in your mind so
you will know what balls to
catch.
Visual message
Show sequence of 5 balls with
two targets and arrows
pointing to the targets.
Positive feedback
Give smiley face or other
congratulations after they
correctly click on two
successive targets.
Error
Miss a target with click
type 2
outside of the ball- no
messaging.
Error
Miss a target with late click-
type 3
no messaging.
Error
False click on a red or blue
type 4
ball
Message criterion
Clicks on 2/5 foils.
Auditory message
“Remember, it is only a target
when it is a different color
from the ball before. Do your
best to remember the color of
the last ball you saw so that
you know whether or not to
catch the next one.”
Visual message
Show the same sequence of 5
balls as for Error message # 1
but indicate “not a target” and
“do not catch” for the foils.
Error
False click on a red or blue
type 5
ball after a green ball
Message criterion
Two of this type of error out
of five times when there is a
sequence R-G-B or B-G-R.
Auditory Message
“Whoops, there was a green
ball just before the ball you
clicked on. If there is a green
ball it means that the next red
of blue ball is coming after a
green ball and not after a red
or blue ball. There can never
be a correct response after a
green ball.”
Visual message
Show a sequence of 6 balls
with two correct targets
indicated by arrows and then
two that would have been
targets except that the green
ball between them means they
are not targets. Indicate these
last two with the green in
between are “not a target” and
“do not catch”.
Error
False click on a green ball
type 6
Message Criterion
click on 2/10 green balls.
Auditory Message
“Whoops, green balls are
never a target.”
Visual Message
Show green ball with an X on
it.
The following is a brief description of this exercise. An individual may be presented with a screen having four stimulus windows on the upper row and three on the lower row (number of windows can be increased on both rows). The stimuli in the first row represent a sequential pattern or have a “story line.” Individuals have to choose the stimulus on the second row that fits with the pattern or story line on the first row. For example: 2, 4, 6 predicts 8. Stimuli can be numbers, words, pictures and/or a mixture of any of the above. The individual may be provided with the following instructions:
If the correct choice is made, the box flashes bright colors and the stimulus selected on the second row appears in the open box on the first row. If the choice is wrong, the computer may generate a “thud” sound, the boxes in the lower row go blank and flash in dull gray, the same trial is repeated with the audio message is given to “try again”. When the stimulus durations and inter-trial interval become short, the audio message is omitted.
The following speed adjustments may be made during this exercise:
An exemplary algorithm for adjusting the speed may include the following criteria: (a) if three consecutive correct choices are made, then exposure time of the boxes is decreased by 10%, (b) if two consecutive errors are made, then the exposure time is increased by 10% up to a maximum of 200% of their starting time.
In order to advance forward, the individual may be required to meet a predetermined graduation criterion. Such criterion may include five consecutive correct choices made with an exposure time of 500 msec. Further, a predetermined plateau criterion may also be required of the individual. Such plateau criterion may include 10 alternations between two speeds without advancing to a faster speed. Upon reaching both criteria, the individual is permitted to advance forward.
Individual stimuli may be randomly selected from a current stimulus set, with the constraint that the same stimulus is not repeated more than twice in a row. The individual may be permitted to continue trying to advance to the next difficulty level by choosing a correct answer based on the stimuli until graduation or plateau criteria are met. The position of the correct response among the response choices in the boxes may vary randomly from trial to trial. The following illustrate some non-limiting examples of stimuli in this exercise:
The following error types may be generated by the individual involved in this exercise:
Error Type 1 may produce auditory/visual messages based on the following message criterion:
Error Types 2 and 3 may produce auditory/visual messages based on the following message criterion:
Error Types 4-8 and 11 may produce auditory/visual messages based on the following message criterion:
Error Types 9, 10, 12, and 13 may produce auditory/visual message based on the following message criterion:
For Error Types 14-20, the following may apply:
For Error Types 21 and 22, the following may be applicable:
With regard to Error Type 23, the following messages may be generated:
The following is a brief description of this exercise. This exercise may be presented to children of a particular age (e.g., 6-8 years of age). As stated above, an object of this exercise is for the individual to recognize and/or identify objects that are being presented to him/her on the screen of a computer, where such objects may be carried by, for example, balloons and/or butterflies. Recognition/identification of objects is made by the individual taking into account various speeds, difficulty levels, etc. This experimental example will be described in terms of a game of balloons/butterflies as presented to children of 6-8 years of age.
The following speed adjustments, algorithm for adjusting speed, graduation criterion, and plateau criterion may be implemented in this exercise:
The following difficulty levels may be implemented in this exercise:
The following stimulus sets may be included in this exercise. Each stimulus set may have an increased difficulty with regard to objects being used and also include a various categories of objects that may be present in the stimulus set.
1. Category Sorting: Basic Numbers
2. Category Sorting: Animals
3. Category Sorting: Food
4. Category Sorting: Furniture
5. Category Sorting: Clothes
6. Category Sorting: Clothes or Food
7. Category Sorting: Big Animals
8. Category Sorting: Big and Small Animals Alternating
9. Category Sorting: Things that you find inside a house
10. Category Sorting: Things that you find outside of a house
11. Category Sorting: Things that you can both find inside and outside of a house
12. Category Sorting: Tools
13. Category Sorting: Things to Play with
14. Category Sorting “Things to Take on Vacation”
15. Category Sorting: Things that go Together Because One is Used to Make the Other
16. Find the Pairs: Numbers
17. Find the Pairs: Any Two Things that go Together
The systems and methods disclosed herein can be embodied in various forms including, for example, a data processor, such as a computer that also includes a database, digital electronic circuitry, firmware, software, or in combinations of them. Moreover, the above-noted features and other aspects and principles of the present disclosed implementations can be implemented in various environments. Such environments and related applications can be specially constructed for performing the various processes and operations according to the disclosed implementations or they can include a general-purpose computer or computing platform selectively activated or reconfigured by code to provide the necessary functionality. The processes disclosed herein are not inherently related to any particular computer, network, architecture, environment, or other apparatus, and can be implemented by a suitable combination of hardware, software, and/or firmware. For example, various general-purpose machines can be used with programs written in accordance with teachings of the disclosed implementations, or it can be more convenient to construct a specialized apparatus or system to perform the required methods and techniques.
The systems and methods disclosed herein can be implemented as a computer program product, i.e., a computer program tangibly embodied in an information carrier, e.g., in a machine readable storage device or in a propagated signal, for execution by, or to control the operation of, data processing apparatus, e.g., a programmable processor, a computer, or multiple computers. A computer program can be written in any form of programming language, including compiled or interpreted languages, and it can be deployed in any form, including as a stand-alone program or as a module, component, subroutine, or other unit suitable for use in a computing environment. A computer program can be deployed to be executed on one computer or on multiple computers at one site or distributed across multiple sites and interconnected by a communication network.
As used herein, the term “user” can refer to any entity including a person or a computer.
Although ordinal numbers such as first, second, and the like can, in some situations, relate to an order; as used in this document ordinal numbers do not necessarily imply an order. For example, ordinal numbers can be merely used to distinguish one item from another. For example, to distinguish a first event from a second event, but need not imply any chronological ordering or a fixed reference system (such that a first event in one paragraph of the description can be different from a first event in another paragraph of the description).
The foregoing description is intended to illustrate but not to limit the scope of the invention, which is defined by the scope of the appended claims. Other implementations are within the scope of the following claims.
These computer programs, which can also be referred to programs, software, software applications, applications, components, or code, include machine instructions for a programmable processor, and can be implemented in a high-level procedural and/or object-oriented programming language, and/or in assembly/machine language. As used herein, the term “machine-readable medium” refers to any computer program product, apparatus and/or device, such as for example magnetic discs, optical disks, memory, and Programmable Logic Devices (PLDs), used to provide machine instructions and/or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term “machine-readable signal” refers to any signal used to provide machine instructions and/or data to a programmable processor. The machine-readable medium can store such machine instructions non-transitorily, such as for example as would a non-transient solid state memory or a magnetic hard drive or any equivalent storage medium. The machine-readable medium can alternatively or additionally store such machine instructions in a transient manner, such as for example as would a processor cache or other random access memory associated with one or more physical processor cores.
To provide for interaction with a user, the subject matter described herein can be implemented on a computer having a display device, such as for example a cathode ray tube (CRT) or a liquid crystal display (LCD) monitor for displaying information to the user and a keyboard and a pointing device, such as for example a mouse or a trackball, by which the user can provide input to the computer. Other kinds of devices can be used to provide for interaction with a user as well. For example, feedback provided to the user can be any form of sensory feedback, such as for example visual feedback, auditory feedback, or tactile feedback; and input from the user can be received in any form, including, but not limited to, acoustic, speech, or tactile input.
The subject matter described herein can be implemented in a computing system that includes a back-end component, such as for example one or more data servers, or that includes a middleware component, such as for example one or more application servers, or that includes a front-end component, such as for example one or more client computers having a graphical user interface or a Web browser through which a user can interact with an implementation of the subject matter described herein, or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication, such as for example a communication network. Examples of communication networks include, but are not limited to, a local area network (“LAN”), a wide area network (“WAN”), and the Internet.
The computing system can include clients and servers. A client and server are generally, but not exclusively, remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.
The implementations set forth in the foregoing description do not represent all implementations consistent with the subject matter described herein. Instead, they are merely some examples consistent with aspects related to the described subject matter. Although a few variations have been described in detail above, other modifications or additions are possible. In particular, further features and/or variations can be provided in addition to those set forth herein. For example, the implementations described above can be directed to various combinations and sub-combinations of the disclosed features and/or combinations and sub-combinations of several further features disclosed above. In addition, the logic flows depicted in the accompanying figures and/or described herein do not necessarily require the particular order shown, or sequential order, to achieve desirable results. Other implementations can be within the scope of the following claims.
Patent | Priority | Assignee | Title |
11810469, | Oct 27 2020 | SECURITY COMPASS TECHNOLOGIES LTD. | Just-in-time training system and method |
Patent | Priority | Assignee | Title |
5065345, | Nov 04 1988 | DynEd International, Inc. | Interactive audiovisual control mechanism |
5169319, | Jul 30 1990 | Method for improving a person's skill for playing an interactive video game requiring eye-hand coordination and operation of manual activation means | |
6435877, | Oct 07 1998 | Houghton Mifflin Harcourt Publishing Company | Phonological awareness, phonological processing, and reading skill training system and method |
6493690, | Dec 22 1998 | Accenture Global Services Limited | Goal based educational system with personalized coaching |
6511324, | Oct 07 1998 | Houghton Mifflin Harcourt Publishing Company | Phonological awareness, phonological processing, and reading skill training system and method |
6634887, | Jun 19 2001 | CARNEGIE LEARNING, INC | Methods and systems for tutoring using a tutorial model with interactive dialog |
8591392, | Apr 03 2009 | NEURONIX LTD | Method and system for neurological treatment |
8666298, | May 15 2008 | Coentre Ventures LLC; IP GENE VENTURES LLC | Differentiated, integrated and individualized education |
8734317, | May 25 2007 | LIM, YOUNG HYUN | Method to improve concentration and/or memory in a subject in need thereof |
20010046658, | |||
20020069189, | |||
20020103428, | |||
20030059750, | |||
20030059759, | |||
20030212579, | |||
20050053903, | |||
20050053904, | |||
20050153263, | |||
20060019227, | |||
20060184494, | |||
20070065789, | |||
20070166675, | |||
20070293735, | |||
20070298401, | |||
20080038705, | |||
20080254420, | |||
20090023977, | |||
20090155754, | |||
20090287619, | |||
20090306534, | |||
20100296649, | |||
20110118534, | |||
20120077160, | |||
20120088216, | |||
20120221075, | |||
20120282578, | |||
20130101976, | |||
20150351655, | |||
20160133149, | |||
WO2009049404, | |||
WO2012064999, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Sep 02 2015 | Yale University | (assignment on the face of the patent) | / | |||
Oct 30 2015 | WEXLER, BRUCE E | Yale University | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 037240 | /0190 |
Date | Maintenance Fee Events |
Mar 24 2023 | M2551: Payment of Maintenance Fee, 4th Yr, Small Entity. |
Date | Maintenance Schedule |
Sep 24 2022 | 4 years fee payment window open |
Mar 24 2023 | 6 months grace period start (w surcharge) |
Sep 24 2023 | patent expiry (for year 4) |
Sep 24 2025 | 2 years to revive unintentionally abandoned end. (for year 4) |
Sep 24 2026 | 8 years fee payment window open |
Mar 24 2027 | 6 months grace period start (w surcharge) |
Sep 24 2027 | patent expiry (for year 8) |
Sep 24 2029 | 2 years to revive unintentionally abandoned end. (for year 8) |
Sep 24 2030 | 12 years fee payment window open |
Mar 24 2031 | 6 months grace period start (w surcharge) |
Sep 24 2031 | patent expiry (for year 12) |
Sep 24 2033 | 2 years to revive unintentionally abandoned end. (for year 12) |