Next Patent: System and method for real-time observation assessment
Next Patent: System and method for real-time observation assessment
[0001] A. Field of the Invention
[0002] The present invention relates to the field of learning assistance tools and techniques, and in particular, to computerized systems that can be used in training or learning programs for such things as hearing, speech, reading, writing, mathematics, and language skills.
[0003] B. Problems in the Art
[0004] Through history many attempts have been made to facilitate more efficient learning of what will be called rule-based systems. Examples are speech and language skills, and mathematical skills. Historically, and yet today, the most conventional learning methods use repetitive, rote learning, which includes teacher/student interaction.
[0005] For example, teaching of reading or writing generally involves repetitive exercises by the learner, beginning with very basic, simple tasks and progressing through more and more difficult tasks. This obviously is “labor” intensive, both from the standpoint of the learner and any teacher or assistant that is monitoring or assisting in the learning exercises. Teachers must spend significant amounts of hands-on time, particularly with students that have special needs or learning difficulties.
[0006] This type of “manual” learning training is therefore time and resource intensive. It also is susceptible to a certain amount of subjectivity on the part of either student or teacher. Still further it relies significantly on the discipline, interest, and skills of student and teacher.
[0007] A more concrete example is as follows. A young student with hearing impairment is to begin to learn to decode spoken language. A teacher, with or without the assistance of recorded sound, repetitively presents spoken words to the student and attempts to train recognition of spoken language. Pictures or other perceivable information can be manually presented to the student along with the spoken words. The teacher decides the pace and content of each lesson and controls the progression of the student subjectively.
[0008] The time and effort of the teacher is critical to success of the program. Such valuable one-on-one learning is extremely valuable, and therefore difficult to obtain for a wide range of students. Therefore, one-on-one teaching time is in many cases by necessity essentially rationed. Students are left to practice or train on their own, or without expert assistance. A deficiency in this arrangement is the lack of supervision and the reliance on the individual for progress. Still further, standardized training materials may not function well for students with a typical or problematic learning or perception skills.
[0009] Attempts at improvement in this area have involved development of somewhat automated or computerized training systems. A substantial number of interactive computerized systems are based primarily on game-type exercises which present tasks which demand a right or wrong answer. The student simply takes the “test” and is scored on the number of right or wrong answers. The primary deficiency in such systems is the lack of flexibility for students with different learning styles or capabilities.
[0010] Such a student just may not function efficiently in a stark “right” or “wrong” question/answer system.
[0011] Still further, such present day interactive systems are somewhat limited in that they are directed only to fairly narrow, limited aspects of learning or training relating to certain subject matter.
[0012] Systems have therefore been developed, called individual learning systems (ILS) that attempt to tailor the learning task to individual students. These systems are still based primarily on right or wrong answers, and even though somewhat individualized, are not as flexible as might be desired.
[0013] The present state of the art therefore lacks flexibility. There is no satisfactory system that can be used for wide variety of individualized problems or learning skills, or which is applicable to a wide range of standard course contents or a wide variety of courses. Still further, the state of the art has room for improvement in the way special learning problems are handled. In effect, many allegedly high technology individualized computerized systems may be no better, or even worse than, training on a one-on-one basis with a human teacher.
[0014] Additionally, a need exists in the art for a powerful training and learning system that is integratable with a number of different learning tasks and subject matter. A need exists with regard to efficiency in terms of economical allocation of resources, speed in terms of providing the most efficient progress for individualized learning skills, incentive in terms of providing motivation for learners and/or teachers to succeed and progress at the most beneficial rate; all to maximize the learning potential and success for the least amount of time and dollars.
[0015] It is widely acknowledged that education is truly a key to many facets of life. In fact, education is and historically has been, in the United States and many countries, a leading public policy priority. Therefore, improvements in the ability to provide learning, from the standpoint of meaningful success for the students, as well as efficient allocation of resources towards that end, should be a primary goal of all levels of government and its citizens. Studies have shown that one root of illiteracy is lack of foundational learning and training by the first grade level. A need therefore exists regarding efficient and effective training of pre-reading skills for first graders and even kindergartners. The ability of children this age to self-teach is minimal. Therefore, an effective automated learning assistance system would be of tremendous value to children, as well as society in general, if viewed from a long-term perspective.
[0016] Additionally, there is great need and increasingly reduced resources for assisting in learning for deaf or the hearing impaired, particularly younger children who would value greatly from speech perception and reading training.
[0017] C. Objectives and Advantages of the Invention
[0018] It is therefore a principle object and advantage of the present invention to provide an interactive learning assistance system which improves upon the state of the art or solves many problems in the state of the art.
[0019] Other objects and advantages of the present invention are to provide a system as above described which:
[0020] Allows most efficient learning, and accommodates different ways of learning both for normal and problem learners.
[0021] Provides a process-oriented learning training system rather than simply right/wrong learning training.
[0022] Provides a system that is dynamic in the sense that it is self-adjusting to different learners' speeds, styles, and needs.
[0023] Is multisensory and perceptually based.
[0024] Allows discovery and exploration for learning rather than imposed rules for learning.
[0025] Does not focus on a presumed learning technique for everyone.
[0026] Is truly individualized for each learner.
[0027] Is flexible but integrateable to many applications and needs.
[0028] Allows selection or imposition of various performance strategies and levels.
[0029] Provides for on-call reporting to allow evaluation of progress and changing of strategies at any time.
[0030] Allows continuous and comprehensive recordation of user responses to derive learning styles along with performance criteria.
[0031] Can be used for a variety of learning, including speech perception, vocabulary, reading, mathematics, geography, language (English and foreign) and other rule-based subject matter.
[0032] Empowers efficiency in learning including improved speed in learning which translates into more efficient use of time and money.
[0033] Is substantially automated and automatic in its dynamic adjustment to learning styles.
[0034] Allows a number of options and features which can enhance learning, for example, interjecting background noise over speech recognition training stimuli for those who are hard of hearing.
[0035] These and other objects, features, and advantages of the invention will become more apparent with reference to the accompanying specification and claims.
[0036] The present invention, in its broadest sense, relates to a system that can be used to transfer learning. It relates to learning assistance, particularly for rule-based systems. Examples are speech, reading, math, and languages. The student interacts with a computer. A user interface includes a computer display, some type of stimuli presentation device (visual, auditory, or otherwise), and a manually operable response device such as a keyboard, touch screen, or mouse. Software presents a series of logically coded analytical units (stimuli) to the user. These analytical units are taken from a predetermined set of core stimuli which can consist, for example, of sentences, words, sounds, images, etc.
[0037] The user is presented with tasks, for example to compare two stimuli and respond whether they are the same or different. The software allows the user to explore or discover information about the two stimuli before making a decision by allowing the user to selectively access further information regarding the stimuli. Different levels of difficulty of the tasks are available. Difficulty levels can be presented based on the amount of sub-information made available to the user regarding any stimuli, the difficulty of the task, time limits imposed on completing the task, rate of progression from less difficult to more difficult, and other criteria.
[0038] To begin a session, the range of level of difficulty is determined for a user. Access to a given amount of information regarding the task can either be selected by an instructor, or the software will test the user and automatically select a beginning level. Thereafter, the system will continuously and comprehensively monitor the performance of the user and provide feedback, not solely on success-rate based on right or wrong responses, but also on type of response, the time it takes to respond, and the specific discovery and answering strategy utilized.
[0039] The user's performance therefore is continuously, essentially in real time, analyzed by comparison to standardized and preset goals or criteria based on right/wrong criteria, but also on non-right/non-wrong criteria. As a result of that feedback, the pre-selected strategies and progression plan will be adjusted. Essentially, tasks can be made more or less difficult depending on performance and method of performance. The level of difficulty can be changed not only as to the subject matter of the stimuli, but also in more subtle aspects, such as rate of progression in each lesson, the amount of information available for exploration and discovery for each task, the type of information made available to discover, etc.
[0040] Software therefore automatically and dynamically sets and controls strategy and movement of the student through series of lessons. Performance is recorded and quantified. The user has a significant amount of control and can explore and discover to match his/her own learning strategies and techniques. A teacher can at any time request a report on performance and subjectively alter the learning strategy and movement for the student. Still further, software allows as an option the ability for a teacher or instructor to customize lessons for individualized students.
[0041] The invention therefore presents a learning training system which allows the efficient utilization of teacher or expert supervision, while presenting to a user a learning training tool for intense, long period, repetitive learning tasks which conforms to the learning styles of the individual and therefore is more likely to be motivating and pleasurable to utilize.
[0042] The invention has a number of options or enhancements that will be discussed in more detail later.
[0043]
[0044]
[0045] FIGS.
[0046]
[0047]
[0048]
[0049]
[0050]
[0051]
[0052]
[0053] FIGS.
[0054]
[0055]
[0056]
[0057]
[0058]
[0059]
[0060] FIGS.
[0061]
[0062]
[0063]
[0064]
[0065]
[0066] FIGS.
[0067] FIGS.
[0068]
[0069] A. Overview
[0070] To assist in a better understanding of the invention, a preferred embodiment will now be described in detail. It is to be understood that this preferred embodiment is but one form the invention can take and is not exclusive of the forms that are possible.
[0071] The drawing figures will be referred to throughout this description. Reference numerals and/or letters will be used to indicate certain parts or locations in the drawings. The same reference numerals will be used to indicate the same parts or locations throughout the drawings unless otherwise indicated.
[0072] B. General Environment of the Preferred Embodiment
[0073] The example given by this preferred embodiment is particularly relevant to the teaching of young children (kindergarten or first graders) and/or children with hearing loss (either total or partial), or children with other types of perception impairments, such as learning disabilities. It is therefore to be understood that the concepts discussed would be by analogy applicable to any learning training, regardless of age, capabilities, or impairments; and particularly to learning of rule-based systems such as speech, reading, language (English and others), math, and the like.
[0074] As will be described in more detail below, the preferred embodiment entails a computer-based interactive system. In the above described environment with regard to learning by relatively small children, a teacher or speech/hearing professional is generally involved to initialize and monitor the training. However, the invention certainly can be used at home by non-technically trained persons.
[0075] Still further it is to be understood that the specific example discussed has some subtle concepts which are generally well known to those in this art, although some will be brought out here to assist those relatively unskilled in the art. First, the learning training discussed is many times very fundamental and highly repetitive. For example, a deaf child trying to distinguish between the sound of a one syllable word and environmental noise such as a car horn or a dog bark, must start at a very fundamental level. The student would be given intensive repetitive tests where the stimuli were simple one syllable words compared to non-speech sounds. Through long period, repetitive training, the child will begin to distinguish the same. This will lay the foundation for movement to more difficult differentiations; for example multi-syllable words or sentences compared to multi-syllable words or sentences of different makeup. One of the main advantages of the present invention is to allow such sometimes tedious, intensive work to be marshalled autonomously by the computer system while maintaining a level of motivation and interest in the user. This allows the teacher, professional, or parent the ability to ration their attention, while maintaining the interest of the user, and in fact, providing the user with the level of difficulty needed for the user's particular needs.
[0076] The following description will be broken down into these segments. First, a basic discussion of a preferred hardware system will be set forth. Thereafter, a high level description of the software of the preferred embodiment will be given. This will be followed by a specific discussion of various fundamental concepts utilized in the system. Thereafter a specific example of operation of the system will be set forth with reference to various examples of data and stimuli that are useful for these purposes. Finally, a discussion of options, alternatives, and features of the invention will be given.
[0077] C. Hardware
[0078]
[0079] An EGA-VGA adapter and monitor
[0080] A sound stimuli component for the user interface consists of a speaker
[0081] As is known to those skilled in the art, each of those auditory components could be used for presenting sound to a user. Speaker
[0082]
[0083] It is further noted that in the preferred embodiment, a comprehensive manual would be given to the user of system
[0084] D. Software Configuration
[0085]
[0086] The software runs on MS-DOS and is written in Turbo C and C+ language.
[0087] A floppy disk is supplied with the programming and is installed into computer
[0088] What is called the core stimuli for the programming are approximately 1600 words, sounds, pictures, and the like which form the basis for the training lessons presented with system
[0089] As will be discussed in more detail later, different courses can be offered with system
[0090] As will be further described below, memory also contains a plurality of different lessons for each specific course to allow variety for the user as well as varying levels of difficulty. In the preferred embodiment approximately 1000 lessons are utilized.
[0091] E. Software Overview
[0092] By referring to
[0093] Under each course is a plurality of lesson packages. Each lesson package (in the preferred embodiment approximately 160 lesson packages) would involve between 1 to 15 lessons. System
[0094] For the listening course each lesson would generally contain one or more word lists. In this context word lists can mean words, combinations of words, sentences, non-speech sounds, or any auditory stimuli.
[0095] As shown at
[0096] Therefore, when operating system
[0097]
[0098] First of all, tasks consist of one or more of pretest, posttest, practice, training, and production. Specific examples of these will be given later. Basically the lesson can predetermine whether the user is prepared for the level of difficulty of the lesson using a pretest. It can also posttest the student to better check what has been learned. A practice component can allow the user to familiarize him or herself with the particular task. The term training refers to the actual learning process.
[0099] A production task involves a variety of tests or processes aimed at requiring the user to essentially produce a result. The production task may differ substantially from the training and is incorporated as an optional feature to go along with the listening training. One example is to have the student vocalize a word or try to match the word as sounded by system
[0100] The term “Mode” in the preferred embodiment means selection between essentially a discrimination task or an identification task. A discrimination task merely asks the user to state whether two presented stimuli are the same or different. Identification tasks present a stimuli and then ask which of two or four succeeding stimuli matches the original stimuli. A comprehension mode is also possible which presents the stimuli and then requires language comprehension to select the answer.
[0101] The “libraries” portion of each lesson relates to the specific audio visual presentations that will be available in the lesson. As can be shown, audio, pictorial, and text are either taken from pre-stored core stimuli, or as indicated by the box labeled “input from stimuli editor”, can be customized and input for use. Still further, the edit feature allows editing of the existing core stimuli.
[0102] As is also shown in
[0103] The feedback component of the lessons simply is any number of built-in presentations that provide reinforcing feedback and motivation to the user of system
[0104]
[0105] The strategy therefore can essentially set the initial difficulty of each lesson and then the rate of progression as far as difficulty from then on.
[0106] In the preferred embodiment, as shown in
[0107] It is to be understood that the system is very flexible in this aspect but provides the advantage of dynamically, on the fly, monitoring a user's progress and then adjusting one or more of these sometimes subtle criteria to in turn adjust presentation of the tasks and allow the user to not only go at his/her own speed, but to discover and explore and to find his/her own best learning strategies.
[0108]
[0109] F. Training Task Displays
[0110] FIGS.
[0111] As is also indicated at
[0112] Therefore, top level presentations relate to a whole stimulus, whereas the attribute sections are a presentation of a whole stimulus or abstractions of the whole stimulus.
[0113]
[0114] It is to be understood that the software allows the user to replay either the top level stimuli to encourage exploration of auditory information. The user is never penalized for requesting repetitions prior to selecting an answer. The user can also replay the attribute information and explore the variety of receptional information available before making a selection.
[0115] G. Word Lists
[0116]
[0117] As can be appreciated, a wide variety of word lists are possible. At the end of this description are provided a number of examples of different types of word lists.
[0118] H. Different Attributes
[0119]
[0120] The second display indicates relative length of the phrase by use of a black bar. The third display shows as an attribute the syllables and each word of the phrase. The fourth display shows each syllable and the stress one would place when speaking each syllable.
[0121]
[0122]
[0123] I. Strategy
[0124]
[0125] J. Preview
[0126]
[0127] K. Production Training
[0128]
[0129] The production training simply allows the user to practice vocalization of words or sounds, in this case, and to allow a teacher to evaluate such vocalizations.
[0130] L. Feedback
[0131] As previously mentioned,
[0132] In
[0133] M. Initial Selection Options
[0134] FIGS.
[0135] For example, regarding pattern perception, if the user is a very young child with a hearing deficiency, he/she may not be able to differentiate between speech and non-speech. If so, lessons and tasks within the lessons would have to start at a very basic level. If the child could differentiate accordingly, he/she may be able to start at a slightly higher level of lessons and tasks.
[0136] FIGS.
[0137]
[0138]
[0139]
[0140]
[0141] Finally,
[0142] It can therefore be seen that a wide variety of flexibility is given to both customize or individualize training for each individual, as well as present different learning strategies for each individual.
[0143] N. Operation
[0144] The basic components and concepts of system
[0145] By referring to
[0146] Certain basic information is then entered including user name (
[0147] Next the user default screen should be configured (see
[0148] Thereafter, a lesson plan is created (see
[0149]
[0150]
[0151] Finally,
[0152] Other selections would then be made available for customization or default selection:
[0153] Starting A/V level: This option specifies the A/V level setting for displaying the stimulus during the training task.
[0154] Preview: This YES/NO option controls whether the user is given a preview of the stimuli prior to the training task. This, option may be used to insure the stimuli are in the user's vocabulary before entering the task.
[0155] Training: This YES/NO option controls whether the user engages in the perception training tasks.
[0156] Task Pass Percent: Determines the percent correct needed to pass to next training task. Default value is 75%.
[0157] Pretest: This YES/NO option controls whether users are given a pretest before receiving training. Pretest value can be compared with training values and posttest values to document changes.
[0158] Posttest: This YES/NO option controls whether the users are given the posttest on completion of training for a lesson.
[0159] Reserve Testing Group: This YES/NO option is relevant only if the pretesting and/or posttest option is set to YES and controls whether content used during testing is or is not used during training.
[0160] Pretest Judgment: This YES/NO option is relevant only if pretest is selected. It controls whether a score obtained on pretest is used to place the user in a training series. The next two options “advance criteria” and “enter criteria” are used to set values for entering a training series based on the pretest score.
[0161] Advance Percentage: This option is relevant only if pretest is selected. The value entered determines when a user advances to the next lesson level. For example, if the value were set to 85% and the user obtained that score or better, the user would advance to the next lesson level for pretest rather than enter the training series.
[0162] Enter Percent: Relevant only if pretest is set to YES. The value entered sets the lowest acceptable limit for entering a lesson series. If the user can not obtain this entry score he/she will be moved back to a less difficult lesson level.
[0163] Production: A five choice option controls whether the user will be placed in a production task and if so when the production task will be sequenced in the training. Options include “none”, “pretest”, “posttest”, “pre/posttest”, and “group based”. If “group based” is selected the production task would be given each time the user moves into a new contrast group.
[0164] Production A/V Level: This option specifies the A/V level setting for displaying the stimulus during the production task.
[0165] Method of Grouping Contrasts From Word Lists: This option controls the way in which groups or stimuli are chosen and contrasts are paired in a lesson. There are four ways of grouping and presentation. A contrast ALWAYS involves a stimulus item from each set. Stimuli within a set are never contrasted. The four choices illustrated below are preceded by an explanation of the terms used.
[0166] Training Contrasts: This option specifies a number of contrasts to be presented within a training task.
[0167] Reps/Training Contrasts: Option specifies a number of times each contrast is repeated within a training task. The total number of trials presented per task can be determine by multiplying the number of training contrasts with the repetitions per contrast. The total number within a task can not exceed twenty.
[0168] Enter the number at the cursor. The backspace or delete keys can be used to erase the current value.
[0169] (Trials=): The number of total trials will appear after training contrasts and repetitions per training contrast have been specified. This value is dynamically derived by multiplying the two contrasts and repetitions. To change this value, one or both of the two preceding parameters must be changed.
[0170] Test Contrasts: This option specifies the number of contrasts to be presented within a pretest and/or posttest task.
[0171] Enter the number at the cursor. The backspace or delete keys can be used to erase the current value.
[0172] Reps/Test Contrast: This option specifies the number of times each contrast is repeated within a pretest and/or posttest task. The total number of trials presented per task can be determined by multiplying the number of training contrasts with the repetitions per contrast.
[0173] The total number of trials within a task cannot exceed 20.
[0174] Enter the number at the cursor. The backspace or delete keys can be used to erase the current value.
[0175] Trials=): The number of total trials will appear after test contracts and repetitions per test contrast have been specified. This value is dynamically derived by multiplying the contrasts and repetitions.
[0176] Enter the number at the cursor. The backspace and delete keys can be used to erase the current value.
[0177] Number of Screen Choices: This option specifies the number of answers available during a task. Either a two-choice or four-choice option is available.
[0178] Select either “2” or “4” by pressing the space bar.
[0179] Retries per trial: This option specifies the number of retries or chances the user has to select the correct answer before moving to the next contrast.
[0180] Enter the number at the cursor. The backspace or delete keys can be used to erase the current value.
[0181] Use Text: This option specifies whether text will be displayed during the task.
[0182] Select “Yes” or “No” by pressing the space bar.
[0183] Site Group: This optional feature specifies the library number of a special library established for specific site purposes.
[0184] Enter the number at this cursor. The backspace or delete keys can be used to erase the current value.
[0185] Picture Group: This option specifies which picture libraries should be used to display visual information. The choices are “Standard” “SEE 2”, and “Oral”. “Standard” refers to illustrated pictures. “SEE2” refers to Signing Exact English sign language and “Oral” refers to presentation of mouth postures. Only one picture group can be chosen per lesson.
[0186] Select the choice by pressing the space bar.
[0187] Audio Group: Standard English is the only audio group currently available.
[0188] Audio Overlay Name: This option allows background noise to be integrated into the audio signal. The default option is to leave the choice blank and have no overlay signal.
[0189] Select the overlay name by pressing F2.
[0190] Audio Overlay Level: This option controls the level of noise integrated into the audio signal. The value entered can range from 1 to 100, soft to loud.
[0191] Enter the number at the cursor. The backspace or delete keys can be used to erase the current value.
[0192] Once all of this is set up, the user can go into the lessons. Depending on what has been selected pretesting can be done to determine the position the student should start within the lessons. Once training starts, stimuli are presented according to the settings regarding A/V support, attributes, initial presentation, etc., and the user proceeds by answering, exploring, or discovering as previously discussed. Software constantly monitors the progress of the user and will adjust to his/her performance.
[0193] O. Appendices
[0194] By referring to FIGS.
[0195] It can be seen that wide variety of difficulty is possible.
[0196] Appendix B presents a printout of the menus for software to allow better understanding of the configuration of the software.
[0197] Appendix C sets forth examples of rules regarding coding of stimuli.
[0198] It is to be understood that this information is submitted in an attempt to disclose one way in which can be realized. The specific software code can be derived from disclosure of this preferred embodiment and is not essential to understanding of the invention. Substantial portion of one example of programming can be found at U.S. copyright registration TX529,929, registered Jul. 27, 1992 to Breakthrough, Inc., and is incorporated by reference herein.
[0199] It is to be appreciated that the invention can take many forms and embodiments. True essence and spirit of this invention are defined in the appended claims, and it is not intended that the embodiment of the invention presented herein should limit the scope thereof.