[0001] The present invention relates to a medical diagnosis technology, more specifically to a device for chaological evaluation of human factor for evaluating the condition of the cerebrum by analyzing a human voice and quantitatively detecting a level of the load generated in the human cerebrum. The present invention further relates to a prediction and a determination of changes in the psychosomatic activity of a person during and after his/her examination.
[0002] Furthermore, in the present invention, an object to be evaluated is a function of the cerebrum. Since activities of all animals are controlled by the cerebrum, the device of the present invention makes it possible not only to predict and determine the psychosomatic activities, specifically such as a sense of sorrow or pleasure, a sense of dread or uneasiness, those of which are tend to be surfaced on the body and can be detected and anticipated by observing through eyes or ears, but also to detect a load arisen on the cerebrum and a psychosomatic condition during a person is examined. The aforementioned load is generated in the cerebrum of a person, arising from, for example, an inferiority complex, for example, in solving a complicated mathematical problem, or likes and tastes of a person which relates to feelings of pleasure and uncomfortable. Also, the psychosomatic activity of a person in the future can be predicted and determined by making a tendency analysis of the person on the basis of the results of the evaluation test. Therefore, the present invention relates widely to an evaluation technology of human factors.
[0003] In prior art, the functions of a cerebrum have been obtained by measuring a brain wave. There have been, for example, a method or device for measuring a state of awakening of consciousness such as somnolence or a level of concentration of mind. Since 1980s, a positron CT equipment (PET) or a single photon CT equipment (SPECT) has been used so far. These equipment can offer images of such a moving state of a cerebral blood flow tracer, administered in the brain, or a metabolic rate of glucose in the brain, by using a gamma camera or a dedicated scanner.
[0004] There have been such another equipment for measuring a state of the brain activities by detecting the strength of reflected infra-red while irradiating the head with week infra-red and by consecutively inspecting and imaging the activities of a cerebral cortex located inside of the head bone (light topographic equipment).
[0005] These conventional methods for measuring brain waves detect an ever-changing electrical change, which is induced by a nerve cell in the cerebral cortex, through an electrode attached to a skin of the head. The size of the equipment itself has become comparatively downsized and inexpensive. The inspection of the brain wave, however, only gives information about such an abnormal wave caused from paroxysmal disease, a change between sleeping and awakening, a change of an overall level of the brain activity caused by disorder of consciousness, effects on brain functions caused by brain infarction, or brain tumor, or the like.
[0006] In an early stage of the study on the brain wave, it was considered that character or mental ability or psychosomatic activities of a person could be determined from the brain wave. But at present it becomes apparent that there is no specific relations between a brain wave and personality or mental ability of a person.
[0007] At present, equipment such as PET, SPECT or a light topographic equipment is the highest in sensitivity, being able to analyze and evaluate brain functions, but the size is still large.
[0008] Moreover, these foregoing equipment are considerably high in price, having difficulty in using these equipment. These situations have not been improved since PET, SPECT and the light topographic equipment were put into practical use.
[0009] Further more, these equipment mentioned above have a sensor to be attached to a human body when in use, or have necessity of administering an imaging agent to a person to be examined. For example, when performing evaluation of a brain function at a normal state, attached sensor may give a stress to the person, causing a different psychosomatic activity from that of the person's normal state, thereby information on the brain activity in normal state, which should be used as a standard in evaluation, can not be obtained, and there is always a possibility that the detection and determination of the psychosomatic condition may not be accurate.
[0010] On the other hand, as human activity is completely controlled by the brain, study and grasp on the function of the brain is considered to be a great significance not only in the field of medical technology but also in an area of studies of mental activities of a person engaging in an art such as music or the like and in an area of study on anthropology or civilization that handles human beings as a group with respect to and in connection with a difference in civilization or culture. In order to make use of the evaluation technique of the brain function in the studies of wide areas, it is indispensable to develop a device or equipment capable of evaluating the function of the brain without difficulty.
[0011] Therefore, an object of the present invention is to provide a device having a comparatively simple structure and also having an ability to predict and determine a psychosomatic condition of a person by detecting a level of a load generated in the cerebrum, without attaching any parts of the device to the person's body.
[0012] In order to solve the above mentioned problems, the inventors of the present invention have been studying strenuously and achieved the invention described hereunder.
[0013] The present inventors first conceived that the function of the cerebrum of a person can be evaluated by analyzing a voice uttered by the person. That is, processes in a nerve center of a cerebral cortex when the person utters a word can be classified into two major stages,—an articulation movement planning stage and a subsequent execution stage of an articulation movement—. An increase in the number of beats of a word to be uttered or complexity of a word or a sentence to be uttered causes an extension of the processing time in the articulation movement planning stage. These processes cause an increase in the load of the cerebrum, therefore the uttered sound is supposed to vary in line with an increase in the load in the cerebrum.
[0014] The uttered sound can be analyzed by a Lyapunov index which can be calculated by using a chaological method. The inventors have found that the psychosomatic activity can be determined and projected by measuring a level of a load generated in the cerebrum, without attaching any parts of the device to the body of a person, and by quantitatively expressing the activities of the brain on the basis of the above mentioned correlation between the cerebrum and the uttered sound.
[0015] Consequently, a first aspect of the present invention is that a device for chaological evaluation of human factor comprises:
[0016] a Lyapunov index calculation means for calculating a Lyapunov index by analyzing a digitized sound signal, which is changed into a digital data from a sound uttered by a person, by using a chaological method;
[0017] a Lyapunov index change detection means for detecting a change in the Lyapunov index of the uttered sound, which is calculated by using the Lyapunov index calculation means;
[0018] wherein a psychosomatic activity is predicted and determined by measuring a level of the load generated in the cerebrum on the basis of the change of the Lyapunov index detected by the Lyapunov index change detection means.
[0019] A second aspect of the present invention is that a device for chaological evaluation of human factor comprises:
[0020] a Lyapunov index calculation means for calculating a Lyapunov index by analyzing a digitized sound signal, which is changed into a digital data from a sound uttered by a person, by using a chaological method;
[0021] a Lyapunov index change detection means for detecting a change in the Lyapunov index of the uttered sound, which is calculated by using the Lyapunov index calculation means;
[0022] a prediction and determination means for predicting and determining a psychosomatic activity by measuring a level of a load generated in a cerebrum on the basis of the change of the Lyapunov index detected by the Lyapunov index change detection means.
[0023] According to the first and second aspect of the present invention, a state of activity of the cerebrum is detected from the state of the Lyapunov index calculated by analyzing a digitized sound signal, which is changed into a digital data from a sound uttered by a person, by using a chaological method. The normal state of cerebrum activity can be obtained, because measurement is carried out without giving an unnecessary psychological and physical burden or a feeling of tension to the person to be examined, that is, the measurement is carried out under a non touching condition of putting no parts of the device such as a sensor or the like on the body of the person to be examined.
[0024] In addition, characteristics of changes in the Lyapunov index can be detected by chaologically analyzing the uttered sound of a person. Subsequently, relative and temporal changes in the thus obtained Lyapunov index can be obtained in real time. A state of the psychosomatic activity of a person such as a state of tension, or tiredness etc. can be easily detected on the basis of the characteristics of the changes in the index, by measuring a change in the uttered sound instructed by the cerebrum, more specifically by detecting a state of the load on the cerebrum in an activity of the cerebrum.
[0025] Furthermore, the Lyapunov indexes obtained in real time by the chaological analysis and the changes in the obtained real time Lyapunov indexes are always checked relatively and temporally. As the changes in the uttered sound instructed by the cerebrum,—more specifically a state of the load on the cerebrum in the activity of the cerebrum—are measured on the basis of the characteristics of the changes in the index, there is no need to prepare in advance a standard value for evaluation. It is possible to make the evaluation immediately during the time of measurement. Furthermore, as there is no need to prepare beforehand a standard value for the evaluation, it is possible to minimize data storage means such as a memory, a magnetic media or the like as much as possible, therefore, it is possible to make the device small, what is more, to realize a built-in type by means of a structure of on-board type or a chip type.
[0026] A third aspect of the present invention is that in addition to the first or the second aspect of the present invention, the device further comprises: a microphone for inputting the uttered sound of a person as a sound signal; and an analogue-digital conversion means for converting the sound signal, which is input into the microphone, into a digital data.
[0027] According to the foregoing aspect of the present invention, when the device comprises the microphone for inputting voices as a sound signal into an uttered sound input means as, what is called, an input signal sensor, and the analogue-digital conversion means for converting the sound signal, which is input into the microphone, into a digital data, voices uttered by a person is possible to be input through an ordinary microphone. Thereby, a person who engages in a work using a microphone such as a pilot of an aircraft, an officer of a flight operations, a driver of a public transportation facility, a guide who takes around customers, an announcer of a broadcasting company, a wireless operator or the like, can use a headset or handy microphone as the uttered sound input means.
[0028] A fourth aspect of the present invention is that in addition to one of the first, second and third aspects of the present invention, the device further comprises: a non-uttered sound elimination means for eliminating a sound data other than the uttered sound data of a person, on the basis of characteristics of the non-uttered sound data, from said digital data, and transferring the thus obtained non-uttered sound eliminated digital data to said Lyapunov index calculation means.
[0029] According to the fourth aspect of the present invention, the sound data other than the uttered sound of a person is eliminated from the digital data of the sound, and the Lyapunov index is obtained through the chaological analysis on the basis of the non-uttered sound eliminated digital data. Therefore, it is possible to detect more accurate state of the load in the activity of the cerebrum because non-uttered sound, what is called as a noise, that has no relation to the uttered sound that corresponds to the state of the load in the cerebrum of a human being, is eliminated. For example, in a case where a sound signal such as a signal recorded on a sound communication recorder through wireless at the time of an aircraft accident, or on a voice recorder on an aircraft having comparatively a lot of noise is handled, investigation on the cause of an accident can be carried out through an analysis in terms of a psychosomatic change or a psychosomatic diagnosis by analyzing the sound signal with the device of the present invention.
[0030] Elimination of a sound data other than an uttered sound of a person from a digital data of the sound allows the device to be set up in a place where there is no environmental facility such as a silent room or the like, resulting in making the device more compact and less expensive, even when the device is used as a diagnosis device like such a diagnosis device as PET, SPECT or the like that have been used as a medical equipment for diagnosing the state of the activity of a brain or the function of a brain.
[0031] A fifth aspect of the present invention is that in addition to one of the first, second, third and fourth aspects of the present invention, the device further comprises, an uttered sound detection means for extracting and distinguishing characteristics of an uttered sound of each person from the non-uttered sound eliminated digital data, and transferring the characteristics to said Lyapunov index calculation means, enabling to predict and determine the psychosomatic activity of each person in the uttered sounds of more than one person.
[0032] According to the foregoing aspect of the present invention, it is possible to analyze and evaluate the uttered sound of each person from the uttered sounds of more than one person because each person's Lyapunov index can be obtained respectively by extracting and distinguishing the characteristics of each person's uttered sound from the non-uttered sound eliminated digital data. According to the foregoing aspect, the device can be used for determining a psychosomatic activity of each speaker at a meeting or discussion of more than one person, and for example, a state of mind such as whether or not who got interested in what topic, or whose story, and fear, stress, a state of awakening or the like as well are able to be determined. Therefore, the device may be used as a counseling machine or a lie detector.
[0033] The device of the present invention is used for quantifying the activity of various fields of the cerebrum that gives a biological signal as an output from the activity of the cerebrum as a whole, by analyzing the signal through a chaological method.
[0034] The present invention enables to evaluate a load generated in the language field of the cerebrum by detecting and evaluating changes of the Lyapunov index relatively and temporally through analyzing an uttered sound chaologically and sequentially.
[0035] In a chaological analysis, all one needs to do is to pick up an uttered sound signal one-dimensionary and time-seriesly and in a case the data picked up simultaneously from the same person to be examined are utilized variously, the data are processed separately and finally the each evaluation result is combined to give a comprehensive evaluation result.
[0036] In addition, each field in the cerebrum is not clearly separated from other fields so that an effect affected by a heavy load in the language field of the cerebrum tends to affect biological signals derived from other fields of the cerebrum.
[0037] Furthermore, by measuring the state of a field such as the language field that plays an important roll in a mental activity of a person, the result of the measurement of the language field can be utilized as a scale of the state of the load of the whole cerebrum, if the application of the results is aimed at use for a specific purpose.
[0038]
[0039]
[0040]
[0041]
[0042] The present invention will be described hereunder by referring to the accompanying drawings.
[0043]
[0044]
[0045] In
[0046] It goes without saying that a recording medium such as a flexible disk, CD-ROM, MO or the like and drive units of them, which are usually used for a computer, can also be used.
[0047] A chaos analysis program is included in each program code of the cerebrum load detection and determination program PG. The chaos analysis program is a program to calculate the Lyapunov index by chaologically analyzing a digital data of a sound read in by the cerebrum load detection and determination program PG.
[0048] The computer
[0049] In addition, an I/O control unit
[0050] The microphone
[0051] The microphone
[0052] Further, a sound reproducing unit such as a sound recorder
[0053] The computer
[0054]
[0055] That is, the hard disk device
[0056] In addition, a signal is input into the uttered sound detector (uttered sound detection means)
[0057] Furthermore, the uttered sound detector
[0058] Furthermore, a signal from the Lyapunov index change detector
[0059] In addition, the hard disk device
[0060] Operation of the device of the present invention will be described hereunder by referring to the block diagram in
[0061] At first the device of the present invention, with which a psychosomatic condition of a person can be evaluated by detecting/determining the level of the load generated in the cerebrum of a person to be examined, takes in an uttered sound of the person, to obtain sound signals. More precisely, as shown in
[0062] When the input sound signals are analog signals, the analog signals are digitized by the analog-digital converter
[0063] Then, the following pre-process is made prior to the execution of chaological analysis. That is, at the non-uttered sound eliminator
[0064] More precisely, the non-uttered sounds to be eliminated are such a sound as a collision damping sound, a collision reverberant sound, a double collision sound, a multiple pile up sound, a crushing sound, a friction sound or the like. These sounds are characterized based on a center frequency, a reverberating time and a band width thereof, then separated and eliminated.
[0065] According to the foregoing processes, thus obtained digitized sound data, which does not include the non-uttered sound, is a digital data of the sound only containing the component of the uttered sound of a person. When the obtained digital data of the uttered sound is a mixture of more than one person, each person's uttered sound must be separated from other's by using the uttered sound detector
[0066] More specifically, all person's uttered sound are characterized separately in advance based on each person's center frequency, a reverberating time and a band width, and then subjected to comparison procedure with the sound signal measured in real time.
[0067] Then, by using the Lyapunov index calculator
[0068] More specifically, when uttered sound of a person is processed as a time-series signal, fractal dimension of the waveform thereof has known to fall on between 5 and 6. The process is executed under a condition that a strange attractor is structured up to 6 dimension. Calculation by the computer can be, for example, performed by a method disclosed in the Laid Open Japan Patent Publication No. 2000-113347 titled “fatigue/drowse detection device and recording media based on voice.”
[0069] Then, in order to detect and determine the level of the load generated in the cerebrum, the Lyapunov index change detector
[0070] For example, when a person is at work, it is generally said that a certain level of a feeling of tension is required for the person to effectively execute one's work. In prior art, there have been no way to know the desirable level of tension at work.
[0071] According to the device of the present invention, it is possible to measure the various levels of the load in the cerebrum such as a level at the time in a state where the person is in a relaxed condition, and the level where the person is in a certain level of tension under which the person may become aware of tiredness in a short period of time. Accordingly, it is possible to control the tension of a person at work within a level of moderate tension or an intermediate level of tension, so that the work does not cause a serious fatigue to a person during the person's working time.
[0072] In the description mentioned above, a person becomes aware of tiredness through a process of gradually accumulating and increasing in the load on the cerebrum, when the person is engaging in a routine type of work. On the contrary, when a person is engaging in a creative type of work or a work in which a person must act in response to a changeable circumstances, the person becomes aware of tiredness through a continuation of a high level of load on the cerebrum for a specific period of time.
[0073] Accordingly, in the present invention, if prediction of a person's psychosomatic condition is intended to be made, it is necessary to apply a prediction algorithm corresponding to the type of work. For example, in a case where a person who engages in a work having a tendency of gradual increase in the load of the cerebrum, it is possible to tell him to take a rest under a rule specified in line with a pattern which is obtained through smoothing of temporally changing Lyapunov index, by simply using moving average calculation method.
[0074] On the contrary, in a case where a person who engages in a work which needs to perform a complicated task according to the circumstances, the person's work must be controlled under a rule specified in line with a pattern which is obtained by using Kalman filter or the like or by using a semantic or a knowledge processing like method, instead of a simple arithmetical method.
[0075] More specifically, the calculated Lyapunov index which changes with time is stored time-seriesly and temporarily and then a value of the Lyapunov index, a change in the Lyapunov index and a range of the change are determined in order to grasp quantitatively a change of the state of the cerebrum. As for the method for determining the change between the time-series adjacent ones or the tendency of the change, a moving average calculation method, a least-squares approximation method, a Kalman filter method or the like can be used for producing the characteristic performance curve. Any one of these methods can be chosen.
[0076]
[0077] In
[0078] As shown in
[0079] As seen from these characteristic performance curves of
[0080] And then, the aforementioned prediction/determination unit
[0081] In other words, the temporal change in the Lyapunov index shows a level of the load generated in the cerebrum at the moment, that is to say the temporal change of the Lyapunov index is just analogous to the measurement of the psychosomatic condition. Accordingly, the measurement of the change of the Lyapunov index with time enables us to estimate the tendency of a person. This fact is also obvious from the experimental results. Hereunder, these experimental results will be explained by referring to
[0082]
[0083] Increase in the Lyapunov index is considered to be a sign of decrease in capacity to adopt to the surrounding environment of the person. Tiredness of the person is said to be a phenomenon as a results of a long time exposure to the state of decrease in the capacity to adopt to the surrounding environment. In other words, when a high level of load is generated in the cerebrum of a person and lasts for a long stretch of time, it results in causing the person to feel tiredness. As mentioned above, in a case where high level of the Lyapunov index continues, it is possible to predict that the person will surely appeal tiredness in due course.
[0084]
[0085] The device of the present invention enables us to evaluate the human factor of a person by figuring out quantitatively and chaologically the tendency of the person, as mentioned above.
[0086] The device of the present invention can be applied to a field of a medical treatment and used as an diagnosing device for a psychosomatic condition of a person. When the device of the present invention is used for such a medical diagnosis area, it is necessary to seek an average value by extracting specific characteristics from many medical examinations. The foregoing requirement can be achieved by further providing the device of the present invention with storage means for storing output results from the uttered sound detector
[0087] Industrial Applicability
[0088] The present invention can be applied to an area of medical treatment, and also can be applied to a device for chalogical evaluation of a human factor in predicting or determining the state of the activity of the cerebrum, changes in a person's psychosomatic activity at the time of examination, and a tendency of the person's psychosomatic activity in the future after the examination is completed.