[0001] The instant nonprovisional patent application claims priority from the following three provisional patent applications, each filed Mar. 10, 2000 and incorporated herein by reference: U.S. provisional patent application No. 60/188,565; U.S. provisional patent application No. 60/188,590; and U.S. provisional patent application No. 60/188,591. The following nonprovisional patent applications are hereby incorporated by reference: U.S. nonprovisional patent application No. ______ (Atty. Docket No. 185641-007810; and U.S. nonprovisional patent application No. ______ (Atty. Docket No. 185641-007910.)
[0002] This invention in general relates to processing information or data over a network of computers. Embodiments of the present invention relate to techniques for monitoring and/or controlling complex processes by comparing the current state of a first process to current, historical, and/or predicted states of the first process or a second process using statistical, structural, or physical models. Other embodiments of the present invention provide a system including computer code for monitoring or controlling, or both monitoring and controlling a process using multi-dimensional data in a commercial setting. The multidimensional data can include, among others, intrinsic information such as temperature, acidity, chemical composition, and color, as well as extrinsic information, such as origin, and age. The multidimensional data can also include symbolic data that is primarily visual in nature and which does not readily lend itself to traditional quantification. Merely by way of example, the present invention is described below in conjunction with an industrial manufacturing process, but it would be recognized that the invention has a much broader range of applicability. The invention can be applied to monitor and control complex processes in other fields such as chemicals, electronics, biological, health care, petrochemical, gaming, hotel, commerce, machining, electrical grids, and the like. Embodiments of the present invention may further accomplish process control in real time utilizing a web-based architecture.
[0003] Techniques and devices for maintaining process control in complex processes are well known. Such techniques often require monitoring individual parameters such as temperature, pressure, flow, incoming fluid characteristics, and the like. Most of these techniques only monitor and adjust a single parameter. The single parameter is often monitored and displayed to an operator or user of the process through an electronic display. For example, refining a petroleum product such as oil or gas often uses temperature measurements of raw or in process fluids such as oil using thermocouples. These thermocouples are often attached to critical processes such as distillation and the like and then coupled to an electronic display for output. The display generally outputs signals corresponding to temperature in a graphical user interface form or numerical value in Celsius, for example. In the most primitive oil refining operations, for example, operators still monitor temperature of a process or processes using the display by visual means. If the temperature goes out of range, the operator merely adjusts the process. In more advanced applications, process controllers monitor and control temperature of processes. The process controllers often use proportional control, derivative control, integral control, or a combination of these to provide an optimum control of temperature for the process. These techniques, however, still only monitor in single parameter such as temperature and adjust such temperature by feedback control means.
[0004] Oil refining is merely one of many examples of industrial processes that require control. Other examples include food processing, chemical production, drug manufacturing, semiconductor processing, water treatment, agriculture, assembly operations, health care, electronic power, gaming, hotel, and other commerce related fields. All of these examples generally use fairly crude processing techniques for adjusting complex processing variables such as temperature, pressure, flow rate, speed, and others, one at a time using automatic feed back control or manual feed back control. In some applications, fairly complex sensor assemblies are used to monitor process parameters. U.S. Pat. No. 5,774,374 in the name of Gross et al. and assigned to the University of Chicago, describes one way of monitoring an industrial or biological process using sensors. This conventional approach relies upon comparing a measured signal against a reference signal by subjective criteria. However, the subjective criteria have often been determined by trial and error and are only as good as the person deciding upon such criteria.
[0005] Many limitations still exist with some or all of these techniques. For example, most of these techniques still only monitor a single parameter and adjust it against a subjective reference point. Human monitoring of multiple parameters is often required, which is only as good as the human operator. Additionally, many if not all of these techniques cannot monitor the quality of a substance in process. Here, only extrinsic variables such as temperature, pressure, and the like can be easily monitored. There is simply no easy way to monitor the substance itself while it is being processed. Although complex chemical analysis methods are available to determine specific components or weights of the substance, there is simply no easy way to identify the quality of the substances while it is being manufactured. These and many other limitations are described throughout the present specification and more particularly below.
[0006] From the above, it is seen that improved ways of monitoring or controlling a process, or both monitoring and controlling a process, are highly desirable.
[0007] According to the present invention, a technique for processing information or data over a network of computers is provided, including a system for monitoring or controlling a process, or both monitoring and controlling a process. Embodiments of the present invention provide a system including computer codes for process monitoring and/or control using multidimensional data. The multidimensional data can include, among others, intrinsic information such as temperature, acidity, chemical composition, and color, as well as extrinsic information such as origin, and age.
[0008] In accordance with embodiments of the present invention, a process may be monitored and/or controlled by comparing the current state of a first process to current, historical, and/or predicted states of the first process or of a second process through the use of statistical, structural, or physical models. The process is then monitored and/or controlled based upon a descriptor predicted by the model. For purposes of this application, the term “descriptor” includes model coefficients/parameters, loadings, weightings, and labels, in addition to other types of information.
[0009] In one specific embodiment of a system for controlling a process, the system comprises a computer program product comprising a code directed to storing a first model in memory, a code directed to acquiring data from a process, and a code directed to applying the first model to the data to identify a first predicted descriptor characteristic of a state of the process. A code is directed to consulting a first knowledge based system to provide an output based upon the first predicted descriptor.
[0010] In another embodiment of a system for controlling an industrial process, the system includes a computer program product. The product includes code directed to accessing a process controller. The product also includes code directed to an input module adapted to input a plurality of parameters from a process. The product also includes code directed to a computer aided process module coupled to the process controller, the computer aided process module code being adapted to compare at least two of the pluarality of parameters against a predetermined training set of parameters, and being adapted to determine if the least two of the plurality of parameters are within a predetermined range of the training set of parameters. Additionally, the product includes code directed to an output module for outputting a result based upon the training set and the plurality of parameters. Other functionality described herein can also be implemented in computer code and the like according to other embodiments of the present invention.
[0011] In another embodiment of a system for controlling a process, the system comprises a first field mounted device in communication with a process and configured to produce a first input. A process manager receives the first input and is configured to apply a first model to the first input to identify a first predicted descriptor characteristic of a state of the process. The process manager is further configured to consult a first knowledge based system to provide an output based upon the first predicted descriptor.
[0012] In one embodiment of a method for controlling a process, the method comprises storing a first model in a memory and acquiring data from a process. The first model is applied to the data to identify a first predicted descriptor characteristic of a state of the process, and a first knowledge based system is consulted to provide an output based upon the first predicted descriptor.
[0013] Numerous benefits are achieved by way of the present invention over conventional techniques. For example, because of its web-based architecture, embodiments of the present invention permit monitoring and/or control over a process to be performed by a user located virtually anywhere. Additionally, embodiments of the invention permit monitoring and control over a process in real time, such that information about the process can rapidly be analyzed by a variety of techniques, with corrective steps based upon the analysis implemented immediately. Further, because the invention utilizes a plurality of analytical techniques in parallel, the results of these analytical techniques can be cross-validated, enhancing the reliability and accuracy of the resulting process monitoring or control. The present invention can be used with a wide variety of processes, e.g., those utilized in the chemical, biological, petrochemical, and food industries. However, the present invention is not limited to controlling the process of any particular industry, and is generally applicable to control over any process. Depending upon the embodiment, one or more of these benefits may be achieved. These and other benefits will be described in more detail throughout the present specification and more particularly below.
[0014] Various additional objects, features and advantages of the present invention can be more fully appreciated with reference to the detailed description and accompanying drawings that follow.
[0015]
[0016]
[0017] FIGS.
[0018]
[0019]
[0020]
[0021]
[0022]
[0023] The present invention relates to processing information or data over a network of computers. More specifically, embodiments of the present invention include methods, systems, and computer code for monitoring or controlling a process, or for both monitoring and controlling a process.
[0024]
[0025] As shown, system
[0026] As used in this patent application and in industry, the concepts of “client” and “server,” as used in this application and the industry, are very loosely defined and, in fact, are not fixed with respect to machines or software processes executing on the machines. Typically, a server is a machine e.g. or process that is providing information to another machine or process, i.e., the “client,” e.g., that requests the information. In this respect, a computer or process can be acting as a client at one point in time (because it is requesting information) and can be acting as a server at another point in time (because it is providing information). Some computers are consistently referred to as “servers” because they usually act as a repository for a large amount of information that is often requested. For example, a website is often hosted by a server computer with a large storage capacity, high-speed processor and Internet link having the ability to handle many high-bandwidth communication lines.
[0027] Wide area network
[0028] Server
[0029] Another subsystem of system
[0030] Field mounted devices
[0031]
[0032]
[0033] Field mounted devices
[0034] Database
[0035] In accordance with embodiments of the present invention, the outcome of applying a specific algorithm or model to process
[0036]
[0037]
[0038] Bottom portion
[0039] Field mounted devices
[0040] Middle portion
[0041] In the next layer
[0042] Common interface
[0043]
[0044] In certain embodiments of systems in accordance with the present invention, algorithms and models, and the results of application of algorithms and models to process data, may all be resident or accessible through a common application server. In this manner, the user may remotely access data and/or model results of interest, carefully controlling the bandwidth of information transmitted communicated according to available communication hardware. This server-based approach simplifies access by requiring user access to a simple browser rather than a specialized software package.
[0045] Yet another aspect of the present invention is the ability to monitor and control a process in real time. Specifically, data collected by the field level sensors may rapidly be communicated over the Internet to the server that is coordinating application of statistical methods, expert systems, and algorithms in accordance with embodiments of the present invention. These techniques can rapidly be applied to the data to produce an accurate view of the process and to provide recommendations for user action.
[0046] Still another aspect of the present invention illustrated in
[0047] Another aspect of the present invention is the ability to rapidly and effectively transfer key preliminary information downstream to process monitoring and modeling functions. For example, the present invention may be utilized to monitor and control an oil refining process. Key operational parameters in such a process would be affected by preliminary information such as the physical properties of incoming lots of crude oil starting material. One example of a test for measuring the physical properties of crude oil is American Society for Testing and Materials (ASTM) method number
[0048] Utilizing the present invention, the crude oil could be sampled and analyzed using the ASTM
[0049] Another aspect of the present invention is parallel use of a wide variety of techniques for process monitoring and control, with enhanced reliability obtained by cross-validating results of these techniques. This aspect is further illustrated in connection with FIGS.
[0050]
[0051]
[0052] As noted, mouse
[0053]
[0054]
[0055] Process manager also couples to data storage device
[0056] The upload process takes data from the acquisition device and uploads them into the main process manager
[0057] The data go through a baseline correction process
[0058] A baseline correction process may also find response peaks, calculate ΔR/R, and plot the ΔR/R verses time stamps, where the data have been captured. It also calculates maximum ΔR/R and maximum slope of ΔR/R for further processing. Baseline drift is often corrected by way of the present process. The main process manager also oversees that data traverse through the normalization process
[0059] Next, the method performs a main process for classifying each of the substances according to each of their characteristics in a pattern recognition process. The pattern recognition process uses more than one algorithms, which are known, are presently being developed, or will be developed in the future. The process is used to find weighting factors for each of the characteristics to ultimately determine an identifiable pattern to uniquely identify each of the substances. That is, descriptors are provided for each of the substances. Examples of some algorithms are described throughout the present specification. Also shown is the output module
[0060] The above processes are merely illustrative. The processes can be performed using computer software or hardware or a combination of hardware and software. Any of the above processes can also be separated or be combined, depending upon the embodiment. In some cases, the processes can also be changed in order without limiting the scope of the invention claimed herein. One of ordinary skill in the art would recognize many other variations, modifications, and alternatives.
[0061]
[0062] As shown in
[0063] As shown in
[0064] One approach is to model the process based upon data received from operation of a similar process, which may or may not be located in the same plant. This aspect of the present invention is particularly attractive given the recent trend of standardizing industrial plants, particularly for newly-constructed batch processes. Such standardized industrial plants may feature identical equipment and/or instrumentation, such that a model built to predict the behavior of one plant can be used to evaluate the health of another plant. For example, the manager of a semiconductor fabrication plant in the United States may compare operation of a particular type of tool with data from an identical tool operating in a second semiconductor fabrication plant located in Malaysia. This comparison may occur in real time, or may utilize archived data from past operation of the tool in the second semiconductor fabrication plant. Moreover, the processes or tools to be compared need not be identical, but may be similar enough that comparison between them will provide information probative of the state of the process.
[0065] Another type of model may be based upon mathematical equations derived from physical laws. Examples of such physical laws include mass balance, heat balance, energy balance, linear momentum balance, angular momentum balance, entropy and a wide variety of other physical models. The mathematical expressions representing these physical laws may be stored in data storage device
[0066] Yet another type of model is based upon algorithms such as statistical techniques. A non-exclusive, explanatory list of univariate techniques which may be utilized by the present invention is presented in TABLE 8. Another type of model is based upon multivariate statistical techniques such as principal component analysis (PCA). A non-exclusive, explanatory list of multivariate techniques that may be utilized by the present invention is presented in TABLE 10. The appended software specification also provides details regarding both model building and model monitoring utilizing several of these multivariate techniques. Still other model types may rely on a neural-based approach, examples of which include but are not limited to neural networks and genetic selection algorithms.
[0067] Other models may themselves be a collection of component models. One significant example of this model type is the System Coherence Rendering Exception Analysis for Maintenance (SCREAM) model currently being developed by the Jet Propulsion Laboratory of Pasadena, Calif. Originally developed to monitor and control satellites, SCREAM is a collection of models that conduct time-series analysis to provide intelligence for system self-analysis. A detailed listing of the techniques utilized by SCREAM is provided in TABLE 11.
[0068] One valuable aspect of SCREAM is recognition of process lifecycles. Many process dynamics exhibit a characteristic life cycle. For example, a given process may exhibit non-linear behavior in an opening stage, followed by more predictable linear or cyclical phases in a mature stage, and then conclude with a return to non-linear behavior in a concluding stage. SCREAM is especially suited not only to recognizing these expected process phases, but also to recognizing undesirable deviation from these expected phases.
[0069] Another valuable aspect of SCREAM is the ability to receive and analyze symbolic data. Symbolic data are typically data not in the form of an analog signal, and hence not readily susceptible to quantitation. Examples of symbolic data typically include labels and digital/integer inputs or outputs. Symbolic data is generally visual in nature, for example a position of a handle, a color of a smoke plume, or the general demeanor of a patient (in the case of a medical diagnostic process).
[0070] SCREAM uses symbolic inputs to determine the state of the process. For example, positions of on/off valves may be communicated as a digital signal using ‘0’ to represent the open position and ‘1’ to represent the closed position, or vice versa. Based on the valve positions, SCREAM may identify the physical state of the process. As valve positions change, the process may enter a different state.
[0071] Once a model has been applied to process data to produce a predicted descriptor characteristic of process state, a knowledge based system is consulted to produce an output for process monitoring and/or control purposes. As shown in
[0072] Examples of such knowledge based systems include self-learning systems, expert systems, and logic systems, as well as so-called “fuzzy” variants of each of these types of systems. An expert system is commonly defined as a computer system programmed to imitate problem-solving procedures of a human expert. For example, in a medical system the user might enter data like the patient's symptoms, lab reports, etc., and derive from the computer a possible diagnosis. The success of an expert system depends on the quality of the data provided to the computer, and the rules the computer has been programmed with for making deductions from that data.
[0073] An expert system may be utilized in conjunction with supervised learning for purposes of process control. For example, where specific measures have previously successfully been implemented to correct a process anomaly, these measures may serve as a training set and be utilized as a basis for addressing similar future problems.
[0074] While the above discussion has proposed analysis of process data through application of a single model followed by consultation with a single knowledge based system to obtain an output, the present invention is not limited to this embodiment. For example, as shown in
[0075] For example, where application of a first model produces a first predicted descriptor in agreement with a second predicted descriptor, the process state assessment is confirmed and the output may reflect a degree of certainty as to the state of the process. This reflection may be in the form of the content of the output (i.e. a process fault is definitely indicated) and/or in the form of the output (i.e. a pager is activated to immediately alert the human user to a high priority issue).
[0076] However, where first and second predicted descriptors resulting from application of different models are not in agreement, a different output may be produced that reflects uncertainty in process state. This reflection may be in the form of the content of the output (i.e. a process fault may be indicated) and/or in the form of the output (i.e. only an email is sent to the human user to indicate a lower priority issue.)
[0077] As an alternative approach, a second knowledge based system may be consulted to resolve a conflict in predicted descriptors from different models. An output based upon the descriptor chosen by the second knowledge based system would then produced.
[0078] A wide variety of structures may be utilized to detect process characteristics and/or modify operational process parameters. Data may be received from a system in a variety of formats, such as text, still image, moving video images, and sound.
[0079] As shown in
[0080] Although the above has been described in terms of a capturing device for fluids including liquids and/or vapors, there are many other types of capturing devices. For example, other types of information capturing devices for converting an intrinsic or extrinsic characteristic to a measurable parameter can be used. These information capturing devices include, among others, pH monitors, temperature measurement devices, humidity devices, pressure sensors, flow measurement devices, chemical detectors, velocity measurement devices, weighting scales, length measurement devices, color identification, and other devices. These devices can provide an electrical output that corresponds to measurable parameters such as pH, temperature, humidity, pressure, flow, chemical types, velocity, weight, height, length, and size.
[0081] In some embodiments, the present invention can be used with at least two sensor arrays. The first array of sensors comprises at least two sensors (e.g., three, four, hundreds, thousands, millions or even billions) capable of producing a first response in the presence of a chemical stimulus. Suitable chemical stimuli capable of detection include, but are not limited to, a vapor, a gas, a liquid, a solid, an odor or mixtures thereof This aspect of the device comprises an electronic nose. Suitable sensors comprising the first array of sensors include, but are not limited to conducting/nonconducting regions sensor, a SAW sensor, a quartz microbalance sensor, a conductive composite sensor, a chemiresistor, a metal oxide gas sensor, an organic gas sensor, a MOSFET, a piezoelectric device, an infrared sensor, a sintered metal oxide sensor, a Pd-gate MOSFET, a metal FET structure, a electrochemical cell, a conducting polymer sensor, a catalytic gas sensor, an organic semiconducting gas sensor, a solid electrolyte gas sensors, and a piezoelectric quartz crystal sensor. It will be apparent to those of skill in the art that the electronic nose array can be comprises of combinations of the foregoing sensors. A second sensor can be a single sensor or an array of sensors capable of producing a second response in the presence of physical stimuli. The physical detection sensors detect physical stimuli. Suitable physical stimuli include, but are not limited to, thermal stimuli, radiation stimuli, mechanical stimuli, pressure, visual, magnetic stimuli, and electrical stimuli.
[0082] Thermal sensors can detect stimuli which include, but are not limited to, temperature, heat, heat flow, entropy, heat capacity, etc. Radiation sensors can detect stimuli that include, but are not limited to, gamma rays, X-rays, ultra-violet rays, visible, infrared, microwaves and radio waves. Mechanical sensors can detect stimuli which include, but are not limited to, displacement, velocity, acceleration, force, torque, pressure, mass, flow, acoustic wavelength, and amplitude. Magnetic sensors can detect stimuli that include, but are not limited to, magnetic field, flux, magnetic moment, magnetization, and magnetic permeability. Electrical sensors can detect stimuli which include, but are not limited to, charge, current, voltage, resistance, conductance, capacitance, inductance, dielectric permittivity, polarization and frequency.
[0083] In certain embodiments, thermal sensors are suitable for use in the present invention that include, but are not limited to, thermocouples, such as a semiconducting thermocouples, noise thermometry, thermoswitches, thermistors, metal thermoresistors, semiconducting thermoresistors, thermodiodes, thermotransistors, calorimeters, thermometers, indicators, and fiber optics.
[0084] In other embodiments, various radiation sensors suitable for use in the present invention include, but are not limited to, nuclear radiation microsensors, such as scintillation counters and solid state detectors, ultra-violet, visible and near infrared radiation microsensors, such as photoconductive cells, photodiodes, phototransistors, infrared radiation microsensors, such as photoconductive IR sensors and pyroelectric sensors.
[0085] In certain other embodiments, various mechanical sensors are suitable for use in the present invention and include, but are not limited to, displacement microsensors, capacitive and inductive displacement sensors, optical displacement sensors, ultrasonic displacement sensors, pyroelectric, velocity and flow microsensors, transistor flow microsensors, acceleration microsensors, piezoresistive microaccelerometers, force, pressure and strain microsensors, and piezoelectric crystal sensors.
[0086] In certain other embodiments, various chemical or biochemical sensors are suitable for use in the present invention and include, but are not limited to, metal oxide gas sensors, such as tin oxide gas sensors, organic gas sensors, chemocapacitors, chemodiodes, such as inorganic Schottky device, metal oxide field effect transistor (MOSFET), piezoelectric devices, ion selective FET for pH sensors, polymeric humidity sensors, electrochemical cell sensors, pellistors gas sensors, piezoelectric or surface acoustical wave sensors, infrared sensors, surface plasmon sensors, and fiber optical sensors.
[0087] Various other sensors suitable for use in the present invention include, but are not limited to, sintered metal oxide sensors, phthalocyanine sensors, membranes, Pd-gate MOSFET, electrochemical cells, conducting polymer sensors, lipid coating sensors and metal FET structures. In certain preferred embodiments, the sensors include, but are not limited to, metal oxide sensors such as a Tuguchi gas sensors, catalytic gas sensors, organic semiconducting gas sensors, solid electrolyte gas sensors, piezoelectric quartz crystal sensors, fiber optic probes, a micro-electro-mechanical system device, a micro-opto-electro-mechanical system device and Langmuir-Blodgett films.
[0088] Additionally, the above description in terms of specific hardware is merely for illustration. It would be recognized that the functionality of the hardware be combined or even separated with hardware elements and/or software. The functionality can also be made in the form of software, which can be predominantly software or a combination of hardware and software. One of ordinary skill in the art would recognize many variations, alternatives, and modifications. Details of methods according to the present invention are provided below.
[0089] A method of controlling a process according to one embodiment of the present invention may be briefly outlined as follows:
[0090] 1. acquire initial data from a source at a first time;
[0091] 2. convert the initial data into electronic form;
[0092] 3. load the initial data into a first memory;
[0093] 4. retrieve the initial data from the first memory;
[0094] 5. acquire subsequent data from the source at a second time;
[0095] 6. assign a first descriptor to the initial data and a second descriptor to the subsequent data;
[0096] 7. construct a model based on the initial data and the first descriptor and on the subsequent data and the second descriptor;
[0097] 8. store the model in a second memory;
[0098] 9. acquire data from a process;
[0099] 10. apply the model to the data to identify a predicted descriptor characteristic of a state of the process; and
[0100] 11. consult a knowledge based system and provide an output based upon the predicted descriptor.
[0101] The above sequence of steps is merely an example of a way to monitor a process according to one embodiment of the present method and system. Details of these steps are provided below, but it is to be understood that one of ordinary skill in the art would recognize many other variations, modifications, and alternatives.
[0102] The first step listed above is acquisition of initial data from a source at a first time. While data is to be acquired from at least one source, in many embodiments data will be acquired from a plurality of sources in contact with the process, for example the field mounted devices illustrated and described in conjunction with
[0103] The second, third, and fourth listed steps are respectively, conversion of the initial data into electronic form, storage of the electronic data, and retrieval of the stored data. Structures for performing these steps are well known in the art.
[0104] The fifth step is to acquire subsequent data from the source at a second time. This step provides the system with exemplary information about changes in the process between the first time and the second time. While in its most general form the present invention samples data from two time periods, in practice it is expected that data from many times will be acquired.
[0105] The sixth step is to assign a first descriptor to the initial data and a second descriptor to the subsequent data. The descriptor characterizes the state of the process in relation to the data. Examples of possible descriptors include “normal process operation”, “process start-up”, “process shut-down”, “over heat condition”, etc.
[0106] The seventh step is to construct a model of process behavior based upon the initial and subsequent data and the first and second descriptors. While at least one model is constructed, in practical implementation of the present invention many types of models based upon different principles may be constructed utilizing approaches such as univariate statistical techniques, time series analysis, and multivariate statistical techniques such as PCA, CDA, and PLS, as are known to one of ordinary skill in the art.
[0107] Once the model has been constructed, the eighth step is to store the model in a second memory. In the ninth step, the stored model is applied to a set of data acquired from the process. This data set can may represent real time parameters of the process that is to be monitored and/or controlled.
[0108] In the tenth step, the model is applied to the third data set to produce a predicted descriptor that characterizes the state of the process. This predicted descriptor is output by the model based upon the construction of the model, utilizing the initial data, the subsequent data, the first descriptor, and the second descriptor.
[0109] Based upon the predicted descriptor predicted by application of the model, in the eleventh and final step a knowledge based system is referenced and an output is provided. This output may be provided to an internal entity such as a process control device, or to an external entity such as associated s supply chain management system (SCM), or to both internal and external systems. For example, where the third descriptor predicted by the model indicates failure of a pump, an output in the form of a purchase order with the relevant replacement pump part number could be communicated to the SCM. Alternatively or in conjunction with notifying an SCM system, the output could be directed to an entity such as a pager or voicemail, thereby communicating the state of the process to a human operator for monitoring and/or possible intervention.
[0110] The above listed steps represent only a specific example of a method for monitoring and controlling a process in accordance with an embodiment of the present invention. One of ordinary skill in the art would recognize many variations, alternatives, and modifications.
[0111] For example, many models useful for predicting process behavior may be created utilizing univariate and multivariate statistical techniques applied to previously collected data. Alternatively however, useful models of process behavior may also be constructed from mathematical expressions of physical or natural laws. Where such a physical model is employed, rules implicit in the model may govern predicted behavior of the system over time. Prior collection of data may therefore not be necessary to create the model, and the model may be directly applied to data acquired from the process.
[0112] In yet another possible embodiment, data from the process may be analyzed in parallel by more than one model. In embodiments of the present invention where multiple models are being used to predict process behavior, the descriptor output by each model may be compared. A difference in the descriptor predicted by the various models could be resolved through application of a knowledge based system such as an expert system.
[0113] A method using digital information for populating a database for identification or classification purposes according to the present invention may be briefly outlined as follows:
[0114] 1. Acquire data, where the data are for one or more substances, each of the substances having a plurality of distinct characteristics;
[0115] 2. Convert data into electronic form;
[0116] 3. Provide data in electronic form (e.g., text, normalized data from an array of sensors) for classification or identification;
[0117] 4. Load the data into a first memory by a computing device;
[0118] 5. Retrieve the data from the first memory;
[0119] 6. Remove first noise levels from the data using one or more filters;
[0120] 7. Correct data to a base line for one or more variables such as drift, temperature, humidity, etc.;
[0121] 8. Normalize data using a base line;
[0122] 9. Reject one or more of the plurality of distinct characteristics from the data;
[0123] 10. Perform one or more pattern recognition methods on the data;
[0124] 11. Classify the one or more substances based upon the pattern recognition methods to form multiple classes that each corresponds to a different substance;
[0125] 12. Determine optimized (or best general fit) pattern recognition method via cross validation process;
[0126] 13. Store the classified substances into a second memory for further analysis; and
[0127] 14. Perform other steps, as desirable.
[0128] The above sequence of steps is merely an example of a way to teach or train the present method and system. The present example takes more than one different substance, where each substance has a plurality of characteristics, which are capable of being detected by sensors. Each of these characteristics are measured, and then fed into the present method to create a training set. The method includes a variety of data processing techniques to provide the training set. Depending upon the embodiment, some of the steps may be separated even further or combined. Details of these steps are provided below according to FIGS.
[0129]
[0130] Next, the method transfers the electronic data, now in electronic form, to a computer aided process (step
[0131] The method filters the data (step
[0132] Optionally, the filtered responses can be displayed, step
[0133] The method performs a baseline correction step (step
[0134] As merely an example,
[0135] where
[0136] ΔR is defined by the average difference between a base line value R(0) and R(max);
[0137] R(max) is defined by a maximum value of R;
[0138] R(0) is defined by an initial value of R; and
[0139] R is defined as a variable or electrical measurement of resistance from a sensor, for example.
[0140] This expression is merely an example, the term ΔR/R could be defined by a variety of other relationships. Here, ΔR/R has been selected in a manner to provide an improved signal to noise ratio for the signals from the sensor, for example. There can be many other relationships that define ΔR/R, which may be a relative relation in another manner. Alternatively, ΔR/R could be an absolute relationship or a combination of a relative relationship and an absolute relationship. Of course, one of ordinary skill in the art would provide many other variations, alternatives, and modifications.
[0141] As noted, the method includes a normalization step, step
[0142] As shown by step
[0143] Next, the method performs a main process for classifying each of the substances according to each of their characteristics, step
[0144] As shown, the method
PCA Principal Components Analysis HCA Hierarchical Cluster Analysis KNN CV K Nearest Neighbor Cross Validation KNN Prd K Nearest Neighbor Prediction SIMCA CV SIMCA Cross Validation SIMCA Prd SIMCA Prediction Canon CV Canonical Discriminant Analysis and Cross Validation Canon Prd Canonical Discriminant Prediction Fisher CV Fisher Linear Discriminant Analysis and Cross Validation Fisher Prd Fisher Linear Discriminant Prediction SCREAM System Coherence Rendering Exception Analysis for Maintenance
[0145] PCA and HCA, are unsupervised learning methods. They can be used for investigating training data and finding the answers of:
[0146] I. How many principal components will cover the most of variances?
[0147] II. How many principal components you have to choose?
[0148] III. How do the loading plots look?
[0149] IV. How do the score plots look?
[0150] V. How are the scores separated among the classes?
[0151] VI. How are the clusters grouped in their classes?
[0152] VII. How much are the distances among the clusters?
[0153] The other four algorithms, KNN CV, SIMCA CV, Canon CV, and Fisher CV, are supervised learning methods used when the goal is to construct models to be used to predict the future behavior of a process. These algorithms will perform cross validation, find the optimum number of parameters, and build models. SCREAM is actually a combination of several techniques employing time series analysis.
[0154] Once the data has been run through the first algorithm, for example, the method repeats through a branch (step
[0155] In a specific embodiment, the present invention provides a cross-validation technique. Here, an auto (or automatic) cross-validation algorithm can be implemented. The present technique uses cross-validation, which is an operation process used to validate models built with chemometrics algorithms based on training data set. During the process, the training data set is divided into calibration and validation subsets. A model is built with the calibration subset and is used to predict the validation subset. The training data set can be divided into calibration and validation subsets called “leave-one-out”, i.e., take one sample out from each class to build a validation subset and use the rest samples to build a calibration subset. This process can be repeated using different subset until every sample in the training set has been included in one validation subset. The predicted results are stored in an array. Then, the correct prediction percentages (CPP) are calculated, and are used to validate the performance of the model.
[0156] According to the present method, a cross-validation with one training data set can be applied to generally all the models built with different algorithms, such as K-Nearest Neighbor (KNN), SIMCA, Canonical Discriminant Analysis, Fisher Linear Discriminant Analysis, and SCREAM respectively. The results of correct prediction percentages (CPP) show the performance differences with the same training data set but with different algorithms. Therefore, one can pick up the best algorithm according to the embodiment.
[0157] During the model building, there are several parameters and options to choice. To build the best model with one algorithm, cross-validation is also used to find the optimum parameters and options. For example, in the process of building a KNN model, cross-validation is used to validate the models built with different number of K, different scaling options, e.g., mean-centering or auto-scaling, and other options, e.g., with PCA or without PCA, to find out the optimum combination of K and other options. In a preferred embodiment, auto-cross-validation can be implemented using a single push-button or two push buttons for ease in use. It will automatically run the processes mentioned above over all the (or any selected) algorithms with the training data set to find out the optimum combination of parameters, scaling options and algorithms.
[0158] The method also performs additional steps of retrieving data, step
[0159] The above sequence of steps is merely illustrative. The steps can be performed using computer software or hardware or a combination of hardware and software. Any of the above steps can also be separated or be combined, depending upon the embodiment. In some cases, the steps can also be changed in order without limiting the scope of the invention claimed herein. One of ordinary skill in the art would recognize many other variations, modifications, and alternatives.
[0160] An alternative method according to the present invention is briefly outlined as follows:
[0161] 1. Acquire raw data in voltages;
[0162] 2. Check base line voltages;
[0163] 3. Filter;
[0164] 4. Calculate ΔR/R
[0165] 5. Determine Training set?
[0166] 6. If yes, find samples (may repeat process);
[0167] 7. Determine outlier?;
[0168] 8. If yes, remove bad data using, for example PCA;
[0169] 9. Find important sensors using importance index (individual filtering process);
[0170] 10. Normalize;
[0171] 11. Find appropriate pattering recognition process;
[0172] 12. Run each pattern recognition process;
[0173] 13. Display (optional);
[0174] 14. Find best fit out of each pattern recognition process;
[0175] 15. Compare against confidence factor (if less than a certain number, this does not work);
[0176] 16. Perform other steps, as required.
[0177] The above sequence of steps is merely an example of a way to teach or train the present method and system according to an alternative embodiment. The present example takes more than one different substance, where each substance has a plurality of characteristics, which are capable of being detected by sensors or other sensing devices. Each of these characteristics are measured, and then fed into the present method to create a training set. The method includes a variety of data processing techniques to provide the training set. Depending upon the embodiment, some of the steps may be separated even further or combined. Details of these steps are provided below according to FIGS.
[0178]
[0179] In a specific embodiment, the method has captured data about the plurality of samples from a data acquisition device. Here, each of the samples should form a distinct class of data according to the present invention. The data acquisition device can be any suitable device for capturing either intrinsic or extrinsic information from a substance. As merely an example, the present method uses a data acquisition device for capturing olfactory information. The device has a plurality of sensors or sensing devices, which convert a scent or olfaction print into an artificial or electronic print. In a specific embodiment, such data acquisition device is disclosed in WO 99/47905, commonly assigned and hereby incorporated by reference for all purposes. Those of skill in the art will know of other devices including other electronic noses suitable for use in the present invention. In a specific embodiment, the present invention captures olfactory information from a plurality of different liquids, e.g., isopropyl alcohol, water, toluene. The olfactory information from each of the different liquids is characterized by a plurality of measurable characteristics, which are acquired by the acquisition device. Each different liquid including the plurality of measurable characteristics can be converted into an electronic data form for use according to the present invention.
[0180] The method acquires the raw data from the sample in the training set often as a voltage measurement, step
[0181] Next, the method checks the base line voltages from the plurality of sensing devices used to capture information from the sample, as shown in step
[0182] The method then determines if the measured voltage for each sensing device is within a predetermined range, step
[0183] The method can convert the voltage into a resistance value, step