[0001] This application claims the benefit of U.S. Provisional Patent Application 60/115373, Jan. 11, 1999, and is a continuation-in-part of U.S. patent application Ser No. 08/782,936, filed Jan. 13, 1997.
[0002] The present invention provides apparatus and methods to derive spatially differentiated analytical information from an exposed surface by analyzing the results of the interaction of electromagnetic radiation with discrete volume elements of the sample. This is achieved by spatially limiting the probing beam to a small volume element and limiting the accepted response detected from the same volume element only, scanning the sample at various depths along the axis of the optical assembly formed by the beam to determine the interaction from volume elements at the different depths and collecting such data from a plurality of points in a plane generally perpendicular to the probing beam.
[0003] An important requirement exists for an instrument that will provide rapid and automatic diagnostic information, for example of cancerous and otherwise diseased tissue. In particular, there is a need for an instrument that would map the extent and stage of cancerous tissue without having to excise a large number of tissue samples for subsequent biopsies. In the current art, the medical profession relies generally on visual analysis and biopsies to determine specific pathologies and abnormalities. Various forms of biochemical imaging are used as well. Unique optical responses of various pathologies are being exploited in attempts to characterize biological tissue as well.
[0004] These prior art techniques, however, contain serious drawback as documented in copending application Ser. Nos. 08/510,041 filed Aug. 1, 1995 and 08/510,043 filed Aug. 1, 1995, which are incorporated herein by reference.
[0005] For example, performing a tissue biopsy and analyzing the extracted tissue in the laboratory requires a great deal of time. In addition, tissue biopsies can only characterize the tissue based upon representative samples taken from the tissue. This results in a large number of resections being routinely performed to gather a selection of tissue capable of accurately representing the sample. In addition, tissue biopsies are subject to sampling and interpretation errors. Magnetic resonance imaging is a successful tool, but is expensive and has serious limitations in detecting pathologies that are very thin or in their early stages of development.
[0006] One technique used in the medical field for tissue analysis is induced fluorescence. Laser induced fluorescence utilizes a laser tuned to a particular wavelength to excite tissue and to cause the tissue to fluoresce at a set of secondary wavelengths that can then be analyzed to infer characteristics of the tissue. Fluorescence can originate either from molecules normally found within the tissue, or from molecules that have been introduced into the body to serve as marker molecules.
[0007] Although the mechanisms involved in the fluorescence response of biological tissue to UV excitation have not been clearly defined, the fluorescence signature of neoplasia appears to reflect both biochemical and morphological changes. The observed changes in the spectra are similar for many cancers, which suggest similar mechanisms are at work. For example, useful auto-fluorescence spectral markers may reflect biochemical changes in the mitochondria, e.g., in the relative concentration of nicotinamide adenine dinucleotide (NADH) and flavins. Mucosal thickening and changes in capillary profusion are structural effects that have been interpreted as causing some typical changes in the spectroscopic record.
[0008] The major molecules in biological tissue which contribute to fluorescence emission under 337 nm near UV light excitation, have been identified as tryptophan (390 nm emission), chromophores in elastin (410 nn) and collagen (300 nm), NADH (470 nm), flavins (520 nm) and melanin (540 nm). However, it should be noted that in tissue, there is some peak shifting and changes in the overall shape relative to the pure compounds. Accordingly, the sample can be illuminated with a UV beam of sufficiently short wavelength and record responses from the above enumerated wavelengths of light in order to determine the presence of each of above identified contributions to tissues types.
[0009] It has been further shown that hemoglobin has an absorption peak between 400 and 540 nm, while both oxyhemoglobin and hemoglobin have strong light absorption above 600 nm. Blood distribution may also influence the observed emission spectra of elastin, collagen, NAD, and NADH. Further compounds present in tissue which may absorb emitted light and change the shape of the emitted spectra include myoglobin, porphyrins, and dinucleotide co-enzymes.
[0010] A general belief is that neoplasia has high levels of NADH because its metabolic pathway is primarily anaerobic. The inability of cells to elevate their NAD+:NADH ratio at confluence is a characteristic of transformed cells related to their defective growth control. The ratio of NADH+:NADH is an indicator of the metabolic capability of the cell, for example, its capacity for glycolysis versus gluconeogenesis. Surface fluorescence has been used to measure the relative level of NADH in both in vitro and in vivo tissues. Emission spectra obtained from individual myocyte produces residual green fluorescence, probably originating from mitochondrial oxidized flavin proteins, and blue fluorescence is consistent with NADH of a mitochondrial origin.
[0011] Collagen, NADH, and flavin adenine dinucleotide are thought to be the major fluorophores in colonic tissue and were used to spectrally decompose the fluorescence spectra. Residuals between the fits and the data resemble the absorption spectra of a mix of oxy-and deoxy-hemoglobin; thus the residuals can be attributed to the presence of blood.
[0012] Alfano, U.S. Pat. No. 4,930,516, teaches the use of luminescence to distinguish cancerous from normal tissue when the shape of the visible luminescence spectra from the normal and cancerous tissue are substantially different, and in particular when the cancerous tissue exhibits a shift to the blue with different intensity peaks. For example, Alfano discloses that a distinction between a known healthy tissue and a suspect tissue can be made by comparing the spectra of the suspect tissue with the healthy tissue. According to Alfano, the spectra of the tissue can be generated by exciting the tissue with substantially monochromatic radiation and comparing the fluorescence induced at least at two wavelengths.
[0013] Alfano, in U.S. Pat. No. 5,042,494, teaches a technique for distinguishing cancer from normal tissue by identifying how the shape of the visible luminescence spectra from the normal and cancerous tissue are substantially different.
[0014] Alfano further teaches, in U.S. Pat. No. 5,131,398, the use of luminescence to distinguish cancer from normal or benign tissue by employing (a) monochromatic or substantially monochromatic excitation wavelengths below about 315 nm, and, in particular, between about 260 and 315 nm, and, specifically, at 300 nm, and (b) comparing the resulting luminescence at two wavelengths about 340 and 440 nm.
[0015] Alfano, however, fails to teach a method capable of distinguishing between normal, malignant, benign, tumorous, dysplastic, hyperplastic, inflamed, or infected tissue. Failure to define these subtle distinctions in diagnosis makes appropriate treatment choices nearly impossible. While the simple ratio, difference and comparison analysis of Alfano and others have proven to be useful tools in cancer research and provocative indicators of tissue status, these have not, to date, enabled a method nor provided means which are sufficiently accurate and robust to be clinically acceptable for cancer diagnosis.
[0016] It is quite evident from the above that the actual spectra obtained from biological tissues are extremely complex and thus difficult to resolve by standard peak matching programs, spectral deconvolution or comparative spectral analysis. Furthermore, spectral shifting further complicates such attempts at spectral analysis. Last, laser fluorescence and other optical responses from tissues typically fail to achieve depth resolution because either the optical or the electronic instrumentation commonly used for these techniques entail integrating the signal emitted by the excited tissue over the entire illuminated tissue volume.
[0017] Rosenthal, U.S. Pat. No. 4,017,192, describes a technique for automatic detection of abnormalities, including cancer, in multi-cellular bulk bio-medical specimens, which overcome the problems associated with complex spectral responses of biological tissues. Rosenthal teaches the determination of optical responses (transmission or reflection) data from biological tissue over a large number of wavelengths for numerous samples and then the correlation of these optical responses to conventional, clinical results to select test wavelengths and a series of constants to form a correlation equation. The correlation equation is then used in conjunction with optical responses at the selected wavelengths taken on an uncharacterized tissue to predict the status of this tissue. However, to obtain good and solid correlations, Rosenthal excises the tissues and obtains in essence a homogeneous sample in which the optical responses do not include the optical signatures of underlying tissues. Rosenthal's methods, therefore, cannot be used in vivo applications as contemplated in the present invention.
[0018] In studies carried out at the Wellman Laboratories of Photomedicine, using a single fiber depth integrating probe, Schomacker has shown that the auto-fluorescence of the signature of human colon polyps in vivo is an indicator of normality, benign hyperplasia, pre-cancerous, and malignant neoplasia. See Schomacker et al.,
[0019] Accordingly, there is a need for a more effective and accurate device to characterize specimen, and particularly in vivo specimen which will obtain responses from well defined volume elements within said specimen, and present data automatically from a relatively large area comprising a plurality of such volume elements. Furthermore, there is a need for methods to automatically interpret such data in terms of simple diagnostic information on said volume elements.
[0020] In the aforementioned applications, Ser. Nos. 08/510,041 and 08/510,043, Modell, DeBaryshe and Hed taught the general principles of obtaining valuable analytical data from a volume element in a target sample by using spatial filters with dimensions that are generally larger than the diffraction limits for the wavelengths of the probing radiation. Such spatial filtration is obtained by an optical device including an illumination and a detection system both containing field stops and the field stops being conjugated to each other via the volume element to be analyzed, providing in essence a non imaging volume microprobe.
[0021] While the family of devices described in the aforementioned application are very useful in the analysis of a plurality of points within a target sample, there is a need to easily and automatically obtain such data on a full array of points so as to convert these data to an artificial image of the analytical findings over a large area of the sample. This is particularly important when heterogeneous samples, such as biological samples are examined with the non imaging volume microprobe. For instance, when examining tissues to determine the presence or absence of oncological pathologies, or other pathologies, visual techniques are followed, in some cases, by the resection of biopsy specimen. Such techniques are naturally limited in that the physician eye can only assess the visual appearance of potential pathologies, and the number of biopsies taken is by necessity limited. The appearance of pathological tissues does not provide information on the depth of the pathologies, and cannot provide positive diagnosis of the pathology. Furthermore, since biopsies are carried out ex vivo, a time lag between the taking of the biopsy and obtaining its results cannot be avoided. It would be very useful for physicians to have a device capable of performing such diagnostic tasks in vivo and to obtain differential diagnostics (between healthy and pathological tissues) while performing the examination. This is particularly important when performing exploratory surgical procedures, but can be very useful when examining more accessible tissues as well.
[0022] Where the diagnostic device is to come into contact with body tissues, there is a further need that its surfaces be insulated from contact with those tissues in order to avoid contamination. During sterile procedures, the device can introduce contamination into body tissues. Furthermore, the device can become contaminated by contact with the tissues of one patient and transmit that contamination to another patient. It is desirable that an apparatus that provides this insulation to the diagnostic device be compatible with the optical characteristics of the diagnostic device, so that the presence of the insulating apparatus does not impair the diagnostic device's accuracy or ease of use. It would be further desirable to provide an insulating apparatus that conforms to the anatomic area in which it is being used. For example, a differently shaped insulating apparatus may be required for diagnosing tissues through an endoscope than would be useful for diagnosing abnormalities of the cervix.
[0023] A number of devices have been described in the prior art relating particularly to confocal microscopy where illumination and detection arrays are provided. For instance, a confocal scanning microscope in which mechanical scanning of the illuminating and the transmitted (or the reflected) beams is avoided is described in U.S. Pat. No. 5,065,008. A light shutter array is used to provide synchronous detection of a scanned light beam without the need to move a photodetector to follow the scanning beam, and each of the shutters is serving, in essence, as a field stop in the confocal microscope. In other embodiments, two overlapping arrays of liquid crystals are used as optical shutter arrays to attempt reduction in the size of the field stops. As is well known in the art of confocal microscopy, in order to obtain the desired resolution afforded by this technique, the dimensions of the field stops need to be small relative to the diffraction limit of the optical beam used in the system. Other embodiments also provide for two sets of field stops, conjugated within the sample, one set for the illuminating beam and one set for the transmitted or reflected beam. While this patent teaches the use of electronic scanning of the illumination and response beams, the illumination intensity and response signal strength are drastically limited due to the use of dual liquid crystal optical shutters required to achieve the pin-hole effect of a scanning confocal microscope.
[0024] Another confocal imaging device is taught in U.S. Pat. No. 5,028,802, where a microlaser array provides a flying spot light source in a confocal configuration. Similarly U.S. Pat. No. 5,239,178 provides for an illuminating grid for essentially the same purpose, except that light emitting diodes are used for the grid's light sources. These approaches, however, are limited to monochromatic illumination and are usable only with relatively long wavelengths at which solid state laser diodes and thus microlaser arrays or light emitting diode arrays are available.
[0025] None of these devices provide for an array of non-imaging volume microprobes. Accordingly, there is a need for a device comprising an array of non-imaging volume microprobes in which a plurality of volume elements in a sample can rapidly be scanned in order to obtain diagnostic or analytical information over a relatively large area of the sample without integrating the data from all the sampled volume elements.
[0026] In the present invention, the principles taught in the aforementioned application are applied to automatically obtain optical responses from a three dimensional array of such volume elements by providing a plurality of non imaging volume microprobes in parallel which automatically presents mapping of the diagnostic information sought, in a plane generally parallel to the surface of the specimen (the xy plane) and in the z direction which is generally perpendicular to the xy plane.
[0027] The optical responses from an array of volume elements are further analyzed to provide visually (namely on a monitor) information which is not readily available by direct examination of the specimen. This is achieved by, in essence, providing an artificial three dimensional biochemical map composed from the optical responses, or more accurately, derivatives of such responses, of each individual volume element examined in an array, and by further converting these biochemical data to an artificial pathological image delineating the nature, extent and depth of pathologies observed. This is achieved by creating an artificial pathological scale, for each pathology of interest, by training the instrument to recognize specific pathologies. Specifically, a training set of specimens on which optical responses with a non imaging volume microprobe were collected, is subjected to a rigorous laboratory determination of the pathological state of each of its specimens and a value is assigned to each specimen on the artificial pathological scale. A set of linear equations relating to the responses (or functions of the responses) for each specimen to the pathological states, is constructed and optimized solutions for the correlation coefficients sought. These correlation coefficients are then used to transform responses obtained on unknown specimen to obtain the pathological state of these unknown specimen.
[0028] The objectives of the instant invention are achieved by providing an array of optical assemblies each consisting of two conjugated, or partially conjugated, optical assemblies. In each such assembly, the first optical assembly is designed to image selectively a transmitted beam from a light source, or another source of radiation, within a plurality of selected volume elements of a sample in a sequential manner. The second optical assembly is designed to collect light, or radiation emanating from the volume elements, in the same sequential manner, and transmit the collected light or radiation to a detector for further analysis of the interaction of the first transmitted beam with the volume elements. The first optical assembly includes a first field stop to achieve selective illumination of a selected volume element, and the second optical assembly includes a second field stop to restrict acceptance of said emanating radiation or light into the collection optics, essentially only from the selected volume element. Furthermore, a controller is provided to adjust the depth of the selected volume elements relative to the surface of the sample by controlling the respective focal points of the two optical assemblies while keeping them conjugated and having the volume element as a common conjugation point for both optical assemblies.
[0029] Sequential illumination of the various volume elements in an array is desired to assure that only responses from a given volume element are collected by the optical assembly associated with the volume element at any given time.
[0030] The sequential illumination of a plurality of volume elements can be carried out with a variety of devices. In some embodiments of the invention, an array of optical shutters is interposed between the light source and the sample, each shutter serving as either a field stop or an aperture stop for a specific optical assembly. In some embodiments, a single array of optical shutters is provided, while in other embodiments two arrays of optical shutters are provided. In yet another embodiment of the invention, an array of micromirrors is used to control the sequential illumination and response collection of the various volume elements in the sample. In yet another embodiment of the invention, an arrayed bundle of optical fibers is used to sequentially illuminate an array of volume elements in the sample and to collect sequentially responses from the volume elements. Appropriate movement of the optics so as to probe various depths of the sample is provided.
[0031] The optical responses from the selected volume elements bear important information about the volume elements, such as chemistry, morphology, and in general the physiological nature of the volume elements. When the sample is spectrally simple, these optical responses are analyzed by classical spectral techniques of peak matching, deconvolution or intensity determination at selected wavelengths. One such system could be the determination of the degree of homogeneity of a mixture or a solution of a plurality of compounds. However, when the samples are complex biological specimens, as mentioned above, the spectral complexity is often too great to obtain meaningful diagnosis. When such biological specimens are analyzed for subtle characteristics, we surprisingly found that the application of correlation transforms to spatially filtered optical responses obtained from an array of discrete volume elements, or the use of such transforms in conjunction with data obtained through non imaging microscopy, yields diagnostically meaningful results.
[0032] Specifically, we first select a training sample of a specific target pathology. Such a sample will preferably have at least 10 specimens. Optical responses are first collected from well defined volume elements in the specimens and recorded. These optical responses can be taken with an array microprobe or with a single volume microprobe device as described in the aforementioned co-pending application. The same volume elements that have been sampled with the non imaging volume microprobe are excised and biopsies (namely cytological analysis of the excised volume elements) is carried out in a classical pathological laboratory and the specimens are scored on an arbitrary scale which relates to the extent of the pathology, C (for instance a specific cancer) being characterized. These scores, C
[0033] It should be understood that other statistical tools, such as principal component regression analysis of the optical responses, could be used as well. One can also consider using in the correlation transforms, in lieu of functions of the optical responses at specific wavelengths, the Fourier transform of the total spectral responses. Furthermore, while taking the spectral responses from specific volume elements, these responses can be treated optically through either a spatial Fourier transform generator (such as a Sagnac interferometer) or a temporal Fourier transform generator (such as a Michelson interferometer), and then the data obtained can be used to create the desired correlation matrices to train the system for further data acquisition and image generation of the distribution of possible pathologies.
[0034] Instruments embodying the invention are deemed useful for obtaining artificial images of some characteristics of turbid materials, such as biological tissue, plastics, coatings, and chemical reaction processes, and may offer particular benefits in analysis of biological tissue, both in vitro and in vivo. To provide internal analysis, the invention is adapted to work with existing endoscopes, laparoscopes, or arthroscopes. To adapt the invention for diagnostic purposes involving contact with biological tissues, the invention can be provided with a covering that can be disposable to insulate the instrument from contact with biological tissues.
[0035]
[0036]
[0037]
[0038]
[0039]
[0040]
[0041]
[0042]
[0043]
[0044]
[0045]
[0046]
[0047]
[0048]
[0049]
[0050]
[0051]
[0052] In
[0053] Responses from each targeted volume element in the form of light emanating from the volume elements, is collected through a collection optics objective
[0054] It should be emphasized that both the illumination optics and the collection optics each contain a field stop having dimensions that are relatively large in relation to the average wavelength of the illuminating radiation, and furthermore, these field stops are conjugated to each other through the volume element examined. As a result, a well defined volume element is illuminated at any time, and the optical response from the element collected through the field stop of the collection optics is essentially limited to responses emanating from the volume element.
[0055] A controller
[0056] In
[0057] In some embodiments, the beam splitter
[0058] The array of light valves, or optical shutters, can be implemented in a number of different ways. One can use liquid crystal sandwiched between two electrode arrays (deposited, as is in the prior art on transparent glass or plastic sheets in the form of transparent electrodes made of Indium Tin Oxide (ITO) or Tin Oxide (TO), usually doped with fluorine to provide good areal conductivity). One can also use films of PDLC (polymer dispersed liquid crystals) that might be easier to handle and have lower production costs. Another embodiment contemplated, when the required scanning is particularly fast, is an array of ferroelectric elements, each acting as a light valve. Yet another embodiment of the light valves can involve an array of PVDF (Polyvinyl-difluoride) bimorphs, each coated to be reflective (or opaque on both sides) on the side facing the light source and designed to bend out of the light path so as to create a light valve. The typical dimensions of the light valve range from a low of about 20 microns to as much as 1000 microns. The size is determined primarily by the application, the nature of the sample analyzed and the particular design of the specific array volume microprobe utilized. When using the general design of
[0059] In operation, the controller
[0060] The controller
[0061] It should be appreciated that since the intensity of illumination is highest within the volume element probed by the excitation beam (relative to zones surrounding the volume element), and that the response detected by the sensor
[0062] In
[0063] Light responses to the exciting radiation from the light source
[0064] In yet another embodiment of the array volume microprobe, the illuminating and detecting optics are each provided with their own array of optical shutters. In
[0065] In
[0066] Yet another embodiment of the invention is illustrated in
[0067] The control of the tilting mirror is performed by controller
[0068] Yet another embodiment of the invention, a variation of the embodiment shown in
[0069] In one embodiment of the invention, the micromirrors are arranged in alternating right rows
[0070] Thus, all mirrors in right rows
[0071] A slightly modified embodiment of the volume probe array shown in
[0072] An advantage of the embodiment shown in
[0073] In
[0074] In operation, the fiber switching element
[0075] In
[0076] In operation, the controller
[0077] This configuration allows for the sequential illumination of an array of volume elements in sample
[0078] Since the excitation of the array of volume elements is carried out sequentially, response will be transmitted through the fiber bundle
[0079] In this embodiment, the use of a beam splitter is avoided, and only very simple optics are used at the distal end of the device. Such a device is particularly suitable when a distance between the sample and the optics (source and detector) is required, such as in laparoscopic and endoscopic devices. This embodiment has the additional advantage that higher excitation energies are feasible, since the light source resources are not distributed simultaneously over a full array as in some embodiments described above, and in this respect is similar to the embodiment shown in
[0080] In
[0081] Since the field stops of both the exciting and detecting optics are conjugated within the volume element probed, the excitations and responses are limited to the individual volume elements probed by each fiber. In operation, the light shutter array is controlled by the controller
[0082] In
[0083] In some embodiments of the volume microprobe arrays described above, a plurality of detectors corresponding to adjacent full regions of the shutter array are employed. Each detector accepts responses from a subarray of the light shutter array, and thus from the sample. In these embodiments, data collection is accelerated by the simultaneous opening of a light valve in each of the subarrays in the light shutter array and detecting the response in their respective detectors. When using this approach, care is taken to assure that interferences (or noise) from responses outside each specific region are smaller than a preset value of the expected response from the sample in each region.
[0084] In several embodiments described above, an array of light shutters is employed to sequence the excitation of an array of volume elements in the sample as well as collect responses from the volume elements. In some embodiments, each shutter serves as an excitation and detection field stop, while in other embodiments other optical elements in the system perform the function of the field stop. Such light shutters are well known in the prior art and have been used in a number of display devices, whereby the sequence of opening and closing sets of optical shutters that are back illuminated provide either a fixed or a time variable image.
[0085] The actual embodiments of such shutters in the prior art can take many forms. The ost widely used light shutter array is an array of liquid crystal elements having two sheets of polarizer one each on the front and the back of the array. On each element in the array, a voltage can be applied. When the voltage is sufficiently high, the liquid crystal causes rotation of the plane of polarization of light passing through it. The two polarizers are oriented in such a way that no light passes through an element when no voltage is applied. Thus, the polarizers are cross polarized (their relative orientation is 90°, thus the first polarizer removes all light polarized in one direction, while the second polarizer blocks the light passing through the then inactive liquid crystal element). When a sufficiently high voltage is applied, the plane of polarization of the light passing through the liquid crystal cell is rotated, so that the second polarizer is essentially transparent to the light passing through the active liquid crystal cell. The addressing can be carried out as in the prior art, either as row and columns, so that only the sum of voltages applied to both a row and column is sufficient to cause the desired rotation of polarized light. Since the dimensions of our light shutters are relatively large and the number of shutters small relative to the current practice in liquid crystal display, such addressing is quite sufficient, and cross talk is minimal and insignificant in view of the strong spatial discrimination due to the conjugation of the excitation and detection field stops.
[0086] When very large arrays are desired, approaches such as used in active matrix liquid crystals display (namely the activation of a pixel through the direct switching of an individual transistor at each pixel) can be practiced as well.
[0087] In yet another embodiment, the shutter array consists of ferroelectric elements activated in a manner similar to that of liquid crystal light shutter arrays. These shutter arrays are useful when the switching rate desired, namely, the rate of opening and closing a given light shutter in the array, is faster.
[0088] In yet another embodiment, the light switching medium is a polymer dispersed liquid crystal (PDLC). In such films, a dispersion of droplets of liquid crystal is embedded in a polymer having an index of refraction equal to the field oriented index of refraction of the liquid crystal dispersion. When no electrical field is applied, the droplets are randomly oriented and light is scattered in all directions. Thus the shutter can be considered as closed. When a sufficiently large electric field is applied to a PDLC element, the liquid crystal droplets orient themselves with the field and thus, in the direction of the field, the index of refraction is essentially constant and light passes through uninterrupted. Thus the shutter is open.
[0089] In yet another embodiment, essentially electromechanical shutters are used. Such can be easily implemented with piezoelectric bimorphs, which when actuated bend out of the path of the light and when inactive, assume a straight geometry which blocks light transmission through a given shutter.
[0090] In