Title:

Kind
Code:

A1

Abstract:

A system and method is provided for performing Turbo Equalization upon a communication system, comprising the usage of nonlinear analog circuitry such as Cellular Nonlinear/neural Networks to overcome the computational burden of traditional DSP technology. Thereby, through operation of various embodiments of the present invention Turbo Equalization may be performed in a more efficient manner.

Inventors:

Olivier, Jan C. (Highland Village, TX, US)

Application Number:

09/834407

Publication Date:

12/05/2002

Filing Date:

04/14/2001

Export Citation:

Assignee:

OLIVIER JAN C.

Primary Class:

International Classes:

View Patent Images:

Related US Applications:

20090313163 | Credit line optimization | December, 2009 | Wang et al. |

20070156624 | System and method of patient specific vital sign estimation | July, 2007 | Palma |

20070094172 | Neural network based rating system | April, 2007 | Thaler |

20090307176 | CLUSTERING-BASED INTEREST COMPUTATION | December, 2009 | Jeong et al. |

20090138360 | METHOD FOR VERIFYING ACCESS BASED ON A DETERMINED GEOGRAPHIC LOCATION OF A SUBSCRIBER OF A SERVICE PROVIDED VIA A COMPUTER NETWORK | May, 2009 | Choti et al. |

20090276383 | RULES GENERATION FOR IT RESOURCE EVENT SITUATION CLASSIFICATION | November, 2009 | Salahshour et al. |

20080222072 | Analysing Documents | September, 2008 | Lovlie et al. |

20080215510 | MULTI-SCALE SEGMENTATION AND PARTIAL MATCHING 3D MODELS | September, 2008 | Regli et al. |

20100096179 | COMMUNICATION CABLING WITH SHIELDING SEPARATOR AND DISCONTINUOUS CABLE SHIELD | April, 2010 | Sparrowhawk et al. |

20040010482 | Creation theory | January, 2004 | Austin |

20090106002 | PROCESS SIMULATION FRAMEWORK | April, 2009 | Viswanathan et al. |

Primary Examiner:

HOLMES, MICHAEL B

Attorney, Agent or Firm:

Nokia, Inc Steven Shaw A. (6000 CONNECTION DRIVE, IRVING, TX, 75039, US)

Claims:

1. A method for performing turbo equalization in real time using an analog circuit comprising a CNN decoder and a CNN equalizer, the method comprising the steps of: minimizing a maximum likelihood metric; and satisfying a constraint function admitting discrete solutions only.

2. The method of claim 1 wherein said discrete solutions will contain only symbol alphabet points.

3. The method of claim 1 wherein the step of mimizing said maximum likelyhood metric is applied to said CNN equalizer.

4. The method of claim 1 wherein the step of mimizing said maximum likelihood metric is applied to said CNN decoder.

5. The method of claim 1 further comprising the step of feeding back a solution from said CNN decoder to said CNN equalizer.

6. The method of claim 5 wherein the steps of minimizing said maximum likelyhood metric and satisfying said constraint function are iteratively performed through said feeding back step.

7. The method of claim 1 wherein said constraint function comprises computing finite number of difference terms.

8. The method of claim 7 wherein said difference terms comprise a candidate solution of said maximum likelyhood metric and a symbol alphabet point.

9. The method of claim 8 wherin said constraint function comprises a constant.

10. The method of claim 9 wherein the usage of said constant forces said candidate solution to a symbol alphabet point.

11. An apparatus for performing turbo equalization in real time using an analog circuit comprising: CNN hardware wherein a maximum likelyhood metric and a constraint function admitting discrete solutions only are implemented.

12. The appratus of claim 11 wherein said discrete solutions will only contain symbol alphabet points.

13. The apparatus of claim 11 wherein said CNN hardware is part of an equalizer apparatus.

14. The apparatus of claim 13 wherein said equalizer apparatus is implemented in a transceiver.

15. The apparatus of claim 11 wherein said CNN hardware is part of a decoder apparatus.

16. The apparatus of claim 15 wherein said decoder apparatus is implemented in a transceiver.

17. A method for performing real time turbo equalization comprising the steps of: using a non-linear network; and embedding in said non-linear network a constraint function which will admit discrete solutions only.

18. A method for performing turbo equalization in real time using analog circuitry comprising the steps of: minimizing a maximum likelyhood metric; and satisfying a constraint function admitting discrete solutions only.

Description:

[0001] The present invention relates generally to communications systems. More specifically this invention relates to Turbo Equalization.

[0002] A typical communication system may be comprised of a sending station and a receiving station interconnected by a communication channel, (such as a radio-link for example). Data to be communicated by the sending station to the receiving station may be converted, if necessary, into a form to permit its communication upon the communication channel. A communication system may be defined by almost any combination of sending and receiving stations, including, for instance, circuit board-positioned elements as well as more conventionally-defined communication systems used by spaced-apart users to communicate data therebetween.

[0003] When data communicated upon a communication channel is received at the receiving station, the receiving station may act upon, if necessary, the received data to recreate the informational content thereof. In an ideal communication system, the data, when received at the receiving station, may be identical to the data when transmitted by the sending station. However, in an actual communication system, the data may be distorted during its communication upon the communication channel. Such distortion may distort values of the data when received at the receiving station. If the distortion is significant, the informational content of the data, as transmitted, may not be recovered.

[0004] All communications circuits contain some noise. This is true whether the signals are analog or digital, and regardless of the type of information conveyed. Noise is the eternal bane of communications engineers, who are always striving to find new ways to improve the signal to noise ratio (S/N) in communications systems. Traditional methods of optimizing S/N ratio include, inter alia, increasing the transmitted signal power and increasing the receiver sensitivity. In wireless systems, specialized antenna systems may also help. Digital signal processing (DSP) dramatically improves the sensitivity of a receiving unit. The effect is most noticeable when noise competes with a desired signal. Despite the dramatic improvements provided by a DSP circuit, there are limits to what it can do. If the noise is so strong that all traces of the signal are obliterated, a DSP circuit may not find any order in the chaos, and no signal will be received.

[0005] The receiver comprises, inter alia, an equalization unit and a decoder unit. Equalization is the process of maintaining the system transfer function characteristics within specified limits by modifying circuit parameters. Equalization includes modification of circuit parameters, such as resistance, inductance, or capacitance.

[0006] These form the bulk of the computational load in the receiver DSP. Digital signal processing (DSP) refers to various techniques for improving the accuracy and reliability of digital communications. The theory behind DSP is quite complex. Basically, DSP works by clarifying, or standardizing, the levels or states of a digital signal. A DSP circuit may be able to differentiate between wanted signals which provide information and noise.

[0007] If an incoming signal is analog, for example a standard television broadcast station, the signal is first converted to digital form by an analog-to-digital converter (ADC). The resulting digital signal has two or more levels. Ideally, these levels are always predictable, i.e. exact voltages or currents. However, because the incoming signal contains noise, the levels are not always at the standard values. The DSP circuit adjusts the levels so they are at the correct values. This practically eliminates the noise. The digital signal is then converted back to analog form via a digital-to-analog converter (DAC).

[0008] If a received signal is digital, for example computer data, then the ADC and DAC are not necessary. The DSP acts directly on the incoming signal, eliminating irregularities caused by noise, and thereby minimizing the number of errors per unit time.

[0009] Currently, an emerging technique called turbo equalization feeds soft information back between these two units by iteration. It has been shown that this technique significantly increases receiver sensitivity.

[0010] The discovery of turbo codes has been an important breakthrough in improving performance of many communication systems. Turbo codes effectively achieve random coding and thereby allow reliable communication at data rates near capacity in many channels, yet they posses enough structure to enable practical encoding and decoding. One significant characteristic of turbo codes is the interleaver gain, which is substantially different from the traditional coding approach of improving distance properties. This appears to make turbo coding applicable to a broad class of communication channels with different signal and noise/interference characteristics.

[0011] Impressive coding gains and simulation performances of turbo codes on various channels, including the magnetic recording channel, have been demonstrated by several researchers. However, there still exist some serious obstacles, such as high complexity and large memory requirements for the decoding operation.

[0012] The CNN Technology (Cellular Nonlinear/neural Network) is based on a new computing paradigm and architecture: the CNN Universal Machine. Its elementary instruction is defined on an array computer where each processor is a dynamical system with continuous signals and containing some additional logic. This unconventional architecture is very close to the anatomy and physiology of many parts of the brain, hence, it is called neuromorphic. In the CNN, each of the processors placed on a two or three-dimensional grid are dynamic cells, and they are interacting mainly with their local neighbor cells/processors. Unlike the cellular automaton or systolic array, here the signals and the time are continuous. The CNN paradigm was invented by Professor Leon Chua of University of California's Department of Electrical Engineering and Computer Sciences (Berkeley; Calif.).

[0013] By extending the CNN cell by analog and logic memory as well as additional interface units, and if a special Global Analogic Program Unit (GAPU) drives the whole array, all the key elements of the CNN Universal Machine (CNN-UM) architecture are present.

[0014] Since the invention of the CNN-UM (Roska-Chua, 1992), several VLSI chips were designed and recent experiments show close to trillion operations per second computing power on 1 cm^{2 }

[0015] It has been shown that turbo equalization significantly increases receiver sensitivity. However, in spite of the potential gain in performance, the computational burden for Turbo Equalization is high so that implementation in software receivers has been difficult.

[0016] In Germany, Joachin Hagenauer has proposed a new kind of implementation technology for equalizers, decoders and also Turbo Equalizers. In his paper, “Analog Turbo Networks in VLSI: The next step in turbo decoding and Equalization” (referencing a German patent application No 19725275.3 filed on Jun. 14, 1997), some non-linear property of the transistor is used to conform to the probability of distribution of the maximum likelihood problem. It is also shown that the statistical nature of the problem he is trying to solve is the same as the transfer function of the transistor. However, in practical applications such as mobile stations for example, the Hagenauer solution would force the usage of multiple chips in order to support different modulations.

[0017] The above-mentioned references are exemplary only and are not meant to be limiting in respect to the resources and/or technologies available to those skilled in the art.

[0018] An embodiment of the present invention defines a method for performing turbo equalization in real time using an analog circuit comprising a CNN decoder and a CNN equalizer. A method is comprised of minimizing a maximum likelihood metric and satisfying a constraint function while admitting discrete solutions.

[0019] An apparatus for performing turbo equalization in real time using an analog circuit is also provided as an embodiment of the present invention. The circuit has CNN hardware wherein a maximum likelihood metric and a constraint function admitting discrete solutions are implemented.

[0020] The present invention, accordingly, advantageously provides a method, and an associated apparatus, by which to effectuate a great number of iterations in the turbo equalizer.

[0021] Operation of embodiments of the present invention provides that the equalizer and the decoder being constructed by analog hardware will be able to supply symbol and bit estimates in a few nanoseconds frame time.

[0022] In the present invention cellular technology is used as the preferred embodiment, providing a series of advantages that will become apparent to the person skilled in the art.

[0023] In case of a phone supporting different modulations the Hagenauer solution would force the usage of multiple chips. It is one object of the present invention to remove such a limitation.

[0024] Another advantage of the present invention in relation to the cited related art is that channel estimation may be implemented in order to perform the detection successfully. This enables embodiments of the present invention to cope with rapidly changing and time varying communications channels.

[0025] These and other features, aspects, and advantages of embodiments of the present invention will become apparent with reference to the following description in conjunction with the accompanying drawings. It is to be understood, however, that the drawings are designed solely for the purposes of illustration and not as a definition of the limits of the invention, for which reference should be made to the appended claims.

[0026]

[0027]

[0028]

[0029]

[0030] In the description of the preferred embodiment, the data source will be considered as a large set of binary numbers, possibly encoded by a channel encoder. In one embodiment of the present invention, we will not be concerned with the nature of the source data, but only with its detection in the receiver after passing through the dispersive and noisy time varying channel. Moreover, operation of an embodiment of the present invention provides that the source data may be transmitted in discrete bursts, containing data as well as known training and pilot symbols. The symbols are complex numbers representing the source data according to the specific modulation technique employed. The carrier may then modulated according to the burst symbols by the modulator.

[0031] In the continuous time domain, a model for the received signal in baseband is given by:

[0032] The noise n(t) is assumed to be a complex random process, and the data sequence d_{m }

[0033] The discrete time equivalent channel, obtained by sampling the received signal y(t) at a fixed rate n/T, yields sufficient statistics to enable data estimation in one embodiment of the present invention.

[0034] The constant T will be referred to as the symbol period. Using matrix notation (upper case matrices and lower case vectors) the discrete time channel can be written as:

_{s}

[0035] The channel impulse response matrix H is fundamental to the equalization and detection problem, and has special properties. It has a form given by:

[0036] Operation of an embodiment of the present invention provides that a sequence d, such that the sequence error (Maximum Likelihood Sequence Estimation) is minimized, should be chosen:

_{se}^{2}^{2}

[0037] The person skilled in the art will recognize that the expression in (4) is not minimum phase. A procedure for transforming it to the minimum phase form is provided in the following.

[0038] The essential idea is to minimize ε^{2 }

^{2}^{2}

[0039] U might be upper or lower triangular, diagonally dominant, and minimum phase.

[0040] In one embodiment of the present invention, the canonical detection system as shown in

[0041] Matrices L and U have to be designed so that the SNR of the signal presented to the decision device in

[0042] The detection circuit represented is used to implement the model for the received signal in baseband described in (1) is so defined:

[0043] in block

[0044] in block

[0045] in block

[0046] Turning now to

[0047] After the process of error decoding has been performed, the input to the equalizer can be easily reconstructed since the encoding and interleaver/deinterleaver processes are very economical digital processes.

[0048] Thus, the analog equalization process can be performed again on data which are less prone to contain errors. Then, since the equalization was performed on improved data, the equalizer output is less likely to contains errors, thus enabling the decoder to produce even better bit estimates, and so the process of turbo equalization continues.

[0049] Referring now to

[0050] A solution is given by a sequence d minimizing a suitable cost function subject to the constraint that the data being estimated are part of a discrete set. Thus, it is an object of the present invention to minimize a maximum likelihood metric that in one embodiment of the present invention would be in the form:

^{2}^{2}^{2}

[0051] subject to a constraint that the elements of d are part of a set D containing all the symbols used in the transmitter modulator The maximum likelihood metric may minimize the symbol probability of error, if the noise statistics are Gaussian. If not Gaussian, it will minimize the least square noise energy.

[0052] Such a constraint in accordance with one embodiment of the present invention would be in the form:

[0053] where A is a non-zero constant, and M the size of the modulation constellation set D. Expression (7) for the constraint on the q^{th }

[0054] The optimization problem as given above constitutes a nonlinear programming problem and is well suited to a solution by the Chua CNN. As shown in (5), the Chua circuit shown in

_{1}_{2}_{3}_{4 }_{Q}

[0055] subject to

[0056] The nonlinear programming problem (8) and (9) has to have the following properties:

[0057] At least one (or more) solution exists;

[0058] Φ and f are continuous; and

[0059] both first and second order partial derivative exist.

[0060] Clearly, these are satisfied by (6) and (7).

[0061] The form of the nonlinear programming problem (8) and (9) is identical to what we require for solving (6) subject to (7).

[0062] With this correspondence, it is postulated that,

_{i}_{i}

[0063] ν_{i }_{q }

[0064] i_{j}_{j}

[0065] Hence the parameters of the Chua circuit can be calculated directly from the minimum phase IR matrix U, the transformed vector Ly and the modulation constellation D for each slot.

[0066] The circuit is turned on with random voltages and is allowed to settle into a state of equilibrium.

[0067] In M. P. Kennedy and L. O. Chua, “Neural Networks for Nonlinear Programming”,

[0068] Since there are no resistors in the circuit, the circuits time constant is only limited by conductor losses, which are very small. Convergence thus will follow in a few nanoseconds with the current VLSI technology.

[0069] The circuit node voltages (i.e. dm) change in time in such a way that ε^{2 }

[0070] Since the circuit settling time is typically many orders of magnitude smaller than the burst duration, it is possible to apply the circuit many times with different random starting points, and the best solution obtained in terms of the smallest ε^{2 }

[0071] _{1}_{2}_{q}_{1}_{2}_{q }_{j }

[0072] The Error Correction Decoding (ECD) problem is an optimization problem and can be solved in the same way as the equalization problem.

[0073] We can model the encoder operating on an analog signal as for the equalization problem, since we will demand the discrete nature of the estimated data via a constraint function. Hence, we replace the modulo

[0074] Where <g

[0075] Thus, the output of the encoder for a vector d(i)=[d_{i}_{i−1}_{i−(k−1)}

[0076] where the encoder is rate 1/n and G denotes the n generator vectors in matrix format.

[0077] A sequence of real numbers may be formed as a function of time that is the output of the encoder, given an input sequence d denoted by E_{out}

[0078] Operation of an embodiment of the present invention provides that the optimum decoder would adhere to the following rules:

[0079] For a memoryless additive white gaussian noise channel, over a finite set of soft received bits from the equalizer, denoted by E_{equ}

^{2}^{2}_{equ}_{out}^{2}

[0080] A memoryless channel means that the bits coming into the decoder are not correlated except for the contribution from the encoder. The channel does not introduce correlation between bits, it only adds noise.

[0081] The elements of d must be part of a discrete set C, typically {0,1}.

[0082] Such a constraint in a particular embodiment of the present invention is represented by:

[0083] Having defined the cost function and the constraint on d as it has been done for the equalization problem, the CNN analog circuit may be applied equivalently also to the Error Decoding problem in the same advantageous way.

[0084]

[0085] The convolutional encoder is part of block

[0086] The present invention, accordingly, advantageously provides a method, and an associated apparatus, by which to better effectuate Turbo Equalization.

[0087] Referring again to

[0088] Block

[0089] While, in the exemplary implementation, the apparatus of an embodiment of the present invention is shown constructed pursuant and citing the EDGE standard, operation of an embodiment of the present invention can also analogously be implemented in other communication systems, wireless and fixed, in which communication is effectuated.

[0090] Equivalently, CNN equalizer and decoder have been shown as the preferred embodiment of the invention.

[0091] Any analog circuit satisfying equations within the scope of (6) and (7) or (13) and (14) would work as well and must be considered within the spirit and scope of the present invention.

[0092] In the present invention, the equalizer and decoder is not implemented in software on a DSP chip as is usually done, but the implementation is in analog hardware. The analog nature of the implementation removes the issue of complexity and the Turbo Equalization method may easily be performed in this way.

[0093] The equalizer and error correcting decoder use an analog search/optimization procedure implemented in Cellular Non-linear Networks (CNN).

[0094] Although described in the context of particular embodiments, it will be apparent to those skilled in the art that a number of modifications and various changes to these teachings may occur. Thus, while the invention has been particularly shown and described with respect to one or more preferred embodiments thereof, it will be understood by those skilled in the art that certain modifications or changes, in form and shape, may be made therein without departing from the scope and spirit of the invention as set forth above and claimed hereafter.