In one embodiment, the present invention provides a computer data encryption/decryption device and program that uses a fingerprint minutiae generated password to encrypt/decrypt credit card information before sending the information over a computer network. The system uses the finger print along with a public key infrastructure (PKI) and some image processing to ensure the security of the user's accounts.
[0001] This patent application claims the benefit of the filing date of United States Provisional Patent Applications Ser. No. 60/219,209, filed Jul. 19, 2000 and entitled “SYSTEM AND METHOD FOR CARDLESS SECURE CREDIT TRANSACTION PROCESSING”; the entire contents of which are hereby expressly incorporated by reference.
[0002] The present invention relates to data security and data authentication. Specifically, the present invention is directed to a system and method for extracting unique numerical information from a fingerprint.
[0003] In the last few years, there has been an exponential interest and growth in business transactions over the Internet. The Internet has recently been popularized by the rapid success of the Web. The Web links together a variety of computers from around the world and various topics in a non-sequential network of associations which permit a user to browse from one topic to another, regardless of the format and order of topics. Users access and browse the Web using a web browser that generally resides and is executed on the user's computer.
[0004] Billions of dollars are spent every year shopping on the Internet. One can already buy almost anything on the Internet—whether it be a book or a new car. However, there is a major problem with online shopping due to the fact that the Internet is inherently an insecure network. As data packets travel across the Internet, anyone along the way could conceivably intercept and examine those packets. Because of that, there are potential risks to doing business online. Specially if a buyer makes a payment over the Internet with a credit card.
[0005] A number of ways to make payments across the Internet have recently sprung up to solve this problem. Most of these methods use procedures and protocols designed to make financial transactions on the Internet as confidential as possible, using encryption technology to make sure that no one can steal a credit card number. Typically, schemes for secure transactions take two approaches. One approach encrypts personal financial information, such as a credit card number, so that it can be transferred across the Internet in a manner that would not let unauthorized people read the data. The second method creates a system of cyber-dollars, electronic credits that only authorized merchants can redeem for real money.
[0006] The Secure Electronic Transaction protocol (SET) has been endorsed by VISA, MasterCard, American Express, Microsoft, and Netscape, among other companies. SET describes a way that people can shop online and have the purchases charged to their credit cards.
[0007] In addition to secured credit card transactions, a number of companies are working on electronic, or “cyber-dollar” scenarios that will enable consumers to purchase goods and services anonymously. That is, the consumer uses the digital equivalent of paper currency to make purchases and need not provide personal information such as, credit card or bank information to do so. Using this method of electronic payment, consumers buy electronic “coins” or “tokens” and use these specially marked and encrypted coins to make purchases.
[0008] Both credit card systems and electronic cash systems have their disadvantages. For example, most of the secure e-commerce web sites provide a secured socket layer (SSL) encryption method to protect customers' information when transmitted over the Internet. This method tends to protect the data being transmitted over the Internet by encrypting the data before it is transmitted. However, even if it is assumed that a hacker will not be able to break in this system, a remaining major concern is that merchants have buyers credit card information. Customers use their credit cards to shop online from many online store. There are many ways these online stores can take advantage of this information. Furthermore, in case of a credit card fraud, it would be very difficult to find out who used the credit card without the permission of the card holder. Sometime, it is the employees or people who have access to the data in any of the e-commerce companies that a buyer had shopped.
[0009] Another concern is having too many credit cards. On average, a card holder has three credit cards. To solve the problem of having too many cards, many companies are trying to find the best way to store all of credit card and other information into a smart card, however, if the smart card is stolen or lost, then someone may gain access to all the credit card and personal information. However, smart cards for online shopping transmit credit card information online, even though, the information is encrypted with a smart card code. Similarly, merchants can still have access to the credit card information. Therefore, smart cards like regular credit cards, still provide the credit card information to merchants and transmit the information over the Internet, which may be intercepted by unauthorized hackers. Additionally, even with a smart card, the card holder needs to have the card or memorize the card information such as, the card number, expiration date, etc. Additionally, smart cards are prone to being lost.
[0010] The system and method of the present invention overcomes the disadvantages of the existing systems by using fingerprint as a password or a key to secure data resulting in the following advantages over the existing systems: convenience, flexibility, portability, different fingerprint sequences can be used for different purposes, can fit in any crypto algorithm as long as, the algorithm requires a password, and hardware independent.
[0011] In one embodiment, the invention extracts unique numerical information from a fingerprint called Fingerprint To Number (FTN) gateway. A fingerprint is first scanned and the scanned image is enhanced. The blurred area of the image is restored and the enhanced image is binarized. The binarized image is then thinned. A core point in the image is detected and minutiae within a given radius from the core point are detected. A number is then extracted from the image by computing relation of minutiae to the core point.
[0012] In one embodiment, the present invention provides a computer data encryption/decryption device and program that uses a fingerprint minutiae generated password to encrypt/decrypt credit card information before sending the information over a computer network. The system uses the finger print along with a public key infrastructure (PKI) and some image processing to ensure the security of the user's accounts.
[0013] In one aspect, the invention describes a method for obtaining a numerical value from a fingerprint comprising the steps of: enhancing a scanned image of the fingerprint; restoring the enhanced image; binarizing the restored image; thinning the binarized image; detecting a core point in the thinned image; detecting minutiae within a predetermined radius from the core point; and extracting the numerical value by computing relations of the minutiae to the core point.
[0014] In another aspect, the invention discloses a fingerprint scanning device comprising: means for scanning a fingerprint for obtaining a fingerprint image; means for enhancing the fingerprint image; means for restoring the fingerprint image; means for binarizing the fingerprint image; means for thinning the fingerprint image; means for detecting a core point in the fingerprint image; means for detecting minutiae within a predetermined radius from the core point; and means for extracting the numerical value by computing relations of the minutiae to the core point.
[0015] General purpose computers, special purpose computers, networked computing systems, and/or special hardwares, such as a Digital Signal Processor (DSP) chips are capable of performing the steps of the present invention.
[0016] The objects, advantages and features of this invention will become more apparent from a consideration of the following detailed description and the drawings, in which:
[0017]
[0018]
[0019]
[0020]
[0021]
[0022]
[0023]
[0024]
[0025]
[0026]
[0027]
[0028] FIGS.
[0029]
[0030] FIGS.
[0031] FIGS.
[0032] FIGS.
[0033] In one embodiment, the present invention is a system and method for extracting unique numerical information from a fingerprint. The system then uses the extracted number as a seed to generate a variable length of numerical information as a “password” to use with any encryption formula that requires a key or password to encrypt data. The length of the generated numerical information “password” depends on the resolution of the fingerprint scanning unit and the method of numerical information extraction algorithms. In one embodiment, the numerical information can be a combination of any number of fingerprints. Furthermore, the information can be more then one persons's fingerprint combination.
[0034] In one embodiment, the present invention uses a fingerprint-capturing device (scanner) to capture fingerprint image and then transforms it to a digital image. After image enhancements and pattern recognition processes, digital image is then transformed into numerical information and applied into an encryption formula (algorithms). In another embodiment, the present invention provides fingerprint scanning and transforms the scanned image into a “minutiae” as digital data. This digital data is then used as a “secret key” in a cryptographic formula for data encryption and user authentication. The system creates a binary file based on this minutiae key and securely stores the binary file.
[0035] In one embodiment, the invention describes a cardless credit/debit card transaction processing system. The system can store multiple card information in a highly secured manner, thus eliminating any need to carry any credit card or debit card. Biometric methods are utilized to identify and authorized transactions in an encrypted and secure environment. Encryption/decryption methods may be applied using multiple fingerprint sequences rather than only one fingerprint. For example, a login fingerprint can be a left thumb fingerprint while the fingerprint authorization sequence may use the left second finger and the right thumb.
[0036] In one embodiment, a computer controlled system notifies users about their purchase detail information through a channel of delivery. These channels of delivery include: voice call, pager alert, e-mail, SMS (short messaging system), instant messaging system, facsimile, and the like.
[0037] In one embodiment, the present invention employs a public kiosk to provide access to Internet through an ISP.
[0038] In one embodiment of the present invention, each of the PCs (kiosks)
[0039] Servers (hosts)
[0040] An exemplary web site location
[0041] An enormous amount of information is sent and stored over the Internet every day-everything from personal e-mail to corporate data to credit card information and other highly sensitive material. Because the information is sent in packets along public routers, the possibility exists that someone could intercept the information, or retrieve the information from the storage facilities. As a way to ensure that the sensitive material can't be looked at, the present invention uses sophisticated cryptographic system and method so that only the sender can retrieve the data from the remote storage facilities.
[0042] The Internet is a notoriously insecure network. Anything that is sent across it or stored in storage connected to it can be tampered with. This is of particular concern when confidential information, such as personal data and credit card numbers, is transmitted and stored across the Internet. Another related concern is that it can be difficult to know that the person sending the information across the Internet, such as credit card information, is really who he says he is. There are ways for people to forge identities and steal credit card numbers, and financial institutions and other businesses require ways to know that the person sending information really is who he says he is.
[0043] In one embodiment, the present invention uses finger print based encryption that uses finger prints as encryption keys. The system then uses the encryption key to transmit data over the Internet. In public key cryptography, two keys are involved: a public key and a private key. Every person has both a public key and a private key. The public key is stored in a secure PKIserver and is not publicly available. This embodiment is a closed system where only the PKIserver can use the public key to identify the data is coming from the “real” source, not a fake source. However, the private key is kept secret on the person's computer. The public key can encrypt messages, but only the private key can decrypt messages that the public key has encrypted. The invention uses a binary file generated from scanning the user's finger print as the private key to encrypt the credit card information and decrypt the data.
[0044] In one embodiment, the invention uses digital certificates that use encryption to authenticate the person sending information, a credit card number, a message, or other data over the Internet. The system uses human fingerprint to digitally sign and encrypt the message sent to payment gateway. As a result, users can shop anywhere in the world, and there is no need to restrict a user to his own computer. When someone with a digital certificate goes to a site or sends e-mail, that certificate is presented to the site or attached to the e-mail, and it verifies that the user is who he claims to be. The information has been encrypted in a way that makes it unique to the user. In one embodiment, the system of the present invention utilizes the finger print of the user (explained in more detail below) to generate a unique digital signature to be used by that user to verify the authenticity of the user.
[0045] A typical financial transaction on the Internet works as follow. Suppose a buyer browses through an electronic catalog on a Web site and he decides to buy a book. To use the Secure Electronic Transaction protocol (SET) to pay for the book, the buyer needs a credit card from a participating bank and a unique “electronic signature” for his computer. This information will verify who the user is, i.e., what computer the signature is coming from. However, because the certificate is installed on a user computer, any person who has access to the user computer can use the user's account to purchase goods without user's authorization.
[0046] The system of the present invention alleviates this problem by utilizing the account owner's fingerprint for authenticating and authorizing the account owner. Furthermore the present invention eliminates fix location problem of today's verification systems, by no longer requiring installation of certificates on any machine identification purposes. A potential consumer can freely shop anywhere around the world using any computer or POS system. Moreover, unlike SET, that can only be used on a card issuing bank that is a SET member, the system of the present invention is bank independent, meaning that any bank's credit card can use the system. This system does not need any bank to join or accept any specific rules or application.
[0047] For the system of the present invention, the merchant does not need to know where the order comes from nor the identity of the buyer is needed. Since the user uses fingerprint to verify and encrypt information, the system can easily authenticate the buyer. This design also protects unnecessary personal data leaks, specially when stored in a third party system, for example, the merchant's system.
[0048] The present invention uses “closed” PKI system for merchant identification purpose. The merchant sends verification to the buyer that the order has been made. The merchant's software creates an authorization request for payment and includes with the merchant's digital signature the transaction identifier and the PI received from the buyer. The software encrypts all of it and sends the encrypted request to the payment gateway. The payment gateway decrypts the messages and uses the merchant's digital signature to verify that the message is from the merchant. By examining the PI, it verifies that they have come from the buyer. The payment gateway then uses a bank card payment system to send an authorization request to the bank that issued the buyer his bank card, asking if the purchase can be made.
[0049] When the bank responds that the payment can be made, the payment gateway creates, digitally signs, and encrypts an authorization (approval) message. This message is then sent to the merchant. The merchant's software decrypts the message and uses the digital signature to verify that it came from the payment gateway. Assured of payment, the merchant now ships the book to the buyer. Some time after the transaction has been completed, the merchant requests payment from the bank. The merchant's software creates a capture request, which includes the amount of the transaction, the transaction identifier, a digital signature, and other information about the transaction. The information is encrypted and sent to the payment gateway.
[0050] The payment gateway decrypts the capture request and uses the digital signature to verify it is from the merchant. It sends a request for payment to the bank, using the bank card payment system. It receives a message authorizing payment, encrypts the message, and then sends the authorization to the merchant. The merchant software decrypts the authorization and verifies that it is from the payment gateway. The software then stores the authorization that will be used to reconcile the credit card payment routinely when it is received from the bank.
[0051] There are many existing encryption algorithms such as, RSA, DSA, etc. All of these encryption algorithms involve altering the original data into different one by means of performing certain calculation on the original data. Some systems use hardware address or ID as a key, however, it requires the user to perform the encryption/decryption on the same machine.
[0052] A Public Key Infrastructure (PKI) algorithm uses a certification authority (CA) and issues a private key that resides in the user's computer and a public key that is obtainable by the receiver of the message. If the user wants to encrypt a message and send it to others, the user has to perform the encryption in his own computer. While the receiver of the message can get the public key to decrypt the message anywhere around the world.
[0053]
[0054] In one embodiment, password length can be increased to improve security by using multiple fingerprints and with different sequence. For example, numbering fingers in 0-9, starting from left to right. Then, using the two thumbs will be “56” and using both small fingers will be “09”. Furthermore, a larger number of fingers can be used in different sequence and frequency to obtain an even more secure system.
[0055] In one embodiment, the credit card information is stored in a data center, so that the user can access this data at anytime anywhere using Internet. The data is stored in an encrypted form which means user has complete privacy for her data. A compatible fingerprint and a computer program record new member's fingerprint minutiae for system login and identification purposes. A software program including a specific private key is used to obtain the member's fingerprint minutiae key, encrypt it with the private key and send it to the data center to complete the registration process. The private key is preferably hard-coded in the program. In one embodiment, an all-in-one device, combines scanner and encryption module in a fingerprint reader unit, with hardware encoded key for encrypted transmission.
[0056] New member's fingerprint minutiae is sent to the data center in encrypted form with the private key that is sent with the membership package. In the data center, a public key that is stored with user ID in a secured database is used to decrypt the encrypted message. This message is a payload data including the encrypted fingerprint minutiae key from the user. The decrypted message (result) is the original minutiae from the user. This fingerprint is for future login verification purpose. This encrypted message is encrypted with specific private key (the one that was sent to the new member). If member's encrypted fingerprint minutiae key cannot be decrypted in the data center, new member needs to retry the process in order to complete the registration process.
[0057] Once registration is completed, the member only needs to type in a user ID and position his/her finger in the fingerprint reader. User ID is encrypted with member fingerprint minutiae and is sent to data center for login request. Then, the data center decrypts the user ID with the presorted fingerprint minutiae key. A portable fingerprint reader unit with Internet connection capability may be provided in the post offices (or any other convenience place) for the new member to complete the registration process.
[0058] In one embodiment, the system of the present invention (M1 system) provides services to both existing and new credit/debit card members. Customers register their banking information (like credit card information, debit card information, etc.) with system's Secured Relay Data Center. All customer information are stored in an encrypted form by means of their own fingerprints as a “key”. When using this embodiment to purchase goods online, customers simply input their userID and their Login fingerprint scan. The Secured Relay Data Center then displays to the customer a pop up screen that includes data such as, “name of card issuing bank” for the customer to choose from. After deciding which card to charged to, the customer then use the system to scan the fingerprint authorization sequence (may have more than one fingerprints). Banking information is then decrypted from the Secured Relay Data Center and is sent to the Merchant Bank for credit processing via line with security capabilities, such as ISO8583.
[0059]
[0060] The first time fingerprint registration is encrypted by a “hard coded” private key in the fingerprint scanner (block
[0061]
[0062] The customer can choose which card to use and then submits fingerprint authorization sequence scan, as shown in block
[0063]
[0064] The server in the data center then looks up credit card information and decrypts the information with customer's fingerprint authorization. The system then encrypts card information and payment details and send them to merchant bank, as shown in block
[0065]
[0066] In one embodiment, the present invention provides service to both new and existing credit/debit card customers (M2 system). With this system, purchasing good and services at any point of sale (POS), including online shopping no longer require a physical card and pin. In this embodiment, the M2 system uses a fingerprint reader to collect customer's login fingerprint (similar to M1 system) and the card number is stored in a matching server located within individual's card issuing bank's site. This embodiment allows existing banking systems to remain intact, while incorporating the new biometric identification and encryption method to provide highly secured electronic transaction environment.
[0067]
[0068] The Matching Server located at the card issuing bank's data center stores the userlD and card information, as shown in block
[0069]
[0070]
[0071] The customer chooses a financial institute to be used from the card listing and then inputs fingerprint authorization sequence in block
[0072] The Matching Server typically located within the card-issuing bank then decrypts the payload with the data center's public key, as shown in block
[0073] A fingerprint is typically formed from composite curve segments. The top part is called “ridges” and the lower portion is called “valleys.” The ridges and valleys alternate, flowing in a local constant direction. The “minutiae” are the small features formed by crossing and ending of ridges in the fingerprint ridges flow pattern. In other words, minutia refers to the ridge ending and bifurcation of a fingerprint pattern. Other important fingerprint features include: core and delta, which can be served as a “landmark” for orientation and act as a “singularity Point”.
[0074]
[0075] In block
[0076] Before thinning the image lines, gray-scale image should be transformed into binary (black and white) image. As shown in block
[0077] In most cases, however, it is very difficult to obtain a clear image that includes lines with similar intensity levels. To overcome this problem, the method and system of the present invention performs the following steps. The image is partitioned and divided into several small areas. Then, an average intensity level of lines within an area is calculated. This average intensity is set as a threshold and the gray-scale image of the area is transformed to binary image. This process is then repeated for each partitioned area until binarization is completed.
[0078] A binary to skeleton processing, called “thinning” may also be performed on the image, as illustrated in block
[0079] After a skeleton image is generated from the gray scale fingerprint image, the core point of the fingerprint is determined in block
[0080] This process shortens the time required for processing an image. For example, using the above segmentation, it takes {fraction (1/64)} of the time required for processing a 256×256 pixel image without segmentation to search the same image. After segmenting the image, a Fast Fourier Transform (FFT) process is applied to each square area. The FFT process enables a computer program to recognize a line in a given area as a combination of dots, and also recognize the density of dots along a line. For example, even on the same line, the density of dots may be high on some area and low on other areas. A direction line vertical to the tangent of a given line in each segment is then extracted. This line represents the direction of a line that can be obtained by slicing the line at a given point. That is why FFT process is applied to fingerprint image.
[0081] As a result of the above process, the image of the fingerprint is replaced with the combination of straight lines crossing from one side to the opposite side of the square area, as shown in FIGS.
[0082] A. Core area exists on a column which has the most squares with number zero (vertical direction lines), or
[0083] B. Core area exists on a square whose upper squares in the same column all have number zero.
[0084] As a result of the above methods, several squares may be obtained. Core point exists on the square that meets the condition of definition B.
[0085] To detect the core point (pixel) within the detected core square, the detected core square obtained above, together with its neighboring squares are further segmented to smaller squares of 4×4 pixels. The above process for detecting core square is applied to the smaller square(s) to detect a smaller core square. The highest pixel on a smaller core square that is on the ridge line is the core point (pixel).
[0086] After the core point is detected, the minutiae have to be detected. Although, every fingerprint image has several minutiae, in one embodiment, only the bifurcation minutiae are detected. First, every 3×3 pixel window is processed to detect connectivity of the pixels within each window. The number of times that color changes from block to white is then counted. FIGS.
[0087] The final process is extracting a unique number from the image, as shown in block
[0088] A second exemplary method for extracting a unique number from the image is shown in
[0089] According to a third exemplary method, from the detected core point, a circle with a radius r is reached and minutiae in different segments within that radius are detected. Then, the numbers of ridges between the core point and the reference minutiae are counted, and added up to obtain the numerical value.
[0090] The above method may be carried out using a general purpose computer, a special purpose computer, a networked computing system, or a special hardware, such as a Digital Signal Processor (DSP) chip. As described above, any or all of the hardware for performing the above steps may be embodied in a single fingerprint scanner device. After a unique numerical value is determined from the fingerprint, the numerical value may used as a password, or a key that is used by an encryption module for data encryption/decryption, or other data security purposes.
[0091] It will be recognized by those skilled in the art that various modifications may be made to the illustrated and other embodiments of the invention described above, without departing from the broad inventive scope thereof. It will be understood therefore that the invention is not limited to the particular embodiments or arrangements disclosed, but is rather intended to cover any changes, adaptations or modifications which are within the scope and spirit of the invention, as defined by the appended claims.