Title:
Method and system for enhanced detail-in-context viewing
United States Patent RE43742


Abstract:
An improved method for display of a transitional region of interest while transitioning between a first region of interest and a second region of interest within visual information on a display screen of a computer. The method comprising the steps of applying a transitional transformation to the visual information and displaying the transitional transformed visual information on the display screen. The transitional transformation requiring a reduced calculation for transforming the visual information in the transitional region.



Inventors:
Baar, David J. P. (Vancouver, CA)
Cowperthwaite, David J. (Hillsboro, OR, US)
Tigges, Mark H. A. (North Vancouver, CA)
Application Number:
12/580540
Publication Date:
10/16/2012
Filing Date:
10/16/2009
Assignee:
Noregin Assets N.V., L.L.C. (Dover, DE, US)
Primary Class:
Other Classes:
345/619, 345/627, 345/629, 345/645, 345/660, 345/661, 345/665, 345/670, 345/672, 345/680
International Classes:
G09G5/00; G06F3/0484; G09G5/373
Field of Search:
345/647, 345/648, 345/660-680
View Patent Images:
US Patent References:
20100262907Interacting with Detail-in-Context PresentationsOctober, 2010Shoemaker et al.
20100208968Occlusion Reduction and Magnification for Multidimensional Data PresentationsAugust, 2010Shoemaker et al.
20100201785Method and system for displaying stereoscopic detail-in-context presentationsAugust, 2010Lantin
7773101Fisheye lens graphical user interfacesAugust, 2010Shoemaker
7761713Method and system for controlling access in detail-in-context presentationsJuly, 2010Baar
7737976Method and system for displaying stereoscopic detail-in-context presentationsJune, 2010Lantin
7714859Occlusion reduction and magnification for multidimensional data presentationsMay, 2010Shoemaker
7698653Graphical user interface including zoom control box representing image and magnification of displayed imageApril, 2010Roman et al.
20100045702Navigating Digital Images using Detail-in-context LensesFebruary, 2010Doyle
20100033503Detail-in-Context Lenses for Interacting with Objects in Digital Image PresentationsFebruary, 2010Baar
20100026718DETAIL-IN-CONTEXT LENSES FOR DIGITAL IMAGE CROPPING, MEASUREMENT AND ONLINE MAPSFebruary, 2010Jetha
7667699Fast rendering of pyramid lens distorted raster imagesFebruary, 2010Komar
20090284542LENS-DEFINED ADJUSTMENT OF DISPLAYSNovember, 2009Baar
20090265656GRAPHICAL USER INTERFACE HAVING AN ATTACHED TOOLBAR FOR DRAG AND DROP EDITING IN DETAIL-IN-CONTEXT LENS PRESENTATIONSOctober, 2009Jetha
7580036Detail-in-context terrain displacement algorithm with optimizationsAugust, 2009Montagnese
20090172587DYNAMIC DETAIL-IN-CONTEXT USER INTERFACE FOR APPLICATION ACCESS AND CONTENT ACCESS ON ELECTRONIC DISPLAYSJuly, 2009Carlisle
20090147023DETAIL-IN-CONTEXT LENSES FOR DIGITAL IMAGE CROPPING AND MEASUREMENTJune, 2009Jetha et al.
20090141044FISHEYE LENS GRAPHICAL USER INTERFACESJune, 2009Shoemaker
7495678Navigating digital images using detail-in-context lensesFebruary, 2009Doyle et al.
7493572Navigation methods, systems, and computer program products for virtual three-dimensional booksFebruary, 2009Card et al.
7489321Using detail-in-context lenses for accurate digital image cropping and measurementFebruary, 2009Jetha et al.
7486302Fisheye lens graphical user interfacesFebruary, 2009Shoemaker
7472354Graphical user interface having an attached toolbar for drag and drop editing in detail-in-context lens presentationsDecember, 2008Jetha et al.
7450114User interface systems and methods for manipulating and viewing digital documentsNovember, 2008Anwar
7443396Instrument having a virtual magnifying glass for displaying magnified portions of a signal waveformOctober, 2008Ilic
7423660Image display apparatus, method and programSeptember, 2008Ouchi et al.
7411610Method and system for generating detail-in-context video presentations using a graphical user interfaceAugust, 2008Doyle
7321824Presenting a travel route using more than one presentation styleJanuary, 2008Nesbitt
7312806Dynamic width adjustment for detail-in-context lensesDecember, 2007Tigges
7310619Detail-in-context lenses for interacting with objects in digital image presentationsDecember, 2007Baar et al.
7283141Method and system for enhanced detail-in-context viewingOctober, 2007Baar et al.
7280105Occlusion reducing transformations for three-dimensional detail-in-context viewingOctober, 2007Cowperthwaite
7275219Fast and accurate rendering of pliable display technology distortions using pre-calculated texel coveragesSeptember, 2007Shoemaker
7274381Panoramic imaging and display system with canonical magnifierSeptember, 2007Mojaver et al.
7256801Elastic presentation spaceAugust, 2007Baar et al.
7246109Method and apparatus for browsing using position informationJuly, 2007Ramaswamy
7233942Method and apparatus for providing geographically authenticated electronic documentsJune, 2007Nye
20070097109Method and system for generating detail-in-context presentations in client/server systemsMay, 2007Shoemaker et al.
7213214Graphical user interface with zoom for detail-in-context presentationsMay, 2007Baar et al.
20070064018Detail-in-context lenses for online mapsMarch, 2007Shoemaker et al.
7197719Graphical user interface for detail-in-context presentationsMarch, 2007Doyle et al.
7197718Interactive virtual area browser for selecting and rescaling graphical representations of displayed dataMarch, 2007Westerman et al.
7194697Magnification engineMarch, 2007Sinclair, II et al.
20070033543Virtual magnifying glass with intuitive use enhancementsFebruary, 2007Ngari et al.
7173636Method and system for generating detail-in-context lens presentations for elevation dataFebruary, 2007Montagnese
7173633Method and system for inversion of detail-in-context presentationsFebruary, 2007Tigges
7158878Digital mapping systemJanuary, 2007Rasmussen et al.
7134092Graphical user interface method and apparatusNovember, 2006Fung et al.
7133054Methods and apparatus for navigating an imageNovember, 2006Aguera y Arcas
20060214951Method and system for enhanced detail-in-context viewingSeptember, 2006Baar et al.
7106349Method and system for enhanced detail-in-context viewingSeptember, 2006Baar et al.
20060192780Method and system for displaying stereoscopic detail-in-context presentationsAugust, 2006Lantin
7088364Method and system for displaying stereoscopic detail-in-context presentationsAugust, 2006Lantin
7084886Using detail-in-context lenses for accurate digital image cropping and measurementAugust, 2006Jetha et al.
7071971Apparatus for identifying the scene location viewed via remotely operated television cameraJuly, 2006Elberbaum
20060139375Secondary map in digital mapping systemJune, 2006Rasmussen et al.
20060098028Compound lenses for multi-source data presentationMay, 2006Baar
7055095Systems and methods for digital document processingMay, 2006Anwar
7038680System for graphical display and interactive exploratory analysis of data and data relationshipsMay, 2006Pitkow
20060082901Interacting with detail-in-context presentationsApril, 2006Shoemaker
20060059432User interface having viewing area with non-transparent and semi-transparent regionsMarch, 2006Bells
20060036629System and process for identifying objects and/or points nearby a given object or pointFebruary, 2006Gray
20060033762Magnification methods, systems, and computer program products for virtual three-dimensional booksFebruary, 2006Card et al.
20060026521Gestures for touch sensitive input devicesFebruary, 2006Hotelling et al.
20060022955Visual expanderFebruary, 2006Kennedy
6985865Method and system for enhanced response to voice commands in a voice command platformJanuary, 2006Packingham et al.
20050285861Detail-in-context lenses for navigationDecember, 2005Fraser
20050278378Systems and methods of geographical text indexingDecember, 2005Frank
6975335Method of displaying magnified and reduced areas and apparatus thereofDecember, 2005Watanabe
20050259118Panoramic imaging and display system with canonical magnifierNovember, 2005Mojaver et al.
6961071Method and system for inversion of detail-in-context presentations with foldingNovember, 2005Montagnese et al.
6956590Method of providing visual continuity when panning and zooming with a map displayOctober, 2005Barton et al.
6938218Method and apparatus for three dimensional internet and computer file interfaceAugust, 2005Rosen
6924822Magnification methods, systems, and computer program products for virtual three-dimensional booksAugust, 2005Card et al.
6919921Camera control using scroll bar for tilt control and having display of tilting direction and controllable range informationJuly, 2005Morota et al.
20050134610Navigating digital images using detail-in-context lensesJune, 2005Doyle et al.
6911975Stereo image display apparatus and method, and storage mediumJune, 2005Iizuka et al.
6906643Systems and methods of viewing, modifying, and interacting with “path-enhanced” multimediaJune, 2005Samadani et al.
6882755Image transmission for low bandwidth with region of interestApril, 2005Silverstein et al.
6874126Method and apparatus for controlling content display by the cursor motionMarch, 2005Lapidous
20050041046Elastic presentation spaceFebruary, 2005Baar et al.
6842175Tools for interacting with virtual environmentsJanuary, 2005Schmalstieg et al.
20040257380Imaging method and systemDecember, 2004Herbert et al.
20040257375Occlusion reducing transformations for three-dimensional detail-in-context viewingDecember, 2004Cowperthwaite
20040240709Method and system for controlling detail-in-context lenses through eye and position trackingDecember, 2004Shoemaker
6833843Panoramic imaging and display system with canonical magnifierDecember, 2004Mojaver et al.
20040217979Elastic presentation spaceNovember, 2004Baar et al.
20040194014User interface systems and methods for viewing and manipulating digital documentsSeptember, 2004Anwar
6798412Occlusion reducing transformations for three-dimensional detail-in-context viewingSeptember, 2004Cowperthwaite
20040150664System and method for accessing remote screen contentAugust, 2004Baudisch
20040125138Detail-in-context lenses for multi-layer imagesJuly, 2004Jetha et al.
6768497Elastic presentation spaceJuly, 2004Baar et al.
6760020Image processing apparatus for displaying three-dimensional imageJuly, 2004Uchiyama et al.
20040111332Detail-in-context lenses for interacting with objects in digital image presentationsJune, 2004Baar et al.
6747611Compact optical system and packaging for head mounted displayJune, 2004Budd et al.
6747610Stereoscopic image display apparatus capable of selectively displaying desired stereoscopic imageJune, 2004Taima et al.
6744430Image processing method and its apparatusJune, 2004Shimizu
6731315Method for selecting display parameters of a magnifiable cursorMay, 2004Ma et al.
6731285System and method for providing high performance image magnification in a web browserMay, 2004Matchen
6727910Method and system for inversion of detail-in-context presentationsApril, 2004Tigges
6721655Vehicle travel guide device and vehicle travel guide methodApril, 2004Koichiro
6720971Image processing method and apparatus, and storage mediumApril, 2004Yamamoto et al.
20040056898Graphical user interface having an attached toolbar for drag and drop editing in detail-in-context lens presentationsMarch, 2004Jetha et al.
20040056869Using detail-in-context lenses for accurate digital image cropping and measurementMarch, 2004Jetha et al.
6704034Method and apparatus for providing accessibility through a context sensitive magnifying glassMarch, 2004Rodriguez et al.
20040026521Linear proportional valveFebruary, 2004Colas et al.
6690387Touch-screen image scrolling system and methodFebruary, 2004Zimmerman et al.
20030231177Method and system for inversion of detail-in-context presentations with foldingDecember, 2003Montagnese et al.
20030227556Method and system for generating detail-in-context video presentations using a graphical user interfaceDecember, 2003Doyle
20030210281Magnifying a thumbnail image of a documentNovember, 2003Ellis et al.
20030196114Persistent access control of protected contentOctober, 2003Brew et al.
6633305System and method for magnifying and editing imagesOctober, 2003Sarfield
6631205Stereoscopic imaging in a portable document formatOctober, 2003Melen et al.
20030179237System and method for arranging, manipulating and displaying objects in a graphical user interfaceSeptember, 2003Nelson et al.
20030179219Image display device, image display method, and image display programSeptember, 2003Nakano et al.
20030179198Stereoscopic image processing apparatus and method, stereoscopic vision parameter setting apparatus and method, and computer program storage medium information processing method and apparatusSeptember, 2003Uchiyama
20030174146Apparatus and method for providing electronic image manipulation in video conferencing applicationsSeptember, 2003Kenoyer
6612930Video game apparatus and method with enhanced virtual camera controlSeptember, 2003Kawagoe et al.
20030151626Fast rendering of pyramid lens distorted raster imagesAugust, 2003Komar et al.
20030151625Fast and accurate rendering of pliable display technology distortions using pre-calculated texel coveragesAugust, 2003Shoemaker
6608631Method, apparatus, and computer program product for geometric warps and deformationsAugust, 2003Milliron
20030137525Method and apparatus for facilitating motion-coupled magnificationJuly, 2003Smith
6590583Method for context-preserving magnification of digital image regionsJuly, 2003Soohoo
6590568Touch screen drag and drop input techniqueJuly, 2003Astala et al.
20030118223Method and apparatus for three-dimensional imaging in the fourier domainJune, 2003Rahn et al.
20030112503Method and system for displaying stereoscopic detail-in-context presentationsJune, 2003Lantin
20030105795Image editing via batch commandsJune, 2003Anderson et al.
20030103063Panoramic imaging and display system with canonical magnifierJune, 2003Mojaver et al.
6584237Method and apparatus for expanding image dataJune, 2003Abe
6577319Method for controlling data displayJune, 2003Kashiwagi et al.
6577311Techniques for automatically providing a high-resolution rendering of a low resolution digital image in a distributed networkJune, 2003Crosby et al.
20030100326Group location and route sharing system for communication units in a trunked communication systemMay, 2003Grube et al.
6559813Selective real image obstruction in a virtual reality display apparatus and methodMay, 2003DeLuca et al.
6549215System and method for displaying images using anamorphic video2003-04-15Jouppi345/660
20030076363Digital image magnification for internet applianceApril, 2003Murphy
6552737Control of window size in response to user operationApril, 2003Tanaka et al.
6542191Image display apparatus, camera control apparatus and methodApril, 2003Yonezawa
20030061211GIS based search engineMarch, 2003Shultz et al.
20030052900Magnification methods, systems, and computer program products for virtual three-dimensional booksMarch, 2003Card et al.
20030052896System and method for synchronizing map imagesMarch, 2003Higgins et al.
20030048447Accurate instrumetation for optical measurement of samplesMarch, 2003Harju et al.
6523024Methods for retrieving database with image informationFebruary, 2003Yajima et al.
6522341Multi-layer image mixing apparatusFebruary, 2003Nagata
6515678Video magnifier for a display of dataFebruary, 2003Boger
6515663Apparatus for and method of processing three-dimensional imagesFebruary, 2003Hung et al.
20030007006Graphical user interface with zoom for detail-in-context presentationsJanuary, 2003Baar et al.
20030006995Orthogonal magnifier within a computer system displayJanuary, 2003Smith et al.
6504535Display techniques for three-dimensional virtual realityJanuary, 2003Edmark
20020180759Camera system with both a wide angle view and a high resolution view2002-12-05Park et al.345/629
20020180801Graphical user interface for detail-in-context presentationsDecember, 2002Doyle et al.
6491585Three-dimensional image processing apparatus with enhanced automatic and user point of view controlDecember, 2002Miyamoto et al.
20020171644Spatial patches for graphics renderingNovember, 2002Reshetov et al.
6487497Method and system for route calculation in a navigation applicationNovember, 2002Khavakh et al.
20020143826Method, apparatus, and program for magnifying the text of a link while still retaining browser function in the magnified displayOctober, 2002Day et al.
20020135601Digital map display zooming method, digital map display zooming device, and storage medium for storing digital map display zooming programSeptember, 2002Watanabe et al.
20020122038Occlusion reducing transformations for three-dimensional detail-in-context viewingSeptember, 2002Cowperthwaite
20020101396Balanced binary color drive method for graphical displays and system implementing sameAugust, 2002Huston et al.
6438576Method and apparatus of a collaborative proxy system for distributed deployment of object renderingAugust, 2002Huang et al.
20020093567Method and system for generating a digital photographic proofJuly, 2002Cromer et al.
20020089520Method and system for enhanced detail-in-context viewingJuly, 2002Baar
20020087894Method and apparatus for enabling a user to select an authentication methodJuly, 2002Foley et al.
6417867Image downscaling using peripheral vision area localizationJuly, 2002Hallberg
6416186Projection display unitJuly, 2002Nakamura
20020075280Method and system for inversion of detail-in-context presentationsJune, 2002Tigges
6411274Digital map display zooming method, digital map display zooming device, and storage medium for storing digital map display zooming programJune, 2002Watanabe et al.
6407747Computer screen image magnification system and methodJune, 2002Chui et al.
6400848Method for modifying the perspective of a digital imageJune, 2002Gallagher
20020063711Camera system with high resolution image inside a wide angle view2002-05-30Park et al.345/428
20020062245System and method for generating real-time promotions on an electronic commerce world wide website to increase the likelihood of purchaseMay, 2002Niu et al.
6396962System and method for providing zooming videoMay, 2002Haffey et al.
6396648Image reader which can shorten focal length in optical system having optical lens while keeping predetermined image reading widthMay, 2002Yamamoto et al.
6392661Method and apparatus for improving situational awareness using multiple map displays employing peripheral range bandsMay, 2002Tankersley
6384849Method for displaying controls in a system using a graphical user interfaceMay, 2002Morcos et al.
20020044154Elastic presentation spaceApril, 2002Baar et al.
6381583Interactive electronic shopping system and methodApril, 2002Kenney
20020038257Apparatus for transmitting and receiving executable applications as for a multimedia systemMarch, 2002Joseph et al.
20020033837Multiple-image viewerMarch, 2002Munro
6359615Movable magnification icons for electronic device display screensMarch, 2002Singh
6346962Control of video conferencing system with pointing deviceFebruary, 2002Goodridge
6346938Computer-resident mechanism for manipulating, navigating through and mensurating displayed image of three-dimensional geometric modelFebruary, 2002Chan et al.
6337709Image display deviceJanuary, 2002Yamaashi et al.
20010055030Apparatus and method for correcting keyston distortionDecember, 2001Han
20010048447Image croppin and synthesizing method, and imaging apparatusDecember, 2001Jogo
20010040636CAMERA CONTROL AND DISPLAY DEVICE USING GRAPHICAL USER INTERFACENovember, 2001Kato et al.
20010040585RESIZING MULTI-DIMENSIONALLY RENDERED GRAPHICAL IMAGESNovember, 2001Hartford et al.
6320599Zooming scale indicator in computer graphicsNovember, 2001Sciammarella et al.
6307612Liquid crystal display element having a precisely controlled cell gap and method of making sameOctober, 2001Smith et al.
6304271Apparatus and method for cropping an image in a zooming graphical user interfaceOctober, 2001Nehme
6288702Information device having enlargement display function and enlargement display control methodSeptember, 2001Tachibana et al.
6278450System and method for customizing controls on a toolbarAugust, 2001Arcuri et al.
6278443Touch screen with random finger placement and rolling on screen to control the movement of information on-screenAugust, 2001Amro et al.
6271854Method and apparatus for facilitating navigation in three-dimensional graphic scenesAugust, 2001Light
6266082Communication apparatus image processing apparatus communication method and image processing methodJuly, 2001Yonezawa et al.
6256737System, method and computer program product for allowing access to enterprise resources using biometric devicesJuly, 2001Bianco et al.
6256115Facsimile networkJuly, 2001Adler et al.
6256043Three dimensional virtual reality enhancement techniquesJuly, 2001Aho et al.
6249281On-demand presentation graphical user interfaceJune, 2001Chen et al.
6246411Drag operation gesture controllerJune, 2001Strauss
6241609Virtual environment viewpoint controlJune, 2001Rutgers
6219052Computer user interface with non-salience deemphasisApril, 2001Gould
6215491Computer user interface with non-salience deemphasisApril, 2001Gould
6204850Scaleable camera model for the navigation and display of information structures using nested, bounded 3D coordinate spacesMarch, 2001Green
6204845Ergonomic viewable object processorMarch, 2001Bates et al.
6201548Graphical user interface for image editingMarch, 2001Cariffe et al.
6201546Systems and methods for generating three dimensional, textured modelsMarch, 2001Bodor et al.
6198484Stereoscopic display systemMarch, 2001Kameyama
6184859Picture display apparatusFebruary, 2001Kojima
6160553Methods, apparatus and data structures for providing a user interface, which exploits spatial memory in three-dimensions, to objects and in which object occlusion is avoidedDecember, 2000Robertson et al.
6154840System and method for transferring encrypted sections of documents across a computer networkNovember, 2000Pebley et al.
6147709Method and apparatus for inserting a high resolution image into a low resolution interactive image to produce a realistic immersive experienceNovember, 2000Martin et al.
6133914Interactive graphical user interface2000-10-17Rogers et al.
6128024Polar controller for defining and generating spiral-like shapes2000-10-03Carver et al.
6108005Method for producing a synthesized stereoscopic image2000-08-22Starks et al.
6091771Workstation for video security system2000-07-18Seeley et al.
6084598Apparatus for modifying graphic images2000-07-04Chekerylla
6081277Apparatus and method for controlling image display2000-06-27Kojima
6075531Computer system and method of manipulating multiple graphical user interface components on a computer display with a proximity pointer2000-06-13DeStefano
6073036Mobile station with touch input having automatic symbol magnification function2000-06-06Heikkinen et al.
6072501Method and apparatus for composing layered synthetic graphics filters2000-06-06Bier
6067372Method and system to enhance robust identification of abnormal regions in radiographs2000-05-23Gur et al.
6064401User interface controls for adjusting the display of multi-dimensional graphical plots2000-05-16Holzman et al.
6057844Drag operation gesture controller2000-05-02Strauss
6052110Dynamic control of zoom operation in computer graphics2000-04-18Sciammarella et al.
6037939Method for enabling interactive manipulation of data retained in computer system, and a computer system for implementing the method2000-03-14Kashiwagi et al.
6005611Wide-angle image dewarping method and apparatus1999-12-21Gullichsen et al.
5999879Navigation apparatus with shape change display function1999-12-07Yano
5991877Object-oriented trusted application framework1999-11-23Luckenbaugh
5973694Method of communication using sized icons, text, and audio1999-10-26Steele et al.
5969706Information retrieval apparatus and method1999-10-19Tanimoto et al.
5959605Video magnifier1999-09-28Gilblom
5950216Method and system for marking and subsequently retrieving a collection of objects within a multipage compound document utilizing selectable page numbered dialog boxes1999-09-07Amro et al.
5949430Peripheral lenses for simulating peripheral vision on a display device1999-09-07Robertson et al.
5926209Video camera apparatus with compression system responsive to video camera adjustment1999-07-20Glatt
5923364Video security system1999-07-13Rhodes et al.
5909219Embedding a transparency enable bit as part of a resizing bit block transfer operation1999-06-01Dye
5872922Method and apparatus for a video conference user interface1999-02-16Hogan et al.
5852440Method and system for facilitating the selection of icons1998-12-22Grossman et al.
5848231System configuration contingent upon secure input1998-12-08Teitelbaum et al.
5844545Image display apparatus capable of combining image displayed with high resolution and image displayed with low resolution1998-12-01Suzuki et al.345/156
5818455Method and apparatus for operating on the model data structure of an image to produce human perceptible output using a viewing operation region having explicit multiple regions1998-10-06Stone et al.
5812111Bifocal picture display system1998-09-22Fuji et al.
5808670Method and system for camera control with monitoring area view1998-09-15Oyashiki et al.
5798752User interface having simultaneously movable tools and cursor1998-08-25Buxton et al.
5786814Computer controlled display system activities using correlated graphical and timeline interfaces for controlling replay of temporal data representing collaborative activities1998-07-28Moran et al.
5764139Information display apparatus for vehicles1998-06-09Nojima et al.
5754348Method for context-preserving magnification of digital image regions1998-05-19Soohoo
5751289Virtual reality imaging system with image replay1998-05-12Myers
5745166Video security system field of the invention1998-04-28Rhodes et al.
5742272Accelerated full screen video playback1998-04-21Kitamura et al.
5731805Method and apparatus for eyetrack-driven text enlargement1998-03-24Tognazzini et al.
5729673Direct manipulation of two-dimensional moving picture streams in three-dimensional space1998-03-17Cooper et al.
5726670Display apparatus to be mounted on the head or face of an individual1998-03-10Tabata et al.345/7
5721853Spot graphic display element with open locking and periodic animation1998-02-24Smith
5696531Image display apparatus capable of combining image displayed with high resolution and image displayed with low resolution1997-12-09Suzuki et al.345/698
5689628Coupling a display object to a viewpoint in a navigable workspace1997-11-18Robertson
5689287Context-preserving display system using a perspective sheet1997-11-18Mackinlay et al.
5682489Method and device for monitoring, manipulating, and viewing system information1997-10-28Harrow et al.
5680524Synthetic environment employing a craft for providing user perspective reference1997-10-21Maples et al.
5670984Image lens1997-09-23Robertson et al.
5657246Method and apparatus for a video conference user interface1997-08-12Hogan et al.
5652851User interface technique for producing a second image in the spatial context of a first image using a model-based operation1997-07-29Stone et al.
5651107Method and apparatus for presenting information in a display system using transparent windows1997-07-22Frank et al.
5644758Bitmap block transfer image conversion1997-07-01Patrick
5638523Method and apparatus for browsing information in a computer database1997-06-10Mullet et al.
5613032System and method for recording, playing back and searching multimedia events wherein video, audio and text can be searched and retrieved1997-03-18Cruz et al.
5610653Method and system for automatically tracking a zoomed video image1997-03-11Abecassis
5598297Image display unit1997-01-28Yamanaka et al.
5596690Method and apparatus for operating on an object-based model data structure to produce a second image in the spatial context of a first image1997-01-21Stone et al.
5594859Graphical user interface for video teleconferencing1997-01-14Palmer et al.
5588098Method and apparatus for direct manipulation of 3-D objects on computer displays1996-12-24Chen et al.
5583977Object-oriented curve manipulation system1996-12-10Seidl
5581670User interface having movable sheet with click-through tools1996-12-03Bier et al.
5539534Method of scaling an image capable of line width preservation1996-07-23Hino et al.
5528289Method for automatically adjusting a videoconferencing system camera to center an object1996-06-18Cortjens et al.
5523783Pan head control system for TV camera1996-06-04Cho
5521634Automatic detection and prioritized image transmission system and method1996-05-28McGary
5473740Method and apparatus for interactively indicating image boundaries in digital image cropping1995-12-05Kasson
5459488Graphical user interface with fisheye adaptation principle1995-10-17Geiser
5451998Home shopping video catalog1995-09-19Hamrick
5432895Virtual reality imaging system1995-07-11Myers
5416900Presentation manager1995-05-16Blanchard et al.
5369527Melanoma detection device1994-11-29McCracken
5341466Fractal computer user centerface with zooming capability1994-08-23Perlin et al.
5329310Method and apparatus for controlling distortion of a projected image1994-07-12Liljegren et al.
5321807Accelerated graphics display method1994-06-14Mumford
5309279Script view a curved convex magnifying device1994-05-03Halstead
5275019Functional ring1994-01-04Pagani
5269687System and method for recursive driver training1993-12-14Mott et al.
5258837Multiple security video display1993-11-02Gormley
5250934Method and apparatus for thinning printed images1993-10-05Denber et al.
5227771Method and system for incrementally changing window size on a display1993-07-13Kerr et al.
5206721Television conference system1993-04-27Ashida et al.
5200818Video imaging system with interactive windowing capability1993-04-06Neta et al.
5185667Omniview motionless camera orientation system1993-02-09Zimmermann
5185599Local display bus architecture and communications method for Raster display1993-02-09Doornink et al.
5175808Method and apparatus for non-affine image warping1992-12-29Sayre
5048077Telephone handset with full-page visual display1991-09-10Wells et al.
5031918Magnifying marker for a game board1991-07-16Brill
4992866Camera selection and positioning system and method1991-02-12Morgan
4985849Image processing system for forming a slantwise-mapped or rotated modified image of an original image1991-01-15Hideaki
4970028Composition for softening fabrics1990-11-13Kenyon et al.
4888713Surface detail mapping system1989-12-19Falk
4885702Method of forming curved surfaces and the apparatus1989-12-05Ohba
4800379Image display with movable magnification1989-01-24Yeomans345/661
4790028Method and apparatus for generating variably scaled displays1988-12-06Ramage
4757616Ruler with magnifying cursor1988-07-19Hills
4688181Image transformations on an interactive raster scan or matrix display1987-08-18Cottrell et al.
4630110Surveillance system1986-12-16Cotton et al.
4581647Computerized automatic focusing control system for multiple television cameras1986-04-08Vye
3762799MAGNIFYING INDICATOR FOR A BURETTE1973-10-02Shapiro
3739739INSTRUMENT FOR ISOLATING ROWS OF PRINTED MATTER FOR READING1973-06-19Brase
3704938PUNCH CARD VIEWER1972-12-05Fanselow
3201546Power controlling device for electrical heating elements1965-08-17Richardson



Foreign References:
CA2350342November, 2002
CA2386560November, 2003
CA2393708January, 2004
CA2394119January, 2004
EP0635779January, 1995User interface having movable sheet with click-through tools
EP0650144April, 1995Image lens
EP0816983July, 1998Method and apparatus for eyetrack-driven text enlargement
JP4410465February, 2010
Other References:
Carpendale, M. Sheelagh T., “A Framework for Elastic Presentation Space”, Simon Fraser University, Burnaby; British Columbia XP001051168; cited in the application figures 2.13, 3.1-3.31, 4.1-4.19, 5.14,(Mar. 1999), pp. 7, 14, 34, 38, 65, 112, 123, and 126.
“Non Final Office Action”, U.S. Appl. No. 11/935,222, (Feb. 20, 2009), 8 pages.
Carpendale, M. Sheelagh T., et al., “A Framework for Unifying Presentation Space”, Proceedings of UIST '01: ACM Symposium on User Interface Software and Technology, Orlando, FL, USA; XP002249323 2001, New York, NY, USA, ISBN: 1-58113-438-X,(Nov. 14, 2001), pp. 61-70, 64.
Ikedo, Tsuneo “A Realtime Video-Image Mapping Using Polygon Rendering Techniques”, IEEE Intl. conf on Ottawa, Ont, Canada Jun. 3-6, 1997, Los Alamitos, CA, USA; IEEE Comput. Soc, US, XP010239181, ISBN: 0-8186-7819-4 Sections 2, 4.4; Multimedia Computing and Systems '97 Proceedings, (Jun. 3, 1997), pp. 127-134.
Bouju, Alain et al., “Client-Server Architecture for Accessing Multimedia and Geographic Databases within Embedded Systems”, Database and Expert Systems Applications, 1999 Proceedings. Tenth International Workshop on Florence, Italy Sep. 1-3, 1999, Los Alamitos, CA, USA, IEEE Comput. Soc, US, XP010352370; ISBN:0-7695-0281-4, abstract, figure 2,(Sep. 1-3, 1999), pp. 760-764.
Robertson, George G., et al., “The Document Lens”, UIST. Proceedings of the Annual ACM Symposium on User Interface Software and Technology, abstract figures 3,4,(Nov. 3, 1993), pp. 101-108.
Dursteler, Juan C., “The Digital Magazine of InfoVis.net”, Retrieved from: on Nov. 9, 2006 (Apr. 22, 2002), 2 pages.
“Presentation for CGDI Workshop”, Retrieved from: http://www.geoconnections.org/developersCorner/devCorner—devNetwork/meetings/2002.05.30/IDELIX—CGDI—20020530—dist.pdf, (May 2002), 19 pages.
Kuederle, Oliver “Presentation of Image Sequences: A Detail-in-context Approach”, Thesis, Simon Fraser University; (Aug. 2000), pp. 1-3, 5-10, 29-31.
Microsoft Corp., “Microsoft Paint”, (1981-1998), pp. 1-14.
“Electronic Magnifying Glasses”, IBM Technical Disclosure Bulletin, IBM Corp., New York, US, vol. 37, No. 3; XP000441501, ISSN: 0018-8689 the whole document; (Mar. 1, 1994), pp. 353-354.
Keahey, T. A., “The Generalized Detail-In-Context Problem”, Information Visualization 1998, Proceedings; IEEE Symposium On Research Triangle, CA, USA; Los Alamitos, CA, USA, IEEE Comput. Soc, US; XP010313304; ISBN: 0-8186-9093,(Oct. 1998), pp. 44-51, 152.
Carpendale, M. Sheelagh T., et al., “Extending Distortion Viewing from 2D to 3D”, IEEE Computer Graphics and Applications,IEEE Inc. New York, US, vol. 17, No. 4; XP000927815, ISSN: 0272-1716., (Jul. 1997), pp. 42-51.
Viega, J et al., “3D magic lenses”, Proceedings of the 9th annual ACM symposium on User interface software and technology; Pub 1996 ACM Press New York, NY, USA; (1996), pp. 51-58.
Cowperthwaite, David J., “Occlusion Resolution Operators for Three-Dimensional Detail-In-Context”, Burnaby, British Columbia: Simon Fraser University; (2000), 166 pages.
Carpendale, M. Sheelagh T., “A Framework for Elastic Presentation Space”, Thesis Simon Fraser University, XP001051168; Chapter 3-5; appendix A,B; (Mar. 1999), pp. 1-271.
Carpendale, M. Sheelagh T., et al., “Exploring Distinct Aspects of the Distortion Viewing Paradigm”, Technical Report TR 97-08, School of Computer Science, Simon Fraser University, Burnaby, British Columbia, Canada; (Sep. 1997), 14 pages.
Cowperthwaite, David J., et al., “Visual Access For 3D Data”, Proceedings of ACM CHI 96 Conference on Human Factors in Computer Systems, Volume 2 of Short Papers: Alternative Methods of Interaction; (1996), 5 pages.
Keahey, T. A., “Visualization of High-Dimensional Clusters Using Nonlinear Magnification”, Technical Report LA-UR-98-2776, Los Alamos National Laboratory; (1998), 8 pages.
Tigges, M. et al., “Generalized Distance Metrics For Implicit Surface Modeling”, Proceedings of the Tenth Western Computer Graphics Symposium; (Mar. 1999), 5 pages.
Bossen, Frank “Anisotropic Mesh Generation With Particles” Technical Report CMU-CS-96-134, CS Dept, Carnegie Mellon University; (May 13, 1996), pp. 1-59.
Bossen, Frank J., et al., “A Pliant Method For Anisotropic Mesh Generation”, 5th Intl. Meshing Roundtable; (Oct. 1996), pp. 63-74.
Wilson, et al., “Direct Volume Rendering Via 3D Textures”, Technical Report UCSC-CRL-94-19, University of California, Santa Cruz, Jack Baskin School of Engineering; (Jun. 1994), 11 pages.
Carpendale, M. Sheelagh T., “A Framework for Elastic Presentation Space”, PhD thesis, Simon Fraser University; Available at ,(Mar. 1999), pp. 69, 72, 78-83,98-100, 240, 241.
Keahey, T. A., et al., “Techniques For Non-Linear Magnification Transformations”, Information Visualization '96, Proceedings IEEE Symposium on, San Francisco, CA, Los Alamitos, CA, USA, IEEE Comput. Soc, US: XP010201943; ISBN: 0-8186-7668-X the whole document,(Oct. 28, 1996), pp. 38-45.
Sheelagh, M et al., “3-Dimensional Pliable Surfaces: For the Effective Presentation of Visual Information”, UIST '95. 8th Annual Symposium on User Interface Software and Technology. Proceedings of the ACM Symposium on User Interface Software and Technology. Pittsburgh, PA; ACM Symposium on User Interface Software and Technology, New York; XP000634423; ISBN: 0-89791-709-X, p. 219, right-hand column, line 219—left-hand column, line 220,(Nov. 14-17, 1995), pp. 217-226.
Tominski, Christian et al., “Fisheye Tree Views and Lenses for Graph Visualization”, pp. 1-8.
Keahey, T. A., “Getting Along: Composition of Visualization Paradigms”, Visual Insights. Inc.; (2001), 4 pages.
Sakamoto, Chikara et al., “Design and Implementation of a Parallel Pthread Library (PPL) with Parallelism and Portability”, Systems and Computers in Japan, New York, US, vol. 29, No. 2; XP0007527130, ISSN: 0882-1666 abstract,(Feb. 1, 1998), pp. 28-35.
Deng, Ke et al., “Texture Mapping with a Jacobian-Based Spatially-Variant Filter”, Proceedings 10th Pacific Conference on Computer Graphics and Applications, XP00224932, ISBN; 0-7695-1784-6 the whole document,(Oct. 2002), pp. 460-461.
Welsh, Michelle “Futurewave Software”, Business Wire; (Nov. 15, 1993), 2 Pages.
Lamar, Eric et al., “A Magnification Lens for Interactive Volume Visualization”, ACM; (Oct. 2001), pp. 1-10.
Fitzmaurice, George et al., “Tracking Menus”, UIST; (2003), pp. 71-79.
Stone, et al., “The movable filter as a user interface tool”, Proceedings of CHI ACM; (1992), 18 pages.
Baudisch, P. et al., “Halo: a Technique for Visualizing Off-Screen Locations”, CHI; Retrieved from: Baudisch, Patrick et al., “Drag-And-Pop: Techniques for Accessing Remote Screen Content On Touch-And-Pen-Operated Systems”, Interact '03 (2003), pp. 57-64.
Carpendale, M. Sheelagh T., et al., “Distortion Viewing Techniques for 3-Dimensional Data”, Information Visualization '96. Proceedings IEEE Symposium On, San Francisco, CA, USA, Los Alamitos, CA, USA, IEEE Comput. Soc., US, Oct. 28, 1996, XP010201944, ISBN: 0-8186-76138-X,(Oct. 28-29, 1996), pp. 46-53 and 119.
Carpendale, M. Sheelagh T., et al., “Making Distortions Comprehensible”, Visual Languages, Proceedings, 1997 IEEE Symposium On Isle of Capri, Italy, Los Alamitos, CA, USA, IEEE Comput. Soc., US, Sep. 23, 1997; XP010250566, ISBN: 0-8186-8144-6,(Sep. 23-26, 1997), pp. 36-45.
Ito, Minoru et al., “A Three-Level Checkerboard Pattern (TCP) Projection Method for Curved Surface Measurement”, Pattern Recognition, vol. 28, No. 1, XP004014030, ISSN 0031-3203,(1995), pp. 27-40.
Keahey, T. A., et al., “Nonlinear Magnification Fields”, Information Visualization, 1997, Proceedings, IEEE Symposium On Phoenix, AZ, USA, Los Alamitos, CA, USA, IEEE Comput. Soc., US: XP010257169; ISBN: 0-8186-8189-6,(Oct. 1997), pp. 51-58 and 121.
Rauschenbach, Uwe “The Rectangular Fish Eye View as an Efficient Method for the Transmission and Display of Large Images”, Image Processing, ICIP 99, Proceedings, 1999 International Conference On, Kobe, Japan. Oct. 24-28, 1999, Piscataway, NJ, USA, IEEE, US, XP01368852, ISBN 0-7803-5467-2 p. 115, left-hand column—p. 116, paragraph 3, p. 118, paragraph 7.1; (Oct. 1999), pp. 115-119.
Keahey, T. A., “Nonlinear Magnification”, (Indiana University Computer Science), (1997), 196 pages.
Watt, et al., “Advanced Animation and Rendering Techniques” (Addison-Wesley Publishing), (1992), p. 106-108.
Boots, Barry N., “Delaunay Triangles: An Alternative Approach to Point Pattern Analysis”, Proceedings of the Association of American Geographers, vol. 6, (1974), pp. 26-29.
Leung, Y. K., et al., “A Review and Taxonomy of Distortion-Oriented Presentation Techniques”, ACM Transactions on Computer-Human Interaction, 'Online! vol. 1, No. 2, XP002252314; Retrieved from the Internet: 'retrieved on Aug. 21, 2003! the whole document,(Jun. 1994), pp. 126-160.
“Non Final Office Action”, U.S. Appl. No. 10/358,394, (Mar. 13, 2009),36 pages.
Sarkar, et al., “Stretching the Rubber Sheet: A Metaphor for Viewing Large Layouts on Small Screens”, Proc. of the 6th annual ACM symp. on User interface software an technology, Atlanta, GA, (Dec. 1993), p. 81-91.
Carpendale, M. Sheelagh T., et al., “Graph Folding: Extending Detail and Context Viewing into a Tool for Subgraph Comparisons”, In Proceedings of Graph Drawing 1995, Passau, Germany, (1995), 13 pages.
Carpendale, M. Sheelagh T., “A Framework for Elastic Presentation Space”, Available at ,(Nov. 19, 1999), 1 page.
“Non Final Office Action”, U.S. Appl. No. 11/542,120, (Jan. 22, 2009),1 2 pages.
“Final Office Action”, U.S. Appl. No. 11/410,024, (Mar. 11, 2009), 20 pages.
“Foreign Office Action”, U.S. Appl. No. 2002-536993, (Mar. 11, 2009), 2 pages.
“Notice of Allowance & Examiner's Amendment”, U.S. Appl. No. 11/401,349, (Apr. 17, 2009), 10 pages.
Schmalstieg, Dieter et al., “Using transparent props for interaction with the virtual table”, Proceedings of the 1999 symposium on Interactive 3D graphics.,(Apr. 26, 1999), 8 pages.
“Final Office Action”, U.S. Appl. No. 10/705,199, (May 12, 2009), 13 pages.
“Non Final Office Action”, U.S. Appl. No. 11/541,778, (Jun. 19, 2009), 11 pages.
“Non Final Office Action”, U.S. Appl. No. 11/673,038, (Jul. 13, 2009), 30 pages.
“Non Final Office Action”, U.S. Appl. No. 11/410,024, (Jul. 20, 2009), 12 pages.
Smith, et al., “Efficient techniques for wide-angle stereo vision using surface projection models”, Retrieved from “Non Final Office Action”, U.S. Appl. No. 11/159,205, (Jul. 27, 2009), 13 pages.
“Advisory Action”, U.S. Appl. No. 11/249,493, (Aug. 11, 2009), 5 pages.
“Advisory Action”, U.S. Appl. No. 10/705,199, (Aug. 18, 2009), 3 pages.
“Restriction Requirement”, U.S. Appl. No. 11/935,222, (Aug. 20, 2009), 6 pages.
“Advisory Action”, U.S. Appl. No. 11/249,493, (Sep. 14, 2009), 4 pages.
“Non-Final Office Action”, U.S. Appl. No. 12/364,450, (Sep. 30, 2009), 10 pages.
“Notice of Allowance”, U.S. Appl. No. 10/358,394, (Oct. 8, 2009), 7 pages.
“Final Office Action”, U.S. Appl. No. 11/935,222, (Nov. 24, 2009), 8 pages.
“Final Office Action”, U.S. Appl. No. 11/541,778, (Dec. 4, 2009), 12 pages.
“Notice of Allowance”, U.S. Appl. No. 11/214,886, (Dec. 15, 2009), 16 pages.
“BPAI Decision”, U.S. Appl. No. 10/682,298, (Dec. 30, 2009), 14 pages.
“Notice of Allowance”, U.S. Appl. No. 11/410,024, (Jan. 4, 2010), 7 pages.
“Final Office Action”, U.S. Appl. No. 11/673,038, (Jan. 8, 2010), 33 pages.
“Advisory Action”, U.S. Appl. No. 11/541,778, (Feb. 1, 2010), 3 pages.
“Advisory Action”, U.S. Appl. No. 11/935,222, (Feb. 4, 2010), 3 pages.
“Restriction Requirement”, U.S. Appl. No. 12/368,263, (Mar. 9, 2010), 7 pages.
“Notice of Allowance”, U.S. Appl. No. 10/705,199, (Mar. 10, 2010), 18 pages.
“Non Final Office Action”, U.S. Appl. No. 11/691,686, (Mar. 18, 2010), 17 pages.
“Advisory Action”, U.S. Appl. No. 11/673,038, (Mar. 25, 2010), 3 pages.
“Final Office Action”, U.S. Appl. No. 11/159,205, (Mar. 25, 2010), 16 pages.
“Notice of Allowance”, U.S. Appl. No. 12/364,450, (Apr. 19, 2010), 4 pages.
“Non-Final Office Action”, U.S. Appl. No. 11/236,694, (Apr. 20, 2010), 9 pages.
“Non Final Office Action”, U.S. Appl. No. 12/368,263, (Apr. 30, 2010), 8 pages.
“Non Final Office Action”, U.S. Appl. No. 12/368,267, (Jun. 11, 2010), 12 pages.
“Notice of Allowability”, U.S. Appl. No. 12/364,451, (Jun. 18, 2010), 2 pages.
“Non Final Office Action”, U.S. Appl. No. 12/388,437, (Jun. 23, 2010), 7 pages.
“Non Final Office Action”, U.S. Appl. No. 12/764,724, (Jul. 1, 2010), 20 pages.
“Non Final Office Action”, U.S. Appl. No. 11/673,038, (Jul. 22, 2010), 39 pages.
“Final Office Action”, U.S. Appl. No. 11/691,686, (Sep. 1, 2010), 16 pages.
“Non Final Office Action”, U.S. Appl. No. 11/138,979, (Sep. 17, 2010), 11 pages.
“Non Final Office Action”, U.S. Appl. No. 11/541,778, (Sep. 29, 2010), 10 pages.
“Non Final Office Action”, U.S. Appl. No. 11/695,104, (Oct. 1, 2010), 9 pages.
“Final Office Action”, U.S. Appl. No. 11/159,20, (Oct. 6, 2010), 16 pages.
“Non Final Office Action”, U.S. Appl. No. 11/236,694, (Oct. 13, 2010), 16 pages.
Lieberman, Henry “Power of Ten Thousand—Navigating in Large Information Spaces”, Proceedings of the 7th annual ACM symposium on User interface software and technology, Marina del Rey, California, United States, (Nov. 1994), pp. 15-16.
Mills, Michael et al., “A Magnifier Tool for Video Data”, Proceedings of the SIGCHI conference on Human factors in computing systems, (1992), pp. 93-96.
Kline, Richard L., et al., “Improving GUI Accessibility for People with Low Vision”, Proceedings of the SIGCHI conference on Human factors in computing systems, (1995), pp. 114-121.
Perlin, Ken et al., “Pad—an alternative approach to the computer interface”, International Conference on Computer Graphics and Interactive Techniques. Proceedings of the 20th annual conference on Computer graphics and interactive techniques., (1993), pp. 57-64.
Bier, Eric A., et al., “The Movable Filter as a User Interface Tool—The Video”, Conference on Human Factors in Computing Systems Conference companion on Human factors in computing systems, (1995), pp. 413-414.
Bier, Eric A., et al., “Toolglass and Magic Lenses—The See-Through Interface”, International Conference on Computer Graphics and Interactive Techniques Proceedings of the 20th annual conference on Computer graphics and interactive techniques, (1993), pp. 73-80.
Bier, Eric A., et al., “Toolglass and Magic Lenses—The See-Through Interface”, Conference on Human Factors in Computing Systems Conference companion on Human factors in computing systems, (1994), pp. 445-446.
Kamba, Tomonari et al., “Using Small Screen Space More Efficiently”, CHI 96 Vancouver, BC Canada, (1996), pp. 383-390.
“Final Office Action”, U.S. Appl. No. 12/368,263, (Nov. 5, 2010), 7 pages.
“Final Office Action”, U.S. Appl. No. 12/764,724, (Nov. 9, 2010), 21 pages.
“Final Office Action”, U.S. Appl. No. 11/691,686, (Nov. 22, 2010), 16 pages.
Primary Examiner:
HARRISON, CHANTE E
Attorney, Agent or Firm:
MCANDREWS HELD & MALLOY, LTD (500 WEST MADISON STREET SUITE 3400, CHICAGO, IL, 60661, US)
Parent Case Data:
This application is a continuation of U.S. patent application Ser. No. 10/021,313, filed Dec. 19, 2001, now U.S. Pat. No. 7,106,349 the disclosure of which is incorporated herein by reference.

This application claims priority from Canadian Patent Application No. 2,328,795, filed Dec. 19, 2000. The invention relates to the field of computer graphics processing, more specifically, the invention relates to the display of visual information including portable document format (PDF) files on a display screen of a computer.

Claims:
What is claimed is:

1. A method for generating a presentation of a region of interest in an original image for display on a display screen, comprising: applying a lens to a border region of the region of interest in the original image by displacing the border region onto the lens and projecting the displacing onto a plane in a uniform direction aligned with a viewpoint, wherein the lens remains constant while transitioning between first and second locations for the region of interest in the original image; and, displaying the presentation on the display screen.

2. The method of claim 1 wherein the viewpoint remains constant while transitioning between the first and second locations.

3. The method of claim 2 wherein the lens has a magnified region for the border region.

4. The method of claim 3 wherein the magnified region has a diminishing magnification.

5. A system for generating a presentation of a region of interest in an original image for display on a display screen, comprising: a processor coupled to memory and the display screen; and, modules within the memory and executed by the processor, the modules including: a module for applying a lens to a border region of the region of interest in the original image by displacing the border region onto the lens and projecting the displacing onto a plane in a uniform direction aligned with a viewpoint, wherein the viewpoint remains constant while transitioning between first and second locations for the region of interest in the original image; and, a module for displaying the presentation on the display screen.

6. The system of claim 5 wherein the lens remains constant while transitioning between the first and second locations.

7. The system of claim 6 wherein the lens has a magnified region for the border region.

8. The system of claim 7 wherein the magnified region has a diminishing magnification.

9. A system for displaying a region of interest while transitioning between first and second locations for the region of interest within visual information on a display screen, comprising: a processor coupled to memory and the display screen; and, modules within the memory and executed by the processor, the modules including: a module for applying a transformation to a border region of the region of interest in the visual information to improve visual detail in the border region of the region of interest by: establishing a lens surface for the border region having a lens surface shape; and, generating a presentation by overlaying the visual information on the lens surface and projecting the lens surface with the visual information onto a plane in a uniform direction aligned with a viewpoint, wherein at least one of the lens surface shape and the viewpoint remain constant during the transitioning between the first and second locations; and, a module for displaying the presentation on the display screen.

10. The system of claim 9 wherein the transformation transforms only a portion of the visual information in the region of interest.

11. The system of claim 10 wherein the portion is the border of the region of interest.

12. The system of claim 9 wherein the border region is a periphery of the region of interest.

13. The system of claim 9 wherein the lens surface for the border region is defined by a distortion function.

14. The system of claim 9 wherein the lens surface for the border region is defined by a predetermined portion of a lens surface for rendering the region of interest.

15. The system of claim 14 wherein the predetermined portion is a border region of the lens surface for rendering the region of interest.

16. The system of claim 15 wherein the predetermined portion is a periphery of the lens surface for rendering the region of interest.

17. The system of claim 14 wherein the lens surface for rendering the region of interest is defined by the distortion function.

18. The system of claim 9 and further comprising a module for establishing a path between the first and second locations for the region of interest.

19. The system of claim 18 wherein the path is established automatically by a predetermined program.

20. The system of claim 18 wherein the path is established by user selection.

21. The system of claim 9 and further comprising a module for at least one of: increasing resolution of the visual information in the region of interest; and, decreasing resolution of the visual information outside the region of interest.

22. The system of claim 21 wherein the transformation provides a smooth transition to the region of interest from an adjacent region by blending increased and decreased resolution visual information in predefined regions adjacent to the region of interest.

23. The system of claim 22 wherein the blending is performed by averaging the increased and decreased resolution visual information.

24. The system of claim 22 wherein the blending is performed by admixing the increased and decreased resolution visual information.

25. The system of claim 9 and further comprising a module for transmitting the presentation over a network to a remote computer.

26. The system of claim 9 wherein the visual information includes a portable document format (PDF) document.

27. The system of claim 26 and further comprising a module for scaling the visual information to fit on the display screen.

28. The system of claim 9 wherein the region of interest, the lens surface, and the lens surface shape include a plurality of regions of interest, a plurality of lens surfaces, and a plurality of lens surface shapes, respectively.

29. The system of claim 9 wherein the visual information includes one or more of newspapers, magazines, telephone directories, and maps.

30. The system of claim 9 wherein the visual information includes web page content.

31. The system of claim 9 wherein the display screen is contained in a handheld device.

32. The system of claim 9 wherein the visual information is a newspaper page.

33. The system of claim 32 wherein the newspaper page includes one or more of a plurality of headlines, columns, articles, graphics, and advertisements.

34. The system of claim 33 wherein the region of interest includes one or more of a headline, a column, an article, a graphic, and an advertisement.

35. The system of claim 34 wherein the lens surface shape has a shape corresponding to that of the region of interest.

36. The system of claim 35 wherein the lens surface shape has a shape corresponding to a column.

37. The system of claim 36 wherein the transformation increases the font size within a portion of the column.

38. The system of claim 37 wherein the lens surface shape is tapered to provide a continuous transition on at least one side of the portion of the column to undistorted text.

39. A method comprising: applying a function by a data processing system to give an appearance of a lens to a region in an original image; and displaying a presentation of the appearance of the lens that keeps the appearance of the lens constant while transitioning between first and second locations for the region in the original image on a display screen of the data processing system, wherein said displaying comprises rendering the appearance of the lens at a first resolution and rendering the original image outside of the lens at a second resolution that is lower than the first resolution.

40. The method of claim 39 wherein the applying includes displacing a border region of the region in the original image onto the lens and projecting the displaying onto a plane in a uniform direction.

41. The method of claim 40 wherein the uniform direction is aligned with a viewpoint.

42. The method of claim 41 wherein the viewpoint remains constant while transitioning between the first and second locations.

43. The method of claim 40 wherein the lens has a magnified region for the border region.

44. The method of claim 43 wherein the magnified region has a diminishing magnification.

45. A method comprising: applying a function by a data processing system to give an appearance of a lens to a region in an original image; and displaying a presentation of the appearance of the lens that restricts rendering of the presentation while transitioning between first and second locations for the region in the original image on a display screen of the data processing system such that a portion of the appearance of the lens is not rendered during the transitioning, wherein the portion of the appearance of the lens that is not rendered during the transitioning is within a border of the appearance of the lens.

46. A method of claim 45 wherein the border of the appearance of the lens is rendered during the transitioning.

47. The method of claim 45 wherein the applying includes displacing a border region of the region in the original image onto the lens and projecting the displaying onto a plane in a uniform direction that is aligned with a viewpoint.

48. The method of claim 45 further comprising displaying the presentation of the appearance of the lens such as not to be restricted when the appearance of the lens is not being transitioned in the original image on the display screen.

49. The method of claim 45 wherein the displaying of the presentation of the appearance of the lens is performed by fully rendering the appearance of the lens if the appearance is not being transitioned.

50. The method of claim 45 wherein the displaying of the presentation of the appearance of the lens is performed by rendering the portion of the appearance of the lens if the appearance is not being transitioned.

51. A client device comprising a processor and memory having instructions that are executable on a processor to receive data via an Internet from a server of an original image having a function applied to give an appearance of a lens to a region of the original image provided by selective high resolution rendering to display data within the region of interest and neighboring regions of the appearance of the lens while remaining data in the original image is rendered at a low resolution, wherein the function causes a border region of the region in the original image to be displaced onto the lens and displayed onto a plane in a uniform direction.

52. The client device of claim 51 wherein the function causes the neighboring regions of the appearance of the lens to give an appearance of a smooth transition from the high resolution rendering of the region to the remaining data in the original image.

53. The client device of claim 52 wherein the function causes the transition by blending of a low resolution rendering of the remaining data in the original image with the selective high resolution rendering of the region.

54. The client device of claim 53 wherein the blending includes admixing or averaging.

55. The client device of claim 56, wherein the uniform direction is aligned with a viewpoint.

56. A method comprising: displaying an image on a display of a computing device; specifying a region of interest in the image; displaying, on the display, the region of interest at a first resolution while displaying, on the display, one or more portions from the image that lie outside the region of interest at a second resolution that is less than the first resolution; and updating display of the region of interest as the region of interest transitions from the first position to the second position, wherein said updating renders only a periphery of the region of interest as the region of interest transitions from the first position to the second position.

57. The method of claim 56, further comprising scaling the region of interest to obtain a magnified presentation of the region of interest having a greater scale than the one or more portions that lie outside the region of interest, wherein said displaying the region of interest comprises displaying the magnified presentation of the region of interest.

58. The method of claim 56, wherein said displaying the region of interest occludes a portion of the image.

59. The method of claim 56, further comprising receiving input that specifies movement of the region of interest from a first position to a second position.

60. The method of claim 56, further comprising smoothing a resolution transition between the region of interest displayed at the first resolution and the one or more other portions displayed at the second resolution.

61. The method of claim 56, wherein said specifying includes embedding locating information for the region of interest in a source of the image.

62. A computing device, comprising an input device configured to receive input that specifies a region of interest in an image; and a processor configured to cause a display to display the region of interest at a first resolution and one or more portions from the image that lie outside the region of interest at a second resolution that is less than the first resolution, wherein the processor is further configured to cause the display to update display of the region of interest as the region of interest transitions from the first position to the second position, and to only update a periphery of the region of interest as the region of interest transitions from the first position to the second position.

63. The computing device of claim 62, wherein the processor is further configured to: scale the region of interest to obtain a magnified presentation of the region of interest having a greater scale than the one or more portions that lie outside the region of interest; and cause the display to display the magnified presentation of the region of interest such that the magnified presentation occludes a portion of the image.

64. The computing device of claim 62, wherein the input device is further configured to receive additional input that specifies movement of the region of interest from a first position to a second position.

65. The computing device of claim 62, wherein said processor is further configured to cause the display to display a smoothed resolution transition between the region of interest displayed at the first resolution and the one or more other portions displayed at the second resolution.

Description:

BACKGROUND OF THE INVENTION

Display screens are the primary visual display interface to a computer. One problem with these visual display screens is that they are limited in size, thus presenting a challenge to user interface design, particularly when larger amounts of information is to be displayed. This problem is normally referred to as the “screen real estate problem”.

Well known solutions to this problem include panning, zooming, scrolling or combinations thereof. While these solutions are suitable for a large number of visual display applications, these solutions become less effective where the visual information is spatially related, such as maps, newspapers and such like. In this type of information display, panning, zooming and/or scrolling is not as effective as much of the context of the panned, zoomed or scrolled display is hidden.

A recent solution to this problem is the application of “detail-in-context” presentation techniques to the display of large surface area media, such as maps. Detail-in-context presentation techniques take on many forms and are useful for displaying large amounts of information on limited size computer screens, and are becoming more important with the increased use of hand held computing devices such as personal digital assistance (PDA's) and cell phones.

Now, in the detail-in-context discourse, differentiation is often made between the terms “representation” and “presentation”. A representation is a formal system, or mapping, for specifying raw information or data that is stored in a computer or data processing system. For example, a digital map of a city is a representation of raw data including street names and the relative geographic location of streets and utilities. Such a representation may be displayed visually on computer screen or printed on paper. On the other hand, a presentation is a spatial organization of a given representation that is appropriate for the task at hand. Thus, a presentation of a representation organizes such things as the point of view and the relative emphasis of different parts or regions of the representation. For example, a digital map of a city may be presented with a region magnified to reveal street names.

Detail-in-context presentations allow for magnification of a particular region of interest (the “focal region”) in a representation while preserving visibility of the surrounding representation. In other words, in detail-in-context presentations focal regions are presented with an increased level of detail without the removal of contextual information from the original representation. In general, a detail-in-context presentation may be considered as a distorted view (or distortion) of a portion of the original representation where the distortion is the result of the application of a “lens” like distortion function to the original representation. A detailed review of various detail-in-context presentation techniques may be found in a publication by Carpendale, Marianne S. T., titled “A Framework for Elastic Presentation Space” (Burnaby, British Columbia: Simon Fraser University, 1999) and incorporated herein by reference.

Thus, detail-in-context presentations of data using techniques such as Elastic Presentation Space (“EPS”) are useful in presenting large amounts of information on limited-size display surfaces. Detail-in-context views allow magnification of a particular region of interest (the “focal region”) in a data presentation while preserving visibility of the surrounding information. Development of increasingly powerful computing devices has lead to new possibilities for applications of detail-in-context viewing. At the same time, the development of new compact, mobile computing platforms such as handheld computers, typically with reduced computing performance and smaller display surfaces as compared to desktop or mainframe computers, has motivated research into alternate implementation techniques and performance improvements to detail-in-context data presentation technologies. Consequently, one shortcoming of current EPS graphics technology and detail-in-context presentation methods is that being computationally inefficient, they are not optimized for newer compact, mobile computing platforms (e.g. handheld computers) that have reduced computing power. Considerable computer processing is required to distort a given presentation so as to produce a detail-in-context “lens”, and to move the lens through the data with adequate performance to provide an acceptable level of interactivity to the user.

A need therefore exists for a method and system that will allow for the effective implementation of EPS graphics technology on computing platforms having variable levels of computing power. Consequently, it is an object of the present invention to obviate or mitigate at least some of the above-mentioned disadvantages.

SUMMARY OF THE INVENTION

In accordance with an aspect of the invention, there is provided an improved method for display of a transitional region of interest while transitioning between a first region of interest and a second region of interest within visual information on a display screen of a computer. The method comprises the steps of: applying a transitional transformation to the visual information, the transitional transformation requiring reduced calculations for transforming the visual information to transitional transformed visual information; and displaying the transitional transformed visual information on the display screen.

In accordance with a further aspect of the invention, there is provided a method for displaying the transition between regions of interest within visual information on a display screen of a computer. The method comprises the steps of: selecting a first region of interest within the visual information; applying a first transformation to the visual information to improve the visual detail in the first region of interest; and displaying the first transformed visual information on the display screen. Selecting a second region of interest within the visual information applying a second transformation to the visual information to improve the visual detail in the second region of interest; and displaying the second transformed visual information on the display screen. Selecting a transitional region of interest on a path between the first region of interest and the second region of interest within the visual information; applying a transitional transformation to the visual information to improve the visual detail in a predetermined portion of the transitional region of interest; and displaying the transitional transformed visual information on the display screen.

In accordance with yet a further aspect of the invention, there is provided a method for displaying visual information on a display screen of a computer. The method comprising the steps of: selecting a region of interest within the visual information; applying a transformation to the visual information for improving visual detail and presentation quality in the region of interest, the transformation for overlaying the visual information on a lens surface, the lens surface having predetermined shape for the region of interest. Projecting the lens surface with the overlaid visual information onto a plane. Increasing resolution of the visual information in the region of interest. Decreasing resolution of the visual information outside the region of interest, and displaying the transformed visual information on the display screen.

In accordance with yet a further aspect of the invention, there is provided a data carrier having stored thereon instructions for improving display of a transitional region while transitioning between a first region of interest and a second region of interest within visual information on a display screen of a computer. The instructions comprise the steps of: applying a transitional transformation to the visual information, the transitional transformation having a reduced a number of calculations required for rendering the transitional transformed visual information; and displaying the transitional transformed visual information on the display screen.

In accordance with yet a further aspect of the invention, there is provided a method for displaying visual information in portable document format (PDF) files on a display screen of a computer is provided. The method comprising the steps of: scaling the visual information to produce a scaled representation to fit on the display screen, the scaled representation generally containing the entire content of the visual information; selecting a region of interest within the scaled representation; applying a transformation to the scaled representation to improve the visual detail in the region of interest; and, displaying the transformed representation on the display screen. The step of applying a transformation further comprising the steps of: creating a lens surface of predetermined shape for the region of interest; and, creating a transformed representation by overlaying the scaled representation on the lens surface and projecting the lens surface with the overlaid scaled representation onto a plane.

In accordance with yet a further aspect of the invention, there is provided the use of a method for displaying visual information on a display screen of a computer for displaying visual information in portable document format (PDF) files is provided. The method comprising the steps of: scaling the visual information to produce a scaled representation to fit on the display screen, the scaled representation generally containing the entire content of the visual information; selecting a region of interest within the scaled representation; applying a transformation to the scaled representation to improve the visual detail in the region of interest; and, displaying the transformed representation on the display screen.

According to one aspect of the invention, there is provided a method for generating a presentation of a region of interest in an original image for display on a display screen, comprising: applying a lens to a border region of the region of interest in the original image by displacing the border region onto the lens and projecting the displacing onto a plane in a uniform direction aligned with a viewpoint, wherein at least one of the lens and the viewpoint remain constant while transitioning between first and second locations for the region of interest in the original image. The method may further include displaying the presentation on the display screen. The lens may have a magnified region for the border region. And, the magnified region may have a diminishing magnification.

According to another aspect of the invention, there is provided a system for generating a presentation of a region of interest in an original image for display on a display screen, comprising: a processor coupled to memory and the display screen; and, modules within the memory and executed by the processor, the modules including: a module for applying a lens to a border region of the region of interest in the original image by displacing the border region onto the lens and projecting the displacing onto a plane in a uniform direction aligned with a viewpoint, wherein at least one of the lens and the viewpoint remain constant while transitioning between first and second locations for the region of interest in the original image. The system may further include a module for displaying the presentation on the display screen. The lens may have a magnified region for the border region. And, the magnified region may have a diminishing magnification.

According to another aspect of the invention, there is provided a system for displaying a region of interest while transitioning between first and second locations for the region of interest within visual information on a display screen, comprising: a processor coupled to memory and the display screen; and, modules within the memory and executed by the processor, the modules including: a module for applying a transformation to a border region of the region of interest in the visual information to improve visual detail in the border region of the region of interest by: establishing a lens surface for the border region having a lens surface shape; and, generating a presentation by overlaying the visual information on the lens surface and projecting the lens surface with the visual information onto a plane in a uniform direction aligned with a viewpoint, wherein at least one of the lens surface shape and the viewpoint remain constant during the transitioning between the first and second locations; and, a module for displaying the presentation on the display screen. The transformation may transform only a portion of the visual information in the region of interest. The portion may be the border of the region of interest. The border region may be a periphery of the region of interest. The lens surface for the border region may be defined by a distortion function. The lens surface for the border region may be defined by a predetermined portion of a lens surface for rendering the region of interest. The predetermined portion may be a border region of the lens surface for rendering the region of interest. The predetermined portion may be a periphery of the lens surface for rendering the region of interest. The system may further include a module for establishing a path between the first and second locations for the region of interest. The path may be established automatically by a predetermined program. The path may be established by user selection. The system may further include a module for at least one of: increasing resolution of the visual information in the region of interest; and, decreasing resolution of the visual information outside the region of interest. The transformation may provide a smooth transition to the region of interest from an adjacent region by blending increased and decreased resolution visual information in predefined regions adjacent to the region of interest. The blending may be performed by averaging the increased and decreased resolution visual information. The blending may be performed by admixing the increased and decreased resolution visual information. The system may further include a module for transmitting the presentation over a network to a remote computer. The visual information may include a portable document format (PDF) document. The lens surface for rendering the region of interest may be defined by the distortion function. The region of interest, the lens surface, and the lens surface shape may include a plurality of regions of interest, a plurality of lens surfaces, and a plurality of lens surface shapes, respectively. The visual information may include one or more of newspapers, magazines, telephone directories, and maps. The visual information may include web page content. The display screen may be contained in a handheld device. The visual information may be a newspaper page. The newspaper page may include one or more of a plurality of headlines, columns, articles, graphics, and advertisements. The region of interest may include one or more of a headline, a column, an article, a graphic, and an advertisement. The lens surface shape may have a shape corresponding to that of the region of interest. The lens surface shape may have a shape corresponding to a column. The transformation may increase the font size within a portion of the column. The lens surface shape may be tapered to provide a continuous transition on at least one side of the portion of the column to undistorted text. And, the system may further include a module for scaling the visual information to fit on the display screen.

BRIEF DESCRIPTION OF THE DRAWINGS

The invention may best be understood by referring to the following description and accompanying drawings which illustrate the invention. In the drawings:

FIG. 1 is a perspective view of a 3D perspective viewing frustum in accordance with known elastic presentation space graphics technology;

FIG. 2 is a cross-sectional view of a presentation in accordance with known elastic presentation space graphics technology;

FIG. 3 is a block diagram of an exemplary data processing system for implementing an embodiment of the invention;

FIG. 4 is a screen capture of a PDF file for a newspaper page that has been shrunk to fit a display surface in accordance with one embodiment of the invention; and,

FIG. 5 is a flow chart illustrating a general method for displaying visual information in portable document format (PDF) files on a display screen of a computer in accordance with one embodiment of the invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

In the following description, numerous specific details are set forth to provide a thorough understanding of the invention. However, it is understood that the invention may be practiced without these specific details. In other instances, well-known software, circuits, structures and techniques have not been described or shown in detail in order not to obscure the invention. The term “data processing system” is used herein to refer to any machine for processing data, including the computer systems and network arrangements described herein. The term “PDF” (Portable Document Format) is used herein to refer to a file format that captures all the elements of a printed document as an electronic image that a user can view, navigate, print, or forward to someone else. The term “Elastic Presentation Space” or “EPS” is used herein to refer to techniques that allow for the adjustment of a visual presentation without interfering with the information content of the representation. The adjective “elastic” is included in the term as it implies the capability of stretching and deformation and subsequent return to an original shape. EPS graphics technology is described by Carpendale in A Framework for Elastic Presentation Space (Carpendale, Marianne S. T., A Framework for Elastic Presentation Space (Burnaby, British Columbia: Simon Fraser University, 1999)) which is incorporated herein by reference. In EPS graphics technology, a two-dimensional visual representation is placed onto a surface; this surface is placed in three-dimensional space; the surface, containing the representation, is viewed through perspective projection; and the surface is manipulated to effect the reorganization of image details. The presentation transformation is separated into two steps: surface manipulation or distortion and perspective projection. In the drawings, like numerals refer to like structures or processes. Referring to FIG. 1, there is shown a perspective view 100 of a 3D perspective viewing frustum 220 in accordance with known elastic presentation space (“EPS”) graphics technology. In EPS, detail-in-context views of 2D visual representations are created with sight-line aligned distortions of a 2D information presentation surface within a 3D perspective viewing frustum 220. In EPS, magnification of regions of interest and the accompanying compression of the context region to accommodate this change in scale are produced by the movement of regions of the surface towards the viewpoint 240 located at the apex of the pyramidal shape 220 containing the frustum. The process of projecting these transformed layouts via a perspective projection results in a new 2D layout which includes the zoomed and compressed regions. The use of the third dimension and perspective distortion to provide magnification in EPS provides a meaningful metaphor for the process of distorting the information presentation surface. The 3D manipulation of the information presentation surface in such a system is an intermediate step in the process of creating a new 2D layout of the information.

Referring to FIG. 2, there is shown a cross-sectional view of a presentation 200 in accordance with known EPS graphics technology. EPS graphics technology employs viewer-aligned perspective projections to produce detail-in-context presentations in a reference view plane 201 which may be viewed on a display. Undistorted 2D data points are located in a basal plane 210 of a 3D perspective viewing volume or frustum 220 which is defined by extreme rays 221 and 222 and the basal plane 210. A viewpoint (“VP”) 240 is located above the centre point of the basal plane 210 and reference view plane 201. Points in the basal plane 210 are displaced upward onto a distorted surface 230 which is defined by a general 3D distortion function (i.e. a detail-in-context distortion basis function). The direction of the viewer-aligned perspective projection corresponding to the distorted surface 230 is indicated by the line FPo-FP 231 drawn from a point FPo 232 in the basal plane 210 through the point FP 233 which corresponds to the focus or focal region or focal point of the distorted surface 230.

To reiterate, EPS refers to a collection of know-how and techniques for performing “detail-in-context viewing” (also known as “multi-scale viewing” and “distortion viewing”) of information such as images, maps, and text, using a projection technique summarized below. EPS is applicable to multidimensional data and is well suited to implementation on a computer for dynamic detail-in-context display on an electronic display surface such as a monitor. In the case of two dimensional data, EPS is typically characterized by magnification of areas of an image where detail is desired, in combination with compression of a restricted range of areas of the remaining information (the “context”), the end result typically giving the appearance of a lens having been applied to the display surface. EPS has numerous advantages over conventional zoom, pan, and scroll technologies, including the capability of preserving the visibility of information outside the local region of interest.

In general, in EPS, the source image to be viewed is located in the basal plane. Magnification and compression are achieved through elevating elements of the source image relative to the basal plane, and then projecting the resultant distorted surface onto the reference view plane. EPS performs detail-in-context presentation of n-dimensional data through the use of a procedure wherein the data is mapped into a region in an (n+l) dimensional space, manipulated through perspective projections in the (n+l) dimensional space, and then finally transformed back into n-dimensional space for presentation.

For example, and referring to FIGS. 1 and 2, in two dimensions, EPS can be implemented through the projection of an image onto a reference plane 201 in the following manner. The source image is located on a basal plane 210, and those regions of interest 233 of the image for which magnification is desired are elevated so as to move them closer to a reference plane situated between the reference viewpoint 240 and the reference view plane (RVP) 201. Magnification of the “focal region” 233 closest to the RVP varies inversely with distance from the RVP 201. As shown in FIGS. 1 and 2, compression of regions outside the focal region 233 is a function of both distance from the RVP 201, and the gradient of the function describing the vertical distance from the RVP 201 with respect to horizontal distance from the focal region 233. The resultant combination of magnification and compression of the image as seen from the reference viewpoint 240 results in a lens-like effect similar to that of a magnifying glass applied to the image, and the resultant distorted image may be referred to as a “pliable display surface”. Hence, the various functions used to vary the magnification and compression of the image via vertical displacement from the basal plane 210 are described as lenses, lens types, or lens functions. Lens functions that describe basic lens types with point and circular focal regions, as well as certain more complex lenses and advanced capabilities such as folding, have previously been described by Carpendale.

System.

Referring to FIG, 3, there is shown a block diagram of an exemplary data processing system 300 for implementing an embodiment of the invention. The data processing system is suitable for implementing EPS technology and for viewing PDF files. The data processing system 300 includes an input device 310, a central processing unit or CPU 320, memory 330, and a display 340. The input device 310 may be a keyboard, mouse, trackball, or similar device. The CPU 320 may include dedicated coprocessors and memory devices. The memory 330 may include RAM, ROM, databases, or disk devices. And, the display 340 may include a computer screen or terminal device. The data processing system 300 has stored therein data representing sequences of instructions which when executed cause the method described herein to be performed. Of course, the data processing system 300 may contain additional software and hardware a description of which is not necessary for understanding the invention.

Presentation of PDF Files Using EPS.

According to one aspect of the invention, EPS is applied to the electronic and online (i.e. Internet) presentation of Portable Document Format (“PDF”) files. PDF is a file format that captures the elements of a printed document as an electronic image that a user can view, navigate, print, or forward to someone else. PDF files are created using software products such as Adobe Acrobat®. To view and use a PDF file, a product such as Adobe Acrobat Reader® is typically used. PDF files are especially useful for documents such as newspaper and magazine articles, product brochures, or flyers where it is desired to preserve the original graphic appearance online. For example, a PDF file may be used for the online distribution of a printed document where it is desirable to preserve its printed appearance.

EPS and detail-in-context viewing can be used to enhance the viewing of PDF file. This is affected by the electronic scaling of the document content to a size that allows presentation of the full content on the display surface, with the use of specialized EPS lenses to enlarge regions of interest 233 to make them readable to the user. This method can be used to achieve the more effective presentation of PDF file content on small display surfaces including handheld computers. This aspect of the invention can be implemented with pre-placed EPS lenses on important content components including headlines, feature articles, tables of contents, and advertisements. Interaction with the reader is such that articles in the reader's region of interest 233 are enlarged automatically via EPS lenses of complex shape to suit the shape of the article or other area of interest.

Referring to FIG. 4, there is shown a screen capture 400 of a PDF file for a newspaper page that has been effectively shrunk to fit a display surface 340 according to one embodiment of the invention. A lens 410 has been used in the fifth column to increase the font size in the reader's region of interest 233. The top 420 and bottom 430 of the lens 410 are tapered to provide a continuous transition to the unmagnified text 440. Partial overwriting of neighboring columns 450 and images 460 by the lens 410, rather than a lateral distortion, is performed to blend the lens 410 into the undistorted regions 470, and provide enough space for the lens 410 while preserving the spatial orientation of the neighboring columns.

The implementation of pre-placed lenses can be achieved as follows. In order to provide the user with an immediate view of certain regions of a file, items of interest such as article headlines, whole articles, or advertisements can have lenses 410 in place when the document is first viewed. This can be implemented, for example, through the use of special lens locating information (i.e. locating tags) embedded within the source file or in a separate data layer, indicating the characteristics, location and/or bounds of the lens.

Method and Use.

Referring to FIG. 5, there is shown a flow chart 500 illustrating a general method for displaying visual information in portable document format (PDF) files on a display screen of a computer according to one embodiment of the invention. At step 501, the method starts. At step 502, the visual information is scaled to produce a scaled representation to fit on the display screen. The scaled representation generally contains the entire content of the visual information. At step 503, a region of interest is selected within the scaled representation. At step 504, a transformation is applied to the scaled representation to improve the visual detail in the region of interest. At step 505, the transformed representation is displayed on the display screen. At step 506, the method ends. Thus, elastic presentation space methodology can be used for displaying visual information in portable document format (PDF) files on a display screen of a computer.

Restricted Rendering of Lens During Lens Motion.

According to another aspect of the invention, a restricted portion of the region of interest (i.e. the “lens”) 233, for example the border or periphery 420, 430 of a lens 410, is rendered to a display 340 during the movement of the lens about the data space. The movement of the lens 410 may be user initiated or automated. By rendering only a portion of the lens 410, the computations required for lens movement and rendering are minimized while a presentation of the changing location of the lens is maintained. When movement of the lens ceases, by user or automated means, a full rendering of the lens in its new location can be displayed. In this way, the number of computations required during the movement of the lens 410 is reduced and hence performance is improved which is especially important for systems 300 with limited computational speed.

Blending and Selective Use of Data at Multiple Resolutions.

To improve detail-in-context presentation quality, an increase in the spatial resolution or level of detail within the region of interest 233, 410 can be provided as can a smooth visual transition from the region of interest to surrounding regions 440, 470.

According to another aspect of the invention, an increase in resolution within the region of interest 233, 410 of a detail-in-context presentation is provided by the selective high resolution rendering to a display 340 of data within the region of interest 233, 410 and neighbouring regions 420, 430 of a detail-in-context lens while the remaining data 440, 470 in the presentation is rendered at low resolution. In this way, resolution within and about the region of interest 233, 410 can be increased with a minimum of computing resources (i.e. processing time and processor memory).

According to another aspect of the invention, a smooth visual transition from the region of interest 233, 410 to surrounding regions 440, 470 is provided by the blending of low and high resolution regions 410, 420, 430, 440, 470. This blending can be accomplished by averaging or admixing of the high and low resolution regions described above. In this way, a smooth visual transition can be provided from the region of interest to surrounding regions with a minimum of computing resources (i.e. processing time and processor memory).

In the case where the client device on which the data is viewed is located apart from the data source (e.g. connected via the Internet), it is an advantage of the present invention that by increasing the resolution within the region of interest and smoothing the visual transition from the region of interest to surrounding regions as described, the amount of data that has to be transferred from the data source (e.g. server) to the viewer (e.g. client) is minimized.

Computer Software Product.

The sequences of instructions which when executed cause the method described herein to be performed by the exemplary data processing system of FIG. 3 can be contained in a computer software product according to one embodiment of the invention. This computer software product can be loaded into and run by the exemplary data processing system of FIG. 3.

Integrated Circuit Product.

The sequences of instructions which when executed cause the method described herein to be performed by the exemplary data processing system of FIG. 3 can be contained in an integrated circuit product including a coprocessor or memory according to one embodiment of the invention. This integrated circuit product can be installed in the exemplary data processing system of FIG. 3.

Although the invention has been described with reference to certain specific embodiments, various modifications thereof will be apparent to those skilled in the art without departing from the spirit and scope of the invention as outlined in the claims appended hereto.