Co-Creating Health - Rohit Talwar

Healthcare 2020+
Rohit Talwar
CEO
Fast Future Research
Handi Health Apps

Birmingham
November 4th 2014
rohit@fastfuture.com
www.fastfuture.com
Contents
Presentation
p. 4
About Fast Future
p. 54
Image Sources
p. 68
Background Notes
p. 72
What we do
Foresight Research
Helping you explore and understand the roadmap of economic,
business, scientific, technological, social, political and environmental
trends, forces, developments and ideas shaping the future of the sector
Investor Support
Advising on emerging sectors, technologies and scientific developments
Consulting
Helping you create future strategies, business models and innovations
to help respond to and create disruptive change
Speaking and Moderating

Delivering keynote speeches offering inspiring insights into a changing
world and how others are responding to the future
Future Leadership Programs and Events

Designing high impact leadership development programs, workshops
and events that encourage new thinking, bring the future to life and
enable you to develop an action agenda
Business Design and Innovation

Facilitating development of innovative, future proofed designs for
products, services, processes and customer experiences
Can we Change our DNA?
Play by the
Rules of the
Game
Create a
New Game
Future Proofed Organisations

Work on 3 Horizons in Parallel
1-12 Months
1-3 Years
4-10+ Years
Operational
Excellence
Search for
Growth
Creating
the Future
Future Global Challenges...
Socio-Demographic Shifts are

Reshaping Society
Free education is a game changer
Magic and Science are Blurring

Mapping and
Uploading the
Human Brain
Cognitive,
Genetic, Physical
and Electronic
Enhancement of
the Human Body
The biological era is emerging
Powerful
Forces are
Reshaping
Business
Thinking...
Intense Competition
Strategy, ICT, Insight, Ideas, Responsiveness, Innovation, Financing,

Structure, Business Models, New Entrants and Talent
New Models for Innovation Funding : e.g. Kickstarter.com
Disruptive
Innovation is
the Holy Grail...
...and
Driving
Systems
Change
Scientific Advances are Extending

and Reshaping Old Industries...
...and Creating New Ones
Affordable
Customised
Manufacturing
is Here
Rapid Execution is Rewriting the Rule Book

e.g. Superfast Construction
Ark Hotel - Dongting Lake - China
Magicians are Creating Wow Factor

E.g. One Time Insurance
Smartphone service
One day contracts
Premiums start around US$4
E.g:
Sports and Leisure
Golf (Hole in one protection)
Domestic and Overseas
Travel
Aliens
in our
Midst
Barbarians at the Gate
Robots are Entering the Workforce
A lot can be done with current and near to

market technology in the next few years...
Embracing the Transformative Role of IT

Patient
Centric
Hive Mind
Innovate to
Differentiate
Talent:
Develop and
Leverage
Staff
Re-engineer
Processes
Technology Timeline
Our Technologies are Evolving From

the Desktop...
...to Portable and Mobile ...
...to Wearable...
...Integrated...
...to Embedded...
e.g. Children
of the Machine
- BitTorrent
... And Connected to an Immersive MultiSensory / Multi-Sensor Internet of Everything
The First Official Cyborg
Biohacking is Becoming a Reality
Intelligent Devices could Become the Norm

e.g. Wireless Smart Lenses
(Google / Novartis Alcon Pilot)
Microscale Delivery
In-Body Robots
e.g. MagnetoSperm
322 microns (U of Twente / Cairo)
Targeted drug
delivery, in vitro
fertilization, cell
sorting and
cleaning of clogged
arteries.
The Future? - Blurred Lines

Augmented / Virtual / Everyday Reality
Augmented Reality could Accelerate the trend

to Self-Managed Maintenance
Surgical Support
e.g. Liver Tumor Removal (Frauhoffer Institue)
EyeDecide Simulating Visual Conditions e.g. Cataract
Virtual Disease Projection

e.g. mARble (Hannover School of Medicine)
Intelligent Agents
and Holobots
Digital Taste
Simulator
Nimesha
Ranasinghe
National
University of
Singapore
Smell - Scentee
Smell
The oPhone
Direct Brain
Manipulation
/ Digital Highs
e.g. TransCranial
Stimulation
Active Skin Enabling Full Sensory A/R
AI and SuperIntelligence are Catalysing

a Heated Debate
Speech / gesture / image recognition, integrated analytics, knowledge management, image / video
/ voice mining, client self-service, intelligent documents, expertise systems, collaboration, secure
email, virtual assistants, intelligent agents and collective intelligence
AI in Healthcare
Potential for >50% cost
reduction (and ~50%
improvement patient
outcome
(500 test cases)
Cost per unit of outcome: $189 vs $497
AI Could Have a Masssive Impact on Diagnosis,

Care Planning and Research (E.g. IBM Watson)
Predictive, Proactive Personal Care (RevUp)
Mindset - 3 Horizon Thinking

12 Months
1-3 Years
4-10 Years
Conclusion - Step into Our Fears
or be Consumed by them
About Fast Future
Fast Future Clients

Technology, Media and
Telecoms
3M
BT
Cable & Wireless
Chloride
CIO Connect
Etisalat
Gartner
GE
Hibu / Yell / Yellow Pages
Hyland Software
IBM
Intel
Microsoft
Nokia
O2
Orange (EE)
Panasonic
RIM (Blackberry)
Samsung
SAP
Siemens
The BBC
T-Mobile
twofour54
Vodafone
Banking and Financial Services

ABN AMRO
Actis
Alliance & Leicester
American Express
AXA
Chartis
Citibank
DeutscheBank
HSBC
ING Group
Invesco
Investcorp
Morgan Stanley
Nomura
Royal Bank of Scotland
Santander
Standard Life
Professional Services
ACCA (Association of Chartered Certified
Accountants)
Berwin Leighton Paisner
Crowe Horwath
Deloitte
Ernst & Young
ILTA (International Legal Technology
Association)
JLT Group
Kennedys
KPMG
Linklaters
Moore Stephens
Mott MacDonald
Norton Rose Fulbright
PwC
RSM Tenon
Simmons and Simmons
Wragge Lawrence Graham & Co
Food, Pharmaceuticals and

Healthcare
Associated British Foods
Astra Zeneca
Bayer
Boehringer Ingelheim
Cargill
Food Service Network Europe
GlaxoSmithKline
NHS London
NHS West Midlands
Novartis
Pepsi
Pfizer
Sara Lee
United Biscuits
Government and Intergovernmental

Defra Department for Environmental, Food
and Rural Affairs
DG Connect, European Commission
DTCM - Dubai Department of Tourism and
Commerce Marketing
Dubai Chamber of Commerce
Government of Finland
Government of Singapore
Ministry of Defence (UK)
OECD (Organisation for Economic Cooperation and Development)
Office of Science and Technology (UK)
Saudi Government
Singapore National Horizon Scanning Centre
UK BIS Department for Business, Innovation
and Skills
UK Foreign and Commonwealth Office
UK Health Modernisation Agency
UK Home Office
US Department of Defense
Fast Future Clients

Emirates
Mumbai Airport
Philip Morris
FCm
Travel
Aeroports de Paris
ACE (Association for Consultancy Playtex
Future Travel Experience Europe / Asia / Schiphol Airport,
Shell
and Engineering)
Global
Vancouver Airport
Tata
Ball Corp.
Global Airport Development
Wellington Airport
Hurel Hispano
Denver Airport
Thames Water
BAT
ICCA
(International
Congress
and
Dubai Airport
California Workforce Association Whirlpool
Convention Association)
Adelaide Convention Centre
Danaher Corporation
IMEX
Melbourne Convention Centre
Aviation, Travel, Tourism,
DHL
Intercontinental Hotels
QEII Convention Centre
IT&CMA (Incentive Travel & Conventions, Qatar Convention Centre
Diamond Trading Corporation (De Hotels, Events Industry
Accor
Meetings)
Vancouver Convention Centre
Beers)
ACI (Airport Council International)
ITB (International Tourism Bourse)
Abu Dhabi Convention Bureau
EdF
Aerovista
MPI (Meeting Professionals International) Athens Convention Bureau
Electrolux
Air Plus
PATA (Pacific Asia Travel Association)
Durban Convention Bureau
Fitflop
Airport Revenue News
Preferred Hotels
London Convention Bureau
AMAC
Qatar
Airways
San Francisco Convention Bureau
Hoover
Amadeus
Qatar
Airways
Seoul Convention Bureau
Hyundai
American Express Business Travel
Sabre
Sydney Convention Bureau
IBTTA (International Bridge
ASAE (Center for Association Leadership) TFWA (Tax Free World Association)
Toronto Convention Bureau
Tunnel and Turnpike Association) ATAG (Air Transport Action Group)
Travelex
Norway Convention Bureau
BAE Systems
Travelodge
Jardines
Boeing
Travelport
Laing ORourke
CANSO (Civil Air Navigation Services
TTRA (Travel and Tourism Research
MAP (Management Association of Organisation)
Association)
Pakistan)
Center Parcs
World Travel Forum
Marks and Spencer
CTW (Corporate Travel World)
Christchurch Airport
EADS / Airbus
Edmonton Airport
Nakheel
Commercial and Industrial
Designing Your Future Key Trends, Challenges and Choices

50 key trends
100 emerging trends
10 major patterns of change
Key challenges and choices for

leaders
Strategic decision making framework
Future Scenarios
Key futures tools and techniques
Reinventing the Airport Ecosystem
Drivers of change
Science and technology advances
Customer expectations
Innovation priorities
Strategies and business models
Surveys to test ideas and scenarios on a
global audience
Models for managing tomorrows airport
ecosystem
http://www.amadeus.com/airlineit/resour
ces/reinventing_the_airport_ecosystem/i
ndex.html?OADS=78
ILTA Legal Technology

Future Horizons Project
Key business and legal trends and forces
Timeline of emerging technologies and IT developments

with high potential legal impact
Explores ITs transformative role in future legal business

models and service differentiation
Defines strategic business and IT imperatives
6 sponsors - combined desk research, interviews with

managing partners, CIOs, vendors, futurists and
technologists, global surveys on the business applications
of IT and emerging technologies
http://www.iltanet.org/Downloads/LTFH-Report.pdf
200 emerging technology developments

http://www.iltanet.org/Downloads/TechTimelineAppendixLTFH.pdf
Futurium - Science and Technology

Transformations Shaping the World of 2050
European Commission project
Examined 87 potential
developments and trends
Clustered into 11 overarching future
societal themes
Content identified through a
combination of crowdsourcing via
the Futurium web platform,
suggestions from the EC, and ideas
proposed by our team
http://ec.europa.eu/digitalagenda/futurium/
Futurium
ACCA / IMA 100 Drivers of Change

Identifies 100 drivers of change
impacting business and the
accounting profession
Outlines future scenarios for the
accounting function
Highlights strategic imperatives for
business and the accounting function
5 minutes on executive summary
Report:
www.accaglobal.co.uk/en/researchinsights/accountancy-futures/driverschange.html
Hotels 2020
Identifying key drivers of change for the

globally branded hotel sector over the
next decade
Examining the implications for:

Hotel strategy
Brand portfolio
Business models
Customer targeting
Innovation
http://www.amadeus.com/hotelit/
beyond-segmentation.html
Convention 2020
Global strategic foresight study to help the meetings industry prepare for
the decade ahead - Industry-wide sponsors
Future strategies for venues, destinations and agencies
Rohit Talwar
Global futurist and founder of Fast Future Research.
Award winning speaker on future insights and strategic innovation

addressing leadership audiences in 40 countries on 5 continents
Author of Designing Your Future
Profiled by UKs Independent Newspaper as one of the Top 10 Global

Future Thinkers
Led futures research, scenario planning and strategic consultancy projects

for clients in telecommunications, technology, pharmaceuticals, banking,
travel and tourism, environment, food and government sectors
Clients include 3M, BBC, BT, BAe, Bayer, Chloride, DTC De Beers, DHL,
EADS, Electrolux, E&Y, GE, Hoover, Hyundai, IBM, ING, Intel, KPMG,
M&S, Nakheel, Nokia, Nomura, Novartis, OECD, Orange, Panasonic,
Pfizer, PwC, Samsung, Shell, Siemens, Symbian, Yell , numerous
international associations and governments agencies in the US, UK,
Finland, Dubai, Nigeria, Saudi Arabia and Singapore.
To receive Fast Futures newsletters please email rohit@fastfuture.com
Videos of Rohit Exploring the Future

The World in 2025 - Driving Forces, Global Challenges and Potential
Disruptions (35 mins) http://vimeo.com/93302584
Anticipating 2025 - Driving forces, global challenges and potential
disruptions (30 mins): https://www.youtube.com/watch?v=kwcLQCIfxpY
A World in Transition (60 mins):
http://www.colliers.com/en-gb/uk/insights/multimedia
Future of Travel (22 mins)
http://www.travelmole.tv/watch_vdo.php?id=14300
Parallel Revolutions Impacting Global Labor: Bloomberg TV Interview (4

mins): http://www.bloomberg.com/video/parallel-revolutions-impactingglobal-labor-talway-T0tJZRX6TpGIxjKShTzv~w.html
Useful Sources
Genetic profiling - https://www.23andme.com/

X Prize - Breakthrough innovation projects - http://www.xprize.org/
Google brain uploading - http://digitaljournal.com/article/352787
Brain mapping projects - http://www.technologyreview.com/news/513011/why-obamas-brain-mapping-project-matters/
Global Future 2045 (immortality) http://2045.com/
Human enhancement - http://en.wikipedia.org/wiki/Human_enhancement
Wearable technology Google Project Glass - http://www.google.com/glass/start/
Emotiv Epoc Brain-Computer Interface - http://www.emotiv.com/
AI Essay Grading Software - http://www.nytimes.com/2013/04/05/science/new-test-for-computers-grading-essays-at-collegelevel.html?pagewanted=all&_r=0
Digital / Crypto currencies
http://www.abc.net.au/technology/articles/2013/09/25/3855973.htm
http://en.wikipedia.org/wiki/Cryptocurrency
http://en.wikipedia.org/wiki/List_of_cryptocurrencies
Autonomous cars http://www.engineering.com/DesignerEdge/DesignerEdgeArticles/ArticleID/6357/Tesla-Working-on-Autonomous-Car.aspx
http://www.popsci.com/cars/article/2013-09/google-self-driving-car
Contact Information
Email
Phone
Web
Twitter
Blog
LinkedIn
Past presentations
Newsletter signup
rohit@fastfuture.com
+44 (0)7973 405145
http://www.fastfuture.com
http://twitter.com/fastfuture
http://widerhorizons.wordpress.com
http://www.linkedin.com/in/talwar
http://www.slideshare.net/fastrohit
http://fastfuture.com/?page_id=13
Our current charitable campaigns:

Charlotte Talwar's fundraising project to build a new toilet block for Sunrise School Ghana
http://www.gofundme.com/7gaxho
Street Kids International - Helping Street-Active Youth In Ghana Start Businesses
https://www.globalgiving.co.uk/projects/help-street-active-youth-in-ghana-start-businesses
Image Sources
Image Sources p.1

Page:
1. http://www.toikee.com/website_deploy/Upload/user/ai/blog/toikee-robot-healthcare-01.jpg
3. http://lifecoachonthego.com/wordpress/wp-content/uploads/2011/02/Woman-Ladder-Binoculars-300x200.jpg
4. http://2.bp.blogspot.com/-EJhAZaiyA8E/TfRRHfKzDMI/AAAAAAAAAGo/JmTQLz1z0xc/s320/6a00d8341c65c453ef010536d4981b970c-800wi.jpg
5. Left, right:
http://2.bp.blogspot.com/-72BxV124lUA/UFvsRsDW46I/AAAAAAAADMQ/cTdnJRp9lVo/s1600/DIA.Gensler.PerspectiveHotelTrainStation.jpg
http://www.kgwings.com/hawkeye/hawkeye05.jpg
6. http://www.energyenhancement.org/hercules.jpg
7. Left, right:
http://inclusionparadox.com/wp-content/uploads/2010/04/Multi-generational_Latino.jpg
http://discoverwebsbest.files.wordpress.com/2011/06/khan-academy.jpg
8. Top, bottom:
http://www.newsyaps.com/wp-content/uploads/2013/03/digital-brain.jpg
http://www.pakalertpress.com/wp-content/uploads/2012/06/Transhuman-Symbolism-in-Prometheus.png
9. http://images.atelier.net/sites/default/files/imagecache/scale_crop_587_310/articles/418551/atelier-visage.jpg
10. http://www.geekbinge.com/wp-content/uploads/2014/04/GoT-4.3-Thenns-620x330.jpg
11. Top, bottom:
http://assets.sbnation.com/assets/828858/kickstarter-project-goal-800.jpeg
http://www.theverge.com/2011/12/20/2644358/kickstarter-success-product-development-revolution
12. http://www.instablogsimages.com/1/2011/10/03/bmw_autonomous_car_dtcci.jpg
13. http://blog.ocad.ca/wordpress/envr4c03-fw2011-01/files/2011/09/vertical-farm-seatle-01.jpg
14. http://static.dnaindia.com/sites/default/files/1838804.jpg
15. http://static.ibnlive.in.com/pix/slideshow/03-2013/the-3d-printing/2-3dprinting-100313.jpg
Image Sources p.2

16. http://www.dailymail.co.uk/news/article-2083883/Ark-Hotel-construction-Chinese-built-30-storey-hotel-scratch-15-days.html
17. http://media.propertycasualty360.com/propertycasualty360/article/2012/03/23/tokio-marine-logo.jpg
18. http://a1.s6img.com/cdn/box_002/post_12/374833_10689477_lz.jpg
19. http://www.daz3d.com/media/catalog/product/cache/1/image/9df78eab33525d08d6e5fb8d27136e95/f/r/frost-giants-8.jpg
20. Clockwise:
http://images.techtimes.com/data/images/full/8770/pepper.jpg?w=600
http://cdn.visualnews.com/wp-content/uploads/2013/02/robot-restaurant-56-600x370.jpg
http://res.img.ifeng.com/2012/0625/wm_5576a382827c4d8515157b8c52200644.jpg
21. http://www.careercapitalist.com/.a/6a00d8345275cf69e201a3fca52fe1970b-450wi
22. http://www.inc.com/uploaded_files/image/protecting-invention-pan_18519.jpg
23. Clockwise:
http://media-cache-ak0.pinimg.com/236x/fe/1a/f4/fe1af47f31e8002cc988b913944d90b2.jpg
http://i.kinja-img.com/gawker-media/image/upload/s--rMZwgTy7--/18kxdi8an8yyzjpg.jpg
http://legalfutures.files.wordpress.com/2012/03/litigation_process_flow_re-engineering1.jpg
http://images.sciencedaily.com/2009/07/090727140349-large.jpg
25. http://wp.streetwise.co/wp-content/uploads/2012/08/10_DesktopComputer.jpeg
26. Clockwise:
http://quietfurybooks.com/blog/wp-content/uploads/2012/09/original-cell-phone.jpg
http://blogs.cio.com/sites/cio.com/files/u7727/Smartphones.jpg
http://images.thenews.com.pk/updates_pics/apple-unviels-ipad-air_10-22-2013_123439_l.jpg
27. Clockwise:
http://cdn2.ubergizmo.com/wp-content/uploads/2013/01/Google_Glass_features_in_flux.jpeg
http://cdn-static.cnet.co.uk/i/c/blg/cat/mobiles/samsung-gear-myvouchercodes.jpeg
http://2.bp.blogspot.com/-StC2ZrWjsfE/T-PV9BO5xsI/AAAAAAAACII/8-DlVgXSrUY/s1600/fuelband3.jpg
Image Sources p.3

28. http://i.kinja-img.com/gawker-media/image/upload/s--WdXonQRZ--/18lv0i1vrr2q0jpg.jpg
30. http://cdn0.vox-cdn.com/uploads/chorus_image/image/37180052/children.0_cinema_1200.0.jpg
31. http://www.telecom-cloud.net/wp-content/uploads/2011/10/Immersive-Media-Paradigm.jpg
32. http://www.newstalk.com/content/000/images/000029/30860_54_news_hub_26016_588x448.jpg
33. http://mashable.com/2014/07/15/google-novartis-contact-lenses
34. http://img.healthworld.tw/wordpress/wp-content/uploads/2014/07/17zzbodybig.jpg
35. http://www.francetvinfo.fr/image/750gulpaz-0f56/1500/843/4139831.jpg
36. http://traumwerk.stanford.edu/presence/Image%202.jpg
37. http://www.autoworldd.com/upload/Augmented-reality-iPad-app-for-car-repiar-AR-media.jpg
38. https://augmentedblog.files.wordpress.com/2014/05/anesthesiologist-viewing-vital-signs-during-surgery.jpg
39. http://www.psfk.com/2013/09/augmented-reality-surgery.html
40. http://www.realareal.com/wp-content/uploads/2013/07/EyeDecide4.jpg
41. http://marble-app.weebly.com/uploads/7/4/0/7/7407163/9254044.png?651
42. http://marktanner.com/blog/wp-content/uploads/2011/12/Toyota-Fun-Vii-Assistant.jpg
43. http://edition.cnn.com/2014/03/17/tech/innovation/the-ophone-phone-lets-you-send-smells/index.html
46. http://blog.practicalethics.ox.ac.uk/wp-content/uploads/2014/04/Photo-on-24-04-2014-at-11.41-2.jpg
48. http://overthemoonscifi.files.wordpress.com/2012/06/brain-mind.jpeg
49. http://images.atelier.net/sites/default/files/imagecache/scale_crop_587_310/articles/shutterstock_94985284.jpg
50. http://www.wired.com/wp-content/uploads/images_blogs/wiredscience/2012/10/IBM_Watson.jpg
51. http://www.psfk.com/2014/01/md-revolution-revup.html
52. http://www.visualphotos.com/photo/2x4524045/businesswoman_on_ladder_looking_through_binoculars_bld005521.jpg
53. http://img4.wikia.nocookie.net/__cb20120605015933/gameofthrones/images/thumb/c/c7/White_Walker_2x10.jpg/500px-White_Walker_2x10.jpg
Background Notes
Children of the Machine

Although there has been a lot of debates around AR and its applications in the near future, not
much has been explored about embedded augmented reality, where users are near-constantly
living in a virtual-meets-analogue world through computer implants in their bodies, and what will
happen when it goes mainstream
Children of the Machine is an upcoming sci-fi series from BitTorrent that plans to ask these
questions. Set eleven years in the future, it aims to address the social and ethical implications of
ubiquitous augmented reality abilities.
In the series a girl implants a chip under her skin on her shoulder and says that this is the coolest
thing ever.
Source: Motherboard, 20/08/2014: http://motherboard.vice.com/en_uk/read/in-bittorrents-vision-of-2025-only-losers-havent-implanted-their-phones

The intro video does not go into details, but it could be assumed that the chip ives the usual benefits of
smartphones or connected devices: sharing content, sending messages, and generally being connected to stuff
and people.
In this future, these chips have become something of a necessity for teenagers. My dad doesnt understand
how important it is to me, the girl says. Its fun and useful, but I also need it to be social. In the same way as
smartphones have become a social requirement in recent years, chips are necessary for growing up in 2025.
The more worrying impacts of the chip are reflected in the girls comments - I need it to have friends, and How
am I supposed to communicate?
Another concept introduced in the series is jolting- a psychedelic-like trip that is brought on by virtual reality
technology.

A snippet shows how a girl eveloped an insular, narcissistic way of dealing with the world,
preferring to shut herself off in a haze of fabricated digital imagery, rather than addressing the
physical world around here.
BitTorrent explains in a blog that chips will make everything knowable, trackable: forever found.
They will also promise new ways of getting lost. , which presumably refers to jolting, and the
escapism that is allows.
A pilot for Children of the Machine is expected to be released in December, but the rest of the
series will only get made if 250,000 BitTorrent users pay a fee in order to fund the project.
AR and AI in Healthcare
AR has been transforming medicine and healthcare, from improving medical training to making
pharmacy benefit management more effective.
In healthcare AR can help save lives and help healthcare organizations make their existing
processes more precise and efficient. In recent years, researchers have been using this technology
for helping doctors conduct surgeries more effectively, improving fitness, teaching complex subjects
to medical students and much more.
Patient education & care management EyeDecide is a medical app which helps educate
patients in a new way. It uses the camera display for simulating the impact of specific conditions on
a persons vision. Using apps like EyeDecide, doctors can show simulation of the vision of a patient
suffering from a specific condition. It can demonstrate the impact of Cataract or AMD.
Source: Healthtech Event, 06/06/2014: http://www.healthtechevent.com/technology/augmented-reality-revolutionizing-medicine-healthcare/
AR Applications in Healthcare
AR could also improve patient care management significantly. Wearable devices like Google Glass
can be used for registering relevant details of patients instead of manually feeding the data into
system. This reduces overheads, facilitates smooth management and reduces chance of humanerror.
Medical training AR medical applications are already being developed that allow students to
have a better understanding of the human body and how it functions. For instance, while teaching
body anatomy, an AR app can help overlay digital information in the form of video, audio or 3D
models onto human skeletons to offer a better understanding. Similarly multimedia information can
be augmented on textbooks as well.
AR Apps for Liver Surgery

The Fraunhofer Institute for Medical Image Computing MEVIS has developed an app to guide surgeons through
complex procedures.
The app was developed for iPads and can be used to help surgeons remove liver tumors without damaging
critical vessels within the organ. Before the surgery takes place, a CT scan is performed on the patient, allowing
an accompanying software to identify and image the pathways of blood vessels. This information is then
transferred to an iPad, which can be used during the surgery.
The surgeon can navigate the imaged liver to see where the vessels are, and if the camera is turned on and
pointed at the exposed liver the app automatically superimposes the vessel structure of the organ onto the live
picture. The great number of blood vessels makes liver surgery quite complex - When using augmented reality
to pinpoint exactly where the surgeon needs to focus, much of the painstaking identification or guesswork is
removed from the procedure.
Source: PSFK, 08/09/2013: http://www.psfk.com/2013/09/augmented-reality-surgery.html
AR Apps for Liver Surgery

The challenge with complex operations is that a large amount of data must be efficiently reduced
so that the surgeon is always supplied with the most recent and important information. Tablet
computers such as the iPad are a compact and intuitive way to allow doctors to reference this realtime data quickly and easily.
Looking ahead, teams at MEVIS are working to develop navigation systems similar to those found
in cars, to project data directly on the patient, and guide surgeons every step of the way.
While doctors will still need to undergo rigorous training to hone their skills, technologies like this
one can help eliminate much of the potential human error.
Source: PSFK, 08/09/2013: http://www.psfk.com/2013/09/augmented-reality-surgery.html
mARble is an app developed by the Hannover School of Medicine that allows students to gain
hands on experience.
Students using the app can learn about medical procedures at their preferred time and place. The
app works by projecting virtual diseases on healthy subjects. The students can also get an
experience to attend to sick patients. Students can also see texts, video and graphic information
which will assist them in training.
Over the years, the healthcare industry has seen a rise in the use of augmented reality to assist
patients, trainees and doctors.
Source: Augmented Reality Trends, 16/09/2014: http://www.augmentedrealitytrends.com/augmented-reality/healthcare-industry.html
Pharmacy Benefit Management (PBM) PBM is a part of an integrated healthcare system.
augmented Reality can help make PBM more efficient. For example, patients wearing Google
Glass and having an app installed on the device can get reminders on taking drugs. The app can
also offer information on drug overdose and its effects or recommend a diet depending on a
persons health condition.
Conducting complex surgeries In surgery precision is of prime importance and doctors can AR
can help surgeons become more efficient. Whether it is conducting a minimally invasive procedure
or locating a tumour in liver, AR healthcare apps can help save lives and treat patients seamlessly.
Fitness management person wearing a smart glass can view work-out related data right around
his field of vision to get details about his/her fitness instead of looking at a mobile app.
AR can play a very important role in reducing the risks associated with minimally invasive surgery.
In this type of surgery, medical instruments are inserted through a tiny cut which is made in the
patients skin. It might require endoscopic technology, where a camera is planted under the
patients skin and images are displayed onto a monitor in the operation theater. If different screens
are used to project the vital statistics of the patient, surgeons might find it difficult to concentrate
fully on the surgery in hand. With AR, all the information is projected directly onto the task at hand,
thereby reducing the risks.
Complex surgeries AR can make these surgeries easier by providing the required information to
the surgeons, which would otherwise be difficult to get. The treatment process will be a smooth one
with AR and it will help in saving patients lives.
Medical imaging With the help of head-mounted displays, medical imagery can be projected on
the patients body. Doctors can get an X-ray vision of patients by projecting CT scans through the
display. Medical students can use this imagery as a learning tool whereas doctors can get the
related signs of any illness and diagnose patients accordingly.
Dentistry When conducting surgeries, AR will allow dentists to get information right in front of
them instead of a monitor which is placed on the other side of the room. With AR, dentists will be
able to know about any structures that are hidden behind any bone tissue. This will help them to
conduct dental surgeries with greater precision and make the surgeries a success.
The Impact of AI on Healthcare

Healthcare has seen many advances in clinical care, but it is generally behind in basic IT, where
simple technology such as electronic medical records is new to many organizations.
Parallel to better IT, improvements in artificial intelligence are also expected to provide better care
and help lower costs, or in other words democratize healthcare. Scott Anthony, managing partner
at Innosight says that the process of democratization of healthcare will let people with less skill do
tasks that require more skill. In the long term, artificial intelligence systems may mean fewer
doctors but in the short run it will mean more efficient operations.
According to Neil Jacobstein, AI and robotics co-chair at Singularity University, the medical industry
has kept artificial intelligence at arms length for decades.
Source: The Wall Street Journal, 24/09/2014: http://blogs.wsj.com/cio/2013/09/24/futurists-talk-technologys-impact-on-healthcare/
The Impact of AI on Healthcare

Yet, with the Affordable Care Act in the US, hospitals are acquiring electronic medical records. Some of those
systems contain artificial intelligence or decision support systems.
A study from 2013, published in the journal Artificial Intelligence in Medicine, concludes that AI can improve both
the cost and quality of health care by combining autonomous AI with the expertise of human clinicians.
Researchers looked at 500 randomly selected outcomes for patients who had seen physicians. They then ran
patient clinical data through their artificial intelligence framework that develops complex treatment plans and
compared the results to the patient outcomes. The results showed that the use of AI could reduce health care
costs by over 50% while also improving patient outcome by nearly 50%. Some of those cost savings come with
finding the right treatment faster and fewer patient visits to doctors. With AI, the cost per unit of outcome
dropped to $189, compared to the conventional treatment cost of $497.
Source: The Wall Street Journal, 24/09/2014: http://blogs.wsj.com/cio/2013/09/24/futurists-talk-technologys-impact-on-healthcare/
RevUp
A great number of devices on the market are designed to track a wide range of human metrics,
everything from the amount of steps taken and heart rate to sun exposure and stress levels.
RevUP is a platform that is designed to help users make sense of their growing collection of health
data. It takes the form of a web and mobile app that analyzes these metrics to deliver personalized
health plans.
The system compiles personal informationeverything from lab results to optional genetic tests
asks about users health goals, and gives tailored strategies to help achieve them.
Users can also sync any apps or gadgets they use to track their health, from diet journals to
pedometers and sleep monitors, so stats will be constantly kept up to date.
Source: PSFK, 20/01/2014: http://www.psfk.com/2014/01/md-revolution-revup.html
RevUp
The platform also uses predictive intelligence to give users better access to proactive and
preventative health care.
The founder Dr. Samir Damani says that the platform has the potential to shift the medical
paradigm from reactive disease treatment to proactive health care.
All RevUp! users receive a highly customized health plan based on their preferences and lifestyle,
in which users are guided by a team of clinicians that track their individual progress and give
constructive, motivational feedback via the online platform or email. An innovative points system
and other gamified elements tap into users competitive sides to keep them close to their goals.
Source: PSFK, 20/01/2014: http://www.psfk.com/2014/01/md-revolution-revup.html
Watson Addressing Healthcare

Challenges
IBMs Watson uses natural language capabilities, hypothesis generation, and evidence-based learning to support medical
professionals as they make decisions.
For example, a physician can use Watson to assist in diagnosing and treating patients the physician might pose a query to
the system, describing symptoms and other related factors. Watson then parses the input to identify the key pieces of
information.
Watson then mines the patient data to find relevant facts about family history, current medications and other existing
conditions. It combines this information with current findings from tests and instruments and then examines all available data
sources to form hypotheses and test them.
Watson can incorporate treatment guidelines, electronic medical record data, doctor's and nurse's notes, research, clinical
studies, journal articles, and patient information into the data available for analysis.
Watson will then provide a list of potential diagnoses along with a score that indicates the level of confidence for each
hypothesis. The ability to take context into account during the hypothesis generation and scoring phases of the processing
pipeline allows Watson to address these complex problems.
Source: IBM: http://www-05.ibm.com/innovation/uk/watson/watson_in_healthcare.shtml
Watson Helping Doctors Fight Cancer

On 29th October 2014 IBM announced a new initiative to accelerate the adoption of genomic based
medicine at Cleveland Clinic. Researchers at Cleveland Clinic will use IBM Watson technology in
the area of genomic research to help oncologists deliver personalized medicine by uncovering new
cancer treatment options for patients.
The institute at Cleveland Clinic plans to evaluate Watsons ability to help oncologists develop more
personalized care to patients for a variety of cancers. Clinicians lack the tools and time required to
bring DNA-based treatment options to their patients and to do so, they must correlate data from
genome sequencing to reams of medical journals, new studies and clinical records. At a time when
medical information is doubling every five years, a faster option is needed.
Source: IBM, 29/10/2014: http://www-03.ibm.com/press/us/en/pressrelease/45277.wss
Watson Helping Doctors Fight Cancer

Watson will help doctors find the needle in the haystack through identifying patterns in genome sequencing
and medical data. The combination of Cleveland Clinics clinical expertise coupled with the power of IBMs
Watson system is expected to enable improvements to, and learnings within, the Watson tool with the shared
goal of helping medical professionals develop personalized cancer care.

The pilot initiative is an extension of on-going programs with Cleveland Clinic to aid the advancement of big data
in healthcare. The use of Watson in genomic research draws on a combination of Watsons cognitive services,
deep computational biology models and IBMs public cloud infrastructure SoftLayer. Watson can continuously
learn as he encounters new patient scenarios, and as more information becomes available through new medical
research, journal articles and clinical studies.
Given the depth and speed of Watsons ability to review massive databases, the goal of the collaboration is to
increase the number of patients who have access to care options tailored to their diseases DNA.
Source: IBM, 29/10/2014: http://www-03.ibm.com/press/us/en/pressrelease/45277.wss
Corvix
Corvix is a system developed by GE Healthcare that performs agent-based simulations on complex problems.
In India, the technology simulated a population of 80 million people in order to determine the best places to build
medical facilities.
GE thinks that it can solve inefficiencies in healthcare using data. Corvix is one step towards achieving this goal
as it uses historical data to predict the future, including everything from how diseases will spread to the cities
where hospitals will be needed the most.
The platform uses agent-based modelling to build a facsimile of some sort of complex system and then simulate
its evolution over time. The agents represent the atomic units of those systems, such as individual people in
the case of human populations or cells in the case of a biological simulation. They act according to a set of rules
in any given situation, which is how the models are able to keep the simulations progressing.
Source: Gigaom, 23/06/2013: https://gigaom.com/2013/06/17/ge-wants-to-use-artificial-intelligence-to-predict-the-future-of-hospitals/
Corvix
Thanks to the advent of big data, GE Healthcare Chief Economist Mitch Higashi thinks the time is right for a
platform like Corvix to provide some real value to real-world decisions. Theres enough raw computing power,
machine intelligence and data-modelling expertise to start doing fast, accurate simulations over very large and
complicated datasets.
The first run of Corvix was in Andra Pradesh in India, where the system simulated a population of 80 million
people in order to figure out where to build hospitals and medical training centres over the coming years. The
GE team used two census datasets and one health care survey.
The original plan was for the Public Health Foundation of India to invest $2 billion building training institutions in
different cities over the next five years. Corvix suggested some possible changes in location of those
institutions, including placing two institutions in the countrys most-populous state, Uttar Pradesh, instead of just
one as was originally planned.
Source: Gigaom, 23/06/2013: https://gigaom.com/2013/06/17/ge-wants-to-use-artificial-intelligence-to-predict-the-future-of-hospitals/
Alme
Alme is a virtual assistant app, like a Siri for the health world and it's designed for doctors to make
sure patients adhere to their treatments. The app uses commands and natural language
processing to bridge the gap between health-care practitioners and their patients and serves as a
"disease management system for patients to handle chronic disease.
Alme for Healthcare's backend can be integrated into Android, HTML 5, iOS, and even hologram
adaptations for hospital lobbies. Individual users go through a validation process under HIPAA rules
and the app gives them daily reminders of treatment needs and tracks specific data. Health care
practitioners also get metrics on adherence and patient behaviour through the app.
Source: The Fast Company, 10/10/2013: http://www.fastcompany.com/3019839/fast-feed/this-virtual-assistant-is-like-siri-for-doctors-and-patients
Augmented Reality Market

KPMG considers AR as one of the six technology
trends that will have a huge impact on businesses,
the other five being big data, cloud, social media,
mobility and embedded systems. The expectation is
that the logical maturity of these trends will bring
them together.
The spread of smart mobile devices has led to rapid
growth in AR. KPMG predicts that against the
backdrop of steadily increasing processing power the
future holds significant potential for AR, with
applications in a wide range of segments, from
agriculture and architecture to education and
medicine.
Source: KPMG (2013), Six Converging Technology Trends: http://www.kpmg.com/IN/en/IssuesAndInsights/ArticlesPublications/Documents/Six-Converging-tech-trends.pdf
Source: KPMG (2013), Six Converging Technology Trends: http://www.kpmg.com/IN/en/IssuesAndInsights/ArticlesPublications/Documents/Six-Converging-tech-trends.pdf
The Future of Augmented Reality

Augmented reality has shown a significant growth over the past few years. MarketsandMarkets
March 2014 report Augmented Reality & Virtual Reality Market predicts the Compound Annual
Growth Rate of AR at around 15% -- making augmented reality a $1 billion market by 2018.
Interactive advertising is one of the most popular applications of AR. UK-based start-up Blippar,
for example, utilizes AR technology to augment print media. Users with Blippar-enabled
smartphones can point their cameras toward supported advertisements to see previously hidden
interactive content (video, text and images.
Blippar has been downloaded more than 4.7 million times
Source: ACM Siggraph 19/05/2014: http://www.siggraph.org/discover/news/future-looks-bright-augmented-reality

Data gathered by Blippar shows that people engage with an advertisement for four and a half
minutes on average, significantly higher than traditional print, internet or television marketing.
Research done by UK-based augmented reality firm Hidden Ltd reveals that the likelihood of a
parent to buy a toy when advertised with augmented reality is 29% higher than when advertised
with 2D print advertisements.

AR systems are applicable in various other fields. Engineers at the Battlefield Air Targeting ManAided (K)nowledge lab (BATMAN) are leveraging Google Glass technology to improve
communication within the Air Force. The apps enable pilots and air traffic controllers to acquire
increased situational awareness and instant updates without losing track of their immediate
tasks.

The technology is also quickly spreading to the educational sphere, as augmented education
apps enable students to become more actively involved in the lessons. AR products allow
students to create and interact they can manipulate and combine elements from their Android
or iOS devices, rather than just reading about them in a textbook. Aurasma, the AR app
developed by Hewlett Packard, identifies twenty percent of its users as educators or students.
A few issues to be addressed regarding augmented reality before it can move forward and
increase its impact on day to day lives. The first is the current stage of AR technology although
it has developed greatly from its inception, the applications still need a lot of work to be thorough
and accurate.

Some technological limitations in computer vision and image processing are some of the factors
that need to be improved for better AR.

Privacy concerns must also be taken into consideration. With the immense amount of data to be
collected through AR devices and stored into corporate databases, certain data governance
regulations must be set in place to ensure consumers feel safe using the applications.
In general, an increasing number of companies and organisations are beginning to embrace this
technology as an alternative to traditional media and there is a great academic involvement in
the field given its vast utility.
Is AR Still Waiting for the Killer App?

New academic research has given us an insight into the exciting future possibilities for AR
browsers. Jules White, Assistant Professor of Computer Science at Vanderbilt University

believes that the really compelling applications that are going to make AR take off just havent
been built yet.
For example, in the future if a persons car breaks down, he or she can whip out a smartphone
and use a diagnostic app that can guide the repair. The app could show where the jumper
cables are and highlight where to connect them on the battery. With the right level of visual
awareness the app could determine that the tire pressure is low, or recognize that a part is
dangerously worn and needs to be replaced.
Source: Digital Trends, 15/03/2014: http://www.digitaltrends.com/mobile/future-ar-mobile/
http://icdn2.digitaltrends.com/image/marta-app-600x315-c.png
Is AR Still Waiting for the Killer App?

The potential of AR is huge and is beginning to come to life.
The Volkswagen MARTA app (Mobile Augmented Reality Technical Assistance) is designed to
display superimposed information on the vehicle and enable technicians to complete a repair or
guide them as they service a vehicle. The app is developed for professional mechanics, its
popularity and adoption are expected to increase in the future.
Theres also the Audi AR app, which is like a user manual, enabling users to view the car using
their iPhone and get data pop-ups on what theyre looking at.
White explains that what takes AR to the next level is having the domain and computer vision
expert to work together and build applications that are helpful to specific industries.
Source: Digital Trends, 15/03/2014: http://www.digitaltrends.com/mobile/future-ar-mobile/
https://www.audi.co.uk/content/dam/audi/production/RestOfSite/AboutAudi/LatestNews/05_2013/Audi%20Vision%20App%202.jpg
Audi Vision
Audi Vision was launched in 2013 to bring Audis brochures to life.
The app allowed potential buyers to point their mobile device at Audi spring 2013 price and
specification guides, and take a picture that unlocks the static pages of the brochure, triggering
additional content such as video, sound, hotspots and additional pictures and text.
Potential buyers would then be able to to look (virtually) under the bonnet of their chosen model,
hear the engine roar, experience the ride from behind the wheel, and appreciate the bodywork
from all angles, as well as boning up on the specification. Once the app has taken a grab from a
particular brochure, it no longer requires a data connection to engage with the AR content.
Source: Mobile Marketing, 16/05/2013: http://mobilemarketingmagazine.com/audi-goes-ar-audi-vision/
Augmented or Transformed Reality?

As AR systems are expected to revolutionise almost every sphere from medicine to
entertainment, the big three tech companies have all invested heavily in research and
development in the AR domain. Google has been working on the Google Glass, Microsoft has
been working on its own AR device and not long ago Facebook bought the virtual reality (VR)
company Oculus Rift.

The notion of AR that these companies seem to be proposing is a kind of "smartphone for the
eyes", as traditional AR and VR converge in the optic realm.
Some are arguing that we are headed to an era where we will be taking our visual information in
real time and integrating this with a wealth of external information to transform our daily lives.
This will give us some degree of control over how we see the world, in the fundamental sense.
Source: PhysOrg, 14/10/2014: http://phys.org/news/2014-10-augmented-reality.html

However, rather than merely augmenting reality, AR could help us transform it. Extrapolating from the
recent history of technology gives us a glimpse of what the future of AR is likely to look like in the hands
of the big tech companies.
First, the idea of the "app" will extend into the visual domain, giving us apps that aid us in all the things
we already do: building a house, studying at a distance, travelling in a new city and even making love.
Second, the price for access to these new services and of having information at our fingertips is likely
to involve surrendering ever more of our personal information. Critically, it will open up new markets for
advertisers to promote their products and services in both tacit and explicit ways an extension of the
world of "advertising everywhere". By surrendering control over our immediate field of vision,
advertising no longer needs to be limited to a screen or a surface but could become truly ubiquitous.

Nick Kelly comments in Phys.org that the vision of AR that we are seeing in the media and in
press releases for products such as Google Glass is a vision of our world as we know it, but
perhaps made a little easier through this technology. However, by changing what we see in real
time, AR could fundamentally change how we live. The transformative potential of this
technology has begun to be envisioned by a number of different artists.

For example, in the Artvertiser project, artists have developed an application that replaces
billboards within the visual field with images of art. So instead of subconsciously consuming
giant advertisements on a billboard from the bank, users could perhaps be consuming artworks.
The example above begs the question what kind of a built environment we want to inhabit. AR
has the potential to change both the cityscape and the horizon, to overlay worlds upon worlds.

Other artists have begun experimenting with ways that the technology could be used to add extra
dynamics to public artworks, bringing them to life.

Kelly argues that the advent of AR presents a significant choice. Through detection, replacement and
synthesis AR has the potential to both add to and subtract from our sensations.
Aspects of the environment, even buildings and people could potentially be filtered in or out based on
personal preference our generation is the first in human history that holds this possibility.
Kelly also suggests that rather than waiting to see what purposes are dreamed up by the purveyors of
this technology, we need to begin thinking about how we want to use it to transform the world for the
better.
The Advertiser Project

The Advertiser is a software platform for replacing billboard advertisements with art in real-time.
It works by teaching computers to 'recognise' individual advertisements so they can be easily

replaced with alternative content, like images and video. The project was launched by Julian
Oliver in February 2008 and has been developed in collaboration with Damian Stewart and
Arturo Castro.
The Founders consider Advertiser as an example of Improved Reality rather than Augmented
Reality technology. It has appeared in full working form in street exhibitions in Berlin as part of
Transmediale 2010, in Brussels for the Europe wide Media Facades Festival, in four inner-city
walks during Rotterdam's Image Festival and in Helsinki as part of an M-CULT public event and
workshop.
Source: The Advertiser: http://theartvertiser.com/
The Advertiser Project

Project progress According to the projects website the software is stable and works well. Currently it runs only
on The Adtvertiser's own digital binoculars, Android devices and netbooks/laptops with webcams. Developers
are invited to download the code and help improve it.
The Advertiser targets three classes of device:
Billboard Intercept Unit it guarantees high-quality immersive advertisement substitution and is more performant
for AR applications than any hand-held device currently available; equipped with a high-quality wide-angle lens,
fast CPU and GPU, powerful wireless adaptor, long battery life and plenty of solid state storage space.
Smartphones - Currently there is a working version for the Android OS.
Standard Camera phones The great bulk of the world's camera phones run the Symbian OS. The team are
drafting up a version of The Artvertiser to provide 'single shot' photo substitution.
Source: The Advertiser: http://theartvertiser.com/
Issy-les-Moulineaux
The French city of Issy-les-Moulineaux has launched the project Radical through the development of
intuitive applications providing citizens information in Augmented Reality. The citys aim is to improve
innovative services using augmented reality as this technology offers offers citizens the opportunity to
discover points of interest and to receive information in a playful way.
Following this logic, the city created a historical visitor-constructed trail of the Fort dIssy, a former
military fortification where combats took place during the 1870-1871 war against the Prussians. This
was done to remind inhabitants and tourists about the history of the Fort. The app gives people a a
realistic view of this place and how it was centuries ago.

Issy is developing a new service, TellMyCity that will let citizens share good and bad experiences of
living in the city.
Source: Radical Project: http://www.radical-project.eu/a-digital-eco-district-in-issy-les-moulineaux.html
Zeiss VR One
ZEISS believes that virtual reality is going to change the way we perceive things, beyond all our imagination. The
firm created the mobile VR goggle - ZEISS VR ONE that enables people to view pictures and videos in
immersive environments.
The device works through a smartphone display and allows users to enjoy the experience with the smartphone
and the VR ONE with tray. The user can feed the phones into a slot using the tray, specifically designed for
whatever phone it is. The ZEISS VR ONE provides specific trays for two smartphones: the iPhone 6/4.7-inch and
Samsung Galaxy S5.
Two ZEISS multimedia apps, VR ONE Media and VR ONE AR, will enable people to view to watch movies, 2D
and 3D, view photos and interact with Augmented Reality.
The VR One is quite cheap, beyond the design and famous quality Carl Zeiss lenses, the VR ONE contains no
electronic equipment. It's also cheap because the project is completely open; development, growth and to a point,
marketing is down to the developer community.
Source: PhysOrg, 12/10/2014: http://phys.org/news/2014-10-optics-experts-vr-headset-december.html#inlRlv
Zeiss VR One
The multimedia app allows users to stream YouTube videos in 2D and 3D, visit "featured views"
from Google, and watch films and view photos saved on a phone.
The AR app can be used in the following way just hold the AR cube (included in the
package) in front of the VR ONE and the avatars will appear automatically. By turning the cube,
you can look at them from any angle.
An open source Unity3D SDK provides functions for app developers. The SDK is available for
iOS and Android operating system platforms on Bitbucket.
Source: PhysOrg, 12/10/2014: http://phys.org/news/2014-10-optics-experts-vr-headset-december.html#inlRlv
Sixth Sense
Sixth Sense is a wearable gestural interface that augments the physical world with digital information and lets us
use natural hand gestures to interact with that information the interface integrates digital information with the
tangible reality.
The SixthSense prototype is comprised of a pocket projector, a mirror and a camera with the hardware
components being coupled in a pendant like mobile wearable device.
Both the projector and the camera are connected to the mobile computing device in the users pocket. The
projector projects visual information enabling surfaces, walls and physical objects around people to be used as
interfaces. The camera recognizes and tracks user's hand gestures and physical objects using computer-vision
based techniques. The software program processes the video stream data captured by the camera and tracks
the locations of the coloured markers at the tip of the users fingers using simple computer-vision techniques.
For example, a newspaper can show live video news or dynamic information can be provided on a regular piece
of paper.
Source: MIT Media Lab, http://www.pranavmistry.com/projects/sixthsense/
Sixth Sense
The movements and arrangements of these fiducials are interpreted into gestures that act as
interaction instructions for the projected application interfaces. The maximum number of tracked fingers
is only constrained by the number of unique fiducials, thus SixthSense also supports multi-touch and
multi-user interaction.
The SixthSense prototype implements several applications that demonstrate the usefulness, viability
and flexibility of the system. The map application lets the user navigate a map displayed on a nearby
surface using hand gestures, similar to gestures supported by Multi-Touch based systems, letting the
user zoom in, zoom out or pan using intuitive hand movements. The drawing application lets the user
draw on any surface by tracking the fingertip movements of the users index finger. SixthSense also
recognizes users freehand gestures (postures). For example, the SixthSense system implements a
gestural camera that takes photos of the scene the user is looking at by detecting the framing gesture.
Source: MIT Media Lab, http://www.pranavmistry.com/projects/sixthsense/
Name Tag
NameTag is a facial recognition app that matches faces/ persons to their online and public record. The
app scans a face and pulls up social media profiles but can also browse through 45,000 entries in the
National Sex Offender Registry.
The app is developed by FacialNetwork.com for Android and iOS devices. It will also be available for
Google Glass.
Kevin Alan Tussy, NameTags creator, says that app was developed for safety. It has the added benefit
of giving users an easy way to learn more about their date, supposedly creating an instant connection
based on mutual interest or hobbies. According to Tussy says Its much easier to meet interesting
new people when we can simply look at someone, see their Facebook, review their LinkedIn page or
maybe even see their dating site profile. Often we were interacting with people blindly or not interacting
at all.
Source: International Business Times, 14/01/2014: http://www.ibtimes.com/nametag-facial-recognition-app-checks-if-your-date-sex-offender-should-you-use-it-1539308
Name Tag
Tussy also says that the privacy issues can be resolved by ddressed by having individuals sign up and
create profiles on NameTag and choosing to not have their profile shown in public searches.
The app lets users compare online profiles based on facial recognition by pasting an images URL,
uploading an existing photo from a phone or using the smartphone to scan the individuals face. It then
compares data points with face in its database to create a summary of their online identity.
Despite the advantages of NameTag and similar apps, people have started to question whether such
apps will harm social relationships.
Questions about database maintenance, accuracy and reliability are also a concern for apps like
NameTag
Source: International Business Times, 14/01/2014: http://www.ibtimes.com/nametag-facial-recognition-app-checks-if-your-date-sex-offender-should-you-use-it-1539308
SAP AR Apps
SAP showcased two mobile AR apps at the 2014 Super Mobility Week in Las Vegas the SAP AR
Warehouse Picker mobile app and SAP AR Service Technician mobile app.
The apps are envisioned to help simplify and improve user experience and work processes by offering
a hands-free working experience.
Rick Costanzo, executive vice president and general manager of Global Mobility Solutions says that
The new augmented reality mobile apps from SAP are intended to simplify and enhance user
experience by providing access to enterprise information from anywhere while helping users stay
focused on their work and environment.
The potential and use cases of the apps expand beyond consumer applications - they are aimed at
creating efficiencies for organizations across various lines of businesses by enabling real-time access
to data for field workers and service technicians.
Source: SAP News Center, 08/09/2014: http://www.news-sap.com/sap-showcase-new-augmented-reality-apps-super-mobility-week-powered-ctia/
SAP AR Apps
SAP AR Warehouse Picker:
Envisioned to allow warehouse workers to do all required tasks using smart glasses, which is expected
to improve situation awareness, efficiency and workplace security.
Aimed at enabling hands-free experience using visualization and voice recognition to receive
instructions via smart glasses, as well as allowing data entry to be handled through scanning or voice
recognition.
Is intended to help warehouse workers by providing inventory location, alerts and instructions for
maintenance handling, and the delivery of safety messages to prevent accidents.

With planned simplified authentication, the user experience is envisioned to be enhanced by eliminating
the need to enter a username, password or other information required on the smart glasses.
SAP AR Apps
SAP AR Service Technician:
Envisioned to allow field service technicians to have hands-free access to visual enterprise model
instructions.
Aims to deliver a remote expert calling function which shall enable field service technicians to request
support from any expert, which can help lower costs by focusing resources where they are needed.
With planned voice recognition, the app is expected to contain multiple features such as integration of
3D model animation and step browsing.
Planned voice notes, recording and playback functions on the device are intended to allow service
technicians to create a knowledge base that is accessible to others.
Amazon FireFly
Firefly is a new feature for the Amazon Fire phone. It is designed to identify and buy things users
see in the real world.

Firefly takes advantage of the smartphones camera and helps users identify things like phone
numbers, movies, books, games, CDs, food, art and more just by pointing the camera at them.
The app can also identify songs or a show a person is listening to and then let him/her access
that specific scene on Amazon.
Under the hood, the technology being used includes semantic boosting it can smartly identify
and understand text based on the context.
Source: Tech Crunch, 18/06/2014: http://techcrunch.com/2014/06/18/amazons-fire-phone-introduces-firefly-a-feature-that-lets-you-identify-and-buy-things-you-see-the-real-world/
AR in Finance
LV= plans to inject some fun into insurance by adding an augmented reality element to its newspaper
flyers. The company has partnered with Blippar, the augmented reality app, to make its flyers
interactive.
Users who scan a LV= flyer will see a 3D house pop up on their screens and will be able to explore it by
tilting their phones to see different objects in and around the house that can also be insured - such as a
car, dog or plane for travel insurance.
LV= will also show users home insurance quotes plus links to its content hub, lvthat.com.
Paul Wishman, LV=s eCommerce director, says that Blippar is a fun and interactive way to engage
with consumers, an important step in the firms strategy to expand its social media presence.
Source: Marketing Magazine, 09/10/2014: http://www.marketingmagazine.co.uk/article/1316510/finance-gets-augmented-reality-treatment-lv-partners-blippar
ULTRA-Vis
The Defense Advanced Research Projects Agency has demonstrated the ULTRA-Vis, an augmented
reality heads-up display system similar to what jet fighter pilots use while patrolling the skies.
The ULTRA-Vis (abbreviation for Urban Leader Tactical Response, Awareness & Visualization) shows
data about the current location to the user, helping him or her identify friend from foe and the mission's
targets even within the chaos of the battlefield. Unlike Google Glass, which projects images directly into
the eye's iris, potentially causing eye strain, the ULTRA-Vis overlays the data over the user's natural
field of vision through a holographic display.
The device is able to track the movements of the head of the user with installed motion sensors and the
user's location with GPS. Fixed markers are displayed on top of the real world locations that the user
sees, which do not go away if the user looks somewhere else and then looks back.
Source: Tech Times, 26/05/2014: http://www.techtimes.com/articles/7459/20140526/darpa-develops-ultra-vis-augmented-reality-hud-system-soldiers.htm
ULTRA-Vis
The device would be very useful for the military as it can display needed information to the
soldiers without obstructing their vision.

The prototype was completed within the past several months. The breakthrough wa] the
holographic wave guide. Users will also be able to decide how much or how little information
they want to see.
On top of the superimposed holographic display, users of the ULTRA-Vis can also use the
device as a communication tool with their fellow soldiers, home base and other friendlies. The
device is also capable of showing video taken by deployed machine drones, allowing the user to
see beyond what the naked eye can see.
Source: Tech Times, 26/05/2014: http://www.techtimes.com/articles/7459/20140526/darpa-develops-ultra-vis-augmented-reality-hud-system-soldiers.htm
AR and Cargo Ships in 2025

The vision for AR & Cargo ships in 2025 developed by the VTT Technical Research Centre of Finland
and Rolls-Royce and looks like this: Cargo ships will still have humans at the helm and will use an
augmented reality bridge to traverse the high seas.
The massive tiller and towering consoles are gone, replaced with minimalist workstations facing floorto-ceiling windows that serve as a vast head-up display. The ships navigation information is overlaid in
front of the crew, along with other vessels routes and obstacles that could be obscured by fog or rain.
At night, thermal cameras display live video over the window to let watchmen keep tabs on whats
ahead.
After inputting the ships destination, the navigation system determines the most economical route.
The bridge concept also extends to tug boats, with the OX concept that automatically detects the
captain and then configures the workstation to both their size and needs.
Source: Wired, 27/03/2014: http://www.wired.com/2014/03/rolls-royce-ship-bridge/
AR and Cargo Ships in 2025

The user interface is fully adjustable for usability and visibility, and places augmented reality
markers on the ship its towing to help with deckhand placement, predict the route of the vessel,
and get real-time winch information.
VTT and Rolls-Royce are already working on the first round of systems, which initially include
remote controls that can be commanded from the bridge or on land.
Rolls and VTT plan to deploy the first remote-controlled ship in the coming years.
Source: Wired, 27/03/2014: http://www.wired.com/2014/03/rolls-royce-ship-bridge/
Future of Internet 2025

A report by Pew Research Centre highlights the trends of internet and our digital life gathered from
2500+ experts. Most of them believe that in 2025 there will be:
A global, immersive, invisible, ambient networked computing environment built through the continued
proliferation of smart sensors, cameras, software, databases, and massive data centers in a world-
spanning information fabric known as the Internet of Things.

Augmented reality enhancements to the real-world input that people perceive through the use of
portable/wearable/implantable technologies.
Disruption of business models established in the 20th century (most notably impacting finance,
entertainment, publishers of all sorts, and education).
Tagging, databasing, and intelligent analytical mapping of the physical and social realms.
Source: World Business Incubation, 17/03/2014: http://worldbusinessincubation.wordpress.com/2014/03/17/future-of-internet-2025-predictions-by-pew-research-center/
Future of Internet 2025

With regard to AR, contributors believe that Augmented reality and wearable devices will be
implemented to monitor and give quick feedback on daily life, especially tied to personal health.
Daren C. Brabham, a professor at the Annenberg School for Communication & Journalism, University
of Southern California, predicted, We will grow accustomed to seeing the world through multiple data
layers. This will change a lot of social practices, such as dating, job interviewing and professional
networking, and gaming, as well as policing and espionage.
Aron Roberts, software developer at the University of California-Berkeley, said, We may well see
wearable devices and/or home and workplace sensors that can help us make ongoing lifestyle changes
and provide early detection for disease risks, not just disease. We may literally be able to adjust both
medications and lifestyle changes on a day-by-day basis or even an hour-by-hour basis, thus
enormously magnifying the effectiveness of an ever more understaffed medical delivery system.
Source: World Business Incubation, 17/03/2014: http://worldbusinessincubation.wordpress.com/2014/03/17/future-of-internet-2025-predictions-by-pew-research-center/
Embedded Augmented Reality

Although there has been a lot of debates around AR and its applications in the near future, not
much has been explored about embedded augmented reality, where users are near-constantly
living in a virtual-meets-analogue world through computer implants in their bodies, and what will
happen when it goes mainstream
Children of the Machine is an upcoming sci-fi series from BitTorrent that plans to ask these
questions. Set eleven years in the future, it aims to address the social and ethical implications of
ubiquitous augmented reality abilities.
In the series a girl implants a chip under her skin on her shoulder and says that this is the
coolest thing ever.

The intro video does not go into details, but it could be assumed that the chip ives the usual benefits of
smartphones or connected devices: sharing content, sending messages, and generally being
connected to stuff and people.
In this future, these chips have become something of a necessity for teenagers. My dad doesnt
understand how important it is to me, the girl says. Its fun and useful, but I also need it to be social.
In the same way as smartphones have become a social requirement in recent years, chips are
necessary for growing up in 2025.
The more worrying impacts of the chip are reflected in the girls comments - I need it to have friends,
and How am I supposed to communicate?

Another concept introduced in the series is jolting- a psychedelic-like trip that is brought on by virtual
reality technology.

A snippet shows how a girl eveloped an insular, narcissistic way of dealing with the world,
preferring to shut herself off in a haze of fabricated digital imagery, rather than addressing the
physical world around here.
BitTorrent explains in a blog that chips will make everything knowable, trackable: forever found.
They will also promise new ways of getting lost. , which presumably refers to jolting, and the
escapism that is allows.
A pilot for Children of the Machine is expected to be released in December, but the rest of the
series will only get made if 250,000 BitTorrent users pay a fee in order to fund the project.
AR & Digital Faces

Futurist designer Jenny Lee has created a series of "digital skins" that she imagines might grace our
faces in the year 2060. The idea comes from Babak Parviz, one of the brains behind Google's smart
lens project.
As a University of Washington nanotechnology expert, in 2008 Parviz and his colleagues advanced the
idea of a solar or radio frequency-powered augmented reality contact lens.
Jenny Lee says that the project illustrates the idea that humans can use technology to evolve beyond
biological bodies - "What I wanted to do is consider new technology as augmented reality--the idea
that we can place a digital mask over the real world.
If we can place masks over the real world, we could also put masks on our own faces. Lee's rationale is
that instead of plastic surgery today, in the future we'll just create digital identities that anyone wearing
augmented reality contact lenses will see instead.
Source: Fast Company, 12/02/2014: http://www.fastcoexist.com/3026290/futurist-forum/this-is-what-your-face-will-look-like-in-2060
AR & Digital Faces

Lee designed the digital masks with technology from Holition to question what something like that might
mean for human interaction. Inspired by alien-like mineral deposits and color-shifting sea creatures,
Lee's future human faces feature pokey metallic outgrowths and 3-D tattoos. She then programmed
them into an interactive mirror in which people could view their new and improved reflections.
Viewers at the exhibitions in Milan, London and the Netherlands have not responded well and the
majority of people said they didnt enjoy interacting with the technology. That discomfort is also part of
Lee's point, too. She says that in an appearance-obsessed culture, digital masks might give rise to new
types of inequality. If we use these technologies to advance ourselves who would benefit the broader
public or an elite group.
Maybe in the future we will have digital faces as a prerequisite for basic online services.
Source: Fast Company, 12/02/2014: http://www.fastcoexist.com/3026290/futurist-forum/this-is-what-your-face-will-look-like-in-2060
AR in 2033
Greg Madison, Designer of innovative HCI / Interaction Designer and illusionist magician on the future
of AR:
TV shows will integrate the connected glasses technology into their programs, although it is more for
the video aspect than for the augmented reality aspect. reviewers will use it as confidence, to interview
somebody, to show behind the scenes, communicate sensations during a test or simply to shoot all
what they do with their hands.
We might have programs based on citizen journalism that will capitalize on the fact that we will all be
potential drones closer to the event. Finally, it would not be surprising to see for example the
appearance of reality TV games in United States, where the viewers would follow in real time and help
bounty hunters teams, who will have as mission to intercept a real criminal in an allotted time.
Source: Medium.com: https://medium.com/ui-collection/the-future-of-augmented-reality-and-virtual-reality-alternative-reality-83539b85b086
AR in 2033
The audience will also be actors then; they would be able to zap between the different participants, thus
choosing the best view to watch the action. Adrenaline by substitute, which will generally not cost much to
produce.
AR will enable time travel - Indexing and processing of specialized geo-time code video sources, will
make the reconstruction of 3D scenes possible and will allow us to physically navigate through past
actions. We can take Obamas inauguration speech in in Washington in 2009. We would then, be able to
go on location to live and relive this historic moment facing him on the spot or be with him on the gazebo.
Later we will be able to model the missing parts of our past and we will add simulations of the
protagonists of that time.
In education - students will follow their school teacher, visiting Notre Dame de Paris cathedral on
December 2nd 1804 to attend the coronation of Napoleon.
AR in 2033
Brands will understand the real value of AR and will think about their consumer product in an
augmented version. We will not buy a product just for what it is anymore, but for what it
proposes to do. A bottle of water of a certain brand may account the amount of fluid you drank
during the day so that you are adequately hydrated.
Users of AR devices will hear everything translated into their language by foreigners equipped
with the same device.
AR in 2033
Thanks to the META Augmented Reality Glasses, to the version of the Oculus Rift equipped with
sensors to capture the real environment and all headsets/ glasses that will arrive on the market,
coupled with a smart-phone, we would possess autonomous solutions available to move and
interact in a mixed Augmented Reality.
All business applications will be redesigned for virtual realities / alternative realities and we will
see an explosion of Geogaming.
Like Ingrees today, the world will become the reference grid for video games. For example you
will be able to challenge any athletes around the world on a 100m race on your usual running
track, or even stroll through the streets of Paris in the 18th century to solve investigations.
AR in 2033
We will superimpose this virtual world on our physical environment, in order to evolve in it.
In this world, we will have to face real challenges. Imagine yourself trying to find the spear of Odin while
physically confronting the far North and actually braving the tumult of a stormy sea to reach the island
Vulcano in Italy to gain Ifrits ultimate fire incantation.
Depending on the game selected, the architecture of your city will be substituted in your view by, for
example steampunk buildings or elven shops. Players will put on their avatars like a costume and only
subscribers will be able to see it.
Since Artificial Intelligence has made rapid progress, we will see the birth of holobots. Indeed, even if
robots eventually become part of our daily lives, for obvious reasons of cost and utility, holobots of
comfort, will be those who will populate our world first.
AR in 2033
Through our augmented reality devices we will be able to converse in natural language with
these digital agents which will be our personal valets. They will be the natural extension of Siri
and Google now and will be fully integrated into our real environment. These holographic
humanoids confidants generated in the cloud, will have as mission to help us in our everyday
tasks, advise us, memorize and then restore all the information we might need.
Due to the need to recover the slightest movements to finely control the interactions with
Augmented Reality and the ubiquitous computing in general, a new general public device will be
launched The Orb. When strategically positioned in one place, this device will act partly as a
hormones boosted Kinect, with a volumetric 360 3D vision and partly as a T-ray scanner , that
will allow it to capture information through certain materials.
AR in 2033
Durable goods manufacturers will create objects with already programmed behaviors. Like a fruit
basket that tells you which seasonal fruits to buy or that checks that you have well consumed 5
recommended daily fruits and if its not the case, it alerts you.
We will be able to speak directly to the objects souls and ask our fridge not to open its door to
our children between meal-times.

So as to make teleportation possible, we will create merge spaces that will be areas built
identically, where, the objects and the living, present in these areas, will overlap as layers. This
will enable brainstorming sessions in firms; presentations in a meeting room with participants
located all around the globe, or enable someone to have his desk in an openspace while staying
at home.
AR in 2033
Merged gardens, parks and public places will enable a British person to stroll with a French
person. It will also enable a Portuguese and a Brazilian person to chat on a bench while being
physically in their respective countries.
At school, students will share their classroom and work with other nationalities. At home, a
broken family will be able to continually forgather in a dedicated area of the living room or
around the dining table, the children will play in their room instantly with their best friends.
The birth of the Egosystem will be imminent. Following the same pattern as the Internet and
mobile networks, the infrastructure that will provide access to it, will unfold itself gradually
covering the dense areas to start. Eventually the era of Augmented Reality will come to an end,
and we will, then, talk about Alternative Reality.

Co-Creating Health - Rohit Talwar

Transféré par

Informations du document

Copyright

Formats disponibles

Partager ce document

Partager ou intégrer le document

Options de partage

Avez-vous trouvé ce document utile ?

Ce contenu est-il inapproprié ?

Droits d'auteur :

Formats disponibles

Co-Creating Health - Rohit Talwar

Transféré par

Droits d'auteur :

Formats disponibles

Healthcare 2020+

Handi Health Apps

About Fast Future

Speaking and Moderating

Future Leadership Programs and Events

Business Design and Innovation

Can we Change our DNA?

Future Proofed Organisations

Future Global Challenges...

Socio-Demographic Shifts are

Free education is a game changer

Magic and Science are Blurring

The biological era is emerging

Strategy, ICT, Insight, Ideas, Responsiveness, Innovation, Financing,

New Models for Innovation Funding : e.g. Kickstarter.com

Scientific Advances are Extending

...and Creating New Ones

Rapid Execution is Rewriting the Rule Book

Magicians are Creating Wow Factor

Barbarians at the Gate

Robots are Entering the Workforce

A lot can be done with current and near to

Embracing the Transformative Role of IT

Our Technologies are Evolving From

...to Portable and Mobile ...

... And Connected to an Immersive MultiSensory / Multi-Sensor Internet of Everything

The First Official Cyborg

Biohacking is Becoming a Reality

Intelligent Devices could Become the Norm

The Future? - Blurred Lines

Augmented Reality could Accelerate the trend

EyeDecide Simulating Visual Conditions e.g. Cataract

Virtual Disease Projection

Active Skin Enabling Full Sensory A/R

AI and SuperIntelligence are Catalysing

Cost per unit of outcome: $189 vs $497

AI Could Have a Masssive Impact on Diagnosis,

Predictive, Proactive Personal Care (RevUp)

Mindset - 3 Horizon Thinking

Conclusion - Step into Our Fears

About Fast Future

Fast Future Clients

Banking and Financial Services

Food, Pharmaceuticals and

Government and Intergovernmental

Fast Future Clients

Commercial and Industrial

Designing Your Future Key Trends, Challenges and Choices

Key challenges and choices for

Reinventing the Airport Ecosystem

ILTA Legal Technology

Key business and legal trends and forces

Timeline of emerging technologies and IT developments

Explores ITs transformative role in future legal business

Defines strategic business and IT imperatives

6 sponsors - combined desk research, interviews with

200 emerging technology developments

Futurium - Science and Technology

ACCA / IMA 100 Drivers of Change

Identifying key drivers of change for the

Examining the implications for:

Future strategies for venues, destinations and agencies

Global futurist and founder of Fast Future Research.

Award winning speaker on future insights and strategic innovation