Académique Documents
Professionnel Documents
Culture Documents
AI & IOT:
AT THE when to bring
CUTTING intelligence
industrial
I
n the internet-of-things (IoT) market, learning in the industrial space. president of IoT at the Amazon subsidiary.
the volume of connected end-points It is only by combining these elements “But there’s loads of compute and stor-
is head-spinning, already: 14.2 billion that we can take that question age in those things. There always
25bn
in 2019, reckons Gartner, rising to 25 entirely seriously. Data science has been; it’s just you can now
billion by 2021. In practical terms, the real is a hard road for humans. In connect them as part of a big-
kicker is what to do with all the data from conversation, AWS quotes a ger IoT deployment, and they
these ‘things’. study about the hard graft of connected do more than just pump data.
That is the question that will determine data science: analysts spend ‘things’ It’s not about a machine do-
whether the potential value of the broad 80 per cent of their time pre- by 2021 ing some local processing; it is
IoT market – $1.2 trillion will be spent on paring data; just 16 per cent - GARTNER about connecting those devic-
IoT technology in 2022, according to IDC – goes on training and refining it es together, and to the cloud,
$1.2tn
is in digital transformation, or just in selling to eke out insights. so the whole system does
the idea of it. Humans have never been awesome stuff.”
It is the difference between ‘sensing’ and much good at donkey work, The difference is the
‘sense-making’, as it were – between the and AI makes lighter works of it. – annual IoT clank and boom of in-
connectivity and intelligence in IoT sys- Computers, beasts of the infor- spending dustrial IoT is opening up
tems. A lucrative market has already grown mation age, are being burdened by 2022 the closed world of oper-
up for technology vendors connecting with increasing volumes of data - IDC ational technology (OT) at
‘things’, but digital change requires them and equipped with advancing ma- last. Industrial machines are
to work together to spark new business chine-learning algorithms as ever-more not alone anymore. They are be-
insight – which only comes with artificial ‘things’ are connected. ing joined into a bigger system; their data
intelligence (AI) at the edge. This is not new; the ‘edge’ – “the things- is being mixed up in the cloud and con-
“If you knew the state of everything and space, the T-space in IoT,” says AWS – has sumed in flight, with each machine able to
could reason on top of that data, what always existed as a venue for industrial execute custom commands.
problems would you solve?” This is the computing. “Maybe in the beginning, Increasingly, the processing is happen-
question AWS asks its interlocutors when software people thought that just meant ing at the outer edge, close to the live ac-
discussing the combination of sensors, silly sensors, pumping data into the big I – tion in factories and industrial plants. This is
distributed compute power, and machine into the cloud,” says Dirk Didascalou, vice the case for time-critical, business-critical,
2
F E AT U R E R E P O R T
75%
But is this conservative, even? handling. Computing power promise that these IDC-sized enterprise in-
People are compelled to know was outsourced and made vestments will ever deliver a return – and,
the future, observes Tom invisible. But the dream of beyond, that AI will ever beget industrial
Bradicich, vice president for enterprise data IoT is to take constant and rebirth. These are the key elements: the
edge and IoT systems at HPE. processed at rapid illumination from motivation to change, and the means to
The laws of statistics and prob- edge by 2025 data – harvested massively, achieve it.
ability say the wider the sample, - GARTNER translated instantly. “For many of the most interesting and
the greater the insight; the IoT sec- Today, the promise of digital valuable problems, the intelligence has
tor is driven to deploy more devices to transformation is nothing short of to be closer to the action,” says Speed. But
gather more data. industrial revolution. “We are in the middle what are these use cases? What are their
“We’re connecting washing machines of one of one of the most significant tech- technical constraints, and how do enterpris-
and dog food bowls,” says Bradicich. “The nology transitions in the last 100 years,” es go about designing an edge architecture
Gartner stat’ is going to be 80 per cent, or comments Jesse Clayton, senior product to support them?
CASE STUDY
WATER FILTRATION UNITS (PENTAIR)
Pentair provides water filtration systems data is sent to AWS IoT Core. When con-
equipped with sensors to fish farms and nectivity is limited, AWS IoT Greengrass
large industrial brewing customers. Most provides Pentair with a local connection
of its industrial customers are located so data is never lost.
in geographies with unreliable internet Pentair can make decisions in near
connectivity. They need to send data from real-time that impact the health of its
sensors and devices to the cloud while devices but also the health of the fish
continuously maintaining connection, – which in turn, results in better yields,
which is challenging in remote areas. prevents the spread of disease, and lowers
From Pentair’s water filtration systems, the cost of operations.
3
F E AT U R E R E P O R T
REAL TIME OPERATIONS Andreas Vogel, vice president at SAP Labs, making the case for private LTE as an indus-
Modern AI is having such an impact because comments: “A round-trip to the cloud which trial transport technology, presents a graph-
“it performs better than previous approach- can be hundreds of milliseconds and more ic with an axis for latency and an axis for
es and, in some cases, better than humans,” might be too slow for certain operations. bandwidth, and AI applications mapped be-
explains Clayton at Nvidia. The problem is, Edge computing can deliver responses in tween (see below). LTE, privately managed,
in many cases, it will not perform at all, or at tens of milliseconds.” gets you to latency of 40-50ms, it reckons;
least not quickly enough to be valuable, if it Bradicich at HPE raises the classic chal- 5G, with tuning, will go further, >> page 6
is locked away in data centres. lenge of response times
“Anything that needs to operate in real in autonomous vehicles.
time has to be done at the edge,” says Owen “How soon do you want to Mapping latency and bandwidth
at ABI Research. Running intelligence in
edge-based infrastructure means applica-
know the object in front of
you is a garbage can ver-
against IoT applications
tions are less constrained by network la- sus a girl? You really want
10Gbps
tency and bandwidth, the twin gods in any to send that data to the 360 VIDEO VR + VEHICLES
real-time comms architecture. cloud – and then wait?”
“The sheer mass of data from industrial He also introduces ideas
IoT applications poses an enormous chal- about compliance and
100Mbps
lenge,” says Bernd Gross, chief technology corruption into the mix –
Bandwidth
officer at Software AG and chief executive benefits that are less about
at Cumulocity. Risks arise when the system making the industrial en-
gets flooded and the pipes get blocked. gine hum, and more about
1Mbps
“This happens when the physical path clearing the road so the
from the sensor to the cloud is ‘too long’,” wheels can roll. But latency
he explains. and bandwidth are the real
The concept of ‘real time’ is relative; frac- showstoppers so far as in-
10kbps
tions matter, as the difference between dustrial performance goes. PEOPLE + THINGS SYSTEM CONTROL
success and failure in the industrial world. They demarcate the
10s 1s 100ms 10ms 1ms 100us
“Seconds of excessive heat stress are suf- edge – how far compute
ficient to cause cost-intensive damage on and inference goes from Latency Source: Nokia
sensitive machines,” says Gross. the factory floor. Nokia,
4
F E AT U R E R E P O R T
SCALE
(IIC) has mapped out a “continuum” DEVICE / EQUIPMENT PLANT FACTORY / RIG / MINE ENTERPRISE
of edge computing in industrial set-
tings, with the ‘edge’ variously locat-
DRIVERS
5
F E AT U R E R E P O R T
3.5m
your eyes is 7ms. Now think of a data cen- In the Bühler solution, corn gets
per sec
tre in the next city, over the horizon. Just fed from a truck to a hopper, and
for the light to go back and forth is 10ms. into a chute, and falls at 3.5
So it’s game over. You must have the edge – rate at which mai ze metres per second as a single
cloud on site – and that’s not just for AR, passes in front of “yellow sheet of corn”. Cameras
but all kinds of industrial processes.” LumoVision camera; project UV light to illuminate
time enough to the grains; a telltale fluores-
id and eliminate
THE ‘SWEET SPOT’ bad kernels cence shows up the aflatoxin,
These are the use cases that have tipped the and high-speed air jets shoot con-
balance, for suppliers and customers. “At taminated kernels into a rejects bin.
some point, over a period of time, the big The rest passes into shipping containers.
cloud guys had an epiphany, and realised, Microsoft is providing the edge and ana-
‘oh crap, we can’t do what we want unless lytics tools. Tamburini comments: “We’re
we move to the edge’,” explains Speed, in talking milliseconds; just imagine: the corn
reference to moves by AWS, Google, IBM, kernel is falling at speed, and the machine
and Microsoft to join the action at various finds time to take a picture, process it, make
points during the past three years. a decision, and take an action.”
“The thing that made them realise was The Bühler solution, called LumoVision,
[machine] vision. They were tackling it by processes 10 to 15 tonnes of maize – or an
taking the data to the cloud, and analysing entire truckload – in an hour. It was tested
it there. That’s okay for a lot of use cases, with Italian agricultural cooperative Capa
but not for all – and vision was the one that Cologna, and shown at Hannover Messe in
broke the camel’s back.” 2018. The phone has been ringing off the
Farshid Sabet, managing director of In- hook ever since.
tel’s vision processor business unit, agrees. But latency and bandwidth constraints
“Right now, we see a confluence of machine do not even have to be combined; stretch-
vision and machine learning,” he comments. ing demand in either direction makes
This confluence is at the edge. The edge computing compulsory. “If you need
volumes of data generated by imaging to shut down a nuclear plant because the
sensors in critical industrial applications temperature goes 0.001 degrees above a
cannot be reasonably processed anywhere Vision – Bühler builds the LumoVision (top) certain level, then you probably want to
6
7
F E AT U R E R E P O R T
% oil
>1fro
of data m
Offshore – an oil rig in the North Sea; analytics must run locally as there is little or no connectivity, and operators are sensitive to breaches rigs is used for
decision
run that at the edge,” says Tamburini. “That’s why data and reliability, which making
Sometimes, the question is not whether plays on both - MCKINSEY
bandwidth is constrained, but whether it analytics revenues will of these, and data
is even available. In certain out-of-reach in- take off in the next few protection are also
dustrial locales – off-shore oil rigs, out-back driving this digital exodus.
mines, to give the most quoted examples
years – because edge These considerations have, until recent-
– the computing is forcibly confined just computing appeals to these ly, kept wireless networks out of industrial
because the edge is out of range. manufacturers that are plants, and OT separate from IT. Indeed,
At other times, it is imposed because the volume of processed data out of most
communications have been knocked out either very cautious about industrial setups has been flat for 30 years.
completely. ADLINK has good example of data privacy, or else can’t Most is never available for analysis; in-
this. It deployed sensors and sense-making stead, it is stored, and eventually trashed.
solutions on the ground in Puerto Rico after
ship much off premise for AWS quotes findings from McKinsey &
Hurricane Maria tore through in late 2017. regulatory reasons.” Company, which asked offshore oil rigs a
The US Federal Emergency Management few years back how much of their data is
Agency deployed “every emergency gen- Pierce Owen, principal analyst, made valuable. “Less than one per cent is
erator it could lay its hands on”, says Speed, ABI Research ever used for any decision making,” says
to re-establish power to hospitals, schools, Didascalou. “Data generation always hap-
and other services. “But none of them were rapid-paced technology “smash-up”, says pens at the edge; it’s just very little finds its
connected – none were instrumented or Speed, to enable local services to function way into a data centre for analytics.”
monitored,” says Speed. until full power returned. This is still the case, to a greater extent.
ADLINK put engineering boots on the But the combination with edge com-
ground in Puerto Rico to establish an emer- IT/OT CONVERGENCE puting, introducing new reliability to
gency IoT network to manage the power But, actually, bandwidth and latency con- critical IoT applications, means sensitive
reserves. Data from the generators was straints do not even have to be decisive to data can be retained in-house, managed
stored locally, and uploaded to the cloud dictate the migration of industrial intelli- between the shop-floor edge and the
as connectivity flashed in and out. It was a gence to the edge of the network. Network private-cloud edge.
8
F E AT U R E R E P O R T
9
F E AT U R E R E P O R T
HYBRID EDGE-CLOUD
Of course, edge computing does not elim- CASE STUDY
inate the value of cloud-based analytical
functions in IoT setups. “The two technol- STEAM
ogies complement each other, to enable
end-to-end industrial IoT solutions,” says
GENERATORS
Gross at Software AG. “The edge is where
time-critical data is processed; the cloud is
(CERTUSS)
where data is retrieved, stored, analysed, German company Certuss produces
and sent back.” low-noise steam generators for contin-
Most industrial devices will continue to uous operation. The devices are used
rely on the cloud to store data. Edge com- in various fields of application, includ-
puting helps balance the workload, stops ing to sterilise surgical instruments.
IoT from overwhelming the system, and As they are often involved in multi-
brings faster inference. A standard model stage production, there is a potential
for edge-cloud computing is well estab- for errors that cannot be ignored –
lished already. even minor faults can have a negative
Didascalou at AWS explains: “The pat- impact on the production result. To Jetson – the latest Xavier AI vision module from Nvidia
tern is always the same: data is collected counteract this, Certuss has set up
at the edge, aggregated and analysed in a real-time analytics and predictive “Deep learning is one of
the cloud, and brought back to machines, maintenance service using the Cumu- the most computationally
where smarter decisions are taken.” Training locity IoT platform.
machine learning algorithms is computa- The solution makes it possible to challenging applications
tionally expensive; running them is not. analyse about 60 parameters – pres- ever devised”
Clayton comments: “Deep learning is sure, temperature, water level, for
one of the most computationally challeng- example – for each steam generator Jesse Clayton, senior product manager
ing applications ever devised.” in real time. With the data obtained, for autonomous machines, Nvidia
Speed says: “It might take a week to train predictions can be made as to when
on a piece of hardware at the edge, and and at which point in the production But the balance is shifting fast. “In prac-
just an hour in the cloud.” chain faults will occur. In addition, tice we see many organisations adopting
It is a case of muscle and flexibility. While the required amount of steam can be a hybrid approach, where some analytics is
training is a fitful labour, carried out at a determined via remote configuration, run at the edge, and then metadata is sent
distance; inference is a constant task, or- which in turn can reduce energy costs. to the cloud for higher-level analysis,” com-
ganised close at hand. “Training requires ments Clayton at Nvidia.
a lot of compute, and frequency is limited; ABI Research predicts 52 per cent of in-
you want to recognise and infer all the dustrial organisations engaging the cloud
time,” explains Sabet at Intel. will take a hybrid approach by 2023. “A hy-
Beyond these disciplines, of heavy-duty brid approach is the best way to deal with
analytics and light-touch inference, data data in industrial environments,” says Owen
collection should be maintained between at ABI Research. “It’s an efficient way to
the edge and cloud on a cycle of continu- leverage compute power both at the edge
ous improvement. and the cloud without the costs of publish-
This hybrid architecture, making use of ing every reading to the cloud.”
public and private clouds, will be the de- But there are myriad variables within hy-
fault methodology within five years, reck- brid architectures, particularly at the edge-
ons ABI Research. As it stands, 54 per cent end. “Different use cases require different
of industrial cloud arrangements are with system topologies,” says Clayton.
public facilities, 31 per cent go private, Where, then, within the edge architecture
and 15 per cent leverage both in hybrid does the intelligence lie? An easy answer is
setups that train in the cloud and deploy Edge – manufacturing rapid steam generators hard to find, but the principle is simple: the
at the edge. edge closes around the ‘thing space’ as the
10
F E AT U R E R E P O R T
EMBEDDED POWER
Let us consider, briefly, the position and will take a hybrid
portfolio of the two chief protagonists in sil- approach by
icon production for industrial edge devices. 2023 - ABI
Nvidia’s Tesla and DGX products are for
data-centre AI; its Jetson kit, including the
new AGX Xavier AI platform, is designed for
the edge. Its hardware-software combina-
tion makes it possible to deploy AI-powered
PUBLIC
11
F E AT U R E R E P O R T
12
F E AT U R E R E P O R T
Assurance – the HPE / Foxconn machine vision solution by Relimetrics (above) checks server assemblages for
anomalies, flagging them to factory workers in a dashboard (right)
CASE STUDY
ELECTRONICS (FOXCONN)
Q
uality assurance is a critical part of “It’s important that part is before they cause delays, and makes good
manufacturing; it’s just humans on Foxconn’s quality promise. “If we say it
are not very good at it. Their fac- correct – otherwise there’ll be will get there on Tuesday, it will get there on
ulties are not trained to pick out a big bang and a squeal from Tuesday.”
anomalies in rapid carousels of industrial On the conveyor in Kutna Hora, every unit
assemblages. More than this, they just can’t
someone inside the vehicle” enters a section for video review; mobile
do it. Modern manufacturing, particularly Steve Fearn, global chief technologist, HPE cameras move into inspect every aspect of
of discrete electronics, is too complex and the unit, from every angle. The cameras are
too various for human eyes. But machine otherwise there’ll be a big bang and a squeal 2D; Foxconn has no requirement for 3D ma-
learning, at the edge, is turning fallible old from someone inside the vehicle.” chine vision at the site, as yet. Its machine
production checks into fail-safe new produc- He shows another image, this time of a learning is trained in the cloud and executed
tivity gains. carbon sample from a Formula One car; it’s on site. Anything that does not pass muster
Case in point: HPE and Foxconn have de- somehow critical, but it could be anything. – “damaged components, missing compo-
veloped a machine version of Where’s Wally? The stakes are high, and humans are falli- nents, foreign objects, incorrect configura-
to discern the production-line equivalent ble, he explains. “Things are getting smaller, tions” – goes to a human referee. Any ques-
striped hats in grey boxes, and raise the things are getting more varied, and yet we tion, and it is seized for a second opinion,
alarm. It is a symbiotic arrangement, using need more precision.” The Foxconn cus- and either righted and re-entered, or else
HPE edge components to automate quali- tom-and-supply circle has been put to work held back; the production lines keeps chug-
ty assurance on a Foxconn production line at Foxconn’s European manufacturing facili- ging along all the while.
carrying HPE servers. The new system, devel- ty in Kutna Hora, in the Czech Republic. John Nothing goes to waste. The facility has
oped with video analytics firm Realmetrics, Gallagher, operations manager of Foxconn, moved away from a “he-said, she-said” de-
is being positioned as a support line for the is in charge. “Quality underpins everything velopment path, says Fearn, towards itera-
standing workforce, to relieve it of duties it that we do,” he says. tive production based on hard data. “Varia-
was never qualified for in the first place. “It’s But, as with discrete manufacturing, its tion is the killer; we can now capture every
always there, and it’s always checking,” says products are complex, its batch sizes are configuration and every fault and improve
Steve Fearn, global chief technologist at HPE. small, its production is swift, and its sched- the manufacturing process.”
Machines bring precision and control, and ule is packed. The Kutna Hora line for HPE Foxconn is working to run the same vid-
they are eminently biddable – the Foxconn servers jumps to a new configuration every eo checks on individual assembly stages, to
system won’t rush the work to clock-off ear- three or four units; 50-60 per cent of its units identify at an earlier stage in the production
ly, “to get home to the family”. We encoun- are shipped within 24 hours of joining the process. “We would basically break down the
ter him at an HPE showcase in Geneva; he assembly line. “We’ve got people inspecting, analytics one by one, and then eliminate the
shows a picture of a slide from a Space X and they miss a lot of things,” says Gallagh- need for a final inspection,” comments Gal-
product. “It’s important that part is correct – er. The new edge system catches the faults lagher.
13
F E AT U R E R E P O R T
But in audio, there remains a deficiency – another, and they talk to each other
with accents and noise,” he says. without any kind of translation,” says
Sabet gives parallel examples of ‘live’ Tamburini at Microsoft.
analysis of motion and mood: a securi- This is where ADLINK plays, as the oil in
ty camera that computes and connects the engine, to translate between different
when a robber comes into view; a baby communication and software protocols.
monitor that records and uploads when Interoperability remains a challenge for
a newborn breaks into a smile; a vehicle the major cloud players, too, it notes – de-
camera that sounds an alarm when the spite their convergence around the same
driver’s eyes get heavy. edge IoT architecture and technology,
What about in the case of the corn-ker- most notably with Google’s open-source
nel sorter, presented earlier, and other ex- machine learning framework, TensorFlow.
treme industrial IoT deployments: where is Each has developed its own programming
the intelligence at? It is down to the ‘thing’ interfaces (APIs); each is making “different
itself, explains Tamburini. “The fastest re- decisions” around security. “There’s some
sponse is close to the sensors and actua- nuance,” says Speed. “At a 10,000 foot lev-
tors; with Bühler, it is on the device itself, el, it’s all the same, but it is quite different
running a beefy chip with lots of memory “The fastest response is when you get into the detail.”
and processing power.” But the cloud players have settled on
close to the sensors and an edge IoT architecture, at least, and
REMAINING BARRIERS actuators – on the device momentum is building around OPC-UA
It is worth noting, before we sign off, that itself, running a beefy chip and MTConnect as complementary http
the work is far from done. The migration of protocols, where the first defines the
industrial intelligence to the edge is just be- with lots of memory and communications pipeline and the second
ginning, as the various forecasts quoted in processing power.” defines the payload. MQTT, a lightweight
this article attest. The fragmentation of the sensor protocol, is also commonly used
IoT market makes it hard to make money Diego Tamburini, principal industry lead for ‘on-ramp’ to the cloud. “You may think
from, for starters, putting a dampener on for manufacturing, Microsoft Azure the standards are still fragmented. But it’s
progress. “If you want to be the next Mark complete progress compared to years ago,
Zuckerberg or Elon Musk, don’t go in to when everyone had their own proprietary
IoT,” Wienke Giezeman, chief executive and seen multiple protocols take root; major protocols and technologies,” comments
co-founder of Amsterdam based LoRaWAN configuration is still required with most Speed at ADLINK.
collective The Things Network, told Enter- industrial IoT deployments just to have Tamburini at Microsoft is more cautious.
prise IoT Insights recently. machines ‘talk’ the same language. “There is some consolidation, but it is far
Significantly, the lack of standards makes “We are a long way from the plug- from ubiquitous,” he says. “Standards are
it hard for startups to scale. That complex- and-play scenario where you connect a like toothbrushes – everybody needs one,
ity is compounded in the industrial space, robot from one vendor and a lathe from no one wants to share.” Even, so, he ob-
where a policy of isolationism, serves “a lot of momentum”, especially as
already discussed, has industrial machinery is upgraded and the
edge takes a more common form.
14
F E AT U R E D C O M PA N Y
15
U P CO M I N G 2 0 1 9 E D I TO R I A L
P R O G R A M S I N C LU D E :
MARCH 2019
25% discount when you sponsor two or more programs. Enterprise IoT Insights |
For information contact: sales@rcrwireless.com Digital Factory Solutions 2# :
Virtual & Augmented Reality (report series)
Fast facts about RCR Wireless:
382,000 monthly page views J U LY 2 0 1 9
170,000 unique monthly visitors to websites
81,000+ opt in newsletter subscribers Enterprise IoT Insights |
Making Industry Smarter #3:
220,526 monthly video minutes
Ports & Shipping (report series)
45,000 leads generated annually
Industry leading demand generation programs and results
AU G U S T 2 0 1 9