Académique Documents
Professionnel Documents
Culture Documents
20th September 2013, Venstpils Final Conference Smart Metering (Smart, Project No LLIV-312)
Low traffic area less problems with installation High buildings for signal reception Easily accessible manholes Enough branches for data analysis and modeling Existing city infrastructure (SELGA old peoples home) for receiver/transmission installations, power supply Existing high buildings for alternate signal reception points Almost all segments can be equipped with meters The BAD: no loop closed main branch
Goals
Provide sensor network for real world experimental environment in University Water leak and unauthorized connection detection EPANET as water quality and future expansion tool Aquamet expansion with network structural definition and modeling compatibility Aquamet expansion with monitoring and model based simulation functionality Provide e-services
Bill generation (also user portal publicmet) Udeka IS compatible data exports check compatibility with bookkeeping
Trial network
All segments and branches have at least one meter Long distribution lines for fluid dynamics simulation (wave propagation)
Trial network
Technical problems solution concerning metering data transmission from the water networks wells
Power supply for pressure meters Existing flow, pressure reader adaption for 868MHz RF transmission instead of GPRS Transmission signal strength obstacles Signal transmission from manholes Data packet retransmission using Ethernet Physical meter installation in the network Software adaption for data processing and visualization (AquaMet)
Software designed solution easily portable to other platforms Base system running customized OpenWRT (linux) image: USB support, networking, VPN Message receiving using USB interface Message processing: C Alternatives: OpenEmbedded
Decision to separate the components USB ICRv9 for easy PC hookup debugging and data retrieval Open standards, human readable, easy development Security: P2P Bridges with dedicated VLAN
Decision to separate the components USB ICRv9 for easy PC hookup debugging and data aquision Open standards, human readable, easy development Security: P2P Bridges with dedicated VLAN
Equipment diagram
Manhole antenna prototype evolution Experiments with urethane plastic rubber and aluminum filled rugged design Has to provide tamper resistance Problems with the dipole verification (laboratory tests)
Progress [1]
The new antenna designs
directional antenna used for concrete manhole covers omnidirectional antennas: low profile used for on street manholes
Manhole antennas
An error of 2% of urethane mixture results an semi-hardened result Sealing concrete (hard and dense) useful in locations near signal reception points
Three times cheaper Easy to handle Hard to destroy Max 10% signal weakening also in wet condition compared to urethane
Antena installations
Local ISP provider 5.8GHz interference Blocking buildings and trees Better in case of new points or reallocation
All three Ethernet gateways are Mini-ITX boards with Linux and Aquamon service PBOX board is the next generation of implementation needs to be tested for stability
Antena installations
Power supply problem - solved
Cheap to build Easy to mount most of cases antennas are mounted to existing poles
Bad cables
Ordered cable defects Bad crimps Loose connections Solder less Missing outer moisture isolation Wrong type
The situation water flow sensors after the first installation (without survey)
Only 5 of 14 domestic transmitters are sending data periodically An reposition of all not received transmitters has to be done as soon as the SCADA signal reception problem is solved repositioning has to be done based on the site survey done earlier
Accessibility Location of the meter Direction of nearest reception point Cable length Is it needed or possible to put the transmitter outside needs to be billed with waterproof filling material (i.e. rubber) Another problem: bad reed switch connections to the flow meters
Third window from left side, 1m above ground, it possible to position in SCADA direction at a small window, cable length 34m.
Transmitter frequency drift correction Better locations for maximum signal strength Filler (hydro sealed) transmitters for outdoor usage
Replaced flow sensors need to be <1m3 to be useful in event generation for periods less than couple hours
Delay because of bad weather conditions and too long cold period
868Mhz micro antenna manhole profile milling in cases where manholes are on sidewalks
Urethane natural UV color decay to grey stealthy when on concrete manhole covers
To get a correct pressure (total head) calculated the height difference has to be known Manual measurements where done for the missing spots
Design failures
Temperature sensor connector missing key wrong insert causes burning, malfunctions, difficult to isolate
Pressure sensor antenna connector difficult to install capacitor in the way Pressure sensors and temperature sensors have no key markers, there are pins in between confusing The 90 degree connectors is not fitting through the case nut extreme force and tools are needed
USB FR
USB Serial interface: EFTDI 1215-C GN510901 FT232RL Display only for testing optional USB Serial commands:
2 read time dd/mm/hh/mm 3 read RAM 4 read EE PROM 8 erase FLASH w set RTC (ddmmhhmm) w28011200
First iteration Tester only for visual readouts of sensor/meter readings Second iteration USB serial interface for connection to embedded Linux gateway for data collection backend communication
Ethernet gateway receiver board is the same as the repeater board changes only by software
PBOX2 features
Composite out for future display handheld device Universal Wi-Fi auto configuration and most dongle support Heartbeat monitor with LED indication of the systems health Read-Only file system after boot up auto configuration is completed to prevent file system corruption in cases of forceful power off GPIO shutdown trigger for future housing integration a software power off function All transmitters are double buffered into RAM and processed regardless of garbage data - built-in auto recovery and parsing All configuration done in a plain text .INI like configuration file easy mountable via first FAT32 partition (the etx3 stays hidden) FUTURE improvement migration to OpenEmbedded\Yocto
Message reception Message analysis for errors and false results Message buffering Message encoding Message preparation for Ethernet transmission Security in transmission process
The Ethernet gateway system contains numerous helper scripts and application to ensure safe and highly available service.
Hostname, internal IP, external IP Easier identification of sites with large gateway count
Ethernet gateway
Done
aquamon multithreaded daemon to parse USB data and prepare for delivery to server MONIT service notification and aquamon service control (e-mail notification, problem detection, service recovery) VPN support (tinc, PPTP, OpenVPN) Watchdog: Broadcom BCM2708 watchdog support (gateway monitoring, overload, data pipe lost - reboot) Wear out Prevention of SD card memory (RAMLOG)
To be researched, implemented:
Stripped down version: OpenWRT (6-10MB) moved to OpenEmbedded Yocto OLSRP - Optimized Link State Routing Protocol B.A.T.M.A.N - Better Approach To Mobile Adhoc Networking
VPN allows logical grouping of sites Ethernet gateways for maintenance and debugging/management
Encryption, authentication and compression
All traffic is optionally compressed using zlib or LZO, and OpenSSL is used to encrypt the traffic and protect it from alteration with message authentication codes and sequence numbers.
Repeater
To solve Ethernet gateway signal reception issues a sink type repeater was created Was dropped in GPRS solution as unpractical solution for Ethernet case problems
Transmission happens only one way Battery status byte server as level identification Is dropped by the Ethernet gateway No message retransmission if repeaters are intersected Collisions in the same domain are prevented with simple random retransmission delay
sinking principle
Main problem power supply, but should not be a problem in municipal dense city scenarios with the right planning
Reception situation
All data is received with maximal delay of 2 hours (lost transmission) depends on weather, but this is the worst observed (rainy, vegetation max.) One flow meter (5!) bad reception sudden RSSI drop from 78 needs to be investigated also is in the range of repeater < 130m (SOLVED)
0 6:00 6:09 6:18 6:27 6:36 6:45 6:54 7:03 7:12 7:21 7:30 7:39 7:48 7:57 8:06 8:15 8:24 8:33 8:42 8:51 9:00
0 6:00 6:07 6:14 6:21 6:28 6:35 6:42 6:49 6:56 7:03 7:10 7:17 7:24 7:31 7:38 7:45 7:52 7:59 8:06 8:13 8:20 8:27 8:34 8:41 8:48 8:55
bar
m/h
0,2
0,4
0,6
0,8
1,2
0 6:00 6:10 6:20 6:30 6:40 6:50 7:00 7:10 7:20 7:30 7:40 7:50 8:00 8:10 8:20 8:30 8:40 8:50 9:00
bar NORM
m/h NORM
Scada problem
Flow is an cumulative average and needs to be recalculated on each iteration All data has to be simulated as an ICR device using same data structure to ensure software homogeneity Flow has to be represented as pulses, but the averaging is only daily, so historical data has to be taken into account to generate flow pulses Solution give a one minute accuracy improvement of 2% in a daily scenario of 33539m3 (calculated 34687) an amount of 1148 liters in lost
One-line solution impractical because of recursion month of data results in a data analysis of 40 minutes Solved by incremental data processing as temporary reference points
iPXE - open source network boot firmware KVM - Kernel-based Virtual Machine OpenVZ - containerbased virtualization
Server setup
Proxmox VE KVM Hypervisor RAID1 mirroring with LVM snapshots Rsnapshot for incremental rotating backups to external network drive
KVM (for Kernel-based Virtual Machine) is a full virtualization solution for Linux on x86 hardware containing virtualization extensions (Intel VT or AMD-V) Live Snapshots OpenVZ is container-based virtualization for Linux Live Migration Open Source RESTful web API Web app for Management No SPOF Easy self containing Backup and Restore Role-based Administration Authentication Realms
ProxMox
Aquamet + Aquamon
All Ethernet gateway recognize NAT and public IP address for easier access through SSH etc. Every equipment gets and system identifier Coordinate identifier Object information on hover On click easy photo viewing and edit option useful in large deployments
Leak causes
Leakages leakage through the crevice of the pipelines uncontrolled overflow of the accumulation tanks leakage of the hydrant shaft leakage of the fittings (valves, connections) Authorized unmeasured water consumption fire department municipal connections hydrants net street washing and sewer cleaning processing water in water plant Errors human factor (wrong reading of the water gauge and/or, calculated consumption) faulty individual water gauge of the consumer faulty main water gauge of the utilities Unauthorized unmeasured water consumption unauthorized connection to the pipelines connections without water gauge unauthorized uses of hydrants bypassing the water gauges
LEAK DETECTION IN UNDERGROUND PIPELINES OF MUNICIPAL WATER DISTRIBUTION Marko Blaevi, Ivan Samardi and Zvonimir Kolumbi
Correlator - The measuring method is based on the analyses of the noise caused by water flow through the crevice Complications
presence of many pipeline crevices near sensors connection of the lateral pipelines near sensors unknown trace of the pipeline influence of the sound waves other than crevice noise (e.g. traffic) noise of the underground installations (e.g. pump).
Selection of practical methods for leaks detection in WDN [1] future research based on trial network data
Common used methods
Neural Networks Statistical analysis Genetic algorithms Bayesian inference (used 15 min. data cycle) Support vector machines (learning alg. also epanet core, tests showed 90lhr detection limit in 10 learning iterations)
Event generation
Water companies should restructuring water networks into smaller sub-networks known as District Metering Areas to simplify network definitions and implementation process Network skeletonisation
Database driven network structure SQL based model generation and data population for analysis
All segments and branches have at least one meter Long distribution lines for fluid dynamics simulation (wave propagation)
MySQL for easier integration with Aquamet system Easy graph traversing and model input file generation
Planned implementation
EPACAD: AutoCAD to EPANet extension If network planing function is required: WaterNetGen should be migrated: generation of synthetic water distribution network models and its sizing based on simple heuristics. It also allows to perform least cost design, by using a Simulated Annealing algorithm, and pressure-driven analysis, a better suited approach to model pressure dependent consumption and leakage.
Vertices are pipe splits used for better map fitting (visualization)
Future expansion
The basic water network components for future expansion in case of more dynamic networks containing active components like controlled valves, pumps etc. were implemented. If further research is continued, also water quality monitoring and modelling can be implemented and analyzed. This is useful not only for the current situation evaluation but also for future network expansion planning and water quality monitoring.
Leak detectors
Pressure average value negative fluctuation leak detector
Averaging period (7 days) Negative fluctuation percentage (20%) Activation period (300s = 5min.)
Leak triggering simulation by opening fire hydrants Straight line of pressure fluctuations Branched position for complex pressure patterns
Leak type
Slow opening long term pressure changes Fast opening shockwave with short term pressure changes
Exact data extraction directly from database for the selected test duration
Test position nr.: 1 15.08.2013 10:40:00 - 11:20:00 Test position nr.: 2 15.08.2013 11:30:00 - 12:00:00
SELECT ( ( ( `readouts`.value -186 ) * `meters`.full_pressure_scale ) /744 ), `readouts`.when, `meters`.number FROM `readouts` LEFT JOIN meters ON `readouts`.meter_id = `meters`.id WHERE `readouts`.`when` < '2013:08:15 11:24:40' AND `readouts`.`when` > '2013:08:15 10:42:47' AND `programm_version` =12 LIMIT 0 , 30 SELECT ( ( ( `readouts`.value -186 ) * `meters`.full_pressure_scale ) /744 ), `readouts`.when, `meters`.number FROM `readouts` LEFT JOIN meters ON `readouts`.meter_id = `meters`.id WHERE `readouts`.`when` < '2013:08:15 11:43:01' AND `readouts`.`when` > '2013:08:15 10:55:03' AND `programm_version` =12 LIMIT 0 , 30
Leak priority type settings alarm level Resolve procedure clears generated errors Event filtering by type
Leak alarm calculation variable information for fine tuning/adaption, map location/visualization
Easy to program
Questions?