Communications with IEC 61850 1 Introduction Eric A. Udren WSU Hands-On Relay School March 2013 March 2013 Discussion leader Eric A. Udren 43 year distinguished career in design & application of protective relaying, control, and communications systems. Executive Advisor with Quanta Technology, LLC of Raleigh, NC in 2008. Developing substation protection and control upgrading strategies for major North American utilities, relay application research and design, and new data communications applications. Developed software for the worlds first computer-based relaying system. S i d l i d t l ft d l t f th i d t fi t d l t f LAN b d Supervised relaying and control software development for the industrys first development of a LAN-based integrated protection and control system. Designed the first interface of a microprocessor protective relay to an optical current sensor. Developed the technical strategy for some of the most progressive utility LAN-based substation protection and control upgrading programs using IEC 61850 and other data communications, including technical design for utility enterprise integration of substation information. IEEE Fellow. Chairman of two IEEE Power System Relaying Committee (PSRC) Standards Working Groups Chair of PSRC Relaying Communications Subcommittee. Received the PSRC Distinguished Service Award in 2001 and again in 2006. Member of IEC TC 57 Working Group 10 responsible for IEC 61850. Technical Advisor to the US National Committee of IEC for TC 95, Measuring Relays. Page 2 2013 Quanta Technology LLC Page 2 ec ca d so o e US a o a Co ee o C o C 95, easu g e ays Member of NERC System Protection and Control Subcommittee (SPCS, formerly SPCTF). Member of NERC Protection System Maintenance Standard Drafting Team. (PRC-005-2) Has written and presented over 80 technical papers and chapters of books on relaying topics, and has taught courses on protection, control, communications, and integration. 2011 GA Tech PRC Walter A. Elmore Best Paper Award; IEEE Prize Paper Award. Holds 8 patents on relaying and power-system communications. Eric is based in Pittsburgh, PA and can be reached at eudren@quanta- technology.com or (412) 596-6959. 2 Impact of substation data communications SUBSTA. LAN Substation or facility local area network (LAN) - Lack of standard protocols and Goal 1: Collect relay data, give control for SCADA & facility operators (speed, accuracy, completeness, interoperability). Goal 2: Access operational and non-operational data from relays or meters for many business purposes intervendor communications was a user issue for years. Page 3 2013 Quanta Technology LLC Page 3 relays or meters for many business purposes. Goal 3: Replace wired P&C schemes with LANs. Goal 4: Replace switchyard/power equipment wiring for instrument transformer, status, control signals with LANs. Relay data for SCADA/EMS RTUs connect to the same ac and apparatus signals as the relays lots of extra wiring & electronics. Microprocessor (P) relays are designed for measurements status control via LAN data measurements, status, control via LAN data communications. Goal 1: Concentrator on LAN collects relay values and reports to SCADA & local interface computer. Serial LAN (RS-485, multiple RS-232) still widely used. Ethernet LAN recommended for Smart Grid Page 4 2013 Quanta Technology LLC Page 4 Ethernet LAN recommended for Smart Grid applications. Standard protocols DNP3/IEC 60870-5 and Modbus serial links or Ethernet LAN. Smart Grid standards DNP3 and IEC 61850. 3 Relay data for SCADA/EMS Capabilities of new P relays: Fast response & fresh accurate data. DNP3 and Modbus on RS-485 serial or Ethernet ports. p IEC 61850 MMS server-client functions. IEC 61850 GOOSE high-speed publish/subscribe of status, metered analogs, synchrophasors. IEEE C37.118 synchrophasor streaming. Trial in 2012 61850-90-5 high security WAN Page 5 2013 Quanta Technology LLC Page 5 Trial in 2012 61850 90 5 high security WAN synchrophasors and wide-area GOOSE. S b t ti Control centers - EMS & SCADA Planning & models Management Goal 2 - Enterprise information reliability & economic benefits Substation LAN CORPORATE WAN with firewalls & push servers Integrate relay data communications to the enterprise Dashboard Asset M t Maintenance Page 6 2013 Quanta Technology LLC Page 6 servers Substation LAN Databases & back office applications for organizational users Management Protection & Control Engineering & models 4 Relay data for non-operational users Goal 2: Use the same communications facilities to get non- operational data to the enterprise: Fault location, outages, failures, and system maintenance maintenance. Fault and disturbance recordings, event logs. Relay and IED self monitoring and failure reporting for condition based maintenance in NERC PRC-005-2. Performance statistics - protection & communications system management. Page 7 2013 Quanta Technology LLC Page 7 system management. Power apparatus monitoring by relays and IEDs. Measurements for trending system operations planning, engineering, and protection. Substation revenue metering. Protection & control over Ethernet LAN Goal 3: Replace control wiring with messages on data networks. Substations & systems with IEC 61850 GOOSE messaging on optical Ethernet GOOSE messaging on optical Ethernet LANs in service. Carry status & control points, including tripping and lockout. High-speed analog values capability. M & l l i l i Page 8 2013 Quanta Technology LLC Page 8 Messages & relay logic replace wires, control switches, lockout switches. Dramatic wiring reduction in the station. Can be faster than wiring. 5 Sampled Values service on process bus Goal 4: Replace switchyard/facility wires with a few optical fibers. Eliminate conventional cables and surge/EMI pickup Page 9 2013 Quanta Technology LLC Page 9 Eliminate conventional cables and surge/EMI pickup. Move some measurement and control closer to the power apparatus. Move the relays away from the apparatus. Why focus on Ethernet communications? Important Ethernet networks bi ti f i d carry any combination of mixed traffic types, protocols, services Network tools to manage & prioritize mixed traffic. Modern Ethernet switches end old concerns about non- deterministic network traffic with collisions. Mission critical electric tilit /ind strial applications in ser ice Page 10 2013 Quanta Technology LLC Page 10 Mission critical electric utility/industrial applications in service. Extra network capacity gets cheaper rapidly. Development of IT is crowding out other approaches. 6 Big standard, evolving for 18 years and still going... 10 original parts now in Edition 2, plus >23 new parts! Multiple services not a monolith: IEC61850 Communicationnetworksand systemsforpowerutilityautomation Multiple services not a monolith: Server-client design for Ethernet networks. Application layers for utility/industrial system application. High speed protection, control, and sampled data streaming services. System-wide data and control services and methods. Single international standard for power system communications. N t j t t l i l d f ti d li t d d Page 11 2013 Quanta Technology LLC Page 11 Not just a protocol includes function modeling standards. Recognized by DOE & NIST as a Smart Grid communications backbone NIST Smart Grid Interoperability Panel (SGIP) Category of Standards (CoS) listing. What is IEC 61850? A single international Ethernet based standard data communications protocol & model structure with services and features aimed at protection and control requirements: Relay/IED measurement & control exchanges with substation hosts RTUs, concentrators, HMIs client-server objects. High-speed status, control, analog value transfer over LAN to eliminate control wiring GOOSE messaging. Switchyard/switchgear data acquisition and apparatus control sampled values (called process bus). Services for time synchronization (SNTP - obsolete), file transfer (FTP). Reporting and configuration services Page 12 2013 Quanta Technology LLC Page 12 Reporting and configuration services. Standardized automatic configuration of substation IEDs (SCL). New wide-area communications services. Vision of a complete solution to replace existing diverse protocols and communications systems. 7 IEC 61850 is not just a protocol on a wire A modeling approach, a system architecture, and a protocol. Multiple services. Models for P&C functions & Ti Switchyard sampled value streaming IEC 61850 Architecture High-speed GOOSE control messaging TCP/IP Ethernet LAN/WAN Standardized configuration process points Page 13 2013 Quanta Technology LLC Page 13 Time synch with SNTP COMTRADE Fault records TCP/IP, UDP/IP, Layer 2 multicast US approach UCA
2 1994 Evolution of IEC 61850 DNP3 becomes IEEE 1815 & stays strong European The international goal agree on a single standard US approach UCA 2 1996 One standard IEC 61850 2000-2012 May 2000 Asheville, NC Page 14 2013 Quanta Technology LLC Page 14 European experience IEC 60870-5 IEC 60870-6 IEC 61850 UCA 2 & IEC 61850 merge IEC 60870-5 vendors shifting support away 8 IEC 61850 wiring reduction Integrated P&C system using fiber optic network cables Ethernet Conventional point to point wiring Standard objects Page 15 2013 Quanta Technology LLC Page 15 objects, models, & point descriptions Be careful the wiring goes away, but not the complexity... Part 1: Introduction and Overview Part 7-4: Compatible Logical Node Classes and Data Classes Part 7-3: Common Data Classes Part 7-2: Abstract Communication Services System Aspects Part 2: Glossary Part 3: General Requirements Part 4: System & Project Management Data and Services Model IEC 61850 Edition 1 Documents Configuration Mapping to Ethernet Interface (ACSI) Part 7-1: Principles and Models Part 4: System & Project Management Part 5: Comms. Requirements for Functions and Device Models Part 8-1: Mapping to MMS and ISO 8802-3 (Ethernet) Part 9-1: Sampled Values over Serial Unidirectional Point-to-Point link Part 6: Configuration Description Language for Communication in Electrical Substations Page 16 2013 Quanta Technology LLC Page 16 Part 10: Conformance Testing Technical Report / Specification using ISO 8802-3 (defunct) Part 9-2: Sampled Values over ISO 8802-3 Test Electrical Substations International Standard (IS) 9-2 LE: UCA Implementation Agreement for merging units in switchyards (LE = Lite Edition) 9 IEC 61850 as multivendor standard Aims for integration of multiple vendors devices. Each product has its own list of implemented services and features. Conformance a product is tested to validate that its included services conform to standard specs. Vendor gets KEMA, TV SD, etc. certificate. Interoperability two or more products actually exchange information (no certification yet). Page 17 2013 Quanta Technology LLC Page 17 exchange information (no certification yet). Be aware of compliant creativity, generic modeling shortcuts. Will products actually interoperate? Performance a system of products performs the application properly (no certification yet). OSI 7-Layer Communications Stack Layer Name Function 7 Application Meaningofthedata(utilityuserspecifics) 6 Presentation Buildingblocksofdataandencryptionforsecurity 5 Session Openingandclosingspecificcommunicationspaths 4 Transport Errorchecking 3 Network Determiningthedatapathswithinthenetwork 2 Li k i i d d i i h k Page 18 2013 Quanta Technology LLC Page 18 2 DataLink Datatransmission,sourceanddestination,checksum 1 Physical Signallevels,connections,wires,fiber,wireless 10 MMS IEC 61850 Applications A li ti P fil IEC 61850 profile or stack - client-server exchanges ISO CO Session ISO CO Presentation TCP IP RFC1006 - ISO TP0 Application Profile Transport Profile Page 19 2013 Quanta Technology LLC Page 19 Ethernet Fiber, Twisted Pair Cu p Client - server Sampled Application (Objects,Services) IEC 61850 Communications stack mappings Client - server communications GOOSE Sampled Values High-speed messaging on LAN skip WAN layers and processing MMS Mapping Page 20 2013 Quanta Technology LLC Page 20 Ethernet Link Layer (with Priority, VLAN) Ethernet 100 MB/s Fiber aye s a d p ocess g delays TCP IP GOOSE& SampledValues: Layer2multicast 11 IEC 61850 Station Bus protocol services SCADA Stationbusmappings(81) ForSCADA,protection,control,and informationfortheenterprise Obj t MMS d TCP/IP l Station Bus Substation Host ObjectsonMMSandTCP/IPlayers GOOSE(onDataLinklayer2) Timesynch(SNTP)[LaterIEEE 1588/C37.232] Page 21 2013 Quanta Technology LLC Page 21 Relay 3 IED2 Relay 1 MU - VT MU - CT Process Bus IEC 61850 server-client object services The bulk of the standard (Parts 7-1, -2, -3, -4; new 7- 5, new applications) describes object modeling methods. In general, relays and IEDs are servers; higher-level computers and systems are clients. Data messages include point descriptions or semantics self-identifying. Products are self-describing aimed at making configuration faster and easier than with manual point Page 22 2013 Quanta Technology LLC Page 22 configuration faster and easier than with manual point maps used with other protocols (Substation Configuration Language, Part 6). 12 Object models - logical groupings Data Logical Device LN2 (MMXU) LN1 (XCBR) Pos A Ph 1 Ph 2 StV q Logical Device (1 to n) Logical Node (1 to n) Data Class Data Page 23 2013 Quanta Technology LLC Page 23 Physical Device (network address) Physical Device (network address) (IED1) Physical Device A single name always used for a particular function. E h b i f i h Logical Node (LN) Each substation function may use one or more other logical nodes to perform its job (e.g., distance protection needs measurements from logical nodes CT and VT). Page 24 2013 Quanta Technology LLC Page 24 13 L: system LN (2) M: Metering and measurement (8) P: protection (28) S: Sensor and monitoring (4) R: protection related (10) X: switchgear (2) Logical node groups C: control (5) T: instrument transformers (2) G: generic (3) Y: power transformers (4) I: interfacing and archiving (4) Z: further power system equipment (15) A: automatic control (4) Examples of Logical Nodes (LNs): Page 25 2013 Quanta Technology LLC Page 25 p g ( ) PDIS: Line distance protection PDIF: Differential protection CSWI: Switch controller RBRF: Breaker failure MMXU: Measurement unit XCBR: Circuit breaker YPTR: Power transformer Disconnect sw. Q9_L1/XSWI Grounding Switch Q8_L1/XSWI Logical Nodes (LN) Control Q0/CSWI Q8/CSWI Q9/CSWI Bay-HMI IHMI Page 26 2013 Quanta Technology LLC Page 26 Primary equipment Control house equipment Distance Protection PDIS Circuit Breaker Q0_L1/XCBR Gas density monitoring Q0_L1/SIMS 14 Accessing data PTOC RREC + + IED1/XCBR.Pos IED1 Tree view Mode (Mode) Beh (Behavior ) Health (Health) Name (Name plate) Loc (Local operation) EEHealth (External equipment) EEName (External equipment name plate) O C t (O ti t ) + + + + + + + XCBR - Page 27 2013 Quanta Technology LLC Page 27 OperCnt (Operation counter) Pos (Switch position) BlkOpen (Block opening) BlkClos (Block closing) ChMotEna (Charger motor enabled) CBOpCap (Circuit breaker operating capability) POWCap (Point On Wave switching capability) + + + + + + + Accessing data Mode (Mode) + XCBR PTOC RREC + + - IED1/XCBR.Pos.stVal IED1 Mode (Mode) Beh (Behavior ) Health (Health) Name (Name plate) Loc (Local operation) EEHealth (External equipment) EEName (External equipment name plate) OperCnt (Operation counter) Pos (Switch position) + + + + + + + + - Page 28 2013 Quanta Technology LLC Page 28 ( p ) ctlVal stVal pulseConfig operTim q more intermediate-state (0) off (1) on (2) bad-state (3) 15 Helpful explanation of 61850 modeling By Karlheinz Schwarz Page 29 2013 Quanta Technology LLC Page 29 By Karlheinz Schwarz, Netted Automation GmBH See http://www.nettedautomation.com/qanda/iec61850/information-service.html#Q1 Example: Substation (S151) Voltage level (E1) Bay (Q3) Physical Device (BC) Logical Device (CTR) Hierarchical standard object naming <prefix> <Logical Node> <instance> Data description (from common data class, CDC) Attribute the current value In MMS notation: S151E1Q3 $ BCCTR $ Q0XCBR1 $ Pos $ ST$ stVal Interpretation: (Substa-V-bay) . (Physical box, and functional l i hi h h b k i ) (I f B k Page 30 2013 Quanta Technology LLC Page 30 element within that has breaker image) . (Image of Breaker Q0) . (Data name Pos is position value) . Functional Constraint ST (a momentary status report only) . [the status value report transition, open, closed, invalid] 16 LN example control, breaker, voltage reg. Page 31 2013 Quanta Technology LLC Page 31 Note generic LNs manual config. versus std. defined LNs supporting auto config. Time synchronization IEC 61850 specifies simple network time protocol (SNTP) from the IT world. Accuracy assured only within a few milliseconds y y (although some claim better recently). Requirement for time stamping of events and oscillographic records is 1 ms (from NERC, for event analysis) Requirement for time synchronization of waveform Page 32 2013 Quanta Technology LLC Page 32 equ e e t o t e sy c o at o o a e o sampling for process bus merging units is 1 to 10 microseconds, tighter for synchrophasors. 17 Time synchronization The practical solution wired IRIG-B or fiber connections of time synchronization signals directly from GPS clock IED to IEC 61850 servers and clients. Same as non-61850 practice Leaves a few wires in an otherwise clean design IEEE 1588 a new standard for time synchronization on a LAN with sub-microsecond accuracy IEC 61850 profile started at IEEE PSRC WG H7. PC37 238 IEEE 1588 Profile for Protection Applications Page 33 2013 Quanta Technology LLC Page 33 PC37.238 IEEE 1588 Profile for Protection Applications Configuration with 61850-6 SCL tools Unified configuration of entire facilities via XML file process even over wide area. Not exactly plug-and-play. Page 34 2013 Quanta Technology LLC Page 34 Functional specifications & design standards 18 Some configuration tools Siemens DIGSI (oldest) GE EnerVista (umbrella for many functions; SCL added) SEL AcSELerator Architect ABB ITT Integrated Toolset (recent benchmark, but only ABB) Applied Systems Engineering (ASE) Visual SCL Triangle Microworks SCL File Editor, Anvil, Forge Kalkitech SCL manager Helinks (from 61850 developers) Page 35 2013 Quanta Technology LLC Page 35 Grid Smart 61850easy handy diagnostics Tools are biggest challenge area of active work and user complaints. 2 - GOOSE Messaging and Networks Protection and Control Communications with IEC 61850 Eric A. Udren WSU Hands-On Relay School March 2013 19 Fast relaying over Ethernet LAN From Part 1 - Goal 3: Replace control wiring with messages on data networks. Logic in the relays exchanges messages over Logic in the relays exchanges messages over high speed redundant optical LANs to replace wires, control switches, lockout switches. Dramatic wiring reduction in the station. Many installations designed with IEC 61850 GOOSE messaging on LANs are in service. Status points control including tripping and Page 37 2013 Quanta Technology LLC Page 37 Status points, control including tripping and lockout, high-speed analog values. Can be faster than wiring. Role of IEC 61850 GOOSE messaging IEC 61850 GOOSE messaging provides: High-speed peer-to-peer transfer of status/control bits (reporting contact state over a wire) or analog values including synchrophasors for protection and control. GOOSE messaging plus programmable logic in relays and IEDs replaces panel wiring and controls. Benefits wiring and control elimination, panel and floor space reduction, less equipment overall in P&C system, continuous monitoring and management of the system design (wiring) Page 38 2013 Quanta Technology LLC Page 38 monitoring and management of the system design ( wiring ). Works with other IEC 61850 services, or without them (e.g., with 60870-5 or DNP3 polling for SCADA) 20 61850 GOOSE and GSSE messaging Generic Object Oriented Substation Event. A relay or IED can send a y sequence of control, status point, or analog value messages to replace control and measurement signals on dedicated wires. Not just a single message to request remote action A process to continuously send intended state from Page 39 2013 Quanta Technology LLC Page 39 A process to continuously send intended state from transmitting IED like a contact that picks up and drops out at critical moments. Even if a subscribing (receiving) relay is just powered up, it can get updated status it needs. GOOSE Protocol in 61850-8-2 Application layer directly accesses link layer for speed no TCP/IP Uses Ethernet frame directly with Priority/VLAN 802.1Q tag Use priority 4 due to criticality or messages. VLAN use is optional. p Fields in payload - source ID, status bits, analog values, time stamp, sequence number, time to live, quality bits, test modes. Typical packets 200 300 bytes long. Ethertype (8100 = Ethernet Page 40 2013 Quanta Technology LLC Page 40 21 Publisher-subscriber exchange: Each relay publishes a continuous stream of packets with values that others might need. Overview of GOOSE messaging Any other relay or IED can subscribe to (view contents from) the streams it needs. Publisher just talks does not know who subscribers are, or whether they got the messages in the stream. Page 41 2013 Quanta Technology LLC Page 41 Overview of GOOSE messaging AdaptiverateofGOOSEmessagetransmission: Time values are examples in standard manufacturers vary. Some let you set base heartbeat rate and acceleration profile. Heartbeat reports values during quiescent times: Communications monitoring by all subscribing relays Page 42 2013 Quanta Technology LLC Page 42 Communications monitoring by all subscribing relays. Update of latest status in case of any relay on the LAN that was just turned on. Modern LAN with Ethernet switches handle all the messages even for a worst-case power system event. 22 GOOSE packet rates SEL example, set 1 s heartbeat: Message b Intervalfrom i Time k GE UR V5.70 example: number previous,ms mark,ms 1 N/A 0 2 4 4 3 8 12 4 16 28 5 32 60 6 64 124 Page 43 2013 Quanta Technology LLC Page 43 6 64 124 7 128 252 8 256 508 9 512 1 s Did the GOOSE messages arrive? Publisher-subscriber exchange: Unconfirmed service, backed up by: Constant repetition or updating Constant repetition or updating. Redundancy in LAN and relaying architecture. Monitoring and alarming by subscriber IEDs that fail to receive publishers message stream call maintenance for Page 44 2013 Quanta Technology LLC Page 44 repair. Wires cannot continuously monitor themselves as GOOSE messages can do! 2011Penwell&Quanta TechnologyLLC 44 23 Analog GOOSE messaging Concept - send analog values with same millisecond exchanges as for status or control points. Change events defined by settable measurement Change events defined by settable measurement deadband. Page 45 2013 Quanta Technology LLC Page 45 Multiple values in one GOOSE packet. Analog GOOSE messaging Products today: Send analog values at a fixed slower rate 100 ms or 250 ms not as useful for relaying as GOOSE t t i t status points. Some will send values at rate driven by status points in message, but analogs are repeated and updated every 100 to 500 ms. NEW: publish synchrophasor values at a rate of 2 to 4 per second (GE and SEL) - Synchrophasor time Page 46 2013 Quanta Technology LLC Page 46 4 per second (GE and SEL) Synchrophasor time tags in packets. Ask vendor how to get at GOOSE time tag not the same as synchrophasor time tag. This GOOSE is too slow for high speed WAMPAC. 24 Speed of GOOSE messaging GOOSE message control can be faster than a wired connection! Save 1-4 ms. How? A wired trip signal goes through: The relay processor output program loop delay. Output delay of hardware interface to wires. Input debounce filter delay of receiving relay. Signal waits milliseconds for the input processing Page 47 2013 Quanta Technology LLC Page 47 g p p g program logic loop to notice it and react. GOOSE message bits are sent and read directly between relay processors with microsecond Ethernet delays. Products vary ask manufacturer, or test. Electromechanical lockout switch drawbacks Adds 1 cycle operating time. Funnels wiring from bus full of breakers into one panel location. A lot of wiring. Wiring reflects and must adapt to changes in substation topology or relaying philosophy. Rarely operates in normal service j d d t t i Page 48 2013 Quanta Technology LLC Page 48 some jam and dont trip. Dangerous testing challenge - NERC says test it. Big cost adder to scheme deterrent to differential relay use. 25 Distributed lockout with GOOSE Each relay with relevant breaker control keep track of lockouts in effect, by logic programming. Relays are coordinated by the lockout initiating relay, or b t ti t l k t it f ti by a station computer lockout monitor function. Each relay has a nonvolatile memory of lockout state (some use mechanically latched output relays). Uses messaging capabilities already in new relays. No extra wiring or cost. Page 49 2013 Quanta Technology LLC Page 49 Self monitoring feature eliminates testing problem. As fast as direct tripping. See 2009 NETAWorld article by Myrda, Donahoe, Udren for design example. Ability to trip is monitored End-to-end check of GOOSE communications: Transformer relay publishes a GOOSE message including a bus breaker trip bit. Normal-state message (do not trip) is generated every second by DSP in transformer relay. Passed through communications network to bus relay DSP Bus relay DSP alarms if no-action message disappears. Wires cannot check themselves this completely! Line Relay Bus Relay System A Page 50 2013 Quanta Technology LLC Page 50 System A System A Xfmr Relay System A Monitor IED System A Ethernet Switch System A 52 TC 26 Engineering of mission Redundant station bus for IEC 61850 GOOSE messaging Engineering of mission critical substation Ethernet network No single point of failure within each of dual redundant LANs. Use relay primary and f il ti l Eth t Page 51 2013 Quanta Technology LLC Page 51 failover optical Ethernet ports. Dual switches and paths for GOOSE messages. Multicast GOOSE messages have no destination address Designed to stay within a LAN or Virtual LAN. Do not pass through routers to the WAN or other LANs. GOOSE and wide area networks But routers make secure bridged connection between two LANs separated by a WAN works like one big LAN. Useable for transfer tripping, monitoring, control or load mitigation via WAN. Need cyber security VPN, firewalls, etc. Slows down messaging today 20 ms getting faster Page 52 2013 Quanta Technology LLC Page 52 Slows down messaging today 20 ms, getting faster. See IEC 61850-90-1 for teleprotection over WAN examples. See 61850-90-5 for new GOOSE streaming over WAN. 52 2013QuantaTechnology,LLC 27 Settings management Need a closed-loop business process that initiates and tracks all installation and updating of setting records. Communicates with the IEDs themselves (over WAN is future method) to check consistency between the data base and the installed settings and firmware. Need a convenient way of installing settings within the management system in every use case. Firmware update, maintenance check, operating emergency, relay replacement, etc. New software data base tools can connect with tested d i t t i t d f t Page 53 2013 Quanta Technology LLC Page 53 devices, test equipment, and enforce management processes OMICRON, EnoServ, IPS, others. This is a big need for all 61850 services and systems, and all new complex relays and IEDs! Using 61850 services on the LAN Use client-server exchanges of standard defined objects for metering, status, control, and IED configuration. Metering and status via polling or report-by-exception. No visible impact on installation benefit is drive to easy No visible impact on installation benefit is drive to easy engineering and maintenance. DNP3 can perform similar role with familiar manual point configuration lists. GOOSE messaging and Sampled Values service get rid of conventional control wiring among relays, IEDs, power apparatus design commitment; visible change. Page 54 2013 Quanta Technology LLC Page 54 DNP3 has no high speed data or control ability like GOOSE or Sampled Values New 90-5 R-GOOSE and R-SV over WAN. LAN can carry mixed traffic e.g. DNP3 metering and status, non- 61850 legacy device traffic, plus GOOSE for wiring elimination. 28 Protection and Control Communications with IEC 61850 3 - Recent Developments in IEC 61850 Eric A. Udren WSU Hands-On Relay School March 2013 IEC 61850 is living and growing IEC 61850 Edition 1 the seed 1700 pages IEC 61850 Edition 2 IEC 61850 Edition 2 International application improved models Expanded structure Improved clarity TISSUES (b ) l d Page 56 2013 Quanta Technology LLC Page 56 TISSUES (bugs) cleared New practical features New application domains 29 IEC 61850 is branching New parts of IEC 61850 Expanding outside the substation Between substations Between substations To control centers Communications and application modeling across the entire power system Integration with enterprise systems Page 57 2013 Quanta Technology LLC Page 57 systems Interfaces with popular SCADA and control protocols Wide-area high-speed data & control services with security What is new in Edition 2 of existing parts? Clarifications and corrections (TISSUES) Modeling Power Quality Statistical evaluation of information New models for mechanical equipment and measurements of non-electrical quantities New features for testing support Support for exchange of engineering information for configuration across projects and between facilities Page 58 2013 Quanta Technology LLC Page 58 configuration across projects and between facilities Redundancy possibility to have IEDs with dual connections 30 Testing improvements Edition 1 required expedient user construction of testing facilities (mainly with GOOSE). Edition 2 /f f Mirroring/feeding back control information Isolation of functions in service Interlocking test methods Page 59 2013 Quanta Technology LLC Page 59 IEC 61850 new parts New facilities modeling: IEC 61850-7-410 Hydroelectric power plants Communication for monitoring and control IEC 61850-7-420 Communication Systems for Distributed Energy Resources (DER) IEC 61850-7-500 /-7-510 (Technical Reports) Explains how to use the concepts of IEC 61850 to model applications Page 60 2013 Quanta Technology LLC Page 60 IEC 61400-25-x Communications for monitoring and control of wind power plants 31 More new parts under development Part 7-5 - defines the usage of information models for substation automation applications - examples on how to apply logical nodes from 7-4 for various applications. Part 7-10- web based IEC 61850 models More consistent implementations than those from programmers reading paper documents. Part 100-1 - Methods for functional testing in IEC 61850 based systems. Configuration management of IEC 61850 based systems Page 61 2013 Quanta Technology LLC Page 61 Configuration management of IEC 61850 based systems Mappings for gateways IEC 61850-80-1 Guideline for exchange information from a common data class (CDC) based data model using IEC 60870-5 Station Controller & Gateway 60870 61850 data model using IEC 60870 5 IEC 61850-80-2/IEEE 1815.1 Exchanging Information between networks implementing IEC 61850 and IEEE 1815 (DNP3) DNP Master DNP Outstation Bay Controller 61850 Protection 61850 Page 62 2013 Quanta Technology LLC Page 62 (DNP3) Just starting IEEE C37.118 synchrophasors to IEC 61850-90-5 synchrophasors at PSRC IEC 61580 Client IEC 61850 Device IEC 61850 Device IEC 61850 Device IEC 61850 Device Gateway 32 How to address new areas? Technical reports explain How to use IEC 61850 for... Technical reports describe: The use cases considered The impact on the communication The impact on the modeling The impact on the engineering Results will be used to update the standards later. ( d t diti ) Page 63 2013 Quanta Technology LLC Page 63 (amendments or new editions) Technical reports (not standards) IEC 61850-90-1: Using IEC 61850 for communication between substations (published) IEC 61850-90-2: Using IEC 61850 for communication b t b t ti d t l t between substations and control center IEC 61850-90-3: Using IEC 61850 for condition monitoring IEC 61850-90-4: Network engineering guidelines IEC 61850-90-5: Using IEC 61850 to transmit h h i f ti di t IEEE C37 118 Page 64 2013 Quanta Technology LLC Page 64 synchrophasor information according to IEEE C37.118 Really important how to stream sampled values, synchrophasors, or GOOSE messages over WAN with security using standard IT services 33 90-1 on interstation communications 61850 communications, modeling/semantics, & system engineering across stations need Ethernet communications. GOOSE needs LAN, or equivalent Ethernet between stations: Wideband direct interfaces of LANs Tunnel that filters and directly passes packets over WAN Gateway that acts as a proxy for packets e.g. teleprotection device Ethernet LAN/WAN configuration advice Station A Station B ? ? Teleprotection equipment acting as gateway ? Page 65 2013 Quanta Technology LLC Page 65 Function A1 Function A2 Function B1 Function B2 Transparent Tunnel ? ? Proxy B1 ? 61850-90-2 and 90-3 90-2 - Using IEC 61850 for the communication between substations and control centers in development 90-3 Condition monitoring of primary power apparatus communications & asset management requirements: Transformers, LTCs GIS Lines, UG cables Sta. batteries Page 66 2013 Quanta Technology LLC Page 66 34 Part 90-4 - Network Engineering Guidelines Ethernet network& physical layers were black box you make it work. Now comprehensive guidance on reliable network design. Page 67 2013 Quanta Technology LLC Page 67 Part 90-4 - Network Engineering Guidelines Layer 2 redundant network paths for protection messages Short-bump or bumpless rerouting for segment failures 62439-3 Parallel Redundancy Protocol (PRP) 2 LANs 62439-3 High availability Seamless Redundancy (HSR) Rapid spanning tree protocol (RSTP) from IT and redundancy simple and fine! DANH CPU DANH CPU source A-frame (HSR) B-frame (HSR) destinations C-frame D-frame DANH CPU DANH CPU switch RedBox singly attached nodes interlink Page 68 2013 Quanta Technology LLC Page 68 DANH CPU DANH CPU DANH CPU DANH CPU DANH CPU DANH CPU DANH CPU DANH CPU DANH CPU DANH CPU destinations 35 90-5 WAN synchrophasor transport Sampled Value or GOOSE publish/subscribe across the WAN useful way beyond just synchrophasors. Add layer 3 transport UDP/IP unicast or multicast (unconfirmed efficient stream of data packets not like slow, confirmed TCP/IP) p , ) Routers can search for subscribers and establish routes dynamically using Internet Group Management Protocol (IGMP) V.3, a standard IT router service. New - a big deal end-to-end authentication in the packet! SHA-2 authentication hash code - computed in real time. Needs new PMU/relay platforms/processors to compute Page 69 2013 Quanta Technology LLC Page 69 Needs new PMU/relay platforms/processors to compute authentication hash code (coming in 2012). Industry standard Group Domain of Interpretation (GDOI) security key distribution/management. Packet encryption specification can be done in routers. WG17 technical reports - SG integration IEC 61850-90-6: Using IEC 61850 for distribution automation. IEC 61850-90-7: IEC 61850 object models for photovoltaic, storage and other DER inverters. IEC 61850-90-8: IEC 61850 object models for electrical vehicles. IEC 61850-90-9: IEC 61850 object models for battery storage systems. IEC 61850-90-10 DER scheduling. IEC 61850-90-11 Modeling of Page 70 2013 Quanta Technology LLC Page 70 IEC 61850 90 11 Modeling of programmable logic per IEC 61499. IEC 61850-90-14 Modeling of FACTS power controllers 36 IEC 62445-2 Standard for communications between substation and control center. C C f C Other standards projects supporting IEC 61850 IEC 62351-6 - Cyber security structure for IEC 61850. Harmonize data models of IEC 61968 Common Information Model [formerly EPRI CIM] and IEC 61850. Page 71 2013 Quanta Technology LLC Page 71 Product development 61850 compliant relays and IEDs are widely available. Its been a long expensive road for manufacturers they are committed to development. See http://www.ucausersgroup.org/ for list of compatible d t d th i f ti products and other information. In early 2012 lots of servers (relays), growing choices for clients (substation hosts), emergence of commercial process bus (sampled data) systems based on IEC 61869-9. Learn status at UCA International Users Group http://sharepoint.ucausersgroup.org/default.aspx Reports and related standards developments at IEEE Power S t R l i C itt (PSRC) ti Page 72 2013 Quanta Technology LLC Page 72 System Relaying Committee (PSRC) meetings http://www.pes-psrc.org/ Articles in PACworld magazine http://www.pacw.org/home.html 37 IEC 61850 supported in products Embeddable stacks for sale to IED manufacturers Triangle Microworks and SISCO. Supported by IED manufacturers SEL, GE, Siemens, ABB, Alstom Grid/Schneider, ZIV, RFL, Ametek Pulsar, others. R l t t t f t i t d i 61850 d t Relay test set manufacturers introducing 61850 products OMICRON, Doble, Megger, others. Industry-standard conformance testing program per 61850-10 and UCAIUG program with laboratories. Substations with significant 61850 in North America since 2005 going into design standards at large utilities. Used in critical special protection schemes. Page 73 2013 Quanta Technology LLC Page 73 IEC 61850 versus DNP3 DNP3 Pros IEEE 1815 standard, long complete (according to its own targets) Widely sold and used IEC 61850 Pros Single international Smart Grid integration standard suite All required services All major vendors support Widely sold and used. Debugged, stable Supported by Users Group DNP3 Cons No high speed control or data services, Just for SCADA High-speed control (GOOSE) and process data (Sampled Values) including wide-area and security Models the functions for automated integration process (little hand configuration) Supported by Users Group IEC 61850 Cons Integration tools have been work in progress Page 74 2013 Quanta Technology LLC Page 74 Just for SCADA Manual configuration of points and data types takes time. Mostly North American Integration tools have been work in progress for a long time Interoperability work in progress Big product development effort, depending on scope focus. Design for usability and maintenance is an area of opportunity 38 Troubleshooting Ethernet/61850 systems Function level monitoring - program the relay logic to report data sent/received catches most problems! This is an IT network. Basic tools for Ethernet networks e g WireShark Basic tools for Ethernet networks e.g., WireShark Protocol-specific tool examples: Applied Systems Engineering DNP3 Analyzer SMC 61850 GOOSEMeter (hand tool) 61850Easy configuration/troubleshooting tools SISCO AXS4MMS Client - analyzer for relays (servers). Page 75 2013 Quanta Technology LLC Page 75 SISCO GOOSE Blaster simulator NetScout network traffic monitoring for GOOSE Most important design functional test features into the logic. 61850 progress Massive standard growing beyond 2000 pages (users dont need to read all this). Continuing development and issue resolution among vendors users and standards developers vendors, users, and standards developers. Edition 2 and new parts of 61850 are being published. Supported by todays major relay vendors. Paper and article traffic reaching saturation level. Varying interpretations by vendors require industry conformance test program Page 76 2013 Quanta Technology LLC Page 76 conformance test program. 61850 reaches inside the devices there are problems get experienced guidance for standard development. DNP3 remains a widely used client-server protocol that works on Ethernet (hand point map; no GOOSE). 39 Steps of typical IEC 61850 project Each utility has unique organization and needs 1. Data gathering engage all stakeholders up front! 2. Develop specifications. 3. Develop Request for Information (RFI) with specs. p q ( ) p 4. Conduct RFI & process get back a practical plan? 5. Business case - justify proceeding? 7. Full specifications. 8. RFP & vendor selection for trial standard system. 9. Detailed design with vendors. 10. Organizational design and preparation. Page 77 2013 Quanta Technology LLC Page 77 10. Organizational design and preparation. 11. Development lab, training facilities. 12. Field trials. 13. Standards development; procedures and documentation. 14. Interface systems to the utility enterprise. Protection and Control Communications with IEC 61850 4 - Sampled Values Service & Process Bus Eric A. Udren WSU Hands-On Relay School March 2013 40 Sampled Values service for process bus If a LAN can carry critical relaying traffic in the control h it d t d house, can it carry data and control between the switchyard and the control house? Goal 4: Replace switchyard wires with a few optical fibers. Eliminate conventional cables and surge/EMI pickup. Move some measurement and control out to the yard, closer to the power apparatus Page 79 2013 Quanta Technology LLC Page 79 power apparatus. Just a few wires left - we still have to get dc and station service power out to the yard. Process bus Voltages, currents, and status sampled near the source and converted directly to Ethernet packet stream. Multiple sample sets per packet for data transmission efficiency. Support trend towards intelligent power apparatus - relays, metering, control IEDs installed directly in the power apparatus, even in the factory. Reduce field wiring cost. Cut wiring losses and burdens. Add field signals without new wiring to control house. Page 80 2013 Quanta Technology LLC Page 80 41 Process Bus concept P 1 OR MORE A/D Sub- system CTs, VTs LP FILTER LP FILTER LP FILTER LP FILTER M U X SAMPLE AND HOLD Ethernet Network Communications If we cut a microprocessor based relay in two and put a communications bus between the I/O and the processing... Comm. Controller A/D Sub- system M U X S/H & Filter S/H & Filter S/H & Filter S/H & Filter O/E Substation LAN Control House Switchyard VTs Relay Output Relay Output Relay Output Trip and alarm circuits Contact Inputs Status contacts POWER SUPPLY 125 Vdc Station Battery Supply Page 81 2013 Quanta Technology LLC Page 81 P Comm. Controller P Comm. Controller O/E Relay Output Combining data from diverse locations around the switchyard Process Bus LAN Comm. Controller A/D Sub- system M U X S/H & Filter S/H & Filter S/H & Filter S/H & Filter Relay Output Optical fibers Process bus services in 61850-9-2 Sampled values protocol (on data link layer 2 for speed and simplicity) GOOSE (on data link layer 2 for d d i li i ) SCADA speed and simplicity) Time synch (SNTP) Relay 3 IED2 Relay1 Station Bus Substation Host Page 82 2013 Quanta Technology LLC Page 82 y IED2 y MU - VT MU - CT Process Bus MU = switchyard Merging Unit 42 Line Protection Bus Protection Ethernet Controller Ethernet Controller Merging unit Merging Unit Ethernet Controller IEC 61850-9-2 Process Bus Binary Inputs & Control Outputs Ethernet Switch C37 92 OVT Sample timing synchronization Page 83 2013 Quanta Technology LLC Page 83 with Combined ECT and EVT MOCT fiber EOVT fiber Conventional VTs Conventional CTs C37.92 OCT C37.92 OVT Process Bus Protocol in 61850-9-2 Application layer directly accesses link layer for speed same as GOOSE messaging no TCP/IP Uses Ethernet frame directly with priority/VLAN .1Q tag Use priority 4 due to criticality or messages, same as GOOSE p y y g , VLAN use is optional What goes into the packet payload? Ethertype (8100 = Ethernet Page 84 2013 Quanta Technology LLC Page 84 43 IEC 61850-9-2 frame generic and flexible Octets 8 7 6 5 4 3 2 1 Notes
Preamble
Start of frame 0 1 2
2 3 4 5 Destination address
6 7 8 9 10 11
Header MAC
Source address
Refer to Address Fields section. 12 13 TPID
14 15 Priority tagged
TCI
Refer to Priority Tagging/VirtualLAN section. 16 17 Ethertype
18 Length Start 19 APPID
20 Ethertype PDU Octets 8 7 6 5 4 3 2 1 1 2 TPI D
0x8100 (802.1Q Ethertype)
3 User priority CFI VI D 4 TCI VI D Servi ce Def aul t VI D Def aul t pr i ori t y Page 85 2013 Quanta Technology LLC Page 85 20 21 Length (m + 8)
22 23 Reserved 1
24 25 Reserved 2
26 . m + 26
APDU (of length m)
Ethertype PDU
Refer to Ethertype and Other Header Information section. . .1517
(Pad bytes if necessary)
. . . .1521
Frame check sequence
Servi ce Def aul t VI D Def aul t pr i ori t y Sampled Values 0 4 9-2 LE Implementation Guideline Page 86 2013 Quanta Technology LLC Page 86 44 IEC 61850-9-2 LE Data Set Fixed sampling rates of 80 or 256 samples per power cycle at 50 or 60 Hz. Fixed data frame format Fixed configuration format Page 87 2013 Quanta Technology LLC Page 87 9-2 LE fiber 1 pps synchronizing clock input specs Page 88 2013 Quanta Technology LLC Page 88 45 Unified substation-wide LAN using 9-2 LE Page 89 2013 Quanta Technology LLC Page 89 Chopping up the ring for redundancy Design concept of big ring station/process bus does not separate the zones of protection zones share merging units and communications. Relay engineers are used to separating zones of protection for reliability & failure mode handling. g Another way to apply MUs dedicated merging unit function for each zone, each location, and System A or System B full redundancy and isolation. Page 90 2013 Quanta Technology LLC Page 90 isolation. This takes a lot more equipment but separates zones. 46 Another direction 61850-9-2, but not 9-2 LE GE Multilin HardFiber process bus system. Uses conformant 61850-9-2 sampled values frame. Uses 61850-8-1 GOOSE for sampling synchronization and control . 61850-8-1 GOOSE is not how 9-2 LE synchronizes sampling not compatible with other vendors MUs. Technically thoughtful (an opinion) architecture solution that addresses application concerns: Isolation of protection zones. Isolation of redundant systems. Works ith toda s GE UR rela s Page 91 2013 Quanta Technology LLC Page 91 Works with todays GE UR relays. Each relay drives its own data sampling, as it does conventionally. Tracks system frequency and avoids distance relay polarizing problems. Design includes solutions to installation efficiency and testing issues. GE HardFiber process bus system Weatherproof Brick mounts on apparatus; has four mini merging units inside GE calls them cores. Connect to relays in control house via premade fiber assemblies and weatherproof connectors. eat e p oo co ecto s Page 92 2013 Quanta Technology LLC Page 92 Images courtesy GE Multilin 47 GE HardFiber components GE prefab multiple fiber plus power cable from Brick to SCE relays in SCE facility. Variety of standard lengths up to 500 meters. C il th bl h GE prefab copper cable for field connections CTs, PTs, contacts, trip circuits. Coil the excess cable where convenient. Brick end and indoor end shown. Page 93 2013 Quanta Technology LLC Page 93 Images courtesy GE Multilin GE HardFiber components Indoors: Cross connect panel. Fibers to/from relays. Power from panel to remote Brick via HardFiber cable. Flexible easy patching of Brick Page 94 2013 Quanta Technology LLC Page 94 patching of Brick cores to multiple GE UR relays. Images courtesy GE Multilin 48 GE HardFiber components Process card replaces UR analog/binary input card. A special purpose Ethernet switch connecting multiple brick core fiber signals to the protection processor. NOTE: No network connection is possible to existing UR Ethernet port used for: IEC 61850 GOOSE messages to control center. Relay settings, events, or configuration. Isolated by protection application processors. Cant hack from Brick into substation network. Page 95 2013 Quanta Technology LLC Page 95 Critical CIP compliance help. Image courtesy GE Multilin GE HardFiber system configuration Sampling is triggered by downward GOOSE messages, not 1 pps timing fibers across switchyard. Electronic data sources are not shared across zones or between redundant systems. Page 96 2013 Quanta Technology LLC Page 96 Image courtesy GE Multilin 49 HardFiber interoperability with other vendors? ABB, Siemens, Alstom Grid, SEL used 9-2 LE. 9-2 LE is an implementation id li t t f 61850 t d d guideline, not part of 61850 standard. Brick cannot work in a 9-2 LE system & vice versa. What about multiple vendors and interoperability of 61850? Page 97 2013 Quanta Technology LLC Page 97 2012 - a way out of the impasse Merging unit standards project in IEC TC 38 (Instrument Transformers) IEC 61869-9 Merging Unit Standard. IEC 61869-9 cites 61850-9-2 and chooses specific options one sampling rate only (4 kHz), standard frames, etc. even more specific than 9-2 LE. Eliminates 1 pps fiber time synchronization - IEEE 1588 precision timing protocol (PTP) on the existing Ethernet connection to synchronize samples. Every vendor can adapt its products to work with this standard without big hardware changes. GE and the others said they will adapt to published standard Page 98 2013 Quanta Technology LLC Page 98 GE and the others said they will adapt to published standard. Products interoperate, with flexible architectures. Implementation agreement in drafting. 50 Ngrid UK 400 kV process bus demo Ratcliffe indoor substation Page 99 2013 Quanta Technology LLC Page 99 Switchyard maintenance solution! Page 100 2013 Quanta Technology LLC Page 100 51 Cost effective partial solution Extend the station bus into the switchyard for binary status and control I/O. Put a remote binary I/O relay (SEL 451, GE UR C90+, etc.) in the switchyard for all status and control via GOOSE. Wire only the CTs and CVTs back to the control house. Eliminate 70-80% of switchyard wiring. We can do it right now. Page 101 2013 Quanta Technology LLC Page 101 Solution for NU 61850 EHV P&C design standard. Questions? Page 102 2013 Quanta Technology LLC Page 102 eudren@quanta-technology.com or (412) 596-6959.