The operator interface device for an hmi system provides for generic, simple communication between human-Machine interface (hmi) software and an operator workstation. The device has at least one signaling device, at least one serial communication port, and an ethernet port mounted on a housing. Disposed within the housing is electronic circuitry that includes a microcontroller having embedded ethernet capability. The microcontroller is configured to pass serial data from a bar code reader, RFID receiver, or the like from the serial communication port via ethernet by TCP/IP to the hmi software on a remote server, and to control driver(s) for the at least one signaling device, which may be a beacon, a light, a horn or other audio device, or a push button switch. The device may also include a power supply and miniconnector port for passing signals between a machine controller, such as a torque controller, and the hmi software.
|
1. An operator interface device for a human-machine interface (hmi) system, comprising:
a housing adapted for mounting at an operator workstation;
at least one signal device disposed on said housing;
a serial communication port disposed on said housing adapted for connection to a serial device at the operator workstation;
at least one ethernet port disposed on said housing adapted for connection to a network, the network having a server running hmi software connected thereto; and
a microcontroller integrated circuit chip having embedded ethernet and at least one serial communication interface disposed thereon, the at least one signal device, the serial communication port, and the at least one ethernet port being connected to the microcontroller, the microcontroller being configured to communicate serial communications signals between the serial device and the hmi software by TCP/IP, the microcontroller configured to execute and run the hmi software immediately upon establishing the connection with the serial device, and to interface the hmi software with the at least one signal device in order to communicate messages between the hmi software and a human operator at the operator workstation.
14. An operator interface device for a human-machine interface (hmi) system, comprising:
a housing adapted for mounting at an operator workstation;
a beacon disposed on top of said housing;
a plurality of signal lights disposed on a front face of said housing;
a speaker disposed on said housing;
an RS-232 connector disposed on said housing adapted for connection to a serial device at the operator workstation;
at least one ethernet port disposed on said housing adapted for connection to a network, the network having a server running hmi software connected thereto;
a miniconnector disposed on said housing;
a microcontroller integrated circuit chip having embedded ethernet and at least one serial communication interface disposed thereon, the at least one ethernet port being connected to the microcontroller, the microcontroller being configured to communicate serial communications signals between the serial device and the hmi software by TCP/IP, the microcontroller configured to execute and run the hmi software immediately upon establishing the connection with the serial device;
an RS-232 interface circuit disposed between the RS-232 connector and the microcontroller, the RS-232 circuit having an RS-232 transceiver; and
a light and speaker circuit electrically connected between the microcontroller and the beacon, the plurality of light, and the speaker in order to communicate messages between the hmi software and a human operator at the operator workstation.
17. A method for interfacing an operator workstation with human-machine interface (hmi) software, comprising the steps of:
locating an operator interface device at the operator workstation, the operator interface device having an audio signaling device, a visual signaling device, a pushbutton switch, a serial communications port, and a microcontroller having embedded ethernet and a serial communications interface, the microcontroller being configured to transmit a serial communications signal received at the serial communications port by ethernet to the hmi software;
connecting a serial device to the serial communications port;
connecting the operator interface device to a network communicating by TCP/IP, the hmi software running on a server computer connected to the network, wherein the microcontroller configured to execute and run the hmi software immediately upon establishing a connection with the serial device;
operating the serial device to generate a serial communications signal, the serial communications signal being automatically passed to the hmi software over the network, the hmi software automatically communicating with the microcontroller to generate a control signal in response thereto on the visual signaling device and, optionally, on the audio signaling device;
performing work on a workpiece at the operator workstation in response to the control signal; and
operating a push button in order to signal completion of the work on the workpiece to the hmi software.
2. The operator interface device according to
3. The operator interface device according to
4. The operator interface device according to
5. The operator interface device according to
6. The operator interface device according to
7. The operator interface device according to
8. The operator interface device according to
9. The operator interface device according to
10. The operator interface device according to
11. The operator interface device according to
12. The operator interface device according to
13. The operator interface device according to
15. The operator interface device according to
16. The operator interface device according to
18. The method for interfacing an operator workstation according to
19. The method for interfacing an operator workstation according to
20. The method for interfacing an operator workstation according to
|
1. Field Of The Invention
The present invention relates to control systems for automated commercial and industrial environments, such as a control system for an assembly line, and particularly to an operator interface device for an HMI (Human-Machine Interface) system that provides for simple, generic communication between an operator work station and HMI software running on a server.
2. Description Of The Related Art
Many commercial, industrial, warehouse, and manufacturing establishments resort to automation in order to reduce labor costs and increase efficiency. Automated systems often are computer-controlled. Typically, the computer will be located at a central location and will control a plurality of operator work stations distributed throughout the establishment remote from the central location.
Machines are used to move products and components from one location to another, to assemble products, to package products, and to perform other services related to the nature of the establishment. Human operators may be located at the operator work stations to operate various machines at the work stations, position components, monitor machine processes, and troubleshoot problems that may occur at the remote locations.
A typical model for such a system is the Supervisory Control and Data Acquisition Model (SCADA) model. A SCADA system customarily includes input and output signal hardware connected to the machines, a plurality of Remote Terminal Units (RTU) or Programmable Logic Controllers (PLC) connected to the hardware, a central station running HMI software connected to the RTUs or PLCs, and a communications infrastructure for communicating between the components. The signal hardware will typically include some sort of alarm, either as a horn or other audio device, or in the form of light signals r beacons, or both.
A problem with this approach is that the hardware signal devices and the PLCs or RTUs are custom selected for the particular application. PLCs, for example, were originally developed to replace systems of relays and switches in automation systems, and used simple logic circuits and “ladder logic” of the type that an electrician or electronics technician could follow and program from an electrical schematic diagram. PLCs have advanced to use block programming languages and, in some cases, structured programming languages; nevertheless, PLCs retain their circuit-based roots and still must be customized by an electrician to interface with particular hardware implementations, which is both expensive and time consuming. RTUs suffer from much the same problem.
An automotive assembly line, for example, requires multiple operator workstations, each of which requires input/output signal hardware and a PLC to interface with HMI software, such as GE Fanuc's Proficy® or Cimplicty® HMI software, Allen-Bradley/Rockwell Automation HMI, Wonderware HMI, and the like. At costs in the tens of thousands per workstation for installation of fifty to one hundred work stations per division or per plant, together with the down time when workstations require maintenance, repair, replacement, or upgrading, plant efficiency suffers.
Consequently, there is a need for a generic operator workstation unit for HMI systems that operates directly under Information Technology (IT) control without requiring custom installation. Thus, a hardware interface device solving the aforementioned problems is desired.
The operator interface device for an HMI system provides for generic, simple communication between Human-Machine Interface (HMI) software and an operator workstation. The device has at least one signaling device, at least one serial communication port, and an Ethernet port mounted on a housing. Disposed within the housing is electronic circuitry that includes a microcontroller having embedded Ethernet capability. The microcontroller is configured to pass serial data from a bar code reader, RFID receiver, or the like from the serial communication port via Ethernet by TCP/IP to the HMI software on a remote server, and to control driver(s) for the at least one signaling device, which may be a beacon, a light, a horn or other audio device, or a push button switch. The device may also include a power supply and miniconnector port for passing signals between a machine controller, such as a torque controller, and the HMI software.
The at least one serial port may be an RS-232 port. Assembly lines, parts warehouses, and other industrial establishments frequently use bar code readers, RFID receivers or transceivers, and other devices that communicate with automation control software via the RS-232 standard, so that such devices, sometimes termed legacy devices, are often equipped with RS-232 cables and jacks. Alternatively, or in addition to the RS-232 port, the at least one serial communication port may be a Universal Serial Bus (USB) port for connection with sensors or input/output devices so equipped, or to a printer, touch screen monitor, keyboard, mouse, or other input device located at the operator workstation. In another alternative, the serial port may be a DeviceNet, Seriplex, Modbus, or other serial communication port.
The at least one signaling device may be a beacon, preferably disposed on top of the housing. The beacon may comprise an LED array, and the device may include a circuit to flash the LED array on instruction from the HMI software to indicate an error at the workstation requiring intervention by the human operator. A driver circuit for turning the beacon on is disposed in the housing, and an oscillator or timing circuit for switching the array on and off at the desired frequency may be incorporated into the microcontroller, or may be supplied as a discrete circuit with the LED driver.
The signaling device may be one or more lights, preferably disposed on the front face of the housing, which may also comprise LED arrays with the driver circuitry disposed in the housing. The lights may include, for example in the case of an assembly line, a green lamp to indicate that work on the product at the workstation is proceeding satisfactorily, a light to indicate that a product on the conveyor belt as arrived on station at the operator workstation, a light that may flash or otherwise indicate that a nonstandard or custom part is required for the product currently at the workstation, etc.
The signaling device may be a speaker, horn, or other audio device with driver circuitry disposed in the housing that is switched on upon a signal received by the microcontroller from the HMI software via Ethernet. The audio device may be a speaker driven by a speech processor disposed within the housing, if desired.
The signaling device may include one or more push buttons operable by the human operator to send a signal to the HMI software. For example, a start button may be provided to signal to the HMI software that an error condition has been corrected and the assembly line may be restarted, or a release button to signal that the error cannot be corrected within the time allotted and that the assembly line can be released or restarted, but the product has been removed from the belt or needs to be diverted for further processing at an appropriate juncture in the assembly line.
The miniconnector may be a six-pin connector providing power to, and receiving inputs from, up to four controllers or sensors located at the workstation. The miniconnector is wired to pass discrete input/output signals to and from the microcontroller, which simply passes the signals on to and from the server. The miniconnector may be an M12 connector. The device may have a plurality of miniconnectors mounted in the housing.
The device may include more than one Ethernet port so that a plurality of operator interface units can be cascaded on the network. Alternatively, the extra Ethernet port may be used for connecting anything that may operate by an Ethernet connection to the network, such as a computer, a printer, a sign, etc. A software driver for meshing the operator interface unit with the HMI software provides a rudimentary command structure proper correlation of communications between the HMI software and one or more human interface units, much as a printer driver controls communication between a computer and a printer.
Thus, the human interface device for an HMI system provides a generic communication between a human operator at a remote workstation with the HMI software by IT control, without the need for custom input/output hardware and a custom PLC, RTU, or other intermediate device at the workstation.
These and other features of the present invention will become readily apparent upon further review of the following specification and drawings.
Similar reference characters denote corresponding features consistently throughout the attached drawings.
The operator interface device for an HMI system provides for generic, simple communication between Human-Machine Interface (HMI) software and an operator workstation. A typical application for the device might be at an operator workstation in an assembly line at an automotive manufacturing facility. The device provides for generic communication between a human operator and the HMI software, eliminating the need for custom devices at the workstation that communicate with the HMI software through a programmable logic controller that would also have to be custom programmed.
The device 10 has at least one signaling device, at least one serial communication port, and an Ethernet port mounted on the housing 12. The embodiment of the device 12 shown in
The number of visual signals, their location on the housing 12, their configuration, and the signal being conveyed by illumination of the visual signals may vary within the scope of the invention. Also, as described below, the beacon 14 and/or the signal lights 16 and 18 may flash or pulse to draw the attention of the human operator to the visual signal, or to convey a particular message relating to the state of the assembly line or the product that is currently located at the work station.
The device 10 may include an audio signaling device with a speaker 24 mounted on the front face or front panel of the housing 12 in addition to, or instead of, visual signaling devices. The audio signaling device may simply be a horn or buzzer, or the device 10 may include a speech synthesizer for conveying short, standard voice signals. The audio signaling device may be used in conjunction with the visual signaling device, e.g., the light 18 may illuminate to indicate a product has arrived at the workstation, and the audio signaling device may beep to indicate special processing of this particular product is required.
The device 10 may include a push button 26 disposed on the front face or panel of the housing 12. The push button 26 may be used by the human operator to signal to the HMI software that an error condition at the workstation has been cleared, a required task has been accomplished, or that the error condition cannot be cleared in a time allotted for the task so that the assembly line should be released for continued operation with the product either being removed from the assembly line at the workstation or marked for diversion at an appropriate junction farther down the assembly line. Different messages may be conveyed by providing a plurality of push buttons, or by a particular pattern of pressing the button (number of pushes in a given time period, duration of push, etc.).
The device 10 includes at least one serial communication port. In the embodiment of
The device 10 may further include a miniconnector 30 for connecting a machine controller or sensor to the HMI software. The miniconnector 30 is preferably a six-pin connector providing power to, and receiving inputs from, up to four controllers or sensors located at the workstation. The miniconnector is wired to pass discrete input/output signals to and from the microcontroller, which simply passes the signals on to and from the server. The miniconnector 30 may be an M12 connector. The device may have a plurality of miniconnectors 30 mounted in the housing.
The device 10 includes an Ethernet connector 32 for receiving an RJ-45 jack in order to connect the device 10 the establishment's local area network (LAN) or wide area network (WAN) for providing communication with the HMI software. Ethernet connector 32 may be disposed on the bottom face of the housing. 12. The device 10 also includes a power input connector, such as a recessed male plug 34, for connecting the device 10 to the a.c. power mains. The power input connector 34 may also be disposed on the bottom face of the housing 12. Instead of a recessed male plug 34, the device 10 may have a power cord extending from the housing 12 for connection to the a.c. power mains.
An electrical circuit for providing the device 10 with its functionality is disposed on a printed circuit board or other support within the housing 12. Referring to
A microcontroller suitable for use in the device 10 should have at least one serial communications port interface and should be programmable to convert a serial communications signal, particularly one using the RS-232standard, into packets for transmission via TCP/IP, either by User Data Protocol (UDP) or, more preferably, by Transmission Control Protocol (TCP), so that the HMI software may receive signals from, e.g., a bar code scanner transparently, as though the bar code scanner were connected directly to the server computer running the HMI software. The microcontroller 36 may be programmed to discard the START, STOP, and PARITY bits, sending only the DATA bits in the packets via Ethernet, or may be programmed to packetize all of the bits in the RS-232 signal, so that the TCP/IP signal may be de-packetized and the entire RS-232 restored at the server computer for transmission over a serial communications bus to the HMI software, depending upon the capability of the particular HMI software used by the manufacturing or commercial establishment.
In this regard, the HMI software 38 may be any commercially available brand of HMI software. HMI software generally provides for the collection, monitoring, supervisory control, and sharing of critical production data relating to plant machinery and operations, including sending alarm or control signals to remote locations in the plant. Exemplary HMI software 38 that device 10 may interface with includes GE Fanuc's Proficy® or Cimplicty® HMI software, Allen-Bradley/Rockwell Automation HMI, Wonderware HMI, and the like. The device 10 may be furnished with a software driver 40 that can be loaded on the server computer on which the HMI software resides. The software driver 40 converts software commands from the HMI software 38 into appropriate input commands in the language of microcomputer 36, e.g., to turn on the beacon 14 or audio alarm speaker 24, and conversely, routes output signals from the microcontroller 36 regarding the status of the machine or from push button 26 to the appropriate HMI input in a form required by the HMI software, much in the fashion of a software printer driver.
The microcontroller should be capable of performance that is near real time from a human perspective (100 ms<response time<500 ms), but not so fast that it does not meet the requirements of machine control applications, which require less than 100 ms. The microcontroller should be programmable so that discrete input/output signals from the machine sensors and controllers trigger a hardware IRQ so that the change in input state can be immediately processed. The microcontroller should also be programmable to poll the TCP/IP stack from the HMI software Ethernet receive port frequently (typically 10 ms-500 ms) to maintain close to real-time response to HMI software commands. Preferably the microcontroller is capable of opening a separate TCP/IP port and TCP/IP stack for each serial input device connected to the microcontroller, and a single port for discrete input/output devices connected via the miniconnector 30.
A microcontroller 36 suitable for use in the device is an MC9S12NE64 made by Freescale Semiconductor, Inc. of Austin, Tex. Among other features, this microcontroller features a 15-bit CPU, 64 K bytes of FLASH EEPROM, 6K of RAM, an A/D converter, an Ethernet media access controller (EMAC) with an integrated Ethernet 10/100 Mbps transceiver, two asynchronous serial communications interface modules (SCI), one synchronous serial peripheral interface (unused in the embodiment of
Referring back to
The circuit for device 10 also includes an Ethernet isolation circuit 46 disposed between microcontroller 36 and RJ-45 Ethernet jack 32. The Ethernet isolation circuit 46 is provided to prevent noise carried over the Ethernet cable from affecting the microcontroller 36 through the Ethernet transceiver pins, and to remove noise from signals being transmitted over the Ethernet network cable to the HMI software 38 running on the server computer. An exemplary Ethernet isolation circuit 46 is shown in
The circuit for device 10 includes a pushbutton circuit 52, which may include one or more optoisolators, such as PS2701 integrated circuits, and other components for debouncing the switch and interfacing pushbutton 26 with microcontroller 36. Such circuits for interfacing a pushbutton switch with a microcontroller or microprocessor are well known in the art, and will not be described further.
The circuit for device 10 includes a light and speaker circuit 54 for driving beacon 14, signal lights 16 and 18, and an audio alarm device that emits an alarm through speaker 28. Illumination for beacon 14 and signal lights 16 and 18 are preferably provided by an array of LEDs, and the circuitry includes current limiting resistors for limiting current through the LEDs and dissipating heat, and a driver provided by a transistor amplifier/switch, such as an ULN2803LW integrated circuit containing an array of photodarlington transistors. Such LED light circuits are conventional and well known in the art. It will be noted that the driver transistor beacon 14 and signal lights 16 and 18 may be flashed or switched on and off by the on-chip timer incorporated into microcontroller 36, or by a discrete LED flasher circuit. Speaker 24 may incorporate a horn, buzzer, or other audio alarm device driven by one of the transistor amplifier/switches of the ULN2803LW, or, alternatively, a separate and discreet speech processor circuit may be provided to furnish a verbal alarm or instruction.
The miniconnector 30 may be connected directly to microcontroller 36. The circuit for the device 10 may also include a regulated power supply circuit 56 that provides a regulated 24-volt power source for power over Ethernet to the machine controllers and sensors connected to the miniconnector port 30, as well as a regulated power supply, e.g., a 3.3-volt power supply using an LM2596 voltage regulator, for the microcontroller 36 and other circuits disposed within housing 12. Such regulated power supply circuits are well known in the art.
The plurality of push buttons 26a and 26b provides the operator with additional options for communicating with the HMI software. The USB port permits other devices, such as a touch screen monitor and control station, a printer, a keyboard, a mouse, or other USB device to the microcontroller 36 through conventional circuitry to expand the operator's capacity to communicate with the HMI software. The plurality of miniconnectors 30 permits additional pickup lights, buttons, sensors, and the like to be connected to the microcontroller for providing additional data inputs to the HMI software.
It will be understood that a plurality of devices 10 or devices 100 will be connected to the server computer running the HMI software by a LAN through an Ethernet hub, router, switches, or the like, or by a WAN through a gateway or other network switching device. Alternatively, the device 10 may communicate with a single computer located at the workstation via Ethernet. It will be seen that the operator interface device for an HMI system provides for generic, simple communication between Human-Machine Interface (HMI) software and an operator workstation, placing the machines and operator workstations directly under IT control from the HMI software through a computer network without the necessity for customized intervening devices or customized workstation alarm and signaling devices. It will be noted that instead of HMI software, the device may be configured to communicate with other software applications running on the server computer by a suitable driver, if desired.
A few examples will exemplify use of the present invention. A worker in an assembly line at an automotive facility attaches an emblem to the trunk of vehicles. The majority of vehicles receive a generic emblem that simply recites the make of the vehicle. A vehicle that requires a different emblem designating the vehicle as an LS model arrives at the workstation. A bar code scanner reads a bar code on the conveyor belt or on the trunk and conveys the code to the HMI software. The HMI software causes the amber “IN Station” light on the device to illuminate. The HMI software recognizes from the bar code that the vehicle requires a special emblem and beeps the horn to alert the worker. The worker presses the release push button after affixing the special emblem as a signal to the HMI software that the special emblem has been affixed, and the HMI software signal the green good job light to acknowledge and advance the assembly line. If the push button is not pushed within the allotted time for affixing the emblem, the beacon flashes and the horn wails continuously, the assembly line halting until the error is corrected and the push button depressed.
In another example, a worker at a dishwasher assembly plant uses a special tool called a torque controller to tighten the same six bolts on each dishwasher passing through the workstation. The torque controller sends an “OK” signal via Ethernet through the device to the HMI software after each bolt is tightened. The HMI software keeps count of the number of OK signals. If six are received, the green light illuminates and the conveyor belt advances. If only five OK signals are received within the allotted time, the beacon flashes and the HMI software causes the conveyor belt to stop until the error is remedied and the release button is pushed.
It is contemplated that the operator interface device for an HMI system may be used in commercial, industrial, warehouse, and manufacturing establishments. Although particularly described for use in automation systems that use HMI software, the scope of the invention is intended to extend to use with any other IT application that provides a control or monitoring system interface between a server computer and an operator workstation.
It is to be understood that the present invention is not limited to the embodiments described above, but encompasses any and all embodiments within the scope of the following claims.
Patent | Priority | Assignee | Title |
Patent | Priority | Assignee | Title |
5805465, | Dec 06 1994 | Mitsubishi Denki Kabushiki Kaisha | Operator support system |
6567709, | Feb 04 2000 | REM TECHNOLOGY, INC | Integrated monitoring, diagnostics, shut-down and control system |
7249023, | Mar 11 2003 | Square D Company | Navigated menuing for industrial human machine interface via speech recognition |
20020046221, | |||
20020156926, | |||
20020198618, | |||
20030048304, | |||
20030208652, | |||
20050037710, | |||
20050155043, | |||
20050175031, | |||
20060169385, | |||
20060200256, | |||
20070033538, | |||
KR2004108524, | |||
WO3056442, |
Executed on | Assignor | Assignee | Conveyance | Frame | Reel | Doc |
Jan 23 2007 | WEST, SCOTT A | DESCARTES TECHNOLOGIES, INC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 018896 | /0052 | |
Oct 26 2007 | DESCARTES TECHNOLOGIES, INC | GE FANUC INTELLIGENT PLATFORMS, INC | ASSIGNMENT OF ASSIGNORS INTEREST SEE DOCUMENT FOR DETAILS | 020284 | /0043 | |
Jan 01 2010 | GE FANUC INTELLIGENT PLATFORMS, INC | GE INTELLIGENT PLATFORMS, INC | CHANGE OF NAME SEE DOCUMENT FOR DETAILS | 026179 | /0003 |
Date | Maintenance Fee Events |
Date | Maintenance Schedule |
May 03 2014 | 4 years fee payment window open |
Nov 03 2014 | 6 months grace period start (w surcharge) |
May 03 2015 | patent expiry (for year 4) |
May 03 2017 | 2 years to revive unintentionally abandoned end. (for year 4) |
May 03 2018 | 8 years fee payment window open |
Nov 03 2018 | 6 months grace period start (w surcharge) |
May 03 2019 | patent expiry (for year 8) |
May 03 2021 | 2 years to revive unintentionally abandoned end. (for year 8) |
May 03 2022 | 12 years fee payment window open |
Nov 03 2022 | 6 months grace period start (w surcharge) |
May 03 2023 | patent expiry (for year 12) |
May 03 2025 | 2 years to revive unintentionally abandoned end. (for year 12) |