When robotics, vision and HMIs work as one

Most manufacturers have a machine on their floor where the robot does one thing, the camera system does another and the human machine interface (HMI) shows whatever was displayed when it was commissioned. Each works, but none of them communicate effectively. This is not a hardware problem. More often, the limitation lies within the control architecture and is more common than the industry likes to admit.

A report by Industry Week, based on a survey of over 214 manufacturing leaders, found that while 92 per cent of manufacturers agree automation is essential for long-term competitiveness, only 37 per cent report having significant or full automation in place.

The same research identified the leading reasons why automation projects fall short: 50 per cent of manufacturers struggle to identify the right technology, 39 per cent cite a lack of internal expertise and 32 per cent experience budget overruns. This points to an industry that is still building automation systems the hard way.

Beckhoff UK recently had the opportunity to demonstrate how robotics, vision and HMI can work together when they are built around a single, unified control system from the outset at the National Manufacturing Institute Scotland (NMIS). The demonstration combined a magnetic levitation transport system, a collaborative robot from Universal Robots, a machine vision system and a large interactive HMI. All of these are running from one controller and using one software.

This unified approach means that passing information between PLC, motion, the HMI and vision is seamless, with no source control conflicts even when multiple programmers from different disciplines are working on the same project. It also allowed the team to split high-speed motion processing with comparatively slower image processing on the same real-time platform.

Vision as part of the process

Machine vision is too often added to automation systems as a quality gate, something that sits at the end of a line and flags problems after they have already occurred. Integrating vision into the control loop from the design stage unlocks considerably more value.

The market reflects how quickly this is changing. According to Grand View Research, the global machine vision market was valued at USD 20.4 billion in 2024 and is projected to reach USD 41.7 billion by 2030, driven by demand across sectors including automotive, electronics and pharmaceuticals.

At NMIS, each item passing through the system carried a unique QR code. The vision station read the code, performed optical character recognition and passed the result directly to the HMI, where the user can see live data about their specific item. The system also simulated batch-of-one manufacturing scenarios, where each item carries different requirements and the control system handles them individually without manual intervention.

The growth in machine vision is not coming from companies bolting cameras onto existing lines as an afterthought. It comes from operations that treat vision as part of the process. A vision system that operates in isolation cannot support the kind of flexibility that end users are increasingly demanding. One that shares a control environment with the rest of the machine can, and the NMIS demonstration showed exactly what that looks like in practice.

The advantage is not just tighter integration. Unified control architectures can reduce engineering complexity, simplify commissioning and give manufacturers greater visibility across increasingly flexible production environments.

The HMI should reflect what is happening

Operator interfaces in industrial settings don't always show the full picture. Data that exists within the control system does not always make it to the screen. When it does, it is not always presented in a way that helps the person looking at it make a faster or better decision. The HMI should be the point at which a live and accurate picture of the process reaches the operator, instead of a rarely updated static dashboard built at commissioning.

At NMIS, visitors can select an item, watch the cobot place it on the transport system and follow its progress across the maglev tiles. Data then appears in real time on the HMI. Nothing about the experience requires specialist knowledge for interpretation. Users who had never encountered industrial automation previously can understand the machine's function.

This accessibility is a direct consequence of the control architecture underneath. When the HMI has direct access to a control system that already holds all the relevant process data, building a useful operator interface is more straightforward. For production environments, this means that better-informed operators can make faster and more confident decisions.

A single control environment

Traditional automation projects often involve multiple software environments layered on top of one another. The robot runs on one platform, the vision system on another and the HMI on a third, each requiring separate engineering workflows and specialist expertise. Integrating them can become time-consuming to maintain as systems scale or production requirements change.

A unified control architecture changes that dynamic. When robotics, motion control, machine vision and HMIs operate within a single control environment, data moves more freely between systems. This leads to faster adjustments, simpler commissioning and operators gain a clearer view of the whole process.

At NMIS, this approach made it possible to coordinate transport movement, robot handling, vision inspection and live operator feedback from a single controller. Rather than stitching together separate technologies, the system functioned as one connected application.

For manufacturers under pressure to become more responsive and efficient, disconnected automation systems are becoming harder to justify. The challenge is no longer simply adding robotics or machine vision to a production line, but ensuring those technologies work together as part of a connected and adaptable system.