machine vision
What is machine vision?
Machine vision is the ability of a computer to see; it employs one or more video cameras, analog-to-digital conversion (ADC) and digital signal processing (DSP). The resulting data goes to a computer or robot controller. Machine vision is similar in complexity to voice recognition.
Machine vision is sometimes conflated with the term computer vision. The technology is often integrated with artificial intelligence (AI), machine learning and deep learning to accelerate image processing.
How does machine vision work?
Machine vision uses cameras to capture visual information from the surrounding environment. It then processes the images using a combination of hardware and software and prepares the information for use in various applications. Machine vision technology often uses specialized optics to acquire images. This approach lets certain characteristics of the image be processed, analyzed and measured.
For example, a machine vision application as part of a manufacturing system can be used to analyze a certain characteristic of a part being manufactured on an assembly line. It could determine if the part meets quality criteria and, if not, dispose of the part.
In manufacturing settings, machine vision systems typically need the following:
- Lighting. Lighting illuminates the object or scene to make its features visible.
- Lens. This captures the image and delivers it to the sensor in the camera as light.
- Capture board, frame grabber or sensor. These devices work together to process the image from the camera and convert it to a digital format as pixels. Image sensors convert light into electric signals using either complementary metal-oxide semiconductor technology or a charge-coupled device.
- Processor. The processor runs software and related algorithms that process the digital image and extracts the required information.
- Communication. These systems enable the machine vision cameras and processing system to communicate with other elements of the bigger system, usually using a discrete input/output signal or a serial connection.
There are two types of cameras used in manufacturing machine vision: area scan cameras and line scan cameras. Here's how they work:
- Area scan. These cameras take pictures in a single frame using a rectangular sensor. The number of pixels in the sensor corresponds to the width and height of the image. Area scan cameras are used for scanning objects that are the same size in terms of width and height.
- Line scan. These cameras build an image pixel by pixel. They are suited for taking images of items in motion or of irregular sizes. The sensor passes in a linear motion over an object when taking the picture. Line scan cameras are not as limited to specific resolution the way area scan cameras are.
Camera lenses vary in optical quality. Two important specifications in any vision system are the sensitivity and the resolution of the lens, which have the following characteristics:
- Sensitivity is the ability of a machine to see in dim light or to detect weak impulses at invisible wavelengths.
- Resolution is the extent to which a machine can differentiate between objects.
In general, the greater the resolution, the more confined the field of vision. Sensitivity and resolution are interdependent. If other factors are constant, increasing the sensitivity reduces the resolution, and increasing the resolution reduces the sensitivity.
Human eyes are sensitive to electromagnetic wavelengths ranging from 390 to 770 nanometers. Video cameras can be sensitive to a range of wavelengths much wider than that. Some machine vision systems function at infrared, ultraviolet or X-ray wavelengths.
Binocular, also called stereo, machine vision requires a computer with an advanced processor. In addition, high-resolution cameras, a large amount of RAM and AI programming are required for depth perception.
How are machine vision systems used?
Machine vision applications are used in a range of industries to perform various tasks, including the following:
- Electronic component analysis. Machine vision is used in the construction of circuit boards for tasks such as solder paste inspection and component placement.
- Optical character recognition. OCR enables a computer to extract printed or handwritten text from images.
- Handwriting and signature recognition. With these features, a computer can detect patterns in images of handwriting and signatures.
- Object recognition. In the automotive industry, self-driving cars use object recognition on images taken by cameras to identify obstacles on the road. Machine vision systems also determine the position of objects, such as the proper placement of a label on a pill bottle.
- Pattern recognition. Medical imaging analysis uses pattern recognition to make diagnoses based on technologies such as magnetic resonance imaging, blood scans and brain scans.
- Materials inspection. Machine vision capabilities in materials inspection systems ensure quality control. Machine vision checks for flaws, defects and contaminants in a range of materials and products. For example, these systems can inspect pills and tablets for issues during manufacture.
- Currency inspection. Machine vision is used to analyze currencies to detect counterfeit notes.
- Item counting. This capability is used to tally items such as pills in a packet or bottles in a case.
Machine vision in AI
AI is used in machine vision to expedite the decision-making process. AI is able to process a large amount of images and data information that was previously too difficult to gather.
Examples of how AI is used with machine vision are the following:
- Signature and character recognition require a level of nuance that AI can assist with.
- In manufacturing, AI helps with object recognition and materials inspection to enable machine vision systems to understand acceptable variations in the shape and texture of an object or material.
- In quality assurance, an AI-enabled system can interpret acceptable anomalies rather than rejecting anything that doesn't rigidly fit one specification.
Machine vision in robotics
Machine vision, paired with AI and deep learning, expands the role of robots in performing production-line tasks, such as picking, sorting, placing and performing a manufacturing line scan. This combination of technologies also enables robotics to operate in other environments, such as supermarkets, hospitals and restaurants.
For example, a robot with machine vision can navigate the supermarket aisles, capturing inventory data about products on the store's shelves. It scans products using radio frequency identification technology to read a barcode and is able to avoid obstacles in crowded aisles. Amazon Go retail stores use machine vision-powered systems to monitor inventory and check customers out when they're ready to pay.
Machine vision technology enables automation, making it possible for process sequences in various applications to be networked. Machine vision also makes collaboration between robots and humans more efficient and safer.
For example, in a supermarket, a robot can be dedicated to performing inventory management tasks so that human associates have more time to assist customers. It can perform inventory scans more frequently than people, with greater accuracy. On an assembly line, robots with machine vision can analyze hazardous materials and perform other dangerous tasks without exposing workers to unsafe conditions.
The data machine vision-enabled robots collect and use can be processed in the cloud or at the edge of the network, enabling scalability and detailed data analysis.
What is the difference between machine vision and computer vision?
In some cases, the terms machine vision and computer vision are used synonymously. In other cases, distinctions are made.
Machine vision is often associated with industrial applications of a computer's ability to see. The term computer vision is often used to describe any technology in which a computer is tasked with digitizing an image, processing the data it contains and taking some kind of action.
Another distinction that is sometimes made is in processing power -- that is, the difference between a machine and a computer. A machine vision system typically has less processing power and is used in lean manufacturing environments, performing practical tasks at a high speed to acquire the data needed to complete a specified job.
Computer vision systems collect as much data as possible about objects or scenes and aim to fully understand them. Computer vision is better for collecting general, transferable information that may be applied to a variety of tasks. It also can be performed without a camera as the term can refer to a computer's ability to process images from any source, including the internet.
Machine vision is one of the many applications of AI in manufacturing. Learn other ways manufacturing companies use AI to simplify business processes and increase efficiency.
