Augmented reality technology, as an important disruptive technology, has achieved remarkable results in practical applications in many fields. With the increasing depth and maturity of basic and applied research, augmented reality will be more widely used on the battlefield and have an important and far-reaching impact.
Augmented Reality (Augmented Reality, or AR for short) is an emerging field of technology, which is based on the development of Virtual Reality (Virtual Reality, or VR). The research on augmented reality technology can be traced back to 1968, the United States Massachusetts Institute of Technology developed the world's first optically transparent head-mounted display using cathode ray tubes for real-time display of computer-generated graphics, on the basis of this research, and since then, head-mounted displays in the aircraft, ground vehicles, and ship training have played an important role in the 2012 Google glasses. The launch of Google Glass in 2012 and Microsoft's HoloLens augmented reality device demonstrated in 2015 have inspired a new boom in the research, development and application of augmented reality technology around the world.
Augmented reality technology, as a cross-discipline, is a technology built on the basis of multiple disciplines. It is a technology that calculates the position and angle of the camera image in real time and adds the corresponding image, and it is a new generation of information technology that integrates the computer-generated virtual image in real time on the ground and dynamically into the real environment seen by the user, and it contains multimedia, 3D modeling, real-time video display and control, multi-sensor fusion, real-time tracking, and real-time tracking and control, and it is also a new generation of information technology. It contains multimedia, three-dimensional modeling, real-time video display and control, multi-sensor fusion, real-time tracking and registration, scene fusion and other new technologies and new means, the goal is to put the virtual world on the screen set in the real world and interaction. The goal is to put the virtual world on the screen and interact with the real world. This technology was introduced in 1990, and as the CPU computing power of portable electronic products improves, the use of augmented reality will become more and more widespread.
Further, augmented reality is a new technology that seamlessly integrates real-world information and virtual-world information. It is a way to apply virtual information to the real world through computer science and technology that simulates and then superimposes the information that is difficult to experience in the real world within a certain time and space (visual information, sound, taste, and touch, etc.), and is perceived by the human senses, thus achieving an experience beyond reality. The virtual information is applied to the real world and perceived by human senses, so as to achieve the sensory experience beyond reality. Augmented reality technology is a supplement to the real scene, it can not completely replace the real scene, through the virtual environment and the organic integration of the real environment, you can enhance the user's understanding of the real environment and feelings, in order to achieve the "augmented reality" effect.
The main advantage of augmented reality technology is that, through the combination of the real world and the virtual world, the real world has been increased and strengthened to a certain extent, so as to enhance people's cognition and the ability to transform the real world in a completely new way, from the "people adapt to the world" to "the world adapts to people". There is a significant change from "people adapting to the world" to "the world adapting to people". Augmented reality technology has three main features: first, the combination of virtual and real. By integrating the virtual environment with the real environment, users basically can't feel the disharmony generated by the integration of the virtual environment and the real environment. Second, real-time interactivity. Users can directly interact with virtual objects or virtual environment through interactive devices, which enhances users' timely perception of the environment. Third, 3D localization. For example, video-based augmented reality system, can be captured by the video camera video directly displayed on the monitor, so that the user to see the real scene, and at the same time can be captured by the virtual camera virtual video transmitted to the monitor, through the virtual and real two cameras all-round alignment, so that the virtual scene and the real scene fusion of the integration of a whole, you can freely add in the three-dimensional space, positioning of virtual objects. What augmented reality strives to achieve is not only to add images to the real environment in real time, but also to change these images to adapt to the user's head and eye rotation, so that the image is always within the user's perspective.
Augmented reality encompasses multimedia, 3D modeling, real-time video display and control, multi-sensor fusion, real-time tracking and registration, scene fusion, and other new technologies and tools. The key technologies of augmented reality technology applied on the battlefield mainly include display technology, registration technology, interaction technology, tracking and localization technology, big data technology, intelligent expert system technology and so on. A complete augmented reality system is realized by a group of closely linked, real-time hardware components and related software systems.
Display Technology Display technology is one of the basic technologies of augmented reality systems. The display technology applied on the battlefield mainly includes projection display, handheld display and ordinary monitor display. Projection display is to project the virtual battlefield information directly onto the battlefield engineering facilities that need to be enhanced, so as to achieve the effect of augmented reality. Handheld display mainly uses other auxiliary components such as cameras to achieve the augmented reality effect. Using augmented reality technology, wearable devices such as helmets and eyeglasses can be used to display real-time information such as map directions, building markings, enemy locations, teammate status, and command commands at the battlefield site to the soldiers, significantly enhancing the remote command capability of the Warfighter's field operations.
Registration Registration is one of the key technologies used in augmented reality on the battlefield. "Registration" is actually the process of "aligning" computer-generated virtual battlefield engineering facilities with the real environment. It must first determine the relationship between the virtual battlefield and the observer, and then project the virtual battlefield into the observer's field of view through the correct geometric projection. Registration is generally categorized into dynamic and static registration. Dynamic registration is the case where the camera is in relative motion with the real object to determine the relative position of the two; static registration is the case where the camera is relatively stationary with the real object to determine the relative position of the two. On the battlefield, the vast majority of dynamic registration is used, including tracker-based registration techniques, vision-based registration techniques, and composite registration techniques that combine the advantages of the first two.
Autonomous Interaction Technology The application of augmented reality technology on the battlefield requires the realization of natural and intuitive three-dimensional interaction between the user and the virtual objects in the real environment, which requires the system to design interaction tools for the augmented reality system and to be able to track and locate the location information of the interaction tools to perform the commands implemented by the user on the spatial objects. Intelligent human-computer interaction software technologies such as voice recognition, sketch recognition, natural language understanding and intelligent question and answer systems can improve the commander's experience of human-computer interaction, allowing the commander to feel as convenient and natural as talking to a human being.
Tracking and Positioning Technology On the battlefield, in order to realize the perfect combination of the virtual battlefield and the physical battlefield, it is necessary to merge the virtual battlefield into an accurate location in the real world, a process often referred to as alignment. A tracking and localization system for augmented reality, therefore, must be able to detect the observer's position in the scene, the direction of movement in real time, so that it can be used to help the system decide what virtual objects to display and reconstruct the coordinate system according to the observer's field of view. In order to generate accurate localization, augmented reality systems require extensive calibration, with measurements such as camera parameters, field of view, sensor offsets, object positioning, and distortion. The most commonly used technique is video detection, which focuses on recognizing pre-defined markers, objects, or datums in the video image using pattern recognition techniques, and then calculating a coordinate transformation matrix based on offsets and rotation angles.
Big Data Technology On the battlefield, the application of augmented reality technology to realize the enhancement of battlefield information requires the use of big data technology to rapidly mine the intrinsic laws of data information to provide more efficient decision support, image recognition services, and so on. Using deep learning methods in big data technology, the accuracy of pattern recognition can be significantly improved; using deep neural network models of big data analysis, significant results can be achieved in the field of image recognition, and the error rate can be significantly reduced in ImageNet evaluation; by analyzing massive heterogeneous real-time data, valuable decision-making information can be obtained, and so on. The presentation of battlefield data information requires timely, fast and accurate analysis and processing of massive multi-source heterogeneous data, and big data technology can play an important role.
Intelligent expert system technology On the battlefield, the application of augmented reality technology to realize the enhancement of knowledge and intelligence, we must use intelligent expert system technology, that is, "knowledge engineering" as the core, the comprehensive application of artificial intelligence and computational intelligence principles and methods, modern design theory and methodology, advanced modeling and design. Theory and methods of artificial intelligence and computational intelligence, modern design theory and methods, advanced modeling and simulation technology, as well as the relevant application areas of expertise of the complex intelligent system. Intelligent expert system has a large number of specialized knowledge of the intelligent program, can apply artificial intelligence technology, according to one or more experts to provide special domain knowledge for reasoning, simulating the process of experts to make a decision, able to solve the complex problems that need to be solved by experts, to provide expert-level answers. Intelligent expert system can solve the needs of augmented reality technology for knowledge-based intelligent engineering technology, establish advanced design technology system based on knowledge engineering and reasoning models at different levels, comprehensively consider various factors, use expert knowledge, logical deduction to prejudge the relevant situation, and assist in selecting and pushing the optimization results.
Augmented reality technology has a wide range of applications in areas such as cutting-edge weapons manufacturing and maintenance, aircraft development, data model visualization, virtual training, etc., and because of its ability to augment the real environment with display output, it has obvious advantages in areas such as environmental display, engineering design, and remote robot control.
Battlefield combat command applications The application of augmented reality technology to the joint combat command system allows all levels of combat command institutions and commanders to simultaneously watch and discuss the battlefield as well as interact with the virtual scene, realizing a high degree of **** enjoyment of the entire battlefield information, which will be more conducive to the commanders at all levels to quickly and correctly understand the operational intentions of the superiors. Through the enhanced combat command system, combat command organizations and commanders can grasp the real-time battlefield situation and the situation of each combat unit, so as to make timely and correct combat decisions.
Battlefield engineering facilities design Augmented reality technology used in battlefield engineering facilities design and construction, mainly reflected in several aspects: First, picking the battlefield engineering facilities construction planning effect superimposed on the real scene, in order to directly get the effect of planning. Second, real-time display and **** enjoy physical, model, design drawings and other battlefield engineering facilities information, the use of multi-channel human-computer natural interaction technology, making off-site, real-time interaction, communication and exchange of battlefield engineering facilities design ideas and concepts, improve the design of battlefield engineering facilities. Thirdly, the model of battlefield engineering facilities and various possible design schemes can be integrated together and displayed to the designers of battlefield engineering facilities, who can comprehensively compare various design schemes through the augmented reality system and can directly reflect the modifications to the model of battlefield engineering facilities. Fourthly, it can provide advance demonstration for users, so that users and designers of battlefield engineering facilities can simultaneously enter the operation in the environment of combining reality and reality, and test the rationality of engineering design programs and their operation. Fifth, the standard workflow guidelines will be accurately displayed to the construction unit, significantly improving the efficiency of the battlefield engineering facilities construction.
Battlefield Environment Enhanced Display Using augmented reality technology in the battlefield environment display, mainly through the fusion of virtual objects in the real environment, not only can the battlefield engineering facilities design and construction personnel to show the real scene, but also through the increase of virtual objects, emphasize the environment information that can not be seen by the naked eye, and then enhance the real scene. display, truly realizing the visualization of battlefield engineering facilities information and the construction and maintenance process. On the front glass of the pilot's cockpit or on the helmet display, vector graphics can be superimposed on the pilot's field of view, which not only provides the pilot with navigational information, but also provides enhanced battlefield information including the enemy's hidden forces. In addition, augmented reality can be utilized for orientation recognition and to obtain important military data such as geographic data of real-time locations.
Battlefield construction site control The use of augmented reality technology in the battlefield construction site control, mainly reflected in three aspects: First, the application of augmented reality technology, the battlefield construction management personnel can make real-time mastery of the battlefield engineering facilities and the construction team's situation, you can make timely management decisions. Secondly, it is applied to the battlefield network system, which can enable combatants to simultaneously watch and discuss the battlefield project and interact with the virtual scene, realizing a high degree of **** enjoyment of the whole battlefield project information. Third, the augmented reality system is applied to multi-user, multi-terminal collaborative work, can be for the users, the terminal to establish a *** enjoy, understandable virtual space, allowing the users, the terminal *** enjoy information, real-time communication and interaction.
Combatant training exercises The use of augmented reality technology in the training of combatants helps to innovate training methods and increase the degree of actual combat training. The application of augmented reality based training system, can build a very realistic combat training environment, the trainee through the portable augmented reality system, not only can see the real training scene, but also can see the scene increased a variety of combat virtual objects, so as to realize the immersive training of combat personnel, to further enhance the actual effect of the training exercises. 2014, the U.S. Army demonstrated the "augmented reality sandbox", which is the first time the U.S. Army has ever used the augmented reality technology in the world.
Operation and Maintenance of Battlefield Engineering Augmented reality technology is used in the operation and maintenance of battlefield engineering facilities, mainly through the addition of various types of maintenance support information in the actual equipment, which can guide the maintenance personnel to carry out maintenance and repair in accordance with the steps, and be able to accurately locate the parts that are not directly visible and visualize them, so as to confirm that the parts to be tested and repaired or replaced, which not only can be used for the maintenance of the equipment, but also for the maintenance of the equipment. This not only helps maintenance personnel to quickly become familiar with and master various maintenance techniques, but also ensures the standardization and normalization of the entire maintenance and repair process, which greatly reduces the training costs of maintenance personnel, reduces the difficulty of equipment disassembly, maintenance and repair, improves maintenance and repair efficiency, and helps to pass on technology and experience.
Augmented reality technology can play an important role in all fields and aspects of the battlefield, and has a broad application prospect. To increase the research and development of augmented reality technology, breakthroughs in high-performance software modeling, content shooting generation, augmented reality and human-computer interaction, integrated environment and tools and other key technologies, the development of virtual display devices, optical devices, high-performance true three-dimensional displays, development engines and other products, the establishment of augmented reality technology, products, service standards and evaluation system. It should be seen that at present, augmented reality technology is still facing many challenges, such as there is no reliable way to use three-dimensional tracking technology for large objects yet, and thus it is not possible to realize real-time image acquisition of large battlefield engineering structures; including graphic rendering, CAD models, and user interfaces, etc. In particular, it is a very heavy workload to convert a large amount of paper-based operating instructions into digital models. For these difficult problems, it is necessary to continue to increase the research and development of augmented reality technology and explore the practice, come up with systematic solutions to enhance the reliability, practicality and adaptability of augmented reality technology, so that in the future, it can be more effectively applied to the battlefield and play a greater role.