The structure of the correlated optical convolutional neural network and its performance.
Newswise — In recent years, artificial intelligence technologies, especially the machine learning algorithms, have made great strides. These technologies have enabled unprecedented efficiency in tasks such as image recognition, natural language generation and processing, and object detection. However, such outstanding functionality requires substantial computational power as a foundation. By far, the computational resources for achieving so are approaching to their limit of current state. Therefore, effectively reducing the training cost of machine learning models and improving their training efficiency is an important issue in the research field.
To address the issue, great efforts have been made in two research directions, which are optical neural networks and quantum neural networks. Optical neural networks utilize advanced optical manipulation methods to execute machine learning algorithms in classic optical information processing. They have unique advantages such as low energy consumption, low crosstalk, and low transmission latency. However, the current optical neural networks do not exhibit algorithmic acceleration, such as faster model convergence speed. Quantum neural networks are neural network algorithms based on quantum computing theory. Recent researches have shown that quantum neural networks can demonstrate algorithmic acceleration because of the quantum correlations. However, due to technical limitations, it is currently difficult to execute such neural network algorithms on hardware at a large scale, making it challenging for their application in practical problems faced by people at present.
In a new paper (https://doi.org/10.1038/s41377-024-01376-7) published in Light Science & Applications, a team of scientists, led by Professor Xiangdong Zhang, from Key Laboratory of advanced optoelectronic quantum architecture and measurements of Ministry of Education; Beijing Key Laboratory of Nanophotonics & Ultrafine Optoelectronic Systems, School of Physics, Beijing Institute of Technology, China, and co-workers have developed a new type of optical neural network which can exhibit the speedup analog to a quantum neural network. This interesting property emerges due to the introduction of classical optical correlations as the carrier of information. In fact, by using such a kind of carrier, one can mimic the way of information processing enabled by quantum computing, which has been proven by earlier works of the researchers. Based on the property, the researchers develop the convolutional and pooling operation on the correlated optical state, and finally establish a correlated optical convolutional neural network. This optical neural network has a one-to-one correspondence with the quantum convolutional neural network. It shows the speedup in training process on learning certain datasets, and can be applied to identify the character of quantum states under particular encoding principle. The reported method and technique will open new avenues for realizing the algorithmically enhanced optical neural networks, which will benefit the information processing in the era of big data.
The basic structure of a correlated optical convolutional neural network including four parts: the correlated light source, the convolution, the pooling, and the detections. The core processing of the correlated optical state is done by the convolution and the pooling part. Different from those applied in classical convolutional neural networks, the two parts in the correlated convolutional optical neural network manipulate the correlation of optical states and generate the simpler correlated states by merging the beams.
“These two parts actually perform the operations analog to the quantum gates in the quantum convolutional neural networks.” Said by the scientists of the work. “The convolution part in our network is composed of unitary operations on the correlated optical state. It is like the unitary operations on the Hilbert space of qubits. The pooling part we consider is equivalent to measuring partial qubits for obtaining a sub-Hilbert space. Such a part leads to an exponential decrease in the dimension of data. Hence, the function of the two parts contribute to a faster convergence of the loss function when learning certain datasets. Besides, we also certify the similarity of our correlated optical convolutional neural network with the quantum convolutional neural network by performing the identification of the topological phase of quantum states. The certification is supported by both theoretical and experimental results.”
“The results also indicate that the properties of quantum neural network can be realized in a more affordable way.” They added. “Despite the potential advantages of quantum neural networks, implementing them practically requires deep quantum circuits with many multi-qubit gates and complicated measurements. This necessitates significant resources to stabilize the circuits and correct errors, which is technically challenging due to the unavoidable environmental disturbances. A potentially better alternative is to find a system described by the same math as quantum theory and interrupted less by the environment. The proposed correlated optical neural networks serve as an example of such a system, as evidenced by the ease of element arrangements and low requirements on the circumstances in our experiments. Given the exponential growth of data and the scarcity of resources for high-quality computation, our approach presents a cost-effective and high-performance solution that could have widespread applications in various data science research fields.”
###
References
DOI
Original Source URL
https://doi.org/10.1038/s41377-024-01376-7
Funding information
This work was supported by the National key R & D Program of China (2022YFA1404904); National Natural Science Foundation of China (No. 12234004). National Natural Science Foundation of China (No.11904022).
About Light: Science & Applications
The Light: Science & Applications will primarily publish new research results in cutting-edge and emerging topics in optics and photonics, as well as covering traditional topics in optical engineering. The journal will publish original articles and reviews that are of high quality, high interest and far-reaching consequence.
RSS