Panoramic stitching is a technology to achieve all-round look of the scene by stitching image sequence. It is a research hotspot of Computer Vision and Image Processing. For large-scale and high-resolution image sequence stitching, stitching efficiency of single computer is hard to meet the needs of the practical application. A new solution for panorama parallel stitching based on a multi-machine parallel architecture with high-speed network InfiniBand was proposed. At first, do the parallelism analysis for the key steps of panoramic stitching and divide into fine-grained and high degree of parallelism subtasks; Secondly assign and execute the tasks through the control node and the compute nodes in the parallel architecture; Finally, in order to solve the problem that the rate of the data transmission between the computer nodes using the traditional TCP/IP network is low with the amount of image data increasing, we designed a high-speed network transmission module based on InfiniBand and TCP/IP which can effectively improve the transmission rate. The experimental results proved that the distributed computing on this parallel architecture can effectively improve the panorama stitching efficiency with a significant practical value.