Skip to content

通用OCR产线执行速度慢 #3898

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
4 tasks
LvZhenChang opened this issue Apr 23, 2025 · 6 comments
Open
4 tasks

通用OCR产线执行速度慢 #3898

LvZhenChang opened this issue Apr 23, 2025 · 6 comments
Assignees

Comments

@LvZhenChang
Copy link

Checklist:

描述问题

腾讯云服务器上通过命令行方式运行通用OCR产线,识别速度慢,指定 --device gpu:0 平均需要6秒,指定--device cpu 平均需要12秒。

复现

命令:
paddlex --pipeline OCR
--input general_ocr_002.png
--use_doc_orientation_classify False
--use_doc_unwarping False
--use_textline_orientation False
--device gpu:0

环境

  1. 请提供您使用的PaddlePaddle和PaddleX的版本号
    paddlePaddle 和PaddleX 均为最新版 V3.0.0-rc0

  2. 请提供您使用的操作系统信息,如Linux/Windows/MacOS

两卡GPU基础型 - 2*16GB+ | 16+TFlops SP
CPU - 16 核 | 内存 - 64GB
云硬盘 - 80GB
Ubuntu 20.04

  1. 请问您使用的Python版本是?
    Python 3.12.9
  2. 请问您使用的CUDA/cuDNN的版本号是?
    Driver 525.105.17, CUDA 12.0, cuDNN 8
@LvZhenChang
Copy link
Author

我使用 文档场景信息抽取v3(PP-ChatOCRv3-doc) 产线,使用服务化部署的方式进行图片识别时,使用GPU,也是需要10秒左右才能够返回数据。

@cuicheng01
Copy link
Collaborator

cuicheng01 commented Apr 23, 2025

第一次初始化的时候需要时间,请问你是怎么测试的呢?如果希望获取模型的推理性能,可以使用这个文档测试

@LvZhenChang
Copy link
Author

第一次初始化的时候需要时间,请问你是怎么测试的呢?如果希望获取模型的推理性能,可以使用这个文档测试

我在云服务器上按用pip安装了最新版的paddlepaddle,和paddleX,使用命令如下:
python -m pip install paddlepaddle-gpu==3.0.0 -i https://www.paddlepaddle.org.cn/packages/stable/cu118/
pip install paddlex==3.0.0rc1

然后就按照通用OCR产线使用教程,采用命令行的模式进行的测试,我实验了很多次,使用GPU基本上都需要6~7秒的时间,使用CPU需要12秒左右的时间。
我也以为是初始化的问题,所有我后面用服务化部署的方式进行测试,时间还是差不多。我看issue上大家都是毫秒级的。请问我是哪里需要再进行配置吗?我查看了云服务器的监控,GPU的使用率才不到20%,应该不是硬件的问题

@LvZhenChang
Copy link
Author

### 以下是我调用 文档场景信息抽取v3(PP-ChatOCRv3-doc)产线产生的日志:
The layout parsing pipeline is not initialized, will initialize it now.
Creating model: ('PP-LCNet_x1_0_doc_ori', None)
Using official model (PP-LCNet_x1_0_doc_ori), the model files will be automatically downloaded and saved in /home/ubuntu/.paddlex/official_models.
/home/ubuntu/miniconda3/lib/python3.12/site-packages/paddle/utils/cpp_extension/extension_utils.py:711: UserWarning: No ccache found. Please be aware that recompiling all source files may be required. You can download and install ccache from: https://github.com/ccache/ccache/blob/master/doc/INSTALL.md
warnings.warn(warning_message)
Creating model: ('UVDoc', None)
Using official model (UVDoc), the model files will be automatically downloaded and saved in /home/ubuntu/.paddlex/official_models.
Creating model: ('RT-DETR-H_layout_3cls', None)
Using official model (RT-DETR-H_layout_3cls), the model files will be automatically downloaded and saved in /home/ubuntu/.paddlex/official_models.
Creating model: ('PP-OCRv4_server_det', None)
Using official model (PP-OCRv4_server_det), the model files will be automatically downloaded and saved in /home/ubuntu/.paddlex/official_models.
Creating model: ('PP-OCRv4_server_rec', None)
Using official model (PP-OCRv4_server_rec), the model files will be automatically downloaded and saved in /home/ubuntu/.paddlex/official_models.
Creating model: ('PP-OCRv4_server_seal_det', None)
Using official model (PP-OCRv4_server_seal_det), the model files will be automatically downloaded and saved in /home/ubuntu/.paddlex/official_models.
Creating model: ('PP-OCRv4_server_rec', None)
Using official model (PP-OCRv4_server_rec), the model files will be automatically downloaded and saved in /home/ubuntu/.paddlex/official_models.
Creating model: ('SLANet_plus', None)
Using official model (SLANet_plus), the model files will be automatically downloaded and saved in /home/ubuntu/.paddlex/official_models.

### 以下是我使用单模型性能测试的数据:

(base) ubuntu@VM-0-2-ubuntu:~/ocr$ PADDLE_PDX_INFER_BENCHMARK=True PADDLE_PDX_INFER_BENCHMARK_WARMUP=5 PADDLE_PDX_INFER_BENCHMARK_ITERS=10 PADDLE_PDX_INFER_BENCHMARK_OUTPUT_DIR=./benchmark python test_infer.py
Using official model (PP-LCNet_x1_0_doc_ori), the model files will be automatically downloaded and saved in /home/ubuntu/.paddlex/official_models.
/home/ubuntu/miniconda3/lib/python3.12/site-packages/paddle/utils/cpp_extension/extension_utils.py:711: UserWarning: No ccache found. Please be aware that recompiling all source files may be required. You can download and install ccache from: https://github.com/ccache/ccache/blob/master/doc/INSTALL.md
warnings.warn(warning_message)
Warmup Data
+-------+------------+-----------+----------------+------------------------+----------------------------+
| Iters | Batch Size | Instances | Type | Avg Time Per Iter (ms) | Avg Time Per Instance (ms) |
+-------+------------+-----------+----------------+------------------------+----------------------------+
| 5 | 1 | 5 | Preprocessing | 16.10610800 | 16.10610800 |
| 5 | 1 | 5 | Inference | 44.23472040 | 44.23472040 |
| 5 | 1 | 5 | Postprocessing | 0.10048160 | 0.10048160 |
| 5 | 1 | 5 | Core | 60.44131000 | 60.44131000 |
| 5 | 1 | 5 | Other | 0.31048580 | 0.31048580 |
| 5 | 1 | 5 | End-to-End | 60.75179580 | 60.75179580 |
+-------+------------+-----------+----------------+------------------------+----------------------------+
Operation Info
+------------------------+---------------------------------------------------------------------------------------------------------------------+
| Operation | Source Code Location |
+------------------------+---------------------------------------------------------------------------------------------------------------------+
| ReadImage | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/common/reader/image_reader.py:47 |
| ResizeByShort | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/common/vision/processors.py:203 |
| Crop | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/image_classification/processors.py:45 |
| Normalize | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/common/vision/processors.py:268 |
| ToCHWImage | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/common/vision/processors.py:277 |
| ToBatch | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/common/vision/processors.py:284 |
| PaddleInferChainLegacy | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/common/static_infer.py:293 |
| Topk | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/image_classification/processors.py:83 |
+------------------------+---------------------------------------------------------------------------------------------------------------------+
Detail Data
+-------+------------+-----------+------------------------+------------------------+----------------------------+
| Iters | Batch Size | Instances | Operation | Avg Time Per Iter (ms) | Avg Time Per Instance (ms) |
+-------+------------+-----------+------------------------+------------------------+----------------------------+
| 10 | 1 | 10 | ReadImage | 14.21120310 | 14.21120310 |
| 10 | 1 | 10 | ResizeByShort | 0.83018590 | 0.83018590 |
| 10 | 1 | 10 | Crop | 0.01069680 | 0.01069680 |
| 10 | 1 | 10 | Normalize | 0.24319110 | 0.24319110 |
| 10 | 1 | 10 | ToCHWImage | 0.00319160 | 0.00319160 |
| 10 | 1 | 10 | ToBatch | 0.07788250 | 0.07788250 |
| 10 | 1 | 10 | PaddleInferChainLegacy | 3.10805520 | 3.10805520 |
| 10 | 1 | 10 | Topk | 0.09051050 | 0.09051050 |
+-------+------------+-----------+------------------------+------------------------+----------------------------+
Summary Data
+-------+------------+-----------+----------------+------------------------+----------------------------+
| Iters | Batch Size | Instances | Type | Avg Time Per Iter (ms) | Avg Time Per Instance (ms) |
+-------+------------+-----------+----------------+------------------------+----------------------------+
| 10 | 1 | 10 | Preprocessing | 15.37635100 | 15.37635100 |
| 10 | 1 | 10 | Inference | 3.10805520 | 3.10805520 |
| 10 | 1 | 10 | Postprocessing | 0.09051050 | 0.09051050 |
| 10 | 1 | 10 | Core | 18.57491670 | 18.57491670 |
| 10 | 1 | 10 | Other | 0.27265820 | 0.27265820 |
| 10 | 1 | 10 | End-to-End | 18.84757490 | 18.84757490 |
+-------+------------+-----------+----------------+------------------------+----------------------------+
{'res': {'input_path': 'vehicle_certificate-1.png', 'page_index': None, 'class_ids': array([0], dtype=int32), 'scores': array([0.85084], dtype=float32), 'label_names': ['0']}}


C++ Traceback (most recent call last):

0 phi::OneDNNContextThreadLocals::Body::~Body()
1 phi::OneDNNContext::Impl::ResetBlobMap(void*)


Error Message Summary:

FatalError: Process abort signal is detected by the operating system.
[TimeInfo: *** Aborted at 1745547746 (unix time) try "date -d @1745547746" if you are using GNU date ***]
[SignalInfo: *** SIGABRT (@0x3e80003b25d) received by PID 242269 (TID 0x7fa718b874c0) from PID 242269 ***]

Aborted (core dumped)
(base) ubuntu@VM-0-2-ubuntu:~/ocr$ PADDLE_PDX_INFER_BENCHMARK=True PADDLE_PDX_INFER_BENCHMARK_WARMUP=5 PADDLE_PDX_INFER_BENCHMARK_ITERS=10 PADDLE_PDX_INFER_BENCHMARK_OUTPUT_DIR=./benchmark python test_infer.py
Using official model (UVDoc), the model files will be automatically downloaded and saved in /home/ubuntu/.paddlex/official_models.
/home/ubuntu/miniconda3/lib/python3.12/site-packages/paddle/utils/cpp_extension/extension_utils.py:711: UserWarning: No ccache found. Please be aware that recompiling all source files may be required. You can download and install ccache from: https://github.com/ccache/ccache/blob/master/doc/INSTALL.md
warnings.warn(warning_message)
Warmup Data
+-------+------------+-----------+----------------+------------------------+----------------------------+
| Iters | Batch Size | Instances | Type | Avg Time Per Iter (ms) | Avg Time Per Instance (ms) |
+-------+------------+-----------+----------------+------------------------+----------------------------+
| 5 | 1 | 5 | Preprocessing | 28.85199060 | 28.85199060 |
| 5 | 1 | 5 | Inference | 108.20549980 | 108.20549980 |
| 5 | 1 | 5 | Postprocessing | 2.28947760 | 2.28947760 |
| 5 | 1 | 5 | Core | 139.34696800 | 139.34696800 |
| 5 | 1 | 5 | Other | 6.77393380 | 6.77393380 |
| 5 | 1 | 5 | End-to-End | 146.12090180 | 146.12090180 |
+-------+------------+-----------+----------------+------------------------+----------------------------+
Operation Info
+------------------------+----------------------------------------------------------------------------------------------------------------+
| Operation | Source Code Location |
+------------------------+----------------------------------------------------------------------------------------------------------------+
| ReadImage | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/common/reader/image_reader.py:47 |
| Normalize | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/common/vision/processors.py:268 |
| ToCHWImage | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/common/vision/processors.py:277 |
| ToBatch | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/common/vision/processors.py:284 |
| PaddleInferChainLegacy | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/common/static_infer.py:293 |
| DocTrPostProcess | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/image_unwarping/processors.py:51 |
+------------------------+----------------------------------------------------------------------------------------------------------------+
Detail Data
+-------+------------+-----------+------------------------+------------------------+----------------------------+
| Iters | Batch Size | Instances | Operation | Avg Time Per Iter (ms) | Avg Time Per Instance (ms) |
+-------+------------+-----------+------------------------+------------------------+----------------------------+
| 10 | 1 | 10 | ReadImage | 13.77925450 | 13.77925450 |
| 10 | 1 | 10 | Normalize | 9.93281320 | 9.93281320 |
| 10 | 1 | 10 | ToCHWImage | 0.00651240 | 0.00651240 |
| 10 | 1 | 10 | ToBatch | 3.34585280 | 3.34585280 |
| 10 | 1 | 10 | PaddleInferChainLegacy | 33.20407950 | 33.20407950 |
| 10 | 1 | 10 | DocTrPostProcess | 2.03138040 | 2.03138040 |
+-------+------------+-----------+------------------------+------------------------+----------------------------+
Summary Data
+-------+------------+-----------+----------------+------------------------+----------------------------+
| Iters | Batch Size | Instances | Type | Avg Time Per Iter (ms) | Avg Time Per Instance (ms) |
+-------+------------+-----------+----------------+------------------------+----------------------------+
| 10 | 1 | 10 | Preprocessing | 27.06443290 | 27.06443290 |
| 10 | 1 | 10 | Inference | 33.20407950 | 33.20407950 |
| 10 | 1 | 10 | Postprocessing | 2.03138040 | 2.03138040 |
| 10 | 1 | 10 | Core | 62.29989280 | 62.29989280 |
| 10 | 1 | 10 | Other | 6.49463190 | 6.49463190 |
| 10 | 1 | 10 | End-to-End | 68.79452470 | 68.79452470 |
+-------+------------+-----------+----------------+------------------------+----------------------------+
{'res': {'input_path': 'vehicle_certificate-1.png', 'page_index': None, 'doctr_img': '...'}}


C++ Traceback (most recent call last):

0 phi::OneDNNContextThreadLocals::Body::~Body()
1 phi::OneDNNContext::Impl::ResetBlobMap(void*)


Error Message Summary:

FatalError: Process abort signal is detected by the operating system.
[TimeInfo: *** Aborted at 1745547781 (unix time) try "date -d @1745547781" if you are using GNU date ***]
[SignalInfo: *** SIGABRT (@0x3e80003bce7) received by PID 244967 (TID 0x7fdbad75c4c0) from PID 244967 ***]

Aborted (core dumped)
(base) ubuntu@VM-0-2-ubuntu:~/ocr$ PADDLE_PDX_INFER_BENCHMARK=True PADDLE_PDX_INFER_BENCHMARK_WARMUP=5 PADDLE_PDX_INFER_BENCHMARK_ITERS=10 PADDLE_PDX_INFER_BENCHMARK_OUTPUT_DIR=./benchmark python test_infer.py
Using official model (RT-DETR-H_layout_3cls), the model files will be automatically downloaded and saved in /home/ubuntu/.paddlex/official_models.
/home/ubuntu/miniconda3/lib/python3.12/site-packages/paddle/utils/cpp_extension/extension_utils.py:711: UserWarning: No ccache found. Please be aware that recompiling all source files may be required. You can download and install ccache from: https://github.com/ccache/ccache/blob/master/doc/INSTALL.md
warnings.warn(warning_message)
Warmup Data
+-------+------------+-----------+----------------+------------------------+----------------------------+
| Iters | Batch Size | Instances | Type | Avg Time Per Iter (ms) | Avg Time Per Instance (ms) |
+-------+------------+-----------+----------------+------------------------+----------------------------+
| 5 | 1 | 5 | Preprocessing | 20.68160440 | 20.68160440 |
| 5 | 1 | 5 | Inference | 283.40761300 | 283.40761300 |
| 5 | 1 | 5 | Postprocessing | 0.09451720 | 0.09451720 |
| 5 | 1 | 5 | Core | 304.18373460 | 304.18373460 |
| 5 | 1 | 5 | Other | 2.89608160 | 2.89608160 |
| 5 | 1 | 5 | End-to-End | 307.07981620 | 307.07981620 |
+-------+------------+-----------+----------------+------------------------+----------------------------+
Operation Info
+------------------------+------------------------------------------------------------------------------------------------------------------+
| Operation | Source Code Location |
+------------------------+------------------------------------------------------------------------------------------------------------------+
| ReadImage | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/object_detection/processors.py:38 |
| Resize | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/object_detection/processors.py:103 |
| Normalize | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/object_detection/processors.py:134 |
| ToCHWImage | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/object_detection/processors.py:147 |
| ToBatch | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/object_detection/processors.py:205 |
| PaddleInferChainLegacy | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/common/static_infer.py:293 |
| DetPostProcess | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/object_detection/processors.py:831 |
+------------------------+------------------------------------------------------------------------------------------------------------------+
Detail Data
+-------+------------+-----------+------------------------+------------------------+----------------------------+
| Iters | Batch Size | Instances | Operation | Avg Time Per Iter (ms) | Avg Time Per Instance (ms) |
+-------+------------+-----------+------------------------+------------------------+----------------------------+
| 10 | 1 | 10 | ReadImage | 13.82514320 | 13.82514320 |
| 10 | 1 | 10 | Resize | 2.43754600 | 2.43754600 |
| 10 | 1 | 10 | Normalize | 2.39597400 | 2.39597400 |
| 10 | 1 | 10 | ToCHWImage | 0.00415720 | 0.00415720 |
| 10 | 1 | 10 | ToBatch | 1.17791910 | 1.17791910 |
| 10 | 1 | 10 | PaddleInferChainLegacy | 105.04511930 | 105.04511930 |
| 10 | 1 | 10 | DetPostProcess | 0.10107210 | 0.10107210 |
+-------+------------+-----------+------------------------+------------------------+----------------------------+
Summary Data
+-------+------------+-----------+----------------+------------------------+----------------------------+
| Iters | Batch Size | Instances | Type | Avg Time Per Iter (ms) | Avg Time Per Instance (ms) |
+-------+------------+-----------+----------------+------------------------+----------------------------+
| 10 | 1 | 10 | Preprocessing | 19.84073950 | 19.84073950 |
| 10 | 1 | 10 | Inference | 105.04511930 | 105.04511930 |
| 10 | 1 | 10 | Postprocessing | 0.10107210 | 0.10107210 |
| 10 | 1 | 10 | Core | 124.98693090 | 124.98693090 |
| 10 | 1 | 10 | Other | 2.52210920 | 2.52210920 |
| 10 | 1 | 10 | End-to-End | 127.50904010 | 127.50904010 |
+-------+------------+-----------+----------------+------------------------+----------------------------+
{'res': {'input_path': 'vehicle_certificate-1.png', 'page_index': None, 'boxes': [{'cls_id': 1, 'label': 'table', 'score': 0.9311704039573669, 'coordinate': [73.02191, 95.94136, 667.29877, 980.638]}]}}


C++ Traceback (most recent call last):

0 phi::OneDNNContextThreadLocals::Body::~Body()
1 phi::OneDNNContext::Impl::ResetBlobMap(void*)


Error Message Summary:

FatalError: Process abort signal is detected by the operating system.
[TimeInfo: *** Aborted at 1745547810 (unix time) try "date -d @1745547810" if you are using GNU date ***]
[SignalInfo: *** SIGABRT (@0x3e80003c61a) received by PID 247322 (TID 0x7fa147dec4c0) from PID 247322 ***]

Aborted (core dumped)
(base) ubuntu@VM-0-2-ubuntu:~/ocr$ PADDLE_PDX_INFER_BENCHMARK=True PADDLE_PDX_INFER_BENCHMARK_WARMUP=5 PADDLE_PDX_INFER_BENCHMARK_ITERS=10 PADDLE_PDX_INFER_BENCHMARK_OUTPUT_DIR=./benchmark python test_infer.py
Using official model (PP-OCRv4_server_det), the model files will be automatically downloaded and saved in /home/ubuntu/.paddlex/official_models.
/home/ubuntu/miniconda3/lib/python3.12/site-packages/paddle/utils/cpp_extension/extension_utils.py:711: UserWarning: No ccache found. Please be aware that recompiling all source files may be required. You can download and install ccache from: https://github.com/ccache/ccache/blob/master/doc/INSTALL.md
warnings.warn(warning_message)
Warmup Data
+-------+------------+-----------+----------------+------------------------+----------------------------+
| Iters | Batch Size | Instances | Type | Avg Time Per Iter (ms) | Avg Time Per Instance (ms) |
+-------+------------+-----------+----------------+------------------------+----------------------------+
| 5 | 1 | 5 | Preprocessing | 20.81693840 | 20.81693840 |
| 5 | 1 | 5 | Inference | 236.74832020 | 236.74832020 |
| 5 | 1 | 5 | Postprocessing | 12.34856240 | 12.34856240 |
| 5 | 1 | 5 | Core | 269.91382100 | 269.91382100 |
| 5 | 1 | 5 | Other | 4.16580140 | 4.16580140 |
| 5 | 1 | 5 | End-to-End | 274.07962240 | 274.07962240 |
+-------+------------+-----------+----------------+------------------------+----------------------------+
Operation Info
+------------------------+----------------------------------------------------------------------------------------------------------------+
| Operation | Source Code Location |
+------------------------+----------------------------------------------------------------------------------------------------------------+
| ReadImage | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/common/reader/image_reader.py:47 |
| DetResizeForTest | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/text_detection/processors.py:58 |
| NormalizeImage | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/text_detection/processors.py:218 |
| ToCHWImage | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/common/vision/processors.py:277 |
| ToBatch | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/common/vision/processors.py:284 |
| PaddleInferChainLegacy | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/common/static_infer.py:293 |
| DBPostProcess | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/text_detection/processors.py:453 |
+------------------------+----------------------------------------------------------------------------------------------------------------+
Detail Data
+-------+------------+-----------+------------------------+------------------------+----------------------------+
| Iters | Batch Size | Instances | Operation | Avg Time Per Iter (ms) | Avg Time Per Instance (ms) |
+-------+------------+-----------+------------------------+------------------------+----------------------------+
| 10 | 1 | 10 | ReadImage | 13.39791720 | 13.39791720 |
| 10 | 1 | 10 | DetResizeForTest | 0.77158390 | 0.77158390 |
| 10 | 1 | 10 | NormalizeImage | 7.00711590 | 7.00711590 |
| 10 | 1 | 10 | ToCHWImage | 0.00505890 | 0.00505890 |
| 10 | 1 | 10 | ToBatch | 2.16757580 | 2.16757580 |
| 10 | 1 | 10 | PaddleInferChainLegacy | 145.84406440 | 145.84406440 |
| 10 | 1 | 10 | DBPostProcess | 12.67285240 | 12.67285240 |
+-------+------------+-----------+------------------------+------------------------+----------------------------+
Summary Data
+-------+------------+-----------+----------------+------------------------+----------------------------+
| Iters | Batch Size | Instances | Type | Avg Time Per Iter (ms) | Avg Time Per Instance (ms) |
+-------+------------+-----------+----------------+------------------------+----------------------------+
| 10 | 1 | 10 | Preprocessing | 23.34925170 | 23.34925170 |
| 10 | 1 | 10 | Inference | 145.84406440 | 145.84406440 |
| 10 | 1 | 10 | Postprocessing | 12.67285240 | 12.67285240 |
| 10 | 1 | 10 | Core | 181.86616850 | 181.86616850 |
| 10 | 1 | 10 | Other | 4.41414280 | 4.41414280 |
| 10 | 1 | 10 | End-to-End | 186.28031130 | 186.28031130 |
+-------+------------+-----------+----------------+------------------------+----------------------------+
{'res': {'input_path': 'vehicle_certificate-1.png', 'page_index': None, 'dt_polys': array([[[536, 945],
...,
[536, 956]],

   ...,

   [[505, 100],
    ...,
    [505, 116]]], dtype=int16), 'dt_scores': [0.9783748014391154, 0.7892184904345345, 0.7089202550035424, 0.9761713038802943, 0.8146517496570596, 0.896040254369792, 0.8377502588153785, 0.8950170023573031, 0.7176804019709427, 0.8337705615332958, 0.8542706139033308, 0.7654022675961869, 0.9474002343517358, 0.8575616145593011, 0.8650544462892286, 0.8586809753664402, 0.7889851525793541, 0.8803309464516739, 0.8836270501551476, 0.8126279773251548, 0.981309599775888, 0.8164555250733558, 0.8053876970794415, 0.8709766506993522, 0.9850344497307733, 0.925043879029881, 0.8064448829959633, 0.9809876685942879, 0.8969101163069948, 0.9485583374542849, 0.8412125518554477, 0.8325863676464983, 0.8012396770104966, 0.9555964050038407, 0.9244447061509797, 0.8553012384181576, 0.8068467783554877, 0.9746997016590981, 0.8715038064091156, 0.8366189380486807, 0.8665188410918095, 0.8594913592941288, 0.8793519126022205, 0.9554292241354352, 0.7600510180777578, 0.8241166554651209, 0.9275989155740217, 0.7683206136510478, 0.9246778135734891, 0.9640559967171837, 0.8921337024245913, 0.8474753094183435, 0.8325307111956031, 0.9612208902835846, 0.9091752883738157, 0.918678525406202, 0.8749961156863719, 0.97849822343067, 0.9402106475351112, 0.9793234429189137, 0.9503538405921842, 0.8575780684297483, 0.9132892940973103, 0.7727381905075162, 0.9310826998906131, 0.8545731708397898, 0.978753199003442, 0.8684021631406934, 0.8890744062581298, 0.8135548901433746, 0.9465989122270709, 0.9868399163208357, 0.9145054673240822, 0.960436312993716, 0.9836310832526046, 0.8350574282095684, 0.800131008977454, 0.9645005668858412, 0.8874452235713038, 0.971668600731718, 0.891572102617759, 0.7971292733847187, 0.9750881058881518, 0.9676651874057998, 0.9931808322870812, 0.9710605057577292, 0.811620898341254, 0.8459590781298736, 0.8459009046172687, 0.8862291950180068, 0.8576702756735568, 0.9708008450033561, 0.9069518026094773]}}

C++ Traceback (most recent call last):

0 phi::OneDNNContextThreadLocals::Body::~Body()
1 phi::OneDNNContext::Impl::ResetBlobMap(void*)


Error Message Summary:

FatalError: Process abort signal is detected by the operating system.
[TimeInfo: *** Aborted at 1745547848 (unix time) try "date -d @1745547848" if you are using GNU date ***]
[SignalInfo: *** SIGABRT (@0x3e80003f01e) received by PID 258078 (TID 0x7f0ba923e4c0) from PID 258078 ***]

Aborted (core dumped)
(base) ubuntu@VM-0-2-ubuntu:~/ocr$ PADDLE_PDX_INFER_BENCHMARK=True PADDLE_PDX_INFER_BENCHMARK_WARMUP=5 PADDLE_PDX_INFER_BENCHMARK_ITERS=10 PADDLE_PDX_INFER_BENCHMARK_OUTPUT_DIR=./benchmark python test_infer.py
Using official model (PP-OCRv4_server_rec), the model files will be automatically downloaded and saved in /home/ubuntu/.paddlex/official_models.
/home/ubuntu/miniconda3/lib/python3.12/site-packages/paddle/utils/cpp_extension/extension_utils.py:711: UserWarning: No ccache found. Please be aware that recompiling all source files may be required. You can download and install ccache from: https://github.com/ccache/ccache/blob/master/doc/INSTALL.md
warnings.warn(warning_message)
Warmup Data
+-------+------------+-----------+----------------+------------------------+----------------------------+
| Iters | Batch Size | Instances | Type | Avg Time Per Iter (ms) | Avg Time Per Instance (ms) |
+-------+------------+-----------+----------------+------------------------+----------------------------+
| 5 | 1 | 5 | Preprocessing | 14.70626340 | 14.70626340 |
| 5 | 1 | 5 | Inference | 98.78566260 | 98.78566260 |
| 5 | 1 | 5 | Postprocessing | 0.72759420 | 0.72759420 |
| 5 | 1 | 5 | Core | 114.21952020 | 114.21952020 |
| 5 | 1 | 5 | Other | 0.20365840 | 0.20365840 |
| 5 | 1 | 5 | End-to-End | 114.42317860 | 114.42317860 |
+-------+------------+-----------+----------------+------------------------+----------------------------+
Operation Info
+------------------------+------------------------------------------------------------------------------------------------------------------+
| Operation | Source Code Location |
+------------------------+------------------------------------------------------------------------------------------------------------------+
| ReadImage | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/common/reader/image_reader.py:47 |
| OCRReisizeNormImg | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/text_recognition/processors.py:65 |
| ToBatch | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/text_recognition/processors.py:235 |
| PaddleInferChainLegacy | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/common/static_infer.py:293 |
| CTCLabelDecode | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/text_recognition/processors.py:189 |
+------------------------+------------------------------------------------------------------------------------------------------------------+
Detail Data
+-------+------------+-----------+------------------------+------------------------+----------------------------+
| Iters | Batch Size | Instances | Operation | Avg Time Per Iter (ms) | Avg Time Per Instance (ms) |
+-------+------------+-----------+------------------------+------------------------+----------------------------+
| 10 | 1 | 10 | ReadImage | 13.79601430 | 13.79601430 |
| 10 | 1 | 10 | OCRReisizeNormImg | 0.14644390 | 0.14644390 |
| 10 | 1 | 10 | ToBatch | 0.16935020 | 0.16935020 |
| 10 | 1 | 10 | PaddleInferChainLegacy | 13.02330340 | 13.02330340 |
| 10 | 1 | 10 | CTCLabelDecode | 0.80318660 | 0.80318660 |
+-------+------------+-----------+------------------------+------------------------+----------------------------+
Summary Data
+-------+------------+-----------+----------------+------------------------+----------------------------+
| Iters | Batch Size | Instances | Type | Avg Time Per Iter (ms) | Avg Time Per Instance (ms) |
+-------+------------+-----------+----------------+------------------------+----------------------------+
| 10 | 1 | 10 | Preprocessing | 14.11180840 | 14.11180840 |
| 10 | 1 | 10 | Inference | 13.02330340 | 13.02330340 |
| 10 | 1 | 10 | Postprocessing | 0.80318660 | 0.80318660 |
| 10 | 1 | 10 | Core | 27.93829840 | 27.93829840 |
| 10 | 1 | 10 | Other | 0.16729240 | 0.16729240 |
| 10 | 1 | 10 | End-to-End | 28.10559080 | 28.10559080 |
+-------+------------+-----------+----------------+------------------------+----------------------------+
{'res': {'input_path': 'vehicle_certificate-1.png', 'page_index': None, 'rec_text': '', 'rec_score': 0.0}}


C++ Traceback (most recent call last):

0 phi::OneDNNContextThreadLocals::Body::~Body()
1 phi::OneDNNContext::Impl::ResetBlobMap(void*)


Error Message Summary:

FatalError: Process abort signal is detected by the operating system.
[TimeInfo: *** Aborted at 1745547876 (unix time) try "date -d @1745547876" if you are using GNU date ***]
[SignalInfo: *** SIGABRT (@0x3e80003fe88) received by PID 261768 (TID 0x7fc0a85794c0) from PID 261768 ***]

Aborted (core dumped)
(base) ubuntu@VM-0-2-ubuntu:~/ocr$ PADDLE_PDX_INFER_BENCHMARK=True PADDLE_PDX_INFER_BENCHMARK_WARMUP=5 PADDLE_PDX_INFER_BENCHMARK_ITERS=10 PADDLE_PDX_INFER_BENCHMARK_OUTPUT_DIR=./benchmark python test_infer.py
Using official model (PP-OCRv4_server_seal_det), the model files will be automatically downloaded and saved in /home/ubuntu/.paddlex/official_models.
/home/ubuntu/miniconda3/lib/python3.12/site-packages/paddle/utils/cpp_extension/extension_utils.py:711: UserWarning: No ccache found. Please be aware that recompiling all source files may be required. You can download and install ccache from: https://github.com/ccache/ccache/blob/master/doc/INSTALL.md
warnings.warn(warning_message)
Warmup Data
+-------+------------+-----------+----------------+------------------------+----------------------------+
| Iters | Batch Size | Instances | Type | Avg Time Per Iter (ms) | Avg Time Per Instance (ms) |
+-------+------------+-----------+----------------+------------------------+----------------------------+
| 5 | 1 | 5 | Preprocessing | 26.84308980 | 26.84308980 |
| 5 | 1 | 5 | Inference | 272.28100240 | 272.28100240 |
| 5 | 1 | 5 | Postprocessing | 12.36584280 | 12.36584280 |
| 5 | 1 | 5 | Core | 311.48993500 | 311.48993500 |
| 5 | 1 | 5 | Other | 6.46528520 | 6.46528520 |
| 5 | 1 | 5 | End-to-End | 317.95522020 | 317.95522020 |
+-------+------------+-----------+----------------+------------------------+----------------------------+
Operation Info
+------------------------+----------------------------------------------------------------------------------------------------------------+
| Operation | Source Code Location |
+------------------------+----------------------------------------------------------------------------------------------------------------+
| ReadImage | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/common/reader/image_reader.py:47 |
| DetResizeForTest | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/text_detection/processors.py:58 |
| NormalizeImage | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/text_detection/processors.py:218 |
| ToCHWImage | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/common/vision/processors.py:277 |
| ToBatch | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/common/vision/processors.py:284 |
| PaddleInferChainLegacy | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/common/static_infer.py:293 |
| DBPostProcess | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/text_detection/processors.py:453 |
+------------------------+----------------------------------------------------------------------------------------------------------------+
Detail Data
+-------+------------+-----------+------------------------+------------------------+----------------------------+
| Iters | Batch Size | Instances | Operation | Avg Time Per Iter (ms) | Avg Time Per Instance (ms) |
+-------+------------+-----------+------------------------+------------------------+----------------------------+
| 10 | 1 | 10 | ReadImage | 13.64812370 | 13.64812370 |
| 10 | 1 | 10 | DetResizeForTest | 0.79956080 | 0.79956080 |
| 10 | 1 | 10 | NormalizeImage | 9.19802970 | 9.19802970 |
| 10 | 1 | 10 | ToCHWImage | 0.00630180 | 0.00630180 |
| 10 | 1 | 10 | ToBatch | 1.66296550 | 1.66296550 |
| 10 | 1 | 10 | PaddleInferChainLegacy | 190.93261820 | 190.93261820 |
| 10 | 1 | 10 | DBPostProcess | 11.76529860 | 11.76529860 |
+-------+------------+-----------+------------------------+------------------------+----------------------------+
Summary Data
+-------+------------+-----------+----------------+------------------------+----------------------------+
| Iters | Batch Size | Instances | Type | Avg Time Per Iter (ms) | Avg Time Per Instance (ms) |
+-------+------------+-----------+----------------+------------------------+----------------------------+
| 10 | 1 | 10 | Preprocessing | 25.31498150 | 25.31498150 |
| 10 | 1 | 10 | Inference | 190.93261820 | 190.93261820 |
| 10 | 1 | 10 | Postprocessing | 11.76529860 | 11.76529860 |
| 10 | 1 | 10 | Core | 228.01289830 | 228.01289830 |
| 10 | 1 | 10 | Other | 6.65302050 | 6.65302050 |
| 10 | 1 | 10 | End-to-End | 234.66591880 | 234.66591880 |
+-------+------------+-----------+----------------+------------------------+----------------------------+
{'res': {'input_path': 'vehicle_certificate-1.png', 'page_index': None, 'dt_polys': [array([[350, 881],
...,
[347, 880]]), array([[179, 836],
...,
[179, 837]]), array([[184, 346],
...,
[185, 343]]), array([[381, 310],
...,
[350, 304]]), array([[547, 285],
...,
[548, 284]]), array([[514, 114],
...,
[513, 114]])], 'dt_scores': [0.9204889685819411, 0.6356337994641965, 0.9493531124297723, 0.9272297078521581, 0.8743904497081926, 0.8812033888481393]}}


C++ Traceback (most recent call last):

0 phi::OneDNNContextThreadLocals::Body::~Body()
1 phi::OneDNNContext::Impl::ResetBlobMap(void*)


Error Message Summary:

FatalError: Process abort signal is detected by the operating system.
[TimeInfo: *** Aborted at 1745547919 (unix time) try "date -d @1745547919" if you are using GNU date ***]
[SignalInfo: *** SIGABRT (@0x3e800040ee7) received by PID 265959 (TID 0x7fea354874c0) from PID 265959 ***]

Aborted (core dumped)
(base) ubuntu@VM-0-2-ubuntu:~/ocr$ PADDLE_PDX_INFER_BENCHMARK=True PADDLE_PDX_INFER_BENCHMARK_WARMUP=5 PADDLE_PDX_INFER_BENCHMARK_ITERS=10 PADDLE_PDX_INFER_BENCHMARK_OUTPUT_DIR=./benchmark python test_infer.py
Using official model (PP-OCRv4_server_rec), the model files will be automatically downloaded and saved in /home/ubuntu/.paddlex/official_models.
/home/ubuntu/miniconda3/lib/python3.12/site-packages/paddle/utils/cpp_extension/extension_utils.py:711: UserWarning: No ccache found. Please be aware that recompiling all source files may be required. You can download and install ccache from: https://github.com/ccache/ccache/blob/master/doc/INSTALL.md
warnings.warn(warning_message)
Warmup Data
+-------+------------+-----------+----------------+------------------------+----------------------------+
| Iters | Batch Size | Instances | Type | Avg Time Per Iter (ms) | Avg Time Per Instance (ms) |
+-------+------------+-----------+----------------+------------------------+----------------------------+
| 5 | 1 | 5 | Preprocessing | 14.67402380 | 14.67402380 |
| 5 | 1 | 5 | Inference | 99.34680800 | 99.34680800 |
| 5 | 1 | 5 | Postprocessing | 0.61290780 | 0.61290780 |
| 5 | 1 | 5 | Core | 114.63373960 | 114.63373960 |
| 5 | 1 | 5 | Other | 0.20404960 | 0.20404960 |
| 5 | 1 | 5 | End-to-End | 114.83778920 | 114.83778920 |
+-------+------------+-----------+----------------+------------------------+----------------------------+
Operation Info
+------------------------+------------------------------------------------------------------------------------------------------------------+
| Operation | Source Code Location |
+------------------------+------------------------------------------------------------------------------------------------------------------+
| ReadImage | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/common/reader/image_reader.py:47 |
| OCRReisizeNormImg | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/text_recognition/processors.py:65 |
| ToBatch | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/text_recognition/processors.py:235 |
| PaddleInferChainLegacy | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/common/static_infer.py:293 |
| CTCLabelDecode | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/text_recognition/processors.py:189 |
+------------------------+------------------------------------------------------------------------------------------------------------------+
Detail Data
+-------+------------+-----------+------------------------+------------------------+----------------------------+
| Iters | Batch Size | Instances | Operation | Avg Time Per Iter (ms) | Avg Time Per Instance (ms) |
+-------+------------+-----------+------------------------+------------------------+----------------------------+
| 10 | 1 | 10 | ReadImage | 13.73071390 | 13.73071390 |
| 10 | 1 | 10 | OCRReisizeNormImg | 0.14797030 | 0.14797030 |
| 10 | 1 | 10 | ToBatch | 0.17887820 | 0.17887820 |
| 10 | 1 | 10 | PaddleInferChainLegacy | 12.82760040 | 12.82760040 |
| 10 | 1 | 10 | CTCLabelDecode | 0.87221440 | 0.87221440 |
+-------+------------+-----------+------------------------+------------------------+----------------------------+
Summary Data
+-------+------------+-----------+----------------+------------------------+----------------------------+
| Iters | Batch Size | Instances | Type | Avg Time Per Iter (ms) | Avg Time Per Instance (ms) |
+-------+------------+-----------+----------------+------------------------+----------------------------+
| 10 | 1 | 10 | Preprocessing | 14.05756240 | 14.05756240 |
| 10 | 1 | 10 | Inference | 12.82760040 | 12.82760040 |
| 10 | 1 | 10 | Postprocessing | 0.87221440 | 0.87221440 |
| 10 | 1 | 10 | Core | 27.75737720 | 27.75737720 |
| 10 | 1 | 10 | Other | 0.17354430 | 0.17354430 |
| 10 | 1 | 10 | End-to-End | 27.93092150 | 27.93092150 |
+-------+------------+-----------+----------------+------------------------+----------------------------+
{'res': {'input_path': 'vehicle_certificate-1.png', 'page_index': None, 'rec_text': '', 'rec_score': 0.0}}


C++ Traceback (most recent call last):

0 phi::OneDNNContextThreadLocals::Body::~Body()
1 phi::OneDNNContext::Impl::ResetBlobMap(void*)


Error Message Summary:

FatalError: Process abort signal is detected by the operating system.
[TimeInfo: *** Aborted at 1745547944 (unix time) try "date -d @1745547944" if you are using GNU date ***]
[SignalInfo: *** SIGABRT (@0x3e800041d1c) received by PID 269596 (TID 0x7fedccfd74c0) from PID 269596 ***]

Aborted (core dumped)

(base) ubuntu@VM-0-2-ubuntu:~/ocr$ PADDLE_PDX_INFER_BENCHMARK=True PADDLE_PDX_INFER_BENCHMARK_WARMUP=5 PADDLE_PDX_INFER_BENCHMARK_ITERS=10 PADDLE_PDX_INFER_BENCHMARK_OUTPUT_DIR=./benchmark python test_infer.py
Using official model (SLANet_plus), the model files will be automatically downloaded and saved in /home/ubuntu/.paddlex/official_models.
/home/ubuntu/miniconda3/lib/python3.12/site-packages/paddle/utils/cpp_extension/extension_utils.py:711: UserWarning: No ccache found. Please be aware that recompiling all source files may be required. You can download and install ccache from: https://github.com/ccache/ccache/blob/master/doc/INSTALL.md
warnings.warn(warning_message)
Warmup Data
+-------+------------+-----------+----------------+------------------------+----------------------------+
| Iters | Batch Size | Instances | Type | Avg Time Per Iter (ms) | Avg Time Per Instance (ms) |
+-------+------------+-----------+----------------+------------------------+----------------------------+
| 5 | 1 | 5 | Preprocessing | 16.37448200 | 16.37448200 |
| 5 | 1 | 5 | Inference | 273.68503060 | 273.68503060 |
| 5 | 1 | 5 | Postprocessing | 1.28600040 | 1.28600040 |
| 5 | 1 | 5 | Core | 291.34551300 | 291.34551300 |
| 5 | 1 | 5 | Other | 2.46695100 | 2.46695100 |
| 5 | 1 | 5 | End-to-End | 293.81246400 | 293.81246400 |
+-------+------------+-----------+----------------+------------------------+----------------------------+
Operation Info
+------------------------+-----------------------------------------------------------------------------------------------------------------------------+
| Operation | Source Code Location |
+------------------------+-----------------------------------------------------------------------------------------------------------------------------+
| ReadImage | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/common/reader/image_reader.py:47 |
| ResizeByLong | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/common/vision/processors.py:161 |
| Normalize | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/common/vision/processors.py:268 |
| Pad | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/table_structure_recognition/processors.py:59 |
| ToCHWImage | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/common/vision/processors.py:277 |
| ToBatch | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/common/vision/processors.py:284 |
| PaddleInferChainLegacy | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/common/static_infer.py:293 |
| TableLabelDecode | /home/ubuntu/miniconda3/lib/python3.12/site-packages/paddlex/inference/models/table_structure_recognition/processors.py:124 |
+------------------------+-----------------------------------------------------------------------------------------------------------------------------+
Detail Data
+-------+------------+-----------+------------------------+------------------------+----------------------------+
| Iters | Batch Size | Instances | Operation | Avg Time Per Iter (ms) | Avg Time Per Instance (ms) |
+-------+------------+-----------+------------------------+------------------------+----------------------------+
| 10 | 1 | 10 | ReadImage | 13.44854900 | 13.44854900 |
| 10 | 1 | 10 | ResizeByLong | 0.51650650 | 0.51650650 |
| 10 | 1 | 10 | Normalize | 1.14763600 | 1.14763600 |
| 10 | 1 | 10 | Pad | 0.42617720 | 0.42617720 |
| 10 | 1 | 10 | ToCHWImage | 0.00423230 | 0.00423230 |
| 10 | 1 | 10 | ToBatch | 0.46889510 | 0.46889510 |
| 10 | 1 | 10 | PaddleInferChainLegacy | 167.11310850 | 167.11310850 |
| 10 | 1 | 10 | TableLabelDecode | 1.27953660 | 1.27953660 |
+-------+------------+-----------+------------------------+------------------------+----------------------------+
Summary Data
+-------+------------+-----------+----------------+------------------------+----------------------------+
| Iters | Batch Size | Instances | Type | Avg Time Per Iter (ms) | Avg Time Per Instance (ms) |
+-------+------------+-----------+----------------+------------------------+----------------------------+
| 10 | 1 | 10 | Preprocessing | 16.01199610 | 16.01199610 |
| 10 | 1 | 10 | Inference | 167.11310850 | 167.11310850 |
| 10 | 1 | 10 | Postprocessing | 1.27953660 | 1.27953660 |
| 10 | 1 | 10 | Core | 184.40464120 | 184.40464120 |
| 10 | 1 | 10 | Other | 1.55052390 | 1.55052390 |
| 10 | 1 | 10 | End-to-End | 185.95516510 | 185.95516510 |
+-------+------------+-----------+----------------+------------------------+----------------------------+
{'res': {'input_path': 'vehicle_certificate-1.png', 'page_index': None, 'bbox': [[4, 14, 736, 14, 747, 124, 5, 126], [9, 87, 603, 86, 613, 136, 9, 137], [74, 121, 211, 120, 217, 153, 78, 153], [204, 117, 388, 116, 392, 141, 210, 142], [412, 114, 603, 114, 611, 139, 420, 139], [508, 112, 661, 113, 658, 139, 502, 139], [75, 148, 203, 148, 209, 175, 78, 175], [209, 143, 416, 142, 415, 167, 211, 168], [389, 142, 674, 142, 682, 167, 397, 167], [69, 171, 195, 172, 197, 199, 71, 198], [207, 166, 476, 166, 471, 191, 205, 191], [485, 158, 653, 157, 656, 188, 486, 189], [69, 195, 199, 195, 199, 216, 71, 215], [214, 189, 477, 189, 473, 209, 215, 209], [474, 184, 653, 183, 657, 206, 477, 206], [70, 216, 208, 217, 208, 235, 71, 234], [219, 209, 462, 209, 460, 228, 221, 228], [477, 204, 660, 204, 664, 225, 479, 226], [62, 235, 205, 235, 205, 254, 63, 253], [224, 232, 426, 232, 425, 250, 225, 249], [437, 235, 611, 235, 618, 251, 443, 251], [52, 250, 212, 252, 212, 275, 52, 273], [218, 250, 380, 250, 379, 272, 217, 271], [443, 257, 605, 257, 609, 275, 445, 275], [55, 273, 210, 274, 210, 294, 55, 293], [216, 272, 374, 272, 372, 293, 215, 293], [429, 281, 621, 281, 624, 298, 429, 299], [56, 294, 208, 295, 208, 315, 55, 314], [221, 294, 384, 295, 381, 314, 219, 313], [428, 303, 600, 303, 603, 319, 428, 319], [66, 309, 212, 310, 211, 335, 66, 333], [236, 313, 360, 314, 358, 335, 234, 335], [338, 312, 406, 313, 404, 337, 335, 335], [430, 314, 529, 315, 529, 333, 428, 332], [525, 310, 626, 312, 627, 328, 522, 327], [88, 330, 232, 330, 227, 346, 86, 346], [249, 338, 349, 336, 347, 357, 249, 359], [328, 336, 408, 336, 407, 359, 325, 359], [434, 337, 533, 336, 534, 357, 434, 358], [519, 333, 623, 333, 625, 351, 519, 351], [87, 349, 226, 349, 222, 369, 86, 369], [242, 355, 349, 353, 345, 373, 239, 375], [343, 356, 454, 355, 451, 378, 339, 380], [457, 356, 554, 355, 554, 377, 455, 378], [529, 349, 652, 349, 652, 371, 526, 372], [88, 369, 222, 369, 218, 388, 87, 388], [230, 373, 367, 372, 363, 392, 227, 392], [339, 378, 476, 377, 473, 407, 334, 408], [452, 376, 570, 376, 568, 402, 447, 403], [529, 370, 664, 369, 662, 395, 524, 395], [88, 389, 219, 389, 216, 407, 88, 407], [232, 393, 419, 392, 416, 413, 230, 413], [337, 397, 486, 396, 483, 428, 333, 428], [430, 396, 569, 396, 566, 425, 426, 426], [515, 392, 657, 392, 654, 416, 508, 417], [86, 409, 221, 409, 217, 426, 85, 426], [236, 413, 481, 412, 479, 434, 234, 435], [75, 425, 216, 426, 217, 456, 77, 454], [244, 430, 563, 431, 562, 459, 241, 458], [73, 444, 213, 447, 214, 475, 75, 473], [240, 447, 407, 448, 403, 475, 237, 474], [416, 453, 540, 455, 543, 480, 415, 479], [504, 447, 674, 449, 665, 474, 491, 472], [72, 470, 203, 471, 200, 498, 71, 496], [237, 472, 398, 472, 394, 498, 234, 498], [388, 474, 510, 474, 515, 499, 389, 499], [491, 471, 665, 472, 659, 493, 482, 493], [69, 494, 201, 495, 198, 523, 68, 521], [225, 499, 356, 499, 353, 522, 222, 522], [365, 493, 478, 494, 478, 519, 364, 518], [483, 493, 670, 493, 671, 514, 482, 515], [56, 516, 204, 517, 202, 551, 56, 550], [228, 522, 348, 524, 343, 548, 223, 547], [409, 516, 529, 518, 533, 555, 410, 554], [501, 511, 700, 512, 690, 551, 489, 550], [60, 541, 211, 543, 209, 573, 60, 572], [216, 546, 357, 548, 352, 569, 212, 567], [426, 552, 557, 553, 563, 604, 430, 603], [74, 567, 221, 570, 219, 598, 75, 595], [219, 570, 360, 572, 354, 592, 215, 591], [480, 580, 654, 582, 661, 652, 484, 651], [64, 595, 205, 597, 203, 626, 65, 625], [183, 597, 353, 598, 348, 612, 179, 612], [93, 620, 227, 621, 226, 636, 94, 636], [208, 620, 364, 620, 357, 630, 202, 630], [106, 644, 277, 644, 270, 713, 104, 713], [290, 645, 442, 643, 432, 715, 279, 716], [123, 683, 292, 683, 289, 760, 123, 760], [269, 683, 446, 684, 439, 772, 260, 771], [125, 767, 511, 771, 497, 877, 120, 874], [451, 802, 630, 804, 641, 933, 457, 933]], 'structure': ['', '', '

', '', '', '<td', ' colspan="5"', '>', '', '', '', '<td', ' colspan="5"', '>', '', '', '', '', '<td', ' colspan="2"', '>', '', '', '', '', '', '', '<td', ' colspan="2"', '>', '', '<td', ' colspan="2"', '>', '', '', '', '', '<td', ' colspan="3"', '>', '', '', '', '', '', '<td', ' colspan="3"', '>', '', '', '', '', '', '<td', ' colspan="3"', '>', '', '', '', '', '', '<td', ' colspan="2"', '>', '', '<td', ' colspan="2"', '>', '', '', '', '', '<td', ' colspan="2"', '>', '', '<td', ' colspan="2"', '>', '', '', '', '', '<td', ' colspan="2"', '>', '', '<td', ' colspan="2"', '>', '', '', '', '', '<td', ' colspan="2"', '>', '', '<td', ' colspan="2"', '>', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '<td', ' colspan="4"', '>', '', '', '', '', '<td', ' colspan="4"', '>', '', '', '', '', '<td', ' colspan="2"', '>', '', '', '', '', '', '', '<td', ' colspan="2"', '>', '', '', '', '', '', '', '', '', '<td', ' colspan="2"', '>', '', '', '', '', '<td', ' colspan="2"', '>', '', '', '<td', ' colspan="2"', '>', '', '', '', '', '<td', ' colspan="2"', '>', '', '<td', ' colspan="2"', '>', '', '', '', '', '<td', ' colspan="2"', '>', '', '<td', ' colspan="2"', ' rowspan="6"', '>', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '<td', ' colspan="2"', '>', '', '<td', ' colspan="2"', '>', '', '', '', '
', '', ''], 'structure_score': 0.96400994}}


C++ Traceback (most recent call last):

0 phi::OneDNNContextThreadLocals::Body::~Body()
1 phi::OneDNNContext::Impl::ResetBlobMap(void*)


Error Message Summary:

FatalError: Process abort signal is detected by the operating system.
[TimeInfo: *** Aborted at 1745548000 (unix time) try "date -d @1745548000" if you are using GNU date ***]
[SignalInfo: *** SIGABRT (@0x3e8000438f4) received by PID 276724 (TID 0x7fd1016194c0) from PID 276724 ***]

Aborted (core dumped)

@LvZhenChang
Copy link
Author

请大神帮忙看看,我测试单个模型的相应都是毫秒级的,为什么用PP-ChatOCRv3-doc产线就需要6~7秒的时间

@LvZhenChang
Copy link
Author

请问这个问题,有啥说法没?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants