README - Ncnn — ContextQMD

Rank the boards.

The table below is generated by RankCards, using the timings found in the /ncnn/benchmark/README.md file.

First, the best set of timings is selected from each board.

The set is then compared to a reference set by calculating the ratio of each model one by one and averaging all results.

Finally, the boards are ranked from fast to slow.

	Board	Ratio
1	NVIDIA Quadro RTX 8000 (TU102 SM x 72 + Tensor Core x 576)	0.147
2	nVIDIA RTX2080 of Desktop	0.15
3	NVIDIA GeForce RTX 3060 Ti of Desktop[2023-10-12]	0.18
4	nVIDIA RTX2060 of Notebook	0.198
5	Intel® Core™ i7-13700K of Desktop[2023-10-12]	0.255
6	AMD Radeon RX 6900 XT of Desktop[2023-10-12]	0.275
7	NVIDIA RTX3090 (GA102 SM x 82 + Tensor Core 328)	0.277
8	MediaTek Dimensity 9300 (MT6989) (Cortex-X4 3.25 GHz + 2.85 GHz x 3 + Cortex-A720 2.0 GHz x 4 + Mali-G720-Immortalis MC12)	0.309
9	MacBook Pro (13-inch, M1, 2020)	0.346
10	AWS c5.4xlarge Instance	0.418
11	AMD Ryzen 9 5950X 16-Core of Desktop[2023-10-12]	0.427
12	Qualcomm SM8550-AB Snapdragon 8 Gen 2 (Kyro 3.20 GHz + 2.8 GHz x 2 + 2.80 GHz x 2 + 2.00 GHz * 3 + Adreno 740)	0.45
13	AMD Ryzen 5700g (Zen3 3.8 GHz ~ 4.6 GHz x 8)	0.478
14	HUAWEI KunPeng 920 3211K (x24 cores)	0.482
15	NVIDIA Jetson AGX Orin (Cortex-A78AE 2.2 GHz x 12 + [email protected] GHz Tensor Cores 64)	0.485
16	HUAWEI KunPeng 920 2251K (x8 cores)	0.54
17	nVIDIA RTX A3000 of Notebook (6GB)	0.577
18	Intel(R) UHD Graphics 770 of Desktop[2023-10-12]	0.593
19	OrangePi5, Rockchip RK3588s (Quad Core A76 2.4GHz + Quad Core A55 1.8GHz)	0.642
20	Qualcomm SM8150-AC Snapdragon 855+ (Kyro485 2.96 GHz + 2.42 GHz x 3 + 1.80 GHz x 4 + Adreno 640)	0.665
21	Rockchip RK3588 (Quad Core A76 2.4GHz + Quad Core A55 1.8GHz)	0.753
22	NVIDIA Jetson Orin Nano	0.819
23	Raspberry Pi 5 Broadcom BCM2712, Cortex-A76 (ARMv8) (2.4GHz x 4)	1
24	Station-M3/ROC-RK3588S-PC, Rockchip RK3588S (Quad Core A76 2.4GHz + Quad Core A55 1.8GHz + Mali-G610) StationOS (Android)	1
25	NVIDIA Jetson AGX Xavier (Carmel 2.2 GHz x 8 + Volta Tensor Cores 64)	1.05
26	Loongson 3A6000 (LA664 2.5GHz * 4+4)	1.11
27	Hyper-V Linux Guest with GPU-PV enabled (Intel Core i7-11800H, NVIDIA GeForce RTX 3070 Laptop GPU)	1.19
28	Rockchip RK3588 (Cortex-A76 2.4GHz x 4 + Cortex-A55 1.8GHz x 4)	1.35
29	NVIDIA Jetson TX2 NX(NV-Denver2 2.0Ghz x 2 + Cortex-A57 2.0Ghz x 4 + 256-core NVIDIA Pascal iGPU)	1.59
30	Hyper-V Linux Guest with GPU-PV enabled (Intel Core i7-7700K, NVIDIA GeForce GTX 1050 Ti)	1.66
31	Phytium FT-2000+/64 (FTC662 armv8 2.4GHz x 8)	1.75
32	AMD Ryzen Threadripper 3970X (Zen2 3.7 GHz ~ 4.5 GHz x 32)	2.19
33	AMD Ryzen Embedded V1605B (Zen 2.0 GHz ~ 3.6 GHz x 4 + Radeon Vega 8 1.1GHz 8CU)	2.23
34	Avaota Aim T527, Allwinner T527 (Cortex-A55 2.2GHz x 4 + Cortex-A55 1.8GHz x 4)	2.28
35	Loongson 3A5000 (LA464 2.5GHz * 4)	2.31
36	Qualcomm MSM8996 Pro Snapdragon 821 (Kyro 2.35GHz x 2 + Kyro 2.19GHz x 2)	2.37
37	NVIDIA Jetson Nano	2.44
38	Intel Celeron N5105	2.8
39	Loongson 3A4000 (GS464V 1.8GHz * 4 with MSA128)	3.24
40	Khadas VIM3, Amlogic A311D (Cortex-A73 2.2GHz x 4 + Cortex-A53 1.8GHz x 2)	3.48
41	Kirin 970 (Cortex-A73 2.4GHz x 4 + Cortex-A53 1.8GHz x 4)	3.58
42	Qualcomm MSM8998 Snapdragon 835 (Kyro 2.45GHz x 4 + Kyro 1.9GHz x 4 + Adreno 540)	3.63
43	MacBook Pro (15-inch, 2019) - 2.6GHz six cores Intel Core i7 && Radeon Pro 555X 4GB && Intel UHD Graphics 630 1536MB	3.75
44	Qualcomm MSM6150 Snapdragon 675 (Kyro460 2.0GHz x 2 + Kyro460 1.7GHz x 6 + Adreno 612)	3.75
45	Qualcomm MSM8994 Snapdragon 810 (Cortex-A57 2.0GHz x 4 + Cortex-A53 1.55GHz x 4)	3.82
46	Station P2, Rockchip RK3568 (Cortex-A55 2.0GHz x 4)	3.85
47	Rock3A, Rockchip RK3568 (Cortex-A55 2.0GHz x 4) ubuntu 20.04	3.86
48	Loongson 3A4000 (GS464V 1.8GHz * 4 with MSA128)	4.08
49	Radxa Zero 3W, Cortex-A55 (ARMv82) (1.416 GHz x 4)	4.5
50	Raspberry Pi 4 Model B Broadcom BCM2711B0, Cortex-A72 (ARMv8) (1.8GHz x 4)	4.95
51	OrangePi4 LTS, Rockchip RK3399 (Cortex-A72 1.8GHz x 2 + Cortex-A53 1.5GHz x 4)	5.11
52	Rockchip RK3399 (Cortex-A72 1.8GHz x 2 + Cortex-A53 1.5GHz x 4)	5.16
53	PhytiumPi, Phytium E2000 ([email protected] x2 + [email protected] x2)	5.16
54	Qualcomm SDM660 Snapdragon 660 (Kyro260 2.2GHz x 4 + Kyro260 1.84GHz x 4 + Adreno 512)	5.26
55	Phytium FT-2000/4 (FTC663 armv8 2.2GHz x 4)	5.27
56	RDK X3 Module (Cortex-A53 1.5GHz x 4) aarch64	5.88
57	Station-M2/ROC-RK3566-PC, Rockchip RK3566 (Cortex-A55 1.8GHz x 4 + Mali-G52) StationOS (Android)	6.51
58	Rockchip RK3288-CG.W (Cortex-A17 1.8GHz x 4)	6.66
59	Qualcomm MSM8916 Snapdragon 410 (Cortex-A53 1.2GHz x 4)	7.63
60	NanoPi R2S, Rockchip RK3328 (Cortex-A53 1.3GHz x 4) Armbian focal (21.05.1) aarch64	7.66
61	Intel Atom x5-Z8350	7.74
62	Loongson 2K2000 (LA364 1.5GHz * 2 with lsx)	8.23
63	EAIDK 310, Rockchip RK3228H (Cortex-A53 1.3GHz x 4) fedora-28 aarch64	8.34
64	OrangePi Zero 2, Allwinner H616 (Cortex-A53 1.5GHz x 4)	9.51
65	Raspberry Pi 3 Model B+ Broadcom BCM2837B0, Cortex-A53 (ARMv8) (1.4GHz x 4)	9.87
66	iPhone 5S (Apple A7 1.3GHz x 2)	11
67	MYIR RemiPi,Renesas RZG2L(Cortex-A55 1.5GHz x 2)	11.9
68	Raspberry Pi 5 Broadcom BCM2712, VideoCore VII Graphics (Vulkan 1.2)	12.5
69	Raspberry Pi Zero 2 W Broadcom BCM2710A1, Cortex-A53 (ARMv8) (1.0GHz x 4)	13.7
70	Xeon Phi 3120A (1.10 GHz 57-core 228-thread)	15.1
71	Loongson 3A3000 (GS464E 1.45GHz * 4)	16.3
72	AXERA AX620A (Cortex-A7 1.0GHz * 4)	18.8
73	Loongson 2K1000LA (LA264 1.0GHz * 2)	24.4
74	Loongson 2K1000 (GS264 1.0GHz x 2)	24.8
75	Freescale i.MX7 Dual (Cortex A7 1.0GHz x 2)	26.7
76	Banana Pi M2 Zero 2 AllWinner H2+, Cortex-A7 (ARMv7-A) (1.2GHz x 4)	26.8
77	HiSilicon Hi3519V101 (Cortex-A17 1.2GHz x 1)	36.2
78	Sunway SW831 (sw_64 2.5GHz * 8)	40.7
79	Z7-Lite 7020 XC7Z020CLG400-2 (Cortex-A9 766MHz x 2)	43.2
80	Intel Celeron M 420 (Yonah 1.60 GHz x 1)	43.9
81	Amlogic S805 (Cortex-A5, 4 × 1.536GHz)	45.9
82	VisionFive2 , JH7110 (SiFive-U74(RV64GC) 1.5GHz x 4) riscv64 with PowerVR B-Series BXE-4-32	72.4
83	T-Head TH1520 (C910V, 1.848 GHz x 4 + BXM-4-64 PowerVR)	83.3
84	Sunway SW421 (sw_64 1.7GHz * 4)	116
85	Ingenic T40XP Xburst2 Core X2 1.4Ghz (without MSA)	165