{"id":8646,"date":"2024-02-22T13:48:38","date_gmt":"2024-02-22T04:48:38","guid":{"rendered":"https:\/\/www.skyer9.pe.kr\/wordpress\/?p=8646"},"modified":"2024-02-22T16:15:54","modified_gmt":"2024-02-22T07:15:54","slug":"onnx-open-neural-network-exchange","status":"publish","type":"post","link":"https:\/\/www.skyer9.pe.kr\/wordpress\/?p=8646","title":{"rendered":"ONNX (Open Neural Network Exchange)"},"content":{"rendered":"

ONNX (Open Neural Network Exchange)<\/h1>\n

ONNX \ub294 \uc11c\ub85c \ub2e4\ub978 DNN \ud504\ub808\uc784\uc6cc\ud06c \ud658\uacbd(ex Tensorflow, PyTorch, etc..)\uc5d0\uc11c \ub9cc\ub4e4\uc5b4\uc9c4 \ubaa8\ub378\ub4e4\uc744 \uc11c\ub85c \ud638\ud658\ub418\uac8c \uc0ac\uc6a9\ud560 \uc218 \uc788\ub3c4\ub85d \ub9cc\ub4e4\uc5b4\uc9c4 \uacf5\uc720 \ud50c\ub7ab\ud3fc\uc774\ub2e4.<\/p>\n

ONNX \ub610\ud55c DNN \ud504\ub808\uc784\uc6cc\ud06c\ub77c\uace0 \ubd80\ub978\ub2e4.<\/p>\n

\ud638\ud658<\/h2>\n

PyTorch \ub85c \ub9cc\ub4e4\uc5b4\uc9c4 \ubaa8\ub378\uc744 TensorRT \uc5d0\uc11c \uc2e4\ud589\ud558\uace0\uc790 \ud560\ub54c\ub3c4 \uc911\uac04\ub2e8\uacc4\uc5d0 ONNX model \ub85c \ubcc0\ud658\ud558\uc5ec \ub2e4\ub978 \uc5d4\uc9c4\uc73c\ub85c \ub118\uae38 \ub54c\ub3c4 \uc88b\ub2e4.<\/p>\n

PyTorch model \u2192 ONNX model \u2192 TensorRT engine<\/p>\n

PyTorch model \u2192 ONNX model \ubcc0\ud658<\/h2>\n

\uae30\ud559\uc2b5\ub41c resnet50 \ubaa8\ub378\uc744 \ubd88\uc5b4\uc640\uc11c onnx \ubaa8\ub378\ub85c \uc800\uc7a5\ud569\ub2c8\ub2e4.<\/p>\n

convert.py<\/p>\n

import torch\nimport torchvision.models as models\n\nmodel = models.resnet50(weights='ResNet50_Weights.DEFAULT')\nmodel.eval()\n\ndummy_input = torch.randn(1, 3, 224, 224)\ntorch.onnx.export(model, dummy_input, "resnet18.onnx")<\/code><\/pre>\n
pytorch \ubaa8\ub378\uacfc onnx \ubaa8\ub378\uc758 \uacb0\uacfc\uac12\uc744 \ube44\uad50\ud569\ub2c8\ub2e4.
\n\uc18c\uc218\uc810\ub2e8\uc704 \uc624\ucc28\uac00 \ubc1c\uc0dd\ud558\ubbc0\ub85c \uc624\ucc28\ubc94\uc704\ub97c \ubcf4\uc815\ud574 \uc90d\ub2c8\ub2e4.
\n\uc544\ubb34\uac83\ub3c4 \ucd9c\ub825\ub418\uc9c0 \uc54a\ub294\ub2e4\uba74 \ud14c\uc2a4\ud2b8\uac00 \uc131\uacf5\ud55c \uac83\uc785\ub2c8\ub2e4.<\/p>\n
compare.py<\/p>\n
import torch\nimport torchvision.models as models\n\nimport numpy as np\nimport onnxruntime as ort\n\ndummy_input = torch.randn(1, 3, 224, 224)\n\nmodel = models.resnet50(weights='ResNet50_Weights.DEFAULT')\nmodel.eval()\ntorch_output = model(dummy_input)\n\nort_session = ort.InferenceSession("resnet18.onnx")\nort_outputs = ort_session.run(None, {"input.1": dummy_input.numpy()})\n\nnp.testing.assert_allclose(torch_output.detach().numpy(), ort_outputs[0], rtol=1e-03, atol=1e-05)<\/code><\/pre>\n","protected":false},"excerpt":{"rendered":"
ONNX (Open Neural Network Exchange) ONNX \ub294 \uc11c\ub85c \ub2e4\ub978 DNN \ud504\ub808\uc784\uc6cc\ud06c \ud658\uacbd(ex Tensorflow, PyTorch, etc..)\uc5d0\uc11c \ub9cc\ub4e4\uc5b4\uc9c4 \ubaa8\ub378\ub4e4\uc744 \uc11c\ub85c \ud638\ud658\ub418\uac8c \uc0ac\uc6a9\ud560 \uc218 \uc788\ub3c4\ub85d \ub9cc\ub4e4\uc5b4\uc9c4 \uacf5\uc720 \ud50c\ub7ab\ud3fc\uc774\ub2e4. ONNX \ub610\ud55c DNN \ud504\ub808\uc784\uc6cc\ud06c\ub77c\uace0 \ubd80\ub978\ub2e4. \ud638\ud658 PyTorch \ub85c \ub9cc\ub4e4\uc5b4\uc9c4 \ubaa8\ub378\uc744 TensorRT \uc5d0\uc11c \uc2e4\ud589\ud558\uace0\uc790 \ud560\ub54c\ub3c4 \uc911\uac04\ub2e8\uacc4\uc5d0 ONNX model \ub85c \ubcc0\ud658\ud558\uc5ec \ub2e4\ub978 \uc5d4\uc9c4\uc73c\ub85c \ub118\uae38 \ub54c\ub3c4 \uc88b\ub2e4. PyTorch model \u2192 ONNX model \u2192\u2026 Read More »<\/a><\/span><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[18],"tags":[],"class_list":["post-8646","post","type-post","status-publish","format-standard","hentry","category-machine-learning"],"_links":{"self":[{"href":"https:\/\/www.skyer9.pe.kr\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/8646","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.skyer9.pe.kr\/wordpress\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.skyer9.pe.kr\/wordpress\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.skyer9.pe.kr\/wordpress\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.skyer9.pe.kr\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=8646"}],"version-history":[{"count":3,"href":"https:\/\/www.skyer9.pe.kr\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/8646\/revisions"}],"predecessor-version":[{"id":8649,"href":"https:\/\/www.skyer9.pe.kr\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/8646\/revisions\/8649"}],"wp:attachment":[{"href":"https:\/\/www.skyer9.pe.kr\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=8646"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.skyer9.pe.kr\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=8646"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.skyer9.pe.kr\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=8646"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}