{"id":5210,"date":"2022-04-13T17:14:59","date_gmt":"2022-04-13T08:14:59","guid":{"rendered":"https:\/\/www.skyer9.pe.kr\/wordpress\/?p=5210"},"modified":"2022-04-13T18:14:39","modified_gmt":"2022-04-13T09:14:39","slug":"spark-cluster-%ec%a2%85%eb%a5%98","status":"publish","type":"post","link":"https:\/\/www.skyer9.pe.kr\/wordpress\/?p=5210","title":{"rendered":"Spark Cluster \uc885\ub958"},"content":{"rendered":"<h1>Spark Cluster \uc885\ub958<\/h1>\n<h2>Local Mode<\/h2>\n<p>\ud14c\uc2a4\ud2b8\uc6a9\uc73c\ub85c \uc4f0\uc778\ub2e4.<br \/>\n\ud558\ub098\uc758 JVM \uc5d0 driver 1\uac1c\uc640 executor 1\uac1c\uc529\ub9cc \uc0dd\uc131\ud55c\ub2e4.<br \/>\nexecutor\ub294 \uc2a4\ub808\ub4dc\ub97c \uc5ec\ub7ec\uac1c \uc0dd\uc131\ud560 \uc218 \uc788\ub2e4.<\/p>\n<h2>Local Cluster Mode<\/h2>\n<p>master \uc640 worker \ud504\ub85c\uc138\uc2a4\uac00 \uc788\ub2e4.<br \/>\nworker \ub294 \uac01\uac01\uc758 JVM \uc5d0\uc11c \uc2e4\ud589\ub41c\ub2e4.<\/p>\n<h2>Spark Standalone Cluster Mode<\/h2>\n<p>master \uc640 worker \ud504\ub85c\uc138\uc2a4\uac00 \uc788\ub2e4.<br \/>\nmaster \ud504\ub85c\uc138\uc2a4\uac00 \ud074\ub7ec\uc2a4\ud130 \ub9e4\ub2c8\uc800 \uc5ed\ud560\uc744 \ud55c\ub2e4.<\/p>\n<h2>Spark Yarn Cluster Mode<\/h2>\n<p>Yarn \uc774 \ud074\ub7ec\uc2a4\ud130 \ub9e4\ub2c8\uc800 \uc5ed\ud560\uc744 \ud55c\ub2e4.<br \/>\nHadoop Cluster \uc5d0 \uac19\uc774 \uc124\uce58\ud574 \uc900\ub2e4.<\/p>\n<h2>Spark Mesos Cluster Mode<\/h2>\n<p>Mesos \uac00 \ud074\ub7ec\uc2a4\ud130 \ub9e4\ub2c8\uc800 \uc5ed\ud560\uc744 \ud55c\ub2e4.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Spark Cluster \uc885\ub958 Local Mode \ud14c\uc2a4\ud2b8\uc6a9\uc73c\ub85c \uc4f0\uc778\ub2e4. \ud558\ub098\uc758 JVM \uc5d0 driver 1\uac1c\uc640 executor 1\uac1c\uc529\ub9cc \uc0dd\uc131\ud55c\ub2e4. executor\ub294 \uc2a4\ub808\ub4dc\ub97c \uc5ec\ub7ec\uac1c \uc0dd\uc131\ud560 \uc218 \uc788\ub2e4. Local Cluster Mode master \uc640 worker \ud504\ub85c\uc138\uc2a4\uac00 \uc788\ub2e4. worker \ub294 \uac01\uac01\uc758 JVM \uc5d0\uc11c \uc2e4\ud589\ub41c\ub2e4. Spark Standalone Cluster Mode master \uc640 worker \ud504\ub85c\uc138\uc2a4\uac00 \uc788\ub2e4. master \ud504\ub85c\uc138\uc2a4\uac00 \ud074\ub7ec\uc2a4\ud130 \ub9e4\ub2c8\uc800 \uc5ed\ud560\uc744 \ud55c\ub2e4. Spark Yarn Cluster Mode Yarn\u2026 <span class=\"read-more\"><a href=\"https:\/\/www.skyer9.pe.kr\/wordpress\/?p=5210\">Read More &raquo;<\/a><\/span><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[12],"tags":[],"class_list":["post-5210","post","type-post","status-publish","format-standard","hentry","category-devops"],"_links":{"self":[{"href":"https:\/\/www.skyer9.pe.kr\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/5210","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.skyer9.pe.kr\/wordpress\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.skyer9.pe.kr\/wordpress\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.skyer9.pe.kr\/wordpress\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.skyer9.pe.kr\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=5210"}],"version-history":[{"count":4,"href":"https:\/\/www.skyer9.pe.kr\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/5210\/revisions"}],"predecessor-version":[{"id":5214,"href":"https:\/\/www.skyer9.pe.kr\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/5210\/revisions\/5214"}],"wp:attachment":[{"href":"https:\/\/www.skyer9.pe.kr\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=5210"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.skyer9.pe.kr\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=5210"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.skyer9.pe.kr\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=5210"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}