{"id":3372,"date":"2021-09-13T23:37:09","date_gmt":"2021-09-13T14:37:09","guid":{"rendered":"https:\/\/www.skyer9.pe.kr\/wordpress\/?p=3372"},"modified":"2021-09-14T17:15:45","modified_gmt":"2021-09-14T08:15:45","slug":"kafka-%eb%8a%94-%ec%99%9c-%eb%b9%a0%eb%a5%bc%ea%b9%8c","status":"publish","type":"post","link":"https:\/\/www.skyer9.pe.kr\/wordpress\/?p=3372","title":{"rendered":"Kafka \ub294 \uc65c \ube60\ub97c\uae4c?"},"content":{"rendered":"

Kafka \ub294 \uc65c \ube60\ub97c\uae4c?<\/h1>\n

\ucc38\uc870<\/a><\/p>\n

Kafka<\/code> \ub294 \ub2e4\ub978 \ud050 \uad00\ub9ac \uc2dc\uc2a4\ud15c\uc774 \uba54\ubaa8\ub9ac \uae30\ubc18\uc73c\ub85c \uc6b4\uc601\ub418\ub294 \uac83\uacfc \ub2ec\ub9ac \ub514\uc2a4\ud06c \uae30\ubc18\uc73c\ub85c \uc6b4\uc601\ub429\ub2c8\ub2e4.<\/p>\n

\ub514\uc2a4\ud06c \uae30\ubc18\uc73c\ub85c \uc6b4\uc601\ub418\uae30\uc5d0 \ub300\ub7c9\uc758 \uba54\uc2dc\uc9c0\ub97c \ubcf4\uad00\ud560 \uc218 \uc788\uace0, \uc608\uce21\ubd88\uac00\ub2a5\ud55c \uc11c\ubc84 \ub2e4\uc6b4\uc5d0\ub3c4 \ub300\ucc98\ud560 \uc218 \uc788\ub294 \uc7a5\uc810\uc774 \uc0dd\uacbc\uc2b5\ub2c8\ub2e4.<\/p>\n

\uadf8\ub7f0\ub370…
\n\ub514\uc2a4\ud06c \uae30\ubc18\uc774\uba74 \ub290\ub824\uc57c \ud558\ub294\ub370 … \uc65c \ube60\ub974\ub2e4\ub294 \uc774\uc57c\uae30\uac00 \ub098\uc62c\uae4c\uc694?<\/p>\n

Zero Copy<\/h2>\n

Traditional Data Transfer<\/h3>\n

\uc77c\ubc18\uc801\uc778 \uc560\ud50c\ub9ac\ucf00\uc774\uc158\uc740 \ub370\uc774\ud0c0\ub97c \uba54\ubaa8\ub9ac\uc5d0 \uc62c\ub9b0 \ud6c4 \uc804\uc1a1\ud569\ub2c8\ub2e4.<\/p>\n

\"\"<\/p>\n

Zero Copy Data Transfer<\/h3>\n

Kafka<\/code> \ub294 \uc560\ud50c\ub9ac\ucf00\uc774\uc158\uc5d0 \ub370\uc774\ud0c0\ub97c \uc62c\ub9ac\ub294 \ub300\uc2e0, \ub514\uc2a4\ud06c\uc5d0\uc11c \ub370\uc774\ud0c0\ub97c \uc77d\uc74c\uacfc \ub3d9\uc2dc\uc5d0 \ub124\ud2b8\uc6cc\ud06c\uc5d0 \uc804\uc1a1\ud569\ub2c8\ub2e4.<\/p>\n

\"\"<\/p>\n

How to Zero Copy<\/h3>\n

Kernel \uba85\ub839\uc5b4 \uc911 sendfile()<\/code> \ud568\uc218\ub97c \uc774\uc6a9\ud568\uc73c\ub85c \ud574\uc11c,
\n\uc571\uc774 \uc0ac\uc6a9\ud558\ub294 \uba54\ubaa8\ub9ac\uc5d0 \ub370\uc774\ud0c0\ub97c \uc62c\ub9ac\uc9c0 \uc54a\uace0,
\n\uc989\uc2dc \ub124\ud2b8\uc6cc\ud06c\uc5d0 \ub370\uc774\ud0c0\uac00 \uc804\uc1a1\ub429\ub2c8\ub2e4.<\/p>\n

SSL enabled??<\/h3>\n

\uc554\ud638\ud654\ub97c \uc704\ud574 SSL<\/code> \uc744 \ud65c\uc131\ud654 \ud558\uba74 \uc5b4\ub5bb\uac8c \ub420\uae4c?<\/p>\n

\ub354\uc774\uc0c1 Zero Copy<\/code> \uc758 \uc774\uc810\uc744 \ubc1b\uc744 \uc218 \uc5c6\uace0,
\n\uc560\ud50c\ub9ac\ucf00\uc774\uc158 \uba54\ubaa8\ub9ac\uc5d0 \ud30c\uc77c\uc744 \uc62c\ub824\uc57c \ud569\ub2c8\ub2e4.<\/p>\n

Page Cache<\/h2>\n

Linux<\/code> \ud30c\uc77c \uc791\uc131 \uba85\ub839\uc774 \uc788\uc744 \ub54c,
\n\uc989\uc2dc \ub514\uc2a4\ud06c\uc5d0 \ud30c\uc77c\uc744 \uc800\uc7a5\ud558\ub294 \ub300\uc2e0 Page Cache<\/code> \ub77c\ub294 \uacf5\uac04\uc5d0 \uc800\uc7a5\ud6c4,
\n\uc9c0\uc5f0\ud558\uc5ec \ud30c\uc77c\uc744 \uc800\uc7a5\ud569\ub2c8\ub2e4.<\/p>\n

\ub610\ud55c, \ud558\ub098\uc758 Consumer<\/code> \uc5d0 \uc758\ud574 \uc77d\uae30 \uc694\uccad\uc774 \uc654\uc744 \ub54c,
\n\uc5ed\uc2dc Page Cache<\/code> \uc5d0 \uc800\uc7a5 \ud6c4,
\n\ub3d9\uc77c\ud55c \ub370\uc774\ud0c0 \uc694\uccad\uc774 \uc654\uc744 \ub54c \uba54\ubaa8\ub9ac\uc5d0 \uc801\uc7ac\ub418\uc5b4 \uc788\ub294 \ub370\uc774\ud0c0\ub97c \uc804\uc1a1\ud569\ub2c8\ub2e4.<\/p>\n

\ub530\ub77c\uc11c OS \uba54\ubaa8\ub9ac\ub97c \ucda9\ubd84\ud788 \ub0a8\uaca8 \ub193\ub294\uac8c \uc911\uc694\ud569\ub2c8\ub2e4.<\/p>\n

\"\"<\/p>\n

Low-Latency IO<\/h2>\n

Kafka<\/code> \ub294 Sequential IO<\/code> \ub97c \uc774\uc6a9\ud574 \ub514\uc2a4\ud06c \uc77d\uae30 \uc18d\ub3c4\ub97c \uc99d\uac00\uc2dc\ud0b5\ub2c8\ub2e4.<\/p>\n

Sequential IO<\/h3>\n

\ub514\uc2a4\ud06c\uc758 \uc77d\uae30 \uc18d\ub3c4\ub294 \uc2e4\uc81c \ub370\uc774\ud0c0\ub97c \uc77d\ub294 \uc18d\ub3c4\uac00 \uc544\ub2c8\ub77c,
\n\ub370\uc774\ud0c0\uc758 \uc704\uce58\ub97c \ucc3e\ub294 \uc2dc\uac04(Seek Time) \uc5d0 \uc758\ud574 \ub514\uc2a4\ud06c \uc77d\uae30 \uc18d\ub3c4\uac00 \uc9c0\uc5f0\ub429\ub2c8\ub2e4.<\/p>\n

Kafka<\/code> \ub294 \ub370\uc774\ud0c0\ub97c \uc21c\ucc28\uc801\uc73c\ub85c \uc800\uc7a5\ud558\uae30\uc5d0,
\nSeek Time<\/code> \uc744 \ucd5c\uc18c\ud654 \ud560 \uc218 \uc788\uc2b5\ub2c8\ub2e4.<\/p>\n

How to Sequential IO<\/h3>\n

\ucc38\uc870<\/a><\/p>\n

\ud30c\uc77c\uc758 \uc800\uc7a5 \uc704\uce58\ub294 OS \uc5d0 \uc758\ud574 \uacb0\uc815\ub418\ub294\ub370,
\n\uc5b4\ub5bb\uac8c Kafka<\/code> \uc758 Sequential IO \uac00 \uac00\ub2a5\ud560\uae4c?<\/p>\n

Kafka<\/code> \ub294 Sequential IO<\/code> \ub97c \ubcf4\uc7a5\ud558\ub294 \uac83\uc774 \uc544\ub2c8\ub77c,
\n\ub300\ubd80\ubd84\uc758 \uacbd\uc6b0\uc5d0 Sequential IO<\/code> \ub85c \uc791\ub3d9\ud558\ub3c4\ub85d \uc6b4\uc601\ub429\ub2c8\ub2e4.<\/p>\n

Kafka<\/code> \ub294 \uac70\ub300\ud55c \ud30c\uc77c\ub4e4(\uac01\uac01 \ub514\ud3f4\ud2b8\ub85c 1G) \uc5d0 \ub370\uc774\ud0c0\ub97c \uc800\uc7a5\ud569\ub2c8\ub2e4.
\n\uadf8 \ud30c\uc77c\ub4e4\uc5d0 \ub370\uc774\ud0c0\ub97c \uc800\uc7a5\ud558\uace0,
\n\uc0ad\uc81c\ub294 \uadf8 \ud30c\uc77c\uc758 \ubaa8\ub4e0 \ub370\uc774\ud0c0\uac00 expire \ub418\uc5c8\uc744\ub54c\ub9cc \uc9c4\ud589\ub429\ub2c8\ub2e4.
\n\uadf8\ub807\uae30\uc5d0 \ud30c\ud3b8\ud654\uac00 \uac70\uc758 \ubc1c\uc0dd\ud558\uc9c0 \uc54a\uc2b5\ub2c8\ub2e4.<\/p>\n

\ub2e4\ub9cc, \ub2e4\ub978 \uc571\uc5d0 \uc758\ud574 \uc77d\uae30\/\uc4f0\uae30\uac00 \uc9c4\ud589\ub418\uace0, \ud30c\ud3b8\ud654\uac00 \uc9c4\ud589\ub418\uba74,
\nKafka<\/code> \ub610\ud55c \ud30c\ud3b8\ud654\uc758 \uc601\ud5a5\uc744 \ubc1b\uac8c \ub429\ub2c8\ub2e4.
\n\ub530\ub77c\uc11c, \ub2e4\ub978 \uc571\uc758 \uc601\ud5a5\uc744 \ubc1b\uc9c0 \uc54a\ub294 \ub3c5\ub9bd\uc801 \ud30c\uc77c \uc2dc\uc2a4\ud15c\uc5d0\uc11c,
\nKafka<\/code> \uac00 \uc6b4\uc601\ub418\ub294 \uac83\uc774 \uad8c\uc7a5\ub429\ub2c8\ub2e4.<\/p>\n

\uba54\uc2dc\uc9c0 \ub370\uc774\ud0c0\uac00 \ucee4\uc9c0\uba74?<\/h3>\n

\ub370\uc774\ud0c0 \uc0ac\uc774\uc988\uac00 \ud070 \uba54\uc2dc\uc9c0\uac00 \ub300\ub7c9\uc73c\ub85c \ud050\uc5d0 \uc62c\ub77c\uc624\uac8c \ub418\uba74,
\n\uce74\ud504\uce74 \ub2e8\ub3c5\uc73c\ub85c\ub3c4 \ub514\uc2a4\ud06c \ud30c\ud3b8\ud654\uac00 \ubc1c\uc0dd\ud558\uac8c \ub429\ub2c8\ub2e4.
\n\ub530\ub77c\uc11c \ub370\uc774\ud0c0 \uc0ac\uc774\uc988\ub97c \uc904\uc774\ub294\uac8c \uc131\ub2a5 \uc720\uc9c0\uc5d0 \ub3c4\uc6c0\uc774 \ub429\ub2c8\ub2e4.<\/p>\n","protected":false},"excerpt":{"rendered":"

Kafka \ub294 \uc65c \ube60\ub97c\uae4c? \ucc38\uc870 Kafka \ub294 \ub2e4\ub978 \ud050 \uad00\ub9ac \uc2dc\uc2a4\ud15c\uc774 \uba54\ubaa8\ub9ac \uae30\ubc18\uc73c\ub85c \uc6b4\uc601\ub418\ub294 \uac83\uacfc \ub2ec\ub9ac \ub514\uc2a4\ud06c \uae30\ubc18\uc73c\ub85c \uc6b4\uc601\ub429\ub2c8\ub2e4. \ub514\uc2a4\ud06c \uae30\ubc18\uc73c\ub85c \uc6b4\uc601\ub418\uae30\uc5d0 \ub300\ub7c9\uc758 \uba54\uc2dc\uc9c0\ub97c \ubcf4\uad00\ud560 \uc218 \uc788\uace0, \uc608\uce21\ubd88\uac00\ub2a5\ud55c \uc11c\ubc84 \ub2e4\uc6b4\uc5d0\ub3c4 \ub300\ucc98\ud560 \uc218 \uc788\ub294 \uc7a5\uc810\uc774 \uc0dd\uacbc\uc2b5\ub2c8\ub2e4. \uadf8\ub7f0\ub370… \ub514\uc2a4\ud06c \uae30\ubc18\uc774\uba74 \ub290\ub824\uc57c \ud558\ub294\ub370 … \uc65c \ube60\ub974\ub2e4\ub294 \uc774\uc57c\uae30\uac00 \ub098\uc62c\uae4c\uc694? Zero Copy Traditional Data Transfer \uc77c\ubc18\uc801\uc778 \uc560\ud50c\ub9ac\ucf00\uc774\uc158\uc740 \ub370\uc774\ud0c0\ub97c \uba54\ubaa8\ub9ac\uc5d0 \uc62c\ub9b0\u2026 Read More »<\/a><\/span><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[12],"tags":[],"class_list":["post-3372","post","type-post","status-publish","format-standard","hentry","category-devops"],"_links":{"self":[{"href":"https:\/\/www.skyer9.pe.kr\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/3372","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.skyer9.pe.kr\/wordpress\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.skyer9.pe.kr\/wordpress\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.skyer9.pe.kr\/wordpress\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.skyer9.pe.kr\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=3372"}],"version-history":[{"count":6,"href":"https:\/\/www.skyer9.pe.kr\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/3372\/revisions"}],"predecessor-version":[{"id":3381,"href":"https:\/\/www.skyer9.pe.kr\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/3372\/revisions\/3381"}],"wp:attachment":[{"href":"https:\/\/www.skyer9.pe.kr\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=3372"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.skyer9.pe.kr\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=3372"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.skyer9.pe.kr\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=3372"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}