{"id":1905,"date":"2017-08-30T15:22:07","date_gmt":"2017-08-30T07:22:07","guid":{"rendered":"http:\/\/www.xttblog.com\/?p=1905"},"modified":"2017-08-30T15:22:07","modified_gmt":"2017-08-30T07:22:07","slug":"%e9%9d%9edocker%e7%8e%af%e5%a2%83%e4%b8%8b%e5%ae%89%e8%a3%85ksql","status":"publish","type":"post","link":"https:\/\/www.xttblog.com\/?p=1905","title":{"rendered":"\u975eDocker\u73af\u5883\u4e0b\u5b89\u88c5KSQL"},"content":{"rendered":"<p>\n\t\u672c\u6587\u5c06\u5f15\u5bfc\u60a8\u5b8c\u6210\u8bbe\u7f6eKafka\u96c6\u7fa4\u5e76\u542f\u52a8\u975eDocker\u73af\u5883\u7684KSQL\u7684\u6b65\u9aa4\u3002\u5b8c\u6210\u8fd9\u4e9b\u6b65\u9aa4\u540e\uff0c\u60a8\u53ef\u4ee5\u5feb\u901f\u5165\u95e8\u5e76\u4f7f\u7528KSQL\u6765\u67e5\u8be2Kafka\u7fa4\u96c6\u3002\n<\/p>\n<p>\n\t\u5173\u4e8eDocker\u73af\u5883\u4e0b\u5b89\u88c5KSQL\uff0c\u53ef\u4ee5\u53c2\u8003\u6211\u7684\u8fd9\u7bc7\u6587\u7ae0\u300a<a href=\"https:\/\/www.xttblog.com\/?p=1901\" name=\"Docker\u5b89\u88c5KSQL\" target=\"_blank\" title=\"Docker\u5b89\u88c5KSQL\">Docker\u5b89\u88c5KSQL<\/a>\u300b\u3002\n<\/p>\n<h2>\n\t\u73af\u5883\u51c6\u5907<br \/>\n<\/h2>\n<ul>\n<li>\n\t\t\u5b89\u88c5<a href=\"http:\/\/docs.confluent.io\/current\/installation.html\" name=\"\u5b89\u88c5Confluent Platform 3.3.0\" target=\"_blank\" title=\"\u5b89\u88c5Confluent Platform 3.3.0\">Confluent Platform 3.3.0<\/a>\u3002\u6b64\u5b89\u88c5\u5305\u62ecKafka\u4ee3\u7406\uff0cZooKeeper\uff0cSchema Registry\uff0cREST Proxy\u548cKafka Connect\u3002\u5982\u679c\u60a8\u901a\u8fc7tar\u6216zip\u5b89\u88c5\u4e86Confluent Platform\uff0c\u8bf7\u8fdb\u5165\u5230\u5b89\u88c5\u76ee\u5f55\u3002\n\t<\/li>\n<li>\n\t\t\u5b89\u88c5<a href=\"https:\/\/maven.apache.org\/install.html\" name=\"Installing Apache Maven\" target=\"_blank\" title=\"Installing Apache Maven\">Maven<\/a>\n\t<\/li>\n<li>\n\t\t\u5b89\u88c5<a href=\"https:\/\/git-scm.com\/downloads\" name=\"Git\" target=\"_blank\" title=\"Git\">Git<\/a>\n\t<\/li>\n<li>\n\t\tJava\uff1a\u6700\u4f4e\u7248\u672c1.8\u3002\u5728\u672c\u5730\u673a\u5668\u4e0a\u5b89\u88c5Oracle Java JRE\u6216JDK&gt; = 1.8\n\t<\/li>\n<\/ul>\n<p>\n\t\u6ce8\u610f\uff1aKSQL\u5728\u5f00\u53d1\u73af\u5883\u4e0a\u6d4b\u8bd5\uff0c\u8bf7\u4e0d\u8981\u5728\u751f\u6210\u73af\u5883\u8fdb\u884c\u6d4b\u8bd5\u3002\n<\/p>\n<h2>\n\t\u542f\u52a8Kafak<br \/>\n<\/h2>\n<p>\n\t\u8fdb\u5165confluent-3.3.0\u76ee\u5f55\u5e76\u4f7f\u7528\u65b0\u7684Confluent CLI\uff08\u514d\u8d39Confluent\u5f00\u653e\u6e90\u7801\u5206\u53d1\u7684\u4e00\u90e8\u5206\uff09\u542f\u52a8Confluent\u5e73\u53f0\u3002ZooKeeper\u6b63\u5728\u542clocalhost:2181\uff0cKafka broker \u76d1\u542clocalhost:9092\uff0c\u800cConfluent Schema Registry\u6b63\u5728\u542clocalhost:8081\u3002\n<\/p>\n<pre class=\"brush:bash;\">\r\n$ .\/bin\/confluent start<\/pre>\n<p>\n\t\u6b63\u786e\u7684\u8f93\u51fa\u7c7b\u4f3c\u4e0b\u9762\u7684\u5185\u5bb9\n<\/p>\n<pre class=\"brush:plain;\">\r\nStarting zookeeper\r\nzookeeper is [UP]\r\nStarting kafka\r\nkafka is [UP]\r\nStarting schema-registry\r\nschema-registry is [UP]\r\nStarting kafka-rest\r\nkafka-rest is [UP]\r\nStarting connect\r\nconnect is [UP]<\/pre>\n<h2>\n\t\u542f\u52a8KSQL<br \/>\n<\/h2>\n<p>\n\t\u514b\u9686Confluent KSQL\u8d44\u6e90\u5e93\u3002\n<\/p>\n<pre class=\"brush:bash;\">\r\n$ git clone git@github.com:confluentinc\/ksql.git<\/pre>\n<p>\n\t\u5c06ksql\u76ee\u5f55\u66f4\u6539\u4e3a\u76ee\u5f55\u5e76\u7f16\u8bd1\u4ee3\u7801\u3002\n<\/p>\n<pre class=\"brush:bash;\">\r\n$ cd ksql\r\n$ mvn clean compile install -DskipTests<\/pre>\n<p>\n\t\u542f\u52a8KSQL\u3002\u8be5local\u53c2\u6570\u5728\u672c\u5730\u542f\u52a8KSQL\u5f15\u64ce\u3002\n<\/p>\n<pre class=\"brush:bash;\">\r\n$ .\/bin\/ksql-cli local<\/pre>\n<p>\n\tKSQL\u542f\u52a8\u540e\uff0c\u7ec8\u7aef\u5e94\u8be5\u6709\u7c7b\u4f3c\u4e8e\u4e0b\u9762\u7684\u5185\u5bb9\u3002\n<\/p>\n<pre class=\"brush:bash;\">\r\nksql &gt;<\/pre>\n<h2>\n\t\u751f\u6210Kafka\u6570\u636e<br \/>\n<\/h2>\n<p>\n\t\u6267\u884c\u4e0b\u5217\u6b65\u9aa4\u6765\u4ea7\u751f\u6570\u636e\u5230kafka\u7684\u4e3b\u9898pageviews\u548cusers\u3002\n<\/p>\n<p>\n\t\u7b2c\u4e00\u6b65\uff1apageviews\u4f7f\u7528\u6570\u636e\u751f\u6210\u5668\u751f\u6210Kafka\u6570\u636e\u5230\u4e3b\u9898\u3002\u4ee5\u4e0b\u793a\u4f8b\u8fde\u7eed\u751f\u6210DELIMITED\u683c\u5f0f\u7684\u6570\u636e\u3002\n<\/p>\n<pre class=\"brush:bash;\">\r\n$ java -jar ksql-examples\/target\/ksql-examples-0.1-SNAPSHOT-standalone.jar \\\r\n    quickstart=pageviews format=delimited topic=pageviews maxInterval=10000<\/pre>\n<p>\n\t\u7b2c\u4e8c\u6b65\uff1ausers\u4f7f\u7528\u6570\u636e\u751f\u6210\u5668\u751f\u6210Kafka\u6570\u636e\u5230\u4e3b\u9898\u3002\u4ee5\u4e0b\u793a\u4f8b\u8fde\u7eed\u751f\u6210JSON\u683c\u5f0f\u7684\u6570\u636e\u3002\n<\/p>\n<pre class=\"brush:bash;\">\r\n$ java -jar ksql-examples\/target\/ksql-examples-0.1-SNAPSHOT-standalone.jar \\\r\n    quickstart=users format=json topic=users maxInterval=10000<\/pre>\n<p>\n\t\u4e0b\u9762\u6211\u4eec\u4f7f\u7528\u547d\u4ee4\u884c\u5de5\u5177\u751f\u6210\u7684\u4e3b\u9898\u6570\u636e\u8fdb\u884c\u5176\u4ed6\u6d4b\u8bd5\u3002\n<\/p>\n<p>\n\t\u4f7f\u7528Kafka\u547d\u4ee4\u884c\u751f\u6210Kafka\u6570\u636ekafka-console-producer\u3002\u4ee5\u4e0b\u793a\u4f8b\u4f7f\u7528DELIMITED\u683c\u5f0f\u7684\u503c\u751f\u6210\u6570\u636e\u3002\n<\/p>\n<pre class=\"brush:bash;\">\r\n$ kafka-console-producer --broker-list localhost:9092  \\\r\n                         --topic t1 \\\r\n                         --property parse.key=true \\\r\n                         --property key.separator=:\r\nkey1:v1,v2,v3\r\nkey2:v4,v5,v6\r\nkey3:v7,v8,v9\r\nkey1:v10,v11,v12<\/pre>\n<p>\n\t\u4e0a\u9762\u793a\u4f8b\u751f\u6210JSON\u683c\u5f0f\u7684\u503c\u7684\u6570\u636e\u3002\n<\/p>\n<pre class=\"brush:bash;\">\r\n$ kafka-console-producer --broker-list localhost:9092 \\\r\n                         --topic t2 \\\r\n                         --property parse.key=true \\\r\n                         --property key.separator=:\r\nkey1:{&quot;id&quot;:&quot;key1&quot;,&quot;col1&quot;:&quot;v1&quot;,&quot;col2&quot;:&quot;v2&quot;,&quot;col3&quot;:&quot;v3&quot;}\r\nkey2:{&quot;id&quot;:&quot;key2&quot;,&quot;col1&quot;:&quot;v4&quot;,&quot;col2&quot;:&quot;v5&quot;,&quot;col3&quot;:&quot;v6&quot;}\r\nkey3:{&quot;id&quot;:&quot;key3&quot;,&quot;col1&quot;:&quot;v7&quot;,&quot;col2&quot;:&quot;v8&quot;,&quot;col3&quot;:&quot;v9&quot;}\r\nkey1:{&quot;id&quot;:&quot;key1&quot;,&quot;col1&quot;:&quot;v10&quot;,&quot;col2&quot;:&quot;v11&quot;,&quot;col3&quot;:&quot;v12&quot;}<\/pre>\n<h2>\n\t\u53c2\u8003\u8d44\u6599<br \/>\n<\/h2>\n<ul>\n<li>\n\t\t<a href=\"https:\/\/github.com\/confluentinc\/ksql\/blob\/0.1.x\/docs\/quickstart\/quickstart-non-docker.md#non-docker-setup-for-ksql\" name=\"Non-Docker Setup for KSQL\" target=\"_blank\" title=\"Non-Docker Setup for KSQL\">Non-Docker Setup for KSQL<\/a>\n\t<\/li>\n<\/ul>\n<!-- <audio autoplay=\"autoplay\" height=\"100\" width=\"100\" hidden=\"true\"><source src=\"https:\/\/c.coka.la\/orAvPR.mp3\" type=\"audio\/mp3\"\/><\/audio><img decoding=\"async\" src=\"https:\/\/images.weserv.nl\/?url=https:\/\/ws3.sinaimg.cn\/large\/8fa5dcfcgy1g4em3rzar5j20ib089ae0.jpg\" alt=\"\u4e1a\u4f59\u8349\u516c\u4f17\u53f7\"\/> --><p><!-- <img decoding=\"async\" src=\"https:\/\/raw.githubusercontent.com\/xmt1139057136\/xttblog\/master\/8fa5dcfcgy1g4em3rzar5j20ib089ae0.jpg\" alt=\"\u4e1a\u4f59\u8349\u516c\u4f17\u53f7\"\/>--><img decoding=\"async\" src=\"https:\/\/saas.51autoparts.cn\/api\/admin\/sys-file\/oss\/file?fileName=84db51f8561e448f9a4fda2eff0811f9.jpg\" alt=\"\u4e1a\u4f59\u8349\u516c\u4f17\u53f7\"\/><\/p><p>\u6700\u540e\uff0c\u6b22\u8fce\u5173\u6ce8\u6211\u7684\u4e2a\u4eba\u5fae\u4fe1\u516c\u4f17\u53f7\uff1a\u4e1a\u4f59\u8349\uff08yyucao\uff09\uff01<b>\u53ef\u52a0\u4f5c\u8005\u5fae\u4fe1\u53f7\uff1a<font color=\"red\">xttblog2<\/font>\u3002\u5907\u6ce8\uff1a\u201c1\u201d\uff0c\u6dfb\u52a0\u535a\u4e3b\u5fae\u4fe1\u62c9\u4f60\u8fdb\u5fae\u4fe1\u7fa4\u3002\u5907\u6ce8\u9519\u8bef\u4e0d\u4f1a\u540c\u610f\u597d\u53cb\u7533\u8bf7\u3002<\/b>\u518d\u6b21\u611f\u8c22\u60a8\u7684\u5173\u6ce8\uff01\u540e\u7eed\u6709\u7cbe\u5f69\u5185\u5bb9\u4f1a\u7b2c\u4e00\u65f6\u95f4\u53d1\u7ed9\u60a8\uff01\u539f\u521b\u6587\u7ae0\u6295\u7a3f\u8bf7\u53d1\u9001\u81f3532009913@qq.com\u90ae\u7bb1\u3002\u5546\u52a1\u5408\u4f5c\u4e5f\u53ef\u6dfb\u52a0\u4f5c\u8005\u5fae\u4fe1\u8fdb\u884c\u8054\u7cfb\uff01<\/p><p>\u672c\u6587\u539f\u6587\u51fa\u5904\uff1a<a href=\"https:\/\/www.xttblog.com\">\u4e1a\u4f59\u8349<\/a>\uff1a &raquo; <a href=\"https:\/\/www.xttblog.com\/?p=1905\">\u975eDocker\u73af\u5883\u4e0b\u5b89\u88c5KSQL<\/a><\/p><!-- <div class=\"bd-reward-stl\"><button id=\"bdRewardBtn\"><span><\/span><\/button><\/div> -->","protected":false},"excerpt":{"rendered":"<p>\u672c\u6587\u5c06\u5f15\u5bfc\u60a8\u5b8c\u6210\u8bbe\u7f6eKafka\u96c6\u7fa4\u5e76\u542f\u52a8\u975eDocker\u73af\u5883\u7684KSQL\u7684\u6b65\u9aa4\u3002\u5b8c\u6210\u8fd9\u4e9b\u6b65\u9aa4\u540e\uff0c\u60a8\u53ef\u4ee5\u5feb\u901f\u5165\u95e8\u5e76\u4f7f [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[12],"tags":[789,1473],"class_list":["post-1905","post","type-post","status-publish","format-standard","hentry","category-sql","tag-kafka","tag-ksql"],"_links":{"self":[{"href":"https:\/\/www.xttblog.com\/index.php?rest_route=\/wp\/v2\/posts\/1905","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.xttblog.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.xttblog.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.xttblog.com\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.xttblog.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1905"}],"version-history":[{"count":1,"href":"https:\/\/www.xttblog.com\/index.php?rest_route=\/wp\/v2\/posts\/1905\/revisions"}],"predecessor-version":[{"id":1906,"href":"https:\/\/www.xttblog.com\/index.php?rest_route=\/wp\/v2\/posts\/1905\/revisions\/1906"}],"wp:attachment":[{"href":"https:\/\/www.xttblog.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1905"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.xttblog.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1905"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.xttblog.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1905"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}