{"id":159,"date":"2021-02-10T02:02:41","date_gmt":"2021-02-09T18:02:41","guid":{"rendered":"http:\/\/vincentluk.synology.me\/lpyv\/?p=159"},"modified":"2021-03-23T00:11:07","modified_gmt":"2021-03-22T16:11:07","slug":"20210209-%e6%92%ae%e8%a8%98","status":"publish","type":"post","link":"https:\/\/vincentluk.synology.me\/lpyv\/2021\/02\/10\/20210209-%e6%92%ae%e8%a8%98\/","title":{"rendered":"20210209 \u64ae\u8a18"},"content":{"rendered":"\n<p>\u3000\u3000\u672c\u4f86\u51cc\u6668\u53ea\u662f\u5beb\u5bebBlog\uff0c\u4f46\u4e0d\u5c0f\u5fc3\u770b\u4e86kafka Connect \u7684\u7247\uff0c\u52d5\u4e86\u52c1\uff0c\u4e00\u6b21\u904e\u88dd\u6652\u6240\u6709Mongo &amp; Kafka \u7684setup\uff0c\u6700\u5f8c\u51cc\u6668\u4e09\u9ede\u7d42\u65bcrun \u5230! \u5118\u7ba1\u9019\u53ea\u662f\u4e00\u500bexercise\uff0c\u4f46\u6211\u505a\u5230\u4e86\u5c07\u9999\u6e2f Aribnb \u7684\u8cc7\u6599\u5012\u5165MongoDB (\u5f88\u7c21\u55ae\u6709Mongo Import)\uff0c\u7136\u5f8c\u958bKafka \u65e2zookeeper\u3001broker\u3001\u958b\u57cbKafdrop\uff0c\uff08\u5514\u8a08\u6211\u7528\u9ecetesting \u65e2Kafka Producer and Kafka Consumer\uff09\uff0c\u4e4b\u5f8crun script \u884c\u8d77\u5de6pyspark \uff0c\u7136\u5f8ctailor made \u8fd4\u5ca9Data Schema\uff0c\u4e4b\u5f8c\u958b\u4e00\u500bPostgresql Database\uff0c\u958b\u8fd4\u5ca9\uff24 Table\uff0c\u7136\u5f8c\u958b\u591a\u4e00\u500bkafka connect-standalone\uff0crun script streaming \u5012MongoDB \u65e2Data \u5165\u53bb Postgresql Database \u3002<\/p>\n\n\n\n<p>\u3000\u3000\u6210\u500bProject \u65e2Credit \u61c9\u8a72\u6bd4\u8fd4Gordon \uff0c\u4f46\u6211\u7adf\u7136run \u5f97\u8d77\u6210\u500bproject \u90fd\u662f\u4e00\u7a2e\u5c0f\u78ba\u5e78\uff01<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1000\" height=\"750\" src=\"https:\/\/i0.wp.com\/vincentluk.synology.me\/lpyv\/wp-content\/uploads\/2021\/02\/IMG_20210209_031549.jpg?resize=1000%2C750\" alt=\"\" class=\"wp-image-160\" srcset=\"https:\/\/i0.wp.com\/vincentluk.synology.me\/lpyv\/wp-content\/uploads\/2021\/02\/IMG_20210209_031549-scaled.jpg?resize=1024%2C768&amp;ssl=1 1024w, https:\/\/i0.wp.com\/vincentluk.synology.me\/lpyv\/wp-content\/uploads\/2021\/02\/IMG_20210209_031549-scaled.jpg?resize=300%2C225&amp;ssl=1 300w, https:\/\/i0.wp.com\/vincentluk.synology.me\/lpyv\/wp-content\/uploads\/2021\/02\/IMG_20210209_031549-scaled.jpg?resize=768%2C576&amp;ssl=1 768w, https:\/\/i0.wp.com\/vincentluk.synology.me\/lpyv\/wp-content\/uploads\/2021\/02\/IMG_20210209_031549-scaled.jpg?resize=1536%2C1152&amp;ssl=1 1536w, https:\/\/i0.wp.com\/vincentluk.synology.me\/lpyv\/wp-content\/uploads\/2021\/02\/IMG_20210209_031549-scaled.jpg?resize=2048%2C1536&amp;ssl=1 2048w, https:\/\/i0.wp.com\/vincentluk.synology.me\/lpyv\/wp-content\/uploads\/2021\/02\/IMG_20210209_031549-scaled.jpg?resize=800%2C600&amp;ssl=1 800w\" sizes=\"auto, (max-width: 1000px) 100vw, 1000px\" data-recalc-dims=\"1\" \/><\/figure>\n\n\n\n<p>\u3000\u3000\u4eca\u5929\u662f\u5de5\u4f5c\u5929\uff0c\u52de\u788c\u4e86\u6574\u5929\uff0c\u5c11\u7d2f\uff0c\u4f46\u6253\u6587\u7684\u4e00\u77ac\u9593\u7cbe\u795e\u53c8\u56de\u4f86\u4e86\uff0c\u611f\u89ba\u5728\u5275\u9020\u610f\u7fa9\u3002<\/p>\n\n\n\n<p>\u3000\u3000\u65e9\u4e0a\u53bb\u4e86\u6df1\u6c34\u57d7\u5beb\u7db2\u9801\uff0c\u6e05\u4e86\u4e4b\u524d\u7684\u554f\u984c\uff0c\u4f46\u4e00\u50be\u53c8\u6709\u65b0\u91ce\u8981\u6211\u8ddf\uff0c\u5305\u62ec<\/p>\n\n\n\n<ol class=\"wp-block-list\"><li>\u4e2d\u91ab\u7db2\u9801\u7684blog\u53ca\u5546\u5e97\u6392\u7248\uff0c\u9084\u6709\u4e5d\u5bae\u683c\u65e2\u5716\u3002<\/li><li>\u516c\u53f8Synology set up, \u8981\u88dd\u5169\u500bwordpress \u3002<\/li><li>\u5efa\u6750\u7db2\u9801\uff0c\u8981\u6284\u8fd4\u4e00\u500b\u65b0\u7db2 <\/li><\/ol>\n\n\n\n<p>\u3000\u3000\u7136\u5f8c\u4e09\u9ede\u96e2\u958b\uff0c\u76f4\u843d\u53bb\u4e0a\u74b0\uff0c\u6bd4\u5de5\u4f5c\u66f4urgent \u7684\u662fgroup project\uff0c\u5f97\u77e5Bruce\u5df2\u8655\u7406\u5de6Express \u5c04\u4e0akafka\uff0c\u500d\u611f\u5b89\u6170\u3002<\/p>\n\n\n\n<p>\u3000\u3000\u540c\u6642\u9593\uff0c\u6709\u6a5f\u98df\u7269\u8001\u95c6\u53c8\u6435\u6211\u6574Logo\uff0c\u7121\u539f\u5716\uff0c\u771f\u4fc2\u53eb\u6211\u4fc2\u5b98\u7db2Screen Capture Logo\u7136\u5f8c\u6539\u5b57\u6539\u984f\u8272\uff0c\u82b1\u4e86\u6211\u597d\u4e00\u6703\u6642\u9593\u3002<\/p>\n\n\n\n<p>\u3000\u3000\u4eca\u65e5\u505a\u5230\u591c\u665a\u5341\u4e00\u9ede\u516b\u5148\u8d70\uff0c\u5341\u4e8c\u9ede\u5230\u5bb6\uff0c\u5fae\u96e8\u5927\u98a8\uff0c\u6620\u7167\u8457\u7576\u4e0b\u7684\u5fc3\u60c5\uff0c\u5fc3\u5f88\u7d2f\u3002<\/p>\n\n\n\n<p>\u3000\u3000<\/p>\n<div id=\"emojics-root\"><\/div>","protected":false},"excerpt":{"rendered":"<p>\u3000\u3000\u672c\u4f86\u51cc\u6668\u53ea\u662f\u5beb\u5bebBlog\uff0c\u4f46\u4e0d\u5c0f\u5fc3\u770b\u4e86kafka Connect \u7684\u7247\uff0c\u52d5\u4e86\u52c1\uff0c\u4e00\u6b21\u904e\u88dd\u6652\u6240\u6709Mongo &amp;&hellip;<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_mi_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":"","jetpack_publicize_message":"","jetpack_is_tweetstorm":false,"jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","enabled":false}}},"categories":[3],"tags":[5],"class_list":["post-159","post","type-post","status-publish","format-standard","hentry","category-3","tag-technology"],"jetpack_publicize_connections":[],"aioseo_notices":[],"jetpack_sharing_enabled":true,"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/vincentluk.synology.me\/lpyv\/wp-json\/wp\/v2\/posts\/159","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/vincentluk.synology.me\/lpyv\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/vincentluk.synology.me\/lpyv\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/vincentluk.synology.me\/lpyv\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/vincentluk.synology.me\/lpyv\/wp-json\/wp\/v2\/comments?post=159"}],"version-history":[{"count":1,"href":"https:\/\/vincentluk.synology.me\/lpyv\/wp-json\/wp\/v2\/posts\/159\/revisions"}],"predecessor-version":[{"id":161,"href":"https:\/\/vincentluk.synology.me\/lpyv\/wp-json\/wp\/v2\/posts\/159\/revisions\/161"}],"wp:attachment":[{"href":"https:\/\/vincentluk.synology.me\/lpyv\/wp-json\/wp\/v2\/media?parent=159"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/vincentluk.synology.me\/lpyv\/wp-json\/wp\/v2\/categories?post=159"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/vincentluk.synology.me\/lpyv\/wp-json\/wp\/v2\/tags?post=159"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}