基于RocketMQConnect構(gòu)建全新數(shù)據(jù)流轉(zhuǎn)處理平臺技術(shù)創(chuàng)新，變革未來基于RocketMQConnect構(gòu)建全新數(shù)據(jù)流轉(zhuǎn)處理平OpenMessagingConnect

OverviewOpenMessagingConnect

ArchitectureOpenMessagingConnectin

practiceOpenMessagingConnectNowand

Future目錄OpenMessagingConnectOverviewConceptRocketMQConnect：AsimpleunderstandingofRocketMQConnectisthemiddlewarethatusesRocketMQ

tocopydatafromasourcedatastoragesystemtoatargetdata

store.Mainlycomposedofsourceconnector,sinkconnector,

runtime.Source

Connector：Responsible

for ingestingthedatafromsourcedataandsendingitto

RocketMQSinkConnector：

ResponsibleforconsumingmessagesfromRocketMQandwritingthedatatotargetstorageRuntime：Theruntimeisthesource,sinkconnectorruntimeenvironment,responsibleforloadingtheConnector,providingthe

RESTful interface,startingtheconnectortask,servicediscoverybetweenclusternodes,configurationsynchronization,consumptionschedulesaving,failover,loadbalancing,andso

on.ConceptRocketMQConnect：AsimFileConnect

DemoFileConnectDemoRocketMQConnect

OverviewOLAPProducerServiceSourcing

DataConsumerServiceTraditionalstreamdataprocess

modelProducerServiceConsumerServiceSink

DataRocketMQConnectOverviewOLAPSOpenMessagingConnect

OverviewChallengeHowtocopiesdatabetweensomanydifferent

sourcesEfficiencyHighAvailability,

failoverScalabilityOpenMessagingConnectOverviewOpenMessagingConnect

OverviewOLAPOpenMessagingConnectOverviewOpenMessagingConnect

OverviewOLAPOpenMessagingConnectOverviewOpenMessagingConnect

OverviewBenefitsofMessaging

ConnectFocusondata

copyingScalestoapplicationAccessibleconnector

APIStreamingand

batchEasycluster

managementOpenMessagingConnectOverviewOpenMessagingConnect

OverviewWhat’sMessaging

ConnectMessagingConnectisadistributed,scalable,fault-tolerantservicedesignedtoreliablystreamdatabetweenmessaging

middleware

and otherdata

system.OpenMessagingConnectOverviewOpenMessagingConnect

OverviewOLAPWhat’sOpenMessagingOpenMessagingisastandardformessaging

middleware.OpenMessagingConnectOverviewOpenMessagingConnect

OverviewRelationshipofOpenMessagingConnectand

RocketMQOpenMessagingConnectisaconnectstandardformessaging

middleware.RuntimebasedonRocketMQprovidetheabilityofsteamingdatabetweenotherdatasystemwithApache

RocketMQOpenMessagingConnectOverviewOpenMessagingConnect

ArchitectureConnect

ModelWorker

ModelConnect

RuntimeOpenMessagingConnectArchitecOpenMessagingConnect

ArchitectureConnect

ModelConnector:defineshowdeveloperscreateconnectorpluginswhichimportandexportdatafromanotherdata

systems.Twokeycomponents:connector,

taskOpenMessagingConnectArchitecOpenMessagingConnect

ArchitectureConnect

ModelOpenMessagingConnectArchitecOpenMessagingConnect

ArchitectureWorker

ModelOpenMessagingConnectArchitecOpenMessagingConnect

ArchitectureConnect

Runtime12345OpenMessagingConnectArchitecConfig

Management12345OpenMessagingConnect

ArchitectureConfigManagement12345OpenMessRebalanceand

Failover12345OpenMessagingConnect

ArchitectureRebalanceandFailover12345OpeREST

APIPOST/connectors/{connector

name}GET/connectors/{connector

name}/configGET/connectors/{connector

name}/statusPOST/connectors/{connector

name}/stopOpenMessagingConnect

ArchitectureRESTAPIOpenMessagingConnectOpenMessagingconnectin

PracticeMySQL

connectorOpenMessagingconnectinPractOpenMessagingconnectin

PracticeMySQL

connectorOpenMessagingconnectinPractOpenMessagingconnectin

PracticeMySQL

connectorOpenMessagingconnectinPractOpenMessagingconnectin

PracticeMySQL

connectorOpenMessagingconnectinPractOpenMessagingConnectNowand

FutureRocketMQOpenMessagingRuntimeRocketMQRuntimeOpenMessa