Flink本地Idea調試源碼環境搭建


1.1 下載源碼並編譯

git clone https://github.com/apache/flink.git

cd flink

git checkout -b dev-1.14 remotes/origin/release-1.14

mvn clean install -DskipTests -Dfast

1.2 啟動JobManager

入口類為:

org.apache.flink.runtime.entrypoint.StandaloneSessionClusterEntrypoint

在Run Configurations配置界面配置以下內容:

-- vm options
-Dlog.file=/Users/jordan95225/IdeaProjects/source_code/flink/build-target/log/flink-jobmanager-1.local.log
-Dlog4j.configuration=file:/Users/jordan95225/IdeaProjects/source_code/flink/build-target/conf/log4j.properties 
-Dlog4j.configurationFile=file:/Users/jordan95225/IdeaProjects/source_code/flink/build-target/conf/log4j.properties 
-Dlogback.configurationFile=file:/Users/jordan95225/IdeaProjects/source_code/flink/build-target/conf/logback.xml

-classpath :/Users/jordan95225/IdeaProjects/source_code/flink/build-target/lib/flink-dist_2.11-1.14-SNAPSHOT.jar:/Users/jordan95225/IdeaProjects/source_code/flink/build-target/lib/flink-table_2.11-1.14-SNAPSHOT.jar:/Users/jordan95225/IdeaProjects/source_code/flink/build-target/lib/flink-csv-1.14-SNAPSHOT.jar:/Users/jordan95225/IdeaProjects/source_code/flink/build-target/lib/flink-json-1.14-SNAPSHOT.jar:/Users/jordan95225/IdeaProjects/source_code/flink/build-target/lib/flink-shaded-zookeeper-3.4.14.jar:/Users/jordan95225/IdeaProjects/source_code/flink/build-target/lib/log4j-1.2-api-2.17.1.jar:/Users/jordan95225/IdeaProjects/source_code/flink/build-target/lib/log4j-api-2.17.1.jar:/Users/jordan95225/IdeaProjects/source_code/flink/build-target/lib/log4j-core-2.17.1.jar:/Users/jordan95225/IdeaProjects/source_code/flink/build-target/lib/log4j-slf4j-impl-2.17.1.jar

-- program arguments
-c /Users/jordan95225/IdeaProjects/source_code/flink/build-target/conf

如下圖所示:

image-20220321221115435

啟動之后可以在http://localhost:8081/查看是否啟動成功

1.3 啟動TaskManager

入口類為:

org.apache.flink.runtime.taskexecutor.TaskManagerRunner

配置同JobManager:

-- vm options
-Dlog.file=/Users/jordan95225/IdeaProjects/source_code/flink/build-target/log/flink-taskexecutor-1.local.log 
-Dlog4j.configuration=file:/Users/jordan95225/IdeaProjects/source_code/flink/build-target/conf/log4j.properties 
-Dlog4j.configurationFile=file:/Users/jordan95225/IdeaProjects/source_code/flink/build-target/conf/log4j.properties 
-Dlogback.configurationFile=file:/Users/jordan95225/IdeaProjects/source_code/flink/build-target/conf/logback.xml

-classpath :/Users/jordan95225/IdeaProjects/source_code/flink/build-target/lib/flink-dist_2.11-1.14-SNAPSHOT.jar:/Users/jordan95225/IdeaProjects/source_code/flink/build-target/lib/flink-table_2.11-1.14-SNAPSHOT.jar:/Users/jordan95225/IdeaProjects/source_code/flink/build-target/lib/flink-csv-1.14-SNAPSHOT.jar:/Users/jordan95225/IdeaProjects/source_code/flink/build-target/lib/flink-json-1.14-SNAPSHOT.jar:/Users/jordan95225/IdeaProjects/source_code/flink/build-target/lib/flink-shaded-zookeeper-3.4.14.jar:/Users/jordan95225/IdeaProjects/source_code/flink/build-target/lib/log4j-1.2-api-2.17.1.jar:/Users/jordan95225/IdeaProjects/source_code/flink/build-target/lib/log4j-api-2.17.1.jar:/Users/jordan95225/IdeaProjects/source_code/flink/build-target/lib/log4j-core-2.17.1.jar:/Users/jordan95225/IdeaProjects/source_code/flink/build-target/lib/log4j-slf4j-impl-2.17.1.jar

-- program arguments
-c /Users/jordan95225/IdeaProjects/source_code/flink/build-target/conf
-D taskmanager.memory.framework.off-heap.size=134217728b 
-D taskmanager.memory.network.max=134217730b 
-D taskmanager.memory.network.min=134217730b 
-D taskmanager.memory.framework.heap.size=134217728b 
-D taskmanager.memory.managed.size=536870920b 
-D taskmanager.cpu.cores=4
-D taskmanager.memory.task.heap.size=402653174b 
-D taskmanager.memory.task.off-heap.size=0b 
-D taskmanager.memory.jvm-metaspace.size=268435456b 
-D taskmanager.memory.jvm-overhead.max=201326592b 
-D taskmanager.memory.jvm-overhead.min=201326592b

如下圖所示:

image-20220321221530120


免責聲明!

本站轉載的文章為個人學習借鑒使用,本站對版權不負任何法律責任。如果侵犯了您的隱私權益,請聯系本站郵箱yoyou2525@163.com刪除。



 
粵ICP備18138465號   © 2018-2025 CODEPRJ.COM