IntelliJ IDEA(Ultimate版本)的下載、安裝和WordCount的初步使用(本地模式和集群模式)


 

 

  不多說,直接上干貨!

 

  IntelliJ IDEA號稱當前Java開發效率最高的IDE工具。IntelliJ IDEA有兩個版本:社區版(Community)和旗艦版(Ultimate)。社區版時免費的、開源的,但功能較少,旗艦版提供了較多的功能,是收費的,可以試用30天。 

  強烈推薦,新手剛入門,可以去用社區版,但是,立馬還是用旗艦版,我可是走了彎路,當然,體會到其中的棘手還是很不錯!

IDEA Community(社區版)再談之無奈之下還是去安裝社區版

IntelliJ IDEA(Community版本)的下載、安裝和WordCount的初步使用(本地模式和集群模式)

 

 

 

 

 

 

 

  1、IntelliJ IDEA(Ultimate)的下載

  2、IntelliJ IDEA(Ultimate)的安裝

    3、IntelliJ IDEA(Ultimate)中的scala插件安裝

    4、用SBT方式來創建工程 或 選擇Scala方式來創建工程

    5、本地模式或集群模式

 

 

 

 我們知道,對於開發而言,IDE是有很多個選擇的版本。如我們大部分人經常用的是如下。

Eclipse *版本

 

Eclipse *下載

 

   而我們知道,對於spark的scala開發啊,有為其專門設計的eclipse,Scala IDE for Eclipse

  

 

Scala IDE for Eclipse的下載、安裝和WordCount的初步使用(本地模式和集群模式)

  這里,我們知道,spark的開發可以通過IntelliJ IDEA或者Scala IDE for Eclipse,包括來構建spark開發環境和源碼閱讀環境。由於IntelliJ IDEA對scala的支持更好,所以目前spark開發團隊使用IntelliJ IDEA作為開發環境。強烈推薦!

 

 

 

 

 

 

1、IntelliJ IDEA(Ultimate)的下載

下載鏈接: http://www.jetbrains.com/idea/download/

      一般,我們使用選擇免費的社區版就好了,不過Apache的貢獻者可以免費獲得商業發行版的使用權。但是,在本博文里,我就是要大家安裝Ultimate版本,因為,我有辦法教大家成功破解並長期使用。

 

 

 

 

 

  直接下載最新版本(當然,你也可以下載歷史版本)

 

 

 

 

 

 

 注意:下載IntelliJ IDEA Ultimate的歷史版本

我們找歷史版本,Windows7下安裝IntelliJ IDEA UltimateEdition 2016.1.4(64)。

 

 

 

 

 

 

 

 

 

 2、IntelliJ IDEA(Ultimate)的安裝

 

 D:\SoftWare\IntelliJ IDEA\IntelliJ IDEA Ultimate Edition 2016.1.4

 

 

創建桌面快捷方式,我只選一個64位的夠了;

注意:如果你的JDK是32位的,Tomcat是32位的,估計要使用32位的才行;

創建擴展名關聯:都選上吧 ;

安裝到這里就完成了,但接下來還有一些步驟需要配置

 

 

 

 

 

 

 

 

 

 

 

 

 3、IntelliJ IDEA(Ultimate)的使用

在這之前,先在本地里安裝好java和scala

 

 

 

 這個必須要同意,不然的話我們安裝它干嘛!

 

 

 

 

 

輸入激活碼##

網上找一個注冊碼,或者使用以下注冊碼(有效期為2017年01月31日至2018年01月30日)

CNEKJPQZEX-eyJsaWNlbnNlSWQiOiJDTkVLSlBRWkVYIiwibGljZW5zZWVOYW1lIjoibGFuIHl1IiwiYXNzaWduZWVOYW1lIjoiIiwiYXNzaWduZWVFbWFpbCI6IiIsImxpY2Vuc2VSZXN0cmljdGlvbiI6IkZvciBlZHVjYXRpb25hbCB1c2Ugb25seSIsImNoZWNrQ29uY3VycmVudFVzZSI6ZmFsc2UsInByb2R1Y3RzIjpbeyJjb2RlIjoiQUMiLCJwYWlkVXBUbyI6IjIwMTgtMDEtMzAifSx7ImNvZGUiOiJETSIsInBhaWRVcFRvIjoiMjAxOC0wMS0zMCJ9LHsiY29kZSI6IklJIiwicGFpZFVwVG8iOiIyMDE4LTAxLTMwIn0seyJjb2RlIjoiUlMwIiwicGFpZFVwVG8iOiIyMDE4LTAxLTMwIn0seyJjb2RlIjoiV1MiLCJwYWlkVXBUbyI6IjIwMTgtMDEtMzAifSx7ImNvZGUiOiJEUE4iLCJwYWlkVXBUbyI6IjIwMTgtMDEtMzAifSx7ImNvZGUiOiJSQyIsInBhaWRVcFRvIjoiMjAxOC0wMS0zMCJ9LHsiY29kZSI6IlBTIiwicGFpZFVwVG8iOiIyMDE4LTAxLTMwIn0seyJjb2RlIjoiREMiLCJwYWlkVXBUbyI6IjIwMTgtMDEtMzAifSx7ImNvZGUiOiJEQiIsInBhaWRVcFRvIjoiMjAxOC0wMS0zMCJ9LHsiY29kZSI6IlJNIiwicGFpZFVwVG8iOiIyMDE4LTAxLTMwIn0seyJjb2RlIjoiUEMiLCJwYWlkVXBUbyI6IjIwMTgtMDEtMzAifSx7ImNvZGUiOiJDTCIsInBhaWRVcFRvIjoiMjAxOC0wMS0zMCJ9XSwiaGFzaCI6IjUxOTU1OTMvMCIsImdyYWNlUGVyaW9kRGF5cyI6MCwiYXV0b1Byb2xvbmdhdGVkIjpmYWxzZSwiaXNBdXRvUHJvbG9uZ2F0ZWQiOmZhbHNlfQ==-QOxwjWvRwJz6vo6J6adC3CJ4ukQHosbPYZ94URUVFna/Rbew8xK/M5gP3kAaPh6ZDveFdtMR1UBoumq3eCwXtXM3U3ls5noB4LIr+QplVlCj2pK5uNq7g/feyNyQcHpSXtvhIOnXDBLOecB05DOsxzm0p7ulGGJoAInmHeb9mc0eYjqc4RPpUQfh6HSYBnvEnKMlLF5bz4KEtzmsvvgA55CwzwQ3gRitm5Q/wUT7AQCBdjmBfNUjKVQL6TSjSDPp56FUdEs4Aab8LqstA2DIMbxocO64rvytmcUeIwu8Mi5uq87KQP5AQMSMYb59Inbd+dmVfx5cJo3fRS4/5s3/Hg==-MIIEPjCCAiagAwIBAgIBBTANBgkqhkiG9w0BAQsFADAYMRYwFAYDVQQDDA1KZXRQcm9maWxlIENBMB4XDTE1MTEwMjA4MjE0OFoXDTE4MTEwMTA4MjE0OFowETEPMA0GA1UEAwwGcHJvZDN5MIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAxcQkq+zdxlR2mmRYBPzGbUNdMN6OaXiXzxIWtMEkrJMO/5oUfQJbLLuMSMK0QHFmaI37WShyxZcfRCidwXjot4zmNBKnlyHodDij/78TmVqFl8nOeD5+07B8VEaIu7c3E1N+e1doC6wht4I4+IEmtsPAdoaj5WCQVQbrI8KeT8M9VcBIWX7fD0fhexfg3ZRt0xqwMcXGNp3DdJHiO0rCdU+Itv7EmtnSVq9jBG1usMSFvMowR25mju2JcPFp1+I4ZI+FqgR8gyG8oiNDyNEoAbsR3lOpI7grUYSvkB/xVy/VoklPCK2h0f0GJxFjnye8NT1PAywoyl7RmiAVRE/EKwIDAQABo4GZMIGWMAkGA1UdEwQCMAAwHQYDVR0OBBYEFGEpG9oZGcfLMGNBkY7SgHiMGgTcMEgGA1UdIwRBMD+AFKOetkhnQhI2Qb1t4Lm0oFKLl/GzoRykGjAYMRYwFAYDVQQDDA1KZXRQcm9maWxlIENBggkA0myxg7KDeeEwEwYDVR0lBAwwCgYIKwYBBQUHAwEwCwYDVR0PBAQDAgWgMA0GCSqGSIb3DQEBCwUAA4ICAQC9WZuYgQedSuOc5TOUSrRigMw4/+wuC5EtZBfvdl4HT/8vzMW/oUlIP4YCvA0XKyBaCJ2iX+ZCDKoPfiYXiaSiH+HxAPV6J79vvouxKrWg2XV6ShFtPLP+0gPdGq3x9R3+kJbmAm8w+FOdlWqAfJrLvpzMGNeDU14YGXiZ9bVzmIQbwrBA+c/F4tlK/DV07dsNExihqFoibnqDiVNTGombaU2dDup2gwKdL81ua8EIcGNExHe82kjF4zwfadHk3bQVvbfdAwxcDy4xBjs3L4raPLU3yenSzr/OEur1+jfOxnQSmEcMXKXgrAQ9U55gwjcOFKrgOxEdek/Sk1VfOjvS+nuM4eyEruFMfaZHzoQiuw4IqgGc45ohFH0UUyjYcuFxxDSU9lMCv8qdHKm+wnPRb0l9l5vXsCBDuhAGYD6ss+Ga+aDY6f/qXZuUCEUOH3QUNbbCUlviSz6+GiRnt1kA9N2Qachl+2yBfaqUqr8h7Z2gsx5LcIf5kYNsqJ0GavXTVyWh7PYiKX4bs354ZQLUwwa/cG++2+wNWP+HtBhVxMRNTdVhSm38AknZlD+PTAsWGu9GyLmhti2EnVwGybSD2Dxmhxk3IPCkhKAK+pl0eWYGZWG3tJ9mZ7SowcXLWDFAk0lRJnKGFMTggrWjV8GYpw5bq23VmIqqDLgkNzuoog==

   為了更加保險,請移步,

IntelliJ IDEA官網:https://www.jetbrains.com 

 

 

 

 

   即可,得到。

 

 

 

 

 

 

 

 

 

   其實啊,這里永久有效就是。

 

     當然也許這里,以后也會失效,自己從網上搜索就好了,很多很多。

   

 

 

 

 

  主題皮膚設置,看你喜歡哪一種吧!(當然后期,可以自己更改)

IntelliJ IDEA的黑白色背景切換(Ultimate和Community版本皆通用)

 

 

 

 

 可以根據你的需要調整定制需要的特性:

這里可以安裝Scala和IdeaVim支持,但我試了幾次,根本安裝不上;(其實啊,這里可以安裝的上,當然,有時候會安裝不上)

 

 

 

  果然,IntelliJ IDEA(Ultimate版本)比IntelliJ IDEA(Community版本)多了好多功能啊!

 

 

 

   由此可以看到,至2018年01月30日

 

 

先選擇Create New Project 創建一個空項目看看吧

 

 

 

 

 補安裝scala插件(其實就是把它給調出來啦)

   Intellij安裝scala插件詳解

 

 

 

 

 

 

 這里,以Maven方式,創建一個項目。

 

 

 

如何在Maven官網下載歷史版本

Eclipse下Maven新建項目、自動打依賴jar包(包含普通項目和Web項目)

最后,這是我的本地maven的配置文件

 

 

 

 

 

  

  別急,等待一會

 

 

 

  點擊 Got it!

 

即,在以上過程中,模仿JDK1.8.x和scala2.10.4。

 

 

 

 

 

 

 

  但是,要說么的是,因為,我的本地是scala2.10.4,它默認是2.7.0

 

 

 

 

 

 

  為了引起,不必要的麻煩,將自帶的刪除吧!

 

  得到

Microsoft Windows [版本 6.1.7601]
版權所有 (c) 2009 Microsoft Corporation。保留所有權利。

D:\Code\IntelliJIDEAUltimateVersionCode\WordCount>mvn clean package
[INFO] Scanning for projects...
[WARNING]
[WARNING] Some problems were encountered while building the effective model for zhouls.bigdata:mySpark:jar:1.0-SNAPSHOT
[WARNING] 'build.plugins.plugin.version' for org.scala-tools:maven-scala-plugin is missing. @ line 51, column 15
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-eclipse-plugin is missing. @ line 69, column 15
[WARNING]
[WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.
[WARNING]
[WARNING] For this reason, future Maven versions might no longer support building such malformed projects.
[WARNING]
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building mySpark 1.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/scala-tools/maven-scala-plugin/maven-metadata.xml
Downloading: http://scala-tools.org/repo-releases/org/scala-tools/maven-scala-plugin/maven-metadata.xml
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/scala-tools/maven-scala-plugin/maven-metadata.xml (2 KB at 1.7 KB/sec)
[WARNING] Could not transfer metadata org.scala-tools:maven-scala-plugin/maven-metadata.xml from/to scala-tools.org (http://scala-tools.org/repo-releases): Received fatal alert: protocol_version
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/scala-tools/maven-scala-plugin/2.15.2/maven-scala-plugin-2.15.2.pom
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/scala-tools/maven-scala-plugin/2.15.2/maven-scala-plugin-2.15.2.pom (15 KB at 35.5 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/scala-tools/maven-scala-plugin/2.15.2/maven-scala-plugin-2.15.2.jar
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/scala-tools/maven-scala-plugin/2.15.2/maven-scala-plugin-2.15.2.jar (113 KB at 190.0 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/plugins/maven-eclipse-plugin/maven-metadata.xml
Downloading: http://scala-tools.org/repo-releases/org/apache/maven/plugins/maven-eclipse-plugin/maven-metadata.xml
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/plugins/maven-eclipse-plugin/maven-metadata.xml (741 B at 2.8 KB/sec)
[WARNING] Could not transfer metadata org.apache.maven.plugins:maven-eclipse-plugin/maven-metadata.xml from/to scala-tools.org (http://scala-tools.org/repo-releases): Received fatal alert: protocol_version
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/plugins/maven-eclipse-plugin/2.10/maven-eclipse-plugin-2.10.pom
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/plugins/maven-eclipse-plugin/2.10/maven-eclipse-plugin-2.10.pom (19 KB at 66.7 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/plugins/maven-plugins/25/maven-plugins-25.pom
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/plugins/maven-plugins/25/maven-plugins-25.pom (0 B at 0.0 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/plugins/maven-eclipse-plugin/2.10/maven-eclipse-plugin-2.10.jar
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/plugins/maven-eclipse-plugin/2.10/maven-eclipse-plugin-2.10.jar (219 KB at 429.1 KB/sec)
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ mySpark ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ mySpark ---
[WARNING] Using platform encoding (GBK actually) to copy filtered resources, i.e. build is platform dependent!
[INFO] skip non existing resourceDirectory D:\Code\IntelliJIDEAUltimateVersionCode\WordCount\src\main\resources
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ mySpark ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- maven-scala-plugin:2.15.2:compile (default) @ mySpark ---
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/commons/commons-exec/1.0.1/commons-exec-1.0.1.pom
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/commons/commons-exec/1.0.1/commons-exec-1.0.1.pom (8 KB at 19.4 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/yaml/snakeyaml/1.4/snakeyaml-1.4.pom
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/yaml/snakeyaml/1.4/snakeyaml-1.4.pom (8 KB at 20.2 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/codehaus/jackson/jackson-core-asl/1.6.1/jackson-core-asl-1.6.1.pom
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/codehaus/jackson/jackson-core-asl/1.6.1/jackson-core-asl-1.6.1.pom (1016 B at 3.0 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/codehaus/jackson/jackson-mapper-asl/1.6.1/jackson-mapper-asl-1.6.1.pom
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/codehaus/jackson/jackson-mapper-asl/1.6.1/jackson-mapper-asl-1.6.1.pom (2 KB at 3.7 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-settings/2.2.1/maven-settings-2.2.1.jar
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-artifact-manager/2.2.1/maven-artifact-manager-2.2.1.jar
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-project/2.2.1/maven-project-2.2.1.jar
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-profile/2.2.1/maven-profile-2.2.1.jar
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-plugin-api/2.2.1/maven-plugin-api-2.2.1.jar
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-artifact-manager/2.2.1/maven-artifact-manager-2.2.1.jar (0 B at 0.0 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/backport-util-concurrent/backport-util-concurrent/3.1/backport-util-concurrent-3.1.jar
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-project/2.2.1/maven-project-2.2.1.jar (0 B at 0.0 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-plugin-registry/2.2.1/maven-plugin-registry-2.2.1.jar
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-plugin-api/2.2.1/maven-plugin-api-2.2.1.jar (0 B at 0.0 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/codehaus/plexus/plexus-interpolation/1.11/plexus-interpolation-1.11.jar
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-settings/2.2.1/maven-settings-2.2.1.jar (0 B at 0.0 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/reporting/maven-reporting-api/2.2.1/maven-reporting-api-2.2.1.jar
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-profile/2.2.1/maven-profile-2.2.1.jar (0 B at 0.0 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/doxia/doxia-logging-api/1.1/doxia-logging-api-1.1.jar
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/backport-util-concurrent/backport-util-concurrent/3.1/backport-util-concurrent-3.1.jar (0 B at 0.0 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-core/2.2.1/maven-core-2.2.1.jar
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/reporting/maven-reporting-api/2.2.1/maven-reporting-api-2.2.1.jar (0 B at 0.0 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-plugin-parameter-documenter/2.2.1/maven-plugin-parameter-documenter-2.2.1.jar
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-plugin-registry/2.2.1/maven-plugin-registry-2.2.1.jar (0 B at 0.0 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/slf4j/slf4j-jdk14/1.5.6/slf4j-jdk14-1.5.6.jar
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/codehaus/plexus/plexus-interpolation/1.11/plexus-interpolation-1.11.jar (0 B at 0.0 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/slf4j/slf4j-api/1.5.6/slf4j-api-1.5.6.jar
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/doxia/doxia-logging-api/1.1/doxia-logging-api-1.1.jar (0 B at 0.0 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/slf4j/jcl-over-slf4j/1.5.6/jcl-over-slf4j-1.5.6.jar
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-core/2.2.1/maven-core-2.2.1.jar (0 B at 0.0 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-repository-metadata/2.2.1/maven-repository-metadata-2.2.1.jar
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-plugin-parameter-documenter/2.2.1/maven-plugin-parameter-documenter-2.2.1.jar (0 B at 0.0 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-error-diagnostics/2.2.1/maven-error-diagnostics-2.2.1.jar
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/slf4j/slf4j-jdk14/1.5.6/slf4j-jdk14-1.5.6.jar (0 B at 0.0 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-plugin-descriptor/2.2.1/maven-plugin-descriptor-2.2.1.jar
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/slf4j/slf4j-api/1.5.6/slf4j-api-1.5.6.jar (0 B at 0.0 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-monitor/2.2.1/maven-monitor-2.2.1.jar
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/slf4j/jcl-over-slf4j/1.5.6/jcl-over-slf4j-1.5.6.jar (0 B at 0.0 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/commons/commons-exec/1.0.1/commons-exec-1.0.1.jar
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-repository-metadata/2.2.1/maven-repository-metadata-2.2.1.jar (0 B at 0.0 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/yaml/snakeyaml/1.4/snakeyaml-1.4.jar
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-error-diagnostics/2.2.1/maven-error-diagnostics-2.2.1.jar (0 B at 0.0 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-model/2.2.1/maven-model-2.2.1.jar
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-plugin-descriptor/2.2.1/maven-plugin-descriptor-2.2.1.jar (0 B at 0.0 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/codehaus/jackson/jackson-core-asl/1.6.1/jackson-core-asl-1.6.1.jar
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-monitor/2.2.1/maven-monitor-2.2.1.jar (0 B at 0.0 KB/sec)
Downloading: http://maven.aliyun.com/nexus/content/repositories/central/org/codehaus/jackson/jackson-mapper-asl/1.6.1/jackson-mapper-asl-1.6.1.jar
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/maven/maven-model/2.2.1/maven-model-2.2.1.jar (0 B at 0.0 KB/sec)
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/apache/commons/commons-exec/1.0.1/commons-exec-1.0.1.jar (49 KB at 50.0 KB/sec)
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/yaml/snakeyaml/1.4/snakeyaml-1.4.jar (213 KB at 194.7 KB/sec)
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/codehaus/jackson/jackson-core-asl/1.6.1/jackson-core-asl-1.6.1.jar (197 KB at 165.6 KB/sec)
Downloaded: http://maven.aliyun.com/nexus/content/repositories/central/org/codehaus/jackson/jackson-mapper-asl/1.6.1/jackson-mapper-asl-1.6.1.jar (530 KB at 391.4 KB/sec)
[INFO] Checking for multiple versions of scala
[INFO] includes = [**/*.scala,**/*.java,]
[INFO] excludes = []
[WARNING] No source files found.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ mySpark ---
[WARNING] Using platform encoding (GBK actually) to copy filtered resources, i.e. build is platform dependent!
[INFO] skip non existing resourceDirectory D:\Code\IntelliJIDEAUltimateVersionCode\WordCount\src\test\resources
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ mySpark ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- maven-scala-plugin:2.15.2:testCompile (default) @ mySpark ---
[INFO] Checking for multiple versions of scala
[INFO] includes = [**/*.scala,**/*.java,]
[INFO] excludes = []
[WARNING] No source files found.
[INFO]
[INFO] --- maven-surefire-plugin:2.12.4:test (default-test) @ mySpark ---
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ mySpark ---
[INFO] Building jar: D:\Code\IntelliJIDEAUltimateVersionCode\WordCount\target\mySpark-1.0-SNAPSHOT.jar
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 25.673 s
[INFO] Finished at: 2017-03-05T00:34:22+08:00
[INFO] Final Memory: 14M/126M
[INFO] ------------------------------------------------------------------------

D:\Code\IntelliJIDEAUltimateVersionCode\WordCount>

 

 

 

 

 

 

 

 

 

 

 

本地模式和集群模式的代碼,這里我不多贅述。

 (1)本地運行

  編寫完Scala程序后,可以直接在IntelliJ IDEA中以本地(local)模式運行。

在IntelliJ IDEA中,點擊Run 按鈕,具體見如下

Spark編程環境搭建(基於Intellij IDEA的Ultimate版本)(包含Java和Scala版的WordCount)(博主強烈推薦)

 

 

 

 

 

 

 

歡迎大家,加入我的微信公眾號:大數據躺過的坑        人工智能躺過的坑
 
 
 

同時,大家可以關注我的個人博客

   http://www.cnblogs.com/zlslch/   和     http://www.cnblogs.com/lchzls/      http://www.cnblogs.com/sunnyDream/   

   詳情請見:http://www.cnblogs.com/zlslch/p/7473861.html

 

  人生苦短,我願分享。本公眾號將秉持活到老學到老學習無休止的交流分享開源精神,匯聚於互聯網和個人學習工作的精華干貨知識,一切來於互聯網,反饋回互聯網。
  目前研究領域:大數據、機器學習、深度學習、人工智能、數據挖掘、數據分析。 語言涉及:Java、Scala、Python、Shell、Linux等 。同時還涉及平常所使用的手機、電腦和互聯網上的使用技巧、問題和實用軟件。 只要你一直關注和呆在群里,每天必須有收獲

 

      對應本平台的討論和答疑QQ群:大數據和人工智能躺過的坑(總群)(161156071) 

 

 

 

 

 

 

 

 

 

 

 

 


免責聲明!

本站轉載的文章為個人學習借鑒使用,本站對版權不負任何法律責任。如果侵犯了您的隱私權益,請聯系本站郵箱yoyou2525@163.com刪除。



 
粵ICP備18138465號   © 2018-2025 CODEPRJ.COM