第ä¸é¨åã软件å®è£
1ã å®è£
JDK ï¼çæ¬ä¸º1.7.0_11ï¼
2ã å®è£
Scala ï¼çæ¬ä¸º2.11.2ï¼
3ã å®è£
ScalaIDEï¼çæ¬ä¸º3.0.4ï¼
第äºé¨åï¼å å缩å®ç½ä¸è½½çæºä»£ç å
æè
æ¾å°éè¿Gitæ½åçSparkæºæ件ï¼
æç¨çæ¯spark-1.1.1çæ¬ï¼ææ°çæ¬ï¼ï¼ç±äºidea 13å·²ç»åçæ¯æsbtï¼æ以æ 须为ideaå®è£
sbtæ件ã
æºç ä¸è½½(ç¨gitå·¥å
·)ï¼
# Masterdevelopment branch
gitclone git://github.com/apache/spark.git
# 1.1 maintenancebranch with stability fixes on top of Spark 1.1.1
gitclone git://github.com/apache/spark.git -b branch-1.1
æºç æ´æ°ï¼ç¨gitå·¥å
·åæ¥è·æ°æºç ï¼ï¼
gitclone
https://github.com/apache/spark.git第ä¸é¨åï¼éè¿sbtå·¥å
·ï¼æ建ScalaçEclipseå·¥ç¨ï¼è¯¦ç»æ¥éª¤å¦ä¸æ示
1ãéè¿cmdå½ä»¤è¿å
¥DOSçé¢ï¼ä¹åéè¿cdå½ä»¤è¿å
¥æºä»£ç 项ç®ä¸ï¼æä¸è½½çSpark.1.1.1çæ¬çæºä»£ç æ¾å¨ï¼E:\Spark计ç®æ¡æ¶çç 究\spark_1_1_1_eclipseï¼æ件夹ä¸ï¼ä¹åè¿è¡sbtå½ä»¤ï¼å¦ä¸æ示ï¼
2ãè¿è¡sbtå½ä»¤ä¹åï¼è§£æç¼è¯ç¸å
³çjarå
ï¼å¹¶åºç°sbtå½ä»¤çé¢çªå£ï¼åºç°çææå¾å¦ä¸æ示ï¼ä¹åè¿è¡eclipseå½ä»¤ï¼sbt对è¿ä¸ªå·¥ç¨è¿è¡ç¼è¯ï¼æ建Eclipse项ç®ï¼ææå¾å¦ä¸æ示ï¼
4ã æå¼ScalaIDEå·¥å
·ï¼File à Import à Existing Projects into Workspace Ã
Next Ã
éæ©å好ç¨sbtå·¥å
·ç¼è¯å¥½çEclipseå·¥ç¨ï¼E:\Spark计ç®æ¡æ¶çç 究\spark_1_1_1_eclipseï¼ï¼å¦ä¸å¾æ示ã
5ã éè¿ä¸é¢çæä½ï¼å°±å¯ä»¥å°éè¿sbtå·¥å
·ç¼è¯çæçEclipse项ç®å¯¼å
¥å°EclipseIDEå¼åç¯å¢ä¸ï¼ææå¾å¦ä¸æ示ï¼
é误æ示å¦ä¸æ示ï¼æ导å
¥çå
为ï¼å¦ä¸æ件夹ä¸æ示ã
ï¼E:\Spark计ç®æ¡æ¶çç 究\spark_1_1_1_eclipse\lib_managed\bundlesï¼
Description Resource Path Location Type
akka-remote_2.10-2.2.3-shaded-protobuf.jar is cross-compiled
with an incompatible version of Scala (2.10).
In case of errorneous report, this check can be disabled
in the compiler preference page.
spark-core Unknown Scala Classpath Problem
Description Resource Path Location Type
akka-slf4j_2.10-2.2.3-shaded-protobuf.jar is cross-compiled with
an incompatible version of Scala (2.10). In case of errorneous report,
this check can be disabled in the compiler preference page.
spark-core Unknown Scala Classpath Problem
Description Resource Path Location Type
akka-testkit_2.10-2.2.3-shaded-protobuf.jar is cross-compiled
with an incompatible version of Scala (2.10).
In case of errorneous report, this check can be disabled in the compiler preference page.
spark-core Unknown Scala Classpath Problem
Description Resource Path Location Type
akka-zeromq_2.10-2.2.3-shaded-protobuf.jar is cross-compiled
with an incompatible version of Scala (2.10).
In case of errorneous report, this check can be disabled in the compiler preference page.
spark-core Unknown Scala Classpath Problem
ä¸é¢è¿äºå
å
¼å®¹æ§é®é¢è¿æ²¡æ解å³ï¼ä¿®æ¹ç¸åºçjarå
å°±å¯ä»¥è§£å³ã