1.下载:
(1)git

git clone https://github.com/apache/spark.git

查看版本:

git tag

选择版本:

git checkout Version(自己指定)

(2) release:
下载:​​​https://github.com/apache/spark/releases​

2.编译安装:

export MAVEN_OPTS="-Xmx2g -XX:MaxPermSize=512M -XX:ReservedCodeCacheSize=512m"
mvn -DskipTests clean package

3.安装记录:

xubo@xubo:~/cloud/down/spark-2.0.0-preview$ export MAVEN_OPTS="-Xmx2g -XX:MaxPermSize=512M -XX:ReservedCodeCacheSize=512m"
xubo@xubo:~/cloud/down/spark-2.0.0-preview$ mvn -DskipTests clean package
[INFO] 
[INFO] --- maven-source-plugin:2.4:test-jar-no-fork (create-source-jar) @ spark-streaming-kafka-0-8-assembly_2.11 ---
[INFO] Building jar: /home/xubo/cloud/down/spark-2.0.0-preview/external/kafka-0-8-assembly/target/spark-streaming-kafka-0-8-assembly_2.11-2.0.0-preview-test-sources.jar
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Spark Project Parent POM ........................... SUCCESS [ 6.289 s]
[INFO] Spark Project Tags ................................. SUCCESS [ 7.540 s]
[INFO] Spark Project Sketch ............................... SUCCESS [ 14.714 s]
[INFO] Spark Project Networking ........................... SUCCESS [ 11.961 s]
[INFO] Spark Project Shuffle Streaming Service ............ SUCCESS [ 7.347 s]
[INFO] Spark Project Unsafe ............................... SUCCESS [ 21.138 s]
[INFO] Spark Project Launcher ............................. SUCCESS [ 12.993 s]
[INFO] Spark Project Core ................................. SUCCESS [04:57 min]
[INFO] Spark Project GraphX ............................... SUCCESS [01:16 min]
[INFO] Spark Project Streaming ............................ SUCCESS [02:18 min]
[INFO] Spark Project Catalyst ............................. SUCCESS [03:49 min]
[INFO] Spark Project SQL .................................. SUCCESS [04:35 min]
[INFO] Spark Project ML Local Library ..................... SUCCESS [ 58.663 s]
[INFO] Spark Project ML Library ........................... SUCCESS [04:03 min]
[INFO] Spark Project Tools ................................ SUCCESS [ 23.157 s]
[INFO] Spark Project Hive ................................. SUCCESS [03:44 min]
[INFO] Spark Project HiveContext Compatibility ............ SUCCESS [ 21.351 s]
[INFO] Spark Project REPL ................................. SUCCESS [ 26.514 s]
[INFO] Spark Project Assembly ............................. SUCCESS [ 9.730 s]
[INFO] Spark Project External Flume Sink .................. SUCCESS [ 30.954 s]
[INFO] Spark Project External Flume ....................... SUCCESS [ 41.156 s]
[INFO] Spark Project External Flume Assembly .............. SUCCESS [ 3.194 s]
[INFO] Spark Integration for Kafka 0.8 .................... SUCCESS [01:18 min]
[INFO] Spark Project Examples ............................. SUCCESS [01:10 min]
[INFO] Spark Project External Kafka Assembly .............. SUCCESS [ 6.295 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 32:20 min
[INFO] Finished at: 2016-05-23T22:45:20+08:00
[INFO] Final Memory: 86M/966M
[INFO] ------------------------------------------------------------------------
xubo@xubo:~/cloud/down/spark-2.0.0-preview$ ls
assembly core graphx NOTICE repl tools
bin data launcher pom.xml sbin yarn
build dev LICENSE project scalastyle-config.xml
common docs licenses python sql
conf examples mllib R streaming
CONTRIBUTING.md external mllib-local README.md target

4.较完整版(可忽略):

apache/spark/examples/mllib/DecisionTreeRunner.scala:302: value precision in class MulticlassMetrics is deprecated: Use accuracy.
[WARNING] new MulticlassMetrics(test.map(lp => (model.predict(lp.features), lp.label))).precision
[WARNING] ^
[WARNING] /home/xubo/cloud/down/spark-2.0.0-preview/examples/src/main/scala/org/apache/spark/examples/mllib/DecisionTreeRunner.scala:326: value precision in class MulticlassMetrics is deprecated: Use accuracy.
[WARNING] .precision
[WARNING] ^
[WARNING] /home/xubo/cloud/down/spark-2.0.0-preview/examples/src/main/scala/org/apache/spark/examples/mllib/DecisionTreeRunner.scala:329: value precision in class MulticlassMetrics is deprecated: Use accuracy.
[WARNING] new MulticlassMetrics(test.map(lp => (model.predict(lp.features), lp.label))).precision
[WARNING] ^
[WARNING] /home/xubo/cloud/down/spark-2.0.0-preview/examples/src/main/scala/org/apache/spark/examples/mllib/GradientBoostedTreesRunner.scala:124: value precision in class MulticlassMetrics is deprecated: Use accuracy.
[WARNING] .precision
[WARNING] ^
[WARNING] /home/xubo/cloud/down/spark-2.0.0-preview/examples/src/main/scala/org/apache/spark/examples/mllib/GradientBoostedTreesRunner.scala:127: value precision in class MulticlassMetrics is deprecated: Use accuracy.
[WARNING] new MulticlassMetrics(test.map(lp => (model.predict(lp.features), lp.label))).precision
[WARNING] ^
[WARNING] /home/xubo/cloud/down/spark-2.0.0-preview/examples/src/main/scala/org/apache/spark/examples/mllib/LinearRegression.scala:115: class LinearRegressionWithSGD in package regression is deprecated: Use ml.regression.LinearRegression or LBFGS
[WARNING] val algorithm = new LinearRegressionWithSGD()
[WARNING] ^
[WARNING] /home/xubo/cloud/down/spark-2.0.0-preview/examples/src/main/scala/org/apache/spark/examples/mllib/LinearRegressionWithSGDExample.scala:46: object LinearRegressionWithSGD in package regression is deprecated: Use ml.regression.LinearRegression or LBFGS
[WARNING] val model = LinearRegressionWithSGD.train(parsedData, numIterations, stepSize)
[WARNING] ^
[WARNING] /home/xubo/cloud/down/spark-2.0.0-preview/examples/src/main/scala/org/apache/spark/examples/mllib/LogisticRegressionWithLBFGSExample.scala:57: value precision in class MulticlassMetrics is deprecated: Use accuracy.
[WARNING] val precision = metrics.precision
[WARNING] ^
[WARNING] /home/xubo/cloud/down/spark-2.0.0-preview/examples/src/main/scala/org/apache/spark/examples/mllib/MulticlassMetricsExample.scala:62: value precision in class MulticlassMetrics is deprecated: Use accuracy.
[WARNING] val precision = metrics.precision
[WARNING] ^
[WARNING] /home/xubo/cloud/down/spark-2.0.0-preview/examples/src/main/scala/org/apache/spark/examples/mllib/MulticlassMetricsExample.scala:63: value recall in class MulticlassMetrics is deprecated: Use accuracy.
[WARNING] val recall = metrics.recall // same as true positive rate
[WARNING] ^
[WARNING] /home/xubo/cloud/down/spark-2.0.0-preview/examples/src/main/scala/org/apache/spark/examples/mllib/MulticlassMetricsExample.scala:64: value fMeasure in class MulticlassMetrics is deprecated: Use accuracy.
[WARNING] val f1Score = metrics.fMeasure
[WARNING] ^
[WARNING] /home/xubo/cloud/down/spark-2.0.0-preview/examples/src/main/scala/org/apache/spark/examples/mllib/PCAExample.scala:51: object LinearRegressionWithSGD in package regression is deprecated: Use ml.regression.LinearRegression or LBFGS
[WARNING] val model = LinearRegressionWithSGD.train(training, numIterations)
[WARNING] ^
[WARNING] /home/xubo/cloud/down/spark-2.0.0-preview/examples/src/main/scala/org/apache/spark/examples/mllib/PCAExample.scala:52: object LinearRegressionWithSGD in package regression is deprecated: Use ml.regression.LinearRegression or LBFGS
[WARNING] val model_pca = LinearRegressionWithSGD.train(training_pca, numIterations)
[WARNING] ^
[WARNING] /home/xubo/cloud/down/spark-2.0.0-preview/examples/src/main/scala/org/apache/spark/examples/mllib/RegressionMetricsExample.scala:43: object LinearRegressionWithSGD in package regression is deprecated: Use ml.regression.LinearRegression or LBFGS
[WARNING] val model = LinearRegressionWithSGD.train(data, numIterations)
[WARNING] ^
[WARNING] /home/xubo/cloud/down/spark-2.0.0-preview/examples/src/main/scala/org/apache/spark/examples/streaming/RecoverableNetworkWordCount.scala:57: class Accumulator in package spark is deprecated: use AccumulatorV2
[WARNING] @volatile private var instance: Accumulator[Long] = null
[WARNING] ^
[WARNING] /home/xubo/cloud/down/spark-2.0.0-preview/examples/src/main/scala/org/apache/spark/examples/streaming/RecoverableNetworkWordCount.scala:59: class Accumulator in package spark is deprecated: use AccumulatorV2
[WARNING] def getInstance(sc: SparkContext): Accumulator[Long] = {
[WARNING] ^
[WARNING] /home/xubo/cloud/down/spark-2.0.0-preview/examples/src/main/scala/org/apache/spark/examples/streaming/RecoverableNetworkWordCount.scala:63: method accumulator in class SparkContext is deprecated: use AccumulatorV2
[WARNING] instance = sc.accumulator(0L, "WordsInBlacklistCounter")
[WARNING] ^
[WARNING] /home/xubo/cloud/down/spark-2.0.0-preview/examples/src/main/scala/org/apache/spark/examples/streaming/RecoverableNetworkWordCount.scala:63: object LongAccumulatorParam in object AccumulatorParam is deprecated: use AccumulatorV2
[WARNING] instance = sc.accumulator(0L, "WordsInBlacklistCounter")
[WARNING] ^
[WARNING] 21 warnings found
[WARNING] /home/xubo/cloud/down/spark-2.0.0-preview/examples/src/main/java/org/apache/spark/examples/mllib/JavaLinearRegressionWithSGDExample.java:32: warning: [deprecation] LinearRegressionWithSGD in org.apache.spark.mllib.regression has been deprecated
[WARNING] import org.apache.spark.mllib.regression.LinearRegressionWithSGD;
[WARNING] ^
[WARNING] /home/xubo/cloud/down/spark-2.0.0-preview/examples/src/main/java/org/apache/spark/examples/mllib/JavaRegressionMetricsExample.java:28: warning: [deprecation] LinearRegressionWithSGD in org.apache.spark.mllib.regression has been deprecated
[WARNING] import org.apache.spark.mllib.regression.LinearRegressionWithSGD;
[WARNING] ^
[WARNING] /home/xubo/cloud/down/spark-2.0.0-preview/examples/src/main/java/org/apache/spark/examples/streaming/JavaRecoverableNetworkWordCount.java:32: warning: [deprecation] Accumulator in org.apache.spark has been deprecated
[WARNING] import org.apache.spark.Accumulator;
[WARNING] ^
[WARNING] /home/xubo/cloud/down/spark-2.0.0-preview/examples/src/main/java/org/apache/spark/examples/mllib/JavaLinearRegressionWithSGDExample.java:66: warning: [deprecation] LinearRegressionWithSGD in org.apache.spark.mllib.regression has been deprecated
[WARNING] LinearRegressionWithSGD.train(JavaRDD.toRDD(parsedData), numIterations, stepSize);
[WARNING] ^
[WARNING] /home/xubo/cloud/down/spark-2.0.0-preview/examples/src/main/java/org/apache/spark/examples/mllib/JavaLogisticRegressionWithLBFGSExample.java:68: warning: [deprecation] precision() in MulticlassMetrics has been deprecated
[WARNING] double precision = metrics.precision();
[WARNING] ^
[WARNING] /home/xubo/cloud/down/spark-2.0.0-preview/examples/src/main/java/org/apache/spark/examples/mllib/JavaMulticlassClassificationMetricsExample.java:71: warning: [deprecation] precision() in MulticlassMetrics has been deprecated
[WARNING] System.out.println("Precision = " + metrics.precision());
[WARNING] ^
[WARNING] /home/xubo/cloud/down/spark-2.0.0-preview/examples/src/main/java/org/apache/spark/examples/mllib/JavaMulticlassClassificationMetricsExample.java:72: warning: [deprecation] recall() in MulticlassMetrics has been deprecated
[WARNING] System.out.println("Recall = " + metrics.recall());
[WARNING] ^
[WARNING] /home/xubo/cloud/down/spark-2.0.0-preview/examples/src/main/java/org/apache/spark/examples/mllib/JavaMulticlassClassificationMetricsExample.java:73: warning: [deprecation] fMeasure() in MulticlassMetrics has been deprecated
[WARNING] System.out.println("F1 Score = " + metrics.fMeasure());
[WARNING] ^
[WARNING] /home/xubo/cloud/down/spark-2.0.0-preview/examples/src/main/java/org/apache/spark/examples/mllib/JavaRegressionMetricsExample.java:57: warning: [deprecation] LinearRegressionWithSGD in org.apache.spark.mllib.regression has been deprecated
[WARNING] final LinearRegressionModel model = LinearRegressionWithSGD.train(JavaRDD.toRDD(parsedData),
[WARNING] ^
[WARNING] /home/xubo/cloud/down/spark-2.0.0-preview/examples/src/main/java/org/apache/spark/examples/streaming/JavaRecoverableNetworkWordCount.java:70: warning: [deprecation] Accumulator in org.apache.spark has been deprecated
[WARNING] private static volatile Accumulator<Integer> instance = null;
[WARNING] ^
[WARNING] /home/xubo/cloud/down/spark-2.0.0-preview/examples/src/main/java/org/apache/spark/examples/streaming/JavaRecoverableNetworkWordCount.java:72: warning: [deprecation] Accumulator in org.apache.spark has been deprecated
[WARNING] public static Accumulator<Integer> getInstance(JavaSparkContext jsc) {
[WARNING] ^
[WARNING] /home/xubo/cloud/down/spark-2.0.0-preview/examples/src/main/java/org/apache/spark/examples/streaming/JavaRecoverableNetworkWordCount.java:161: warning: [deprecation] Accumulator in org.apache.spark has been deprecated
[WARNING] final Accumulator<Integer> droppedWordsCounter =
[WARNING] ^
[WARNING] 12 warnings
[INFO]
[INFO] --- maven-compiler-plugin:3.5.1:compile (default-compile) @ spark-examples_2.11 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 110 source files to /home/xubo/cloud/down/spark-2.0.0-preview/examples/target/scala-2.11/classes
[WARNING] /home/xubo/cloud/down/spark-2.0.0-preview/examples/src/main/java/org/apache/spark/examples/mllib/JavaLinearRegressionWithSGDExample.java:[32,40] [deprecation] LinearRegressionWithSGD in org.apache.spark.mllib.regression has been deprecated
[WARNING] /home/xubo/cloud/down/spark-2.0.0-preview/examples/src/main/java/org/apache/spark/examples/streaming/JavaRecoverableNetworkWordCount.java:[32,23] [deprecation] Accumulator in org.apache.spark has been deprecated
[WARNING] /home/xubo/cloud/down/spark-2.0.0-preview/examples/src/main/java/org/apache/spark/examples/mllib/JavaRegressionMetricsExample.java:[28,40] [deprecation] LinearRegressionWithSGD in org.apache.spark.mllib.regression has been deprecated
[WARNING] /home/xubo/cloud/down/spark-2.0.0-preview/examples/src/main/java/org/apache/spark/examples/mllib/JavaLinearRegressionWithSGDExample.java:[66,6] [deprecation] LinearRegressionWithSGD in org.apache.spark.mllib.regression has been deprecated
[WARNING] /home/xubo/cloud/down/spark-2.0.0-preview/examples/src/main/java/org/apache/spark/examples/mllib/JavaMulticlassClassificationMetricsExample.java:[71,47] [deprecation] precision() in MulticlassMetrics has been deprecated
[WARNING] /home/xubo/cloud/down/spark-2.0.0-preview/examples/src/main/java/org/apache/spark/examples/mllib/JavaMulticlassClassificationMetricsExample.java:[72,44] [deprecation] recall() in MulticlassMetrics has been deprecated
[WARNING] /home/xubo/cloud/down/spark-2.0.0-preview/examples/src/main/java/org/apache/spark/examples/mllib/JavaMulticlassClassificationMetricsExample.java:[73,46] [deprecation] fMeasure() in MulticlassMetrics has been deprecated
[WARNING] /home/xubo/cloud/down/spark-2.0.0-preview/examples/src/main/java/org/apache/spark/examples/mllib/JavaLogisticRegressionWithLBFGSExample.java:[68,30] [deprecation] precision() in MulticlassMetrics has been deprecated
[WARNING] /home/xubo/cloud/down/spark-2.0.0-preview/examples/src/main/java/org/apache/spark/examples/streaming/JavaRecoverableNetworkWordCount.java:[70,26] [deprecation] Accumulator in org.apache.spark has been deprecated
[WARNING] /home/xubo/cloud/down/spark-2.0.0-preview/examples/src/main/java/org/apache/spark/examples/streaming/JavaRecoverableNetworkWordCount.java:[72,16] [deprecation] Accumulator in org.apache.spark has been deprecated
[WARNING] /home/xubo/cloud/down/spark-2.0.0-preview/examples/src/main/java/org/apache/spark/examples/streaming/JavaRecoverableNetworkWordCount.java:[161,14] [deprecation] Accumulator in org.apache.spark has been deprecated
[WARNING] /home/xubo/cloud/down/spark-2.0.0-preview/examples/src/main/java/org/apache/spark/examples/mllib/JavaRegressionMetricsExample.java:[57,40] [deprecation] LinearRegressionWithSGD in org.apache.spark.mllib.regression has been deprecated
[INFO]
[INFO] --- maven-antrun-plugin:1.8:run (create-tmp-dir) @ spark-examples_2.11 ---
[INFO] Executing tasks

main:
[mkdir] Created dir: /home/xubo/cloud/down/spark-2.0.0-preview/examples/target/tmp
[INFO] Executed tasks
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-examples_2.11 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/xubo/cloud/down/spark-2.0.0-preview/examples/src/test/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.2:testCompile (scala-test-compile-first) @ spark-examples_2.11 ---
[INFO] No sources to compile
[INFO]
[INFO] --- maven-compiler-plugin:3.5.1:testCompile (default-testCompile) @ spark-examples_2.11 ---
[INFO] No sources to compile
[INFO]
[INFO] --- maven-dependency-plugin:2.10:build-classpath (generate-test-classpath) @ spark-examples_2.11 ---
[INFO]
[INFO] --- maven-surefire-plugin:2.19.1:test (default-test) @ spark-examples_2.11 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-surefire-plugin:2.19.1:test (test) @ spark-examples_2.11 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- scalatest-maven-plugin:1.0:test (test) @ spark-examples_2.11 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.6:jar (default-jar) @ spark-examples_2.11 ---
[INFO] Building jar: /home/xubo/cloud/down/spark-2.0.0-preview/examples/target/scala-2.11/jars/spark-examples_2.11-2.0.0-preview.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-examples_2.11 ---
[INFO]
[INFO] --- maven-dependency-plugin:2.10:copy-dependencies (copy-module-dependencies) @ spark-examples_2.11 ---
[INFO] Copying scopt_2.11-3.3.0.jar to /home/xubo/cloud/down/spark-2.0.0-preview/examples/target/scala-2.11/jars/scopt_2.11-3.3.0.jar
[INFO]
[INFO] --- maven-shade-plugin:2.4.3:shade (default) @ spark-examples_2.11 ---
[INFO] Excluding com.github.scopt:scopt_2.11:jar:3.3.0 from the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/xubo/cloud/down/spark-2.0.0-preview/examples/target/scala-2.11/jars/spark-examples_2.11-2.0.0-preview.jar with /home/xubo/cloud/down/spark-2.0.0-preview/examples/target/spark-examples_2.11-2.0.0-preview-shaded.jar
[INFO]
[INFO] --- maven-source-plugin:2.4:jar-no-fork (create-source-jar) @ spark-examples_2.11 ---
[INFO] Building jar: /home/xubo/cloud/down/spark-2.0.0-preview/examples/target/spark-examples_2.11-2.0.0-preview-sources.jar
[INFO]
[INFO] --- maven-source-plugin:2.4:test-jar-no-fork (create-source-jar) @ spark-examples_2.11 ---
[INFO] Building jar: /home/xubo/cloud/down/spark-2.0.0-preview/examples/target/spark-examples_2.11-2.0.0-preview-test-sources.jar
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project External Kafka Assembly 2.0.0-preview
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:3.0.0:clean (default-clean) @ spark-streaming-kafka-0-8-assembly_2.11 ---
[INFO]
[INFO] --- maven-enforcer-plugin:1.4.1:enforce (enforce-versions) @ spark-streaming-kafka-0-8-assembly_2.11 ---
[INFO]
[INFO] --- scala-maven-plugin:3.2.2:add-source (eclipse-add-source) @ spark-streaming-kafka-0-8-assembly_2.11 ---
[INFO] Add Source directory: /home/xubo/cloud/down/spark-2.0.0-preview/external/kafka-0-8-assembly/src/main/scala
[INFO] Add Test Source directory: /home/xubo/cloud/down/spark-2.0.0-preview/external/kafka-0-8-assembly/src/test/scala
[INFO]
[INFO] --- maven-dependency-plugin:2.10:build-classpath (default-cli) @ spark-streaming-kafka-0-8-assembly_2.11 ---
[INFO] Dependencies classpath:
/home/xubo/.m2/repository/org/scala-lang/modules/scala-parser-combinators_2.11/1.0.2/scala-parser-combinators_2.11-1.0.2.jar:/home/xubo/.m2/repository/org/apache/avro/avro/1.7.7/avro-1.7.7.jar:/home/xubo/.m2/repository/javax/inject/javax.inject/1/javax.inject-1.jar:/home/xubo/.m2/repository/org/scala-lang/modules/scala-xml_2.11/1.0.2/scala-xml_2.11-1.0.2.jar:/home/xubo/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.9.13.jar:/home/xubo/.m2/repository/com/google/inject/guice/3.0/guice-3.0.jar:/home/xubo/.m2/repository/org/apache/kafka/kafka_2.11/0.8.2.1/kafka_2.11-0.8.2.1.jar:/home/xubo/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar:/home/xubo/.m2/repository/org/apache/hadoop/hadoop-yarn-api/2.2.0/hadoop-yarn-api-2.2.0.jar:/home/xubo/.m2/repository/org/tukaani/xz/1.0/xz-1.0.jar:/home/xubo/.m2/repository/org/apache/avro/avro-ipc/1.7.7/avro-ipc-1.7.7.jar:/home/xubo/.m2/repository/org/apache/kafka/kafka-clients/0.8.2.1/kafka-clients-0.8.2.1.jar:/home/xubo/.m2/repository/org/apache/commons/commons-compress/1.4.1/commons-compress-1.4.1.jar:/home/xubo/cloud/down/spark-2.0.0-preview/external/kafka-0-8/target/spark-streaming-kafka-0-8_2.11-2.0.0-preview.jar:/home/xubo/.m2/repository/org/apache/hadoop/hadoop-yarn-client/2.2.0/hadoop-yarn-client-2.2.0.jar:/home/xubo/.m2/repository/org/apache/hadoop/hadoop-yarn-common/2.2.0/hadoop-yarn-common-2.2.0.jar:/home/xubo/.m2/repository/aopalliance/aopalliance/1.0/aopalliance-1.0.jar:/home/xubo/.m2/repository/com/yammer/metrics/metrics-core/2.2.0/metrics-core-2.2.0.jar:/home/xubo/cloud/down/spark-2.0.0-preview/common/tags/target/spark-tags_2.11-2.0.0-preview.jar:/home/xubo/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.13.jar:/home/xubo/.m2/repository/com/101tec/zkclient/0.3/zkclient-0.3.jar:/home/xubo/.m2/repository/com/thoughtworks/paranamer/paranamer/2.6/paranamer-2.6.jar:/home/xubo/.m2/repository/org/spark-project/spark/unused/1.0.0/unused-1.0.0.jar
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-streaming-kafka-0-8-assembly_2.11 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-streaming-kafka-0-8-assembly_2.11 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/xubo/cloud/down/spark-2.0.0-preview/external/kafka-0-8-assembly/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.2:compile (scala-compile-first) @ spark-streaming-kafka-0-8-assembly_2.11 ---
[INFO] No sources to compile
[INFO]
[INFO] --- maven-compiler-plugin:3.5.1:compile (default-compile) @ spark-streaming-kafka-0-8-assembly_2.11 ---
[INFO] No sources to compile
[INFO]
[INFO] --- maven-antrun-plugin:1.8:run (create-tmp-dir) @ spark-streaming-kafka-0-8-assembly_2.11 ---
[INFO] Executing tasks

main:
[mkdir] Created dir: /home/xubo/cloud/down/spark-2.0.0-preview/external/kafka-0-8-assembly/target/tmp
[INFO] Executed tasks
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-streaming-kafka-0-8-assembly_2.11 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/xubo/cloud/down/spark-2.0.0-preview/external/kafka-0-8-assembly/src/test/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.2:testCompile (scala-test-compile-first) @ spark-streaming-kafka-0-8-assembly_2.11 ---
[INFO] No sources to compile
[INFO]
[INFO] --- maven-compiler-plugin:3.5.1:testCompile (default-testCompile) @ spark-streaming-kafka-0-8-assembly_2.11 ---
[INFO] No sources to compile
[INFO]
[INFO] --- maven-dependency-plugin:2.10:build-classpath (generate-test-classpath) @ spark-streaming-kafka-0-8-assembly_2.11 ---
[INFO]
[INFO] --- maven-surefire-plugin:2.19.1:test (default-test) @ spark-streaming-kafka-0-8-assembly_2.11 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-surefire-plugin:2.19.1:test (test) @ spark-streaming-kafka-0-8-assembly_2.11 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- scalatest-maven-plugin:1.0:test (test) @ spark-streaming-kafka-0-8-assembly_2.11 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.6:test-jar (prepare-test-jar) @ spark-streaming-kafka-0-8-assembly_2.11 ---
[INFO] Building jar: /home/xubo/cloud/down/spark-2.0.0-preview/external/kafka-0-8-assembly/target/spark-streaming-kafka-0-8-assembly_2.11-2.0.0-preview-tests.jar
[INFO]
[INFO] --- maven-jar-plugin:2.6:jar (default-jar) @ spark-streaming-kafka-0-8-assembly_2.11 ---
[INFO] Building jar: /home/xubo/cloud/down/spark-2.0.0-preview/external/kafka-0-8-assembly/target/spark-streaming-kafka-0-8-assembly_2.11-2.0.0-preview.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-streaming-kafka-0-8-assembly_2.11 ---
[INFO]
[INFO] --- maven-shade-plugin:2.4.3:shade (default) @ spark-streaming-kafka-0-8-assembly_2.11 ---
[INFO] Including org.apache.spark:spark-streaming-kafka-0-8_2.11:jar:2.0.0-preview in the shaded jar.
[INFO] Including org.apache.kafka:kafka_2.11:jar:0.8.2.1 in the shaded jar.
[INFO] Including com.yammer.metrics:metrics-core:jar:2.2.0 in the shaded jar.
[INFO] Including org.scala-lang.modules:scala-parser-combinators_2.11:jar:1.0.2 in the shaded jar.
[INFO] Including com.101tec:zkclient:jar:0.3 in the shaded jar.
[INFO] Including org.apache.kafka:kafka-clients:jar:0.8.2.1 in the shaded jar.
[INFO] Including org.apache.spark:spark-tags_2.11:jar:2.0.0-preview in the shaded jar.
[INFO] Including com.thoughtworks.paranamer:paranamer:jar:2.6 in the shaded jar.
[INFO] Including commons-io:commons-io:jar:2.4 in the shaded jar.
[INFO] Including org.apache.avro:avro:jar:1.7.7 in the shaded jar.
[INFO] Including org.apache.commons:commons-compress:jar:1.4.1 in the shaded jar.
[INFO] Including org.tukaani:xz:jar:1.0 in the shaded jar.
[INFO] Including org.apache.hadoop:hadoop-yarn-client:jar:2.2.0 in the shaded jar.
[INFO] Including com.google.inject:guice:jar:3.0 in the shaded jar.
[INFO] Including javax.inject:javax.inject:jar:1 in the shaded jar.
[INFO] Including aopalliance:aopalliance:jar:1.0 in the shaded jar.
[INFO] Including org.apache.hadoop:hadoop-yarn-api:jar:2.2.0 in the shaded jar.
[INFO] Including org.apache.hadoop:hadoop-yarn-common:jar:2.2.0 in the shaded jar.
[INFO] Including org.apache.avro:avro-ipc:jar:1.7.7 in the shaded jar.
[INFO] Including org.codehaus.jackson:jackson-core-asl:jar:1.9.13 in the shaded jar.
[INFO] Including org.codehaus.jackson:jackson-mapper-asl:jar:1.9.13 in the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Including org.scala-lang.modules:scala-xml_2.11:jar:1.0.2 in the shaded jar.
[WARNING] unused-1.0.0.jar, spark-tags_2.11-2.0.0-preview.jar, spark-streaming-kafka-0-8_2.11-2.0.0-preview.jar define 1 overlapping classes:
[WARNING] - org.apache.spark.unused.UnusedStubClass
[WARNING] hadoop-yarn-api-2.2.0.jar, hadoop-yarn-common-2.2.0.jar define 3 overlapping classes:
[WARNING] - org.apache.hadoop.yarn.factories.package-info
[WARNING] - org.apache.hadoop.yarn.util.package-info
[WARNING] - org.apache.hadoop.yarn.factory.providers.package-info
[WARNING] maven-shade-plugin has detected that some class files are
[WARNING] present in two or more JARs. When this happens, only one
[WARNING] single version of the class is copied to the uber jar.
[WARNING] Usually this is not harmful and you can skip these warnings,
[WARNING] otherwise try to manually exclude artifacts based on
[WARNING] mvn dependency:tree -Ddetail=true and the above output.
[WARNING] See http://maven.apache.org/plugins/maven-shade-plugin/
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/xubo/cloud/down/spark-2.0.0-preview/external/kafka-0-8-assembly/target/spark-streaming-kafka-0-8-assembly_2.11-2.0.0-preview.jar with /home/xubo/cloud/down/spark-2.0.0-preview/external/kafka-0-8-assembly/target/spark-streaming-kafka-0-8-assembly_2.11-2.0.0-preview-shaded.jar
[INFO] Dependency-reduced POM written at: /home/xubo/cloud/down/spark-2.0.0-preview/external/kafka-0-8-assembly/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/xubo/cloud/down/spark-2.0.0-preview/external/kafka-0-8-assembly/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.4:jar-no-fork (create-source-jar) @ spark-streaming-kafka-0-8-assembly_2.11 ---
[INFO] Building jar: /home/xubo/cloud/down/spark-2.0.0-preview/external/kafka-0-8-assembly/target/spark-streaming-kafka-0-8-assembly_2.11-2.0.0-preview-sources.jar
[INFO]
[INFO] --- maven-source-plugin:2.4:test-jar-no-fork (create-source-jar) @ spark-streaming-kafka-0-8-assembly_2.11 ---
[INFO] Building jar: /home/xubo/cloud/down/spark-2.0.0-preview/external/kafka-0-8-assembly/target/spark-streaming-kafka-0-8-assembly_2.11-2.0.0-preview-test-sources.jar
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Spark Project Parent POM ........................... SUCCESS [ 6.289 s]
[INFO] Spark Project Tags ................................. SUCCESS [ 7.540 s]
[INFO] Spark Project Sketch ............................... SUCCESS [ 14.714 s]
[INFO] Spark Project Networking ........................... SUCCESS [ 11.961 s]
[INFO] Spark Project Shuffle Streaming Service ............ SUCCESS [ 7.347 s]
[INFO] Spark Project Unsafe ............................... SUCCESS [ 21.138 s]
[INFO] Spark Project Launcher ............................. SUCCESS [ 12.993 s]
[INFO] Spark Project Core ................................. SUCCESS [04:57 min]
[INFO] Spark Project GraphX ............................... SUCCESS [01:16 min]
[INFO] Spark Project Streaming ............................ SUCCESS [02:18 min]
[INFO] Spark Project Catalyst ............................. SUCCESS [03:49 min]
[INFO] Spark Project SQL .................................. SUCCESS [04:35 min]
[INFO] Spark Project ML Local Library ..................... SUCCESS [ 58.663 s]
[INFO] Spark Project ML Library ........................... SUCCESS [04:03 min]
[INFO] Spark Project Tools ................................ SUCCESS [ 23.157 s]
[INFO] Spark Project Hive ................................. SUCCESS [03:44 min]
[INFO] Spark Project HiveContext Compatibility ............ SUCCESS [ 21.351 s]
[INFO] Spark Project REPL ................................. SUCCESS [ 26.514 s]
[INFO] Spark Project Assembly ............................. SUCCESS [ 9.730 s]
[INFO] Spark Project External Flume Sink .................. SUCCESS [ 30.954 s]
[INFO] Spark Project External Flume ....................... SUCCESS [ 41.156 s]
[INFO] Spark Project External Flume Assembly .............. SUCCESS [ 3.194 s]
[INFO] Spark Integration for Kafka 0.8 .................... SUCCESS [01:18 min]
[INFO] Spark Project Examples ............................. SUCCESS [01:10 min]
[INFO] Spark Project External Kafka Assembly .............. SUCCESS [ 6.295 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 32:20 min
[INFO] Finished at: 2016-05-23T22:45:20+08:00
[INFO] Final Memory: 86M/966M
[INFO] ------------------------------------------------------------------------
xubo@xubo:~/cloud/down/spark-2.0.0-preview$ ls
assembly core graphx NOTICE repl tools
bin data launcher pom.xml sbin yarn
build dev LICENSE project scalastyle-config.xml
common docs licenses python sql
conf examples mllib R streaming
CONTRIBUTING.md external mllib-local README.md target
xubo@xubo:~/cloud/down/spark-2.0.0-preview$

xubo@xubo:~/cloud/down/spark-2.0.0-preview$ export MAVEN_OPTS="-Xmx2g -XX:MaxPermSize=512M -XX:ReservedCodeCacheSize=512m"
xubo@xubo:~/cloud/down/spark-2.0.0-preview$ mvn -DskipTests clean package

生成的jars包:

ubo@xubo:~/cloud/down/spark-2.0.0-preview/assembly/target/scala-2.11/jars$ ll -h
total 130M
drwxrwxr-x 2 xubo xubo 12K May 23 22:41 ./
drwxrwxr-x 3 xubo xubo 4.0K May 23 22:41 ../
-rw-rw-r-- 1 xubo xubo 295K May 23 22:41 antlr4-runtime-4.5.2-1.jar
-rw-rw-r-- 1 xubo xubo 4.4K May 23 22:41 aopalliance-1.0.jar
-rw-rw-r-- 1 xubo xubo 15K May 23 22:41 aopalliance-repackaged-2.4.0-b34.jar
-rw-rw-r-- 1 xubo xubo 1.2M May 23 22:41 arpack_combined_all-0.1.jar
-rw-rw-r-- 1 xubo xubo 427K May 23 22:41 avro-1.7.7.jar
-rw-rw-r-- 1 xubo xubo 189K May 23 22:41 avro-ipc-1.7.7.jar
-rw-rw-r-- 1 xubo xubo 177K May 23 22:41 avro-mapred-1.7.7-hadoop2.jar
-rw-rw-r-- 1 xubo xubo 13M May 23 22:41 breeze_2.11-0.11.2.jar
-rw-rw-r-- 1 xubo xubo 133K May 23 22:41 breeze-macros_2.11-0.11.2.jar
-rw-rw-r-- 1 xubo xubo 219K May 23 22:41 chill_2.11-0.8.0.jar
-rw-rw-r-- 1 xubo xubo 50K May 23 22:41 chill-java-0.8.0.jar
-rw-rw-r-- 1 xubo xubo 185K May 23 22:41 commons-beanutils-1.7.0.jar
-rw-rw-r-- 1 xubo xubo 202K May 23 22:41 commons-beanutils-core-1.8.0.jar
-rw-rw-r-- 1 xubo xubo 41K May 23 22:41 commons-cli-1.2.jar
-rw-rw-r-- 1 xubo xubo 278K May 23 22:41 commons-codec-1.10.jar
-rw-rw-r-- 1 xubo xubo 575K May 23 22:41 commons-collections-3.2.2.jar
-rw-rw-r-- 1 xubo xubo 30K May 23 22:41 commons-compiler-2.7.8.jar
-rw-rw-r-- 1 xubo xubo 236K May 23 22:41 commons-compress-1.4.1.jar
-rw-rw-r-- 1 xubo xubo 292K May 23 22:41 commons-configuration-1.6.jar
-rw-rw-r-- 1 xubo xubo 141K May 23 22:41 commons-digester-1.8.jar
-rw-rw-r-- 1 xubo xubo 298K May 23 22:41 commons-httpclient-3.1.jar
-rw-rw-r-- 1 xubo xubo 181K May 23 22:41 commons-io-2.4.jar
-rw-rw-r-- 1 xubo xubo 278K May 23 22:41 commons-lang-2.6.jar
-rw-rw-r-- 1 xubo xubo 404K May 23 22:41 commons-lang3-3.3.2.jar
-rw-rw-r-- 1 xubo xubo 813K May 23 22:41 commons-math-2.1.jar
-rw-rw-r-- 1 xubo xubo 2.0M May 23 22:41 commons-math3-3.4.1.jar
-rw-rw-r-- 1 xubo xubo 208K May 23 22:41 commons-net-2.2.jar
-rw-rw-r-- 1 xubo xubo 78K May 23 22:41 compress-lzf-1.0.3.jar
-rw-rw-r-- 1 xubo xubo 161K May 23 22:41 core-1.1.2.jar
-rw-rw-r-- 1 xubo xubo 66K May 23 22:41 curator-client-2.4.0.jar
-rw-rw-r-- 1 xubo xubo 176K May 23 22:41 curator-framework-2.4.0.jar
-rw-rw-r-- 1 xubo xubo 236K May 23 22:41 curator-recipes-2.4.0.jar
-rw-rw-r-- 1 xubo xubo 2.1M May 23 22:41 guava-14.0.1.jar
-rw-rw-r-- 1 xubo xubo 694K May 23 22:41 guice-3.0.jar
-rw-rw-r-- 1 xubo xubo 17K May 23 22:41 hadoop-annotations-2.2.0.jar
-rw-rw-r-- 1 xubo xubo 49K May 23 22:41 hadoop-auth-2.2.0.jar
-rw-rw-r-- 1 xubo xubo 2.5K May 23 22:41 hadoop-client-2.2.0.jar
-rw-rw-r-- 1 xubo xubo 2.7M May 23 22:41 hadoop-common-2.2.0.jar
-rw-rw-r-- 1 xubo xubo 5.0M May 23 22:41 hadoop-hdfs-2.2.0.jar
-rw-rw-r-- 1 xubo xubo 471K May 23 22:41 hadoop-mapreduce-client-app-2.2.0.jar
-rw-rw-r-- 1 xubo xubo 641K May 23 22:41 hadoop-mapreduce-client-common-2.2.0.jar
-rw-rw-r-- 1 xubo xubo 1.4M May 23 22:41 hadoop-mapreduce-client-core-2.2.0.jar
-rw-rw-r-- 1 xubo xubo 35K May 23 22:41 hadoop-mapreduce-client-jobclient-2.2.0.jar
-rw-rw-r-- 1 xubo xubo 22K May 23 22:41 hadoop-mapreduce-client-shuffle-2.2.0.jar
-rw-rw-r-- 1 xubo xubo 1.2M May 23 22:41 hadoop-yarn-api-2.2.0.jar
-rw-rw-r-- 1 xubo xubo 93K May 23 22:41 hadoop-yarn-client-2.2.0.jar
-rw-rw-r-- 1 xubo xubo 1.3M May 23 22:41 hadoop-yarn-common-2.2.0.jar
-rw-rw-r-- 1 xubo xubo 172K May 23 22:41 hadoop-yarn-server-common-2.2.0.jar
-rw-rw-r-- 1 xubo xubo 175K May 23 22:41 hk2-api-2.4.0-b34.jar
-rw-rw-r-- 1 xubo xubo 178K May 23 22:41 hk2-locator-2.4.0-b34.jar
-rw-rw-r-- 1 xubo xubo 117K May 23 22:41 hk2-utils-2.4.0-b34.jar
-rw-rw-r-- 1 xubo xubo 1.3M May 23 22:41 ivy-2.4.0.jar
-rw-rw-r-- 1 xubo xubo 39K May 23 22:41 jackson-annotations-2.5.3.jar
-rw-rw-r-- 1 xubo xubo 225K May 23 22:41 jackson-core-2.5.3.jar
-rw-rw-r-- 1 xubo xubo 227K May 23 22:41 jackson-core-asl-1.9.13.jar
-rw-rw-r-- 1 xubo xubo 1.1M May 23 22:41 jackson-databind-2.5.3.jar
-rw-rw-r-- 1 xubo xubo 763K May 23 22:41 jackson-mapper-asl-1.9.13.jar
-rw-rw-r-- 1 xubo xubo 488K May 23 22:41 jackson-module-scala_2.11-2.5.3.jar
-rw-rw-r-- 1 xubo xubo 599K May 23 22:41 janino-2.7.8.jar
-rw-rw-r-- 1 xubo xubo 698K May 23 22:41 javassist-3.18.1-GA.jar
-rw-rw-r-- 1 xubo xubo 26K May 23 22:41 javax.annotation-api-1.2.jar
-rw-rw-r-- 1 xubo xubo 2.5K May 23 22:41 javax.inject-1.jar
-rw-rw-r-- 1 xubo xubo 5.9K May 23 22:41 javax.inject-2.4.0-b34.jar
-rw-rw-r-- 1 xubo xubo 94K May 23 22:41 javax.servlet-api-3.1.0.jar
-rw-rw-r-- 1 xubo xubo 113K May 23 22:41 javax.ws.rs-api-2.0.1.jar
-rw-rw-r-- 1 xubo xubo 17K May 23 22:41 jcl-over-slf4j-1.7.16.jar
-rw-rw-r-- 1 xubo xubo 164K May 23 22:41 jersey-client-2.22.2.jar
-rw-rw-r-- 1 xubo xubo 683K May 23 22:41 jersey-common-2.22.2.jar
-rw-rw-r-- 1 xubo xubo 18K May 23 22:41 jersey-container-servlet-2.22.2.jar
-rw-rw-r-- 1 xubo xubo 65K May 23 22:41 jersey-container-servlet-core-2.22.2.jar
-rw-rw-r-- 1 xubo xubo 949K May 23 22:41 jersey-guava-2.22.2.jar
-rw-rw-r-- 1 xubo xubo 72K May 23 22:41 jersey-media-jaxb-2.22.2.jar
-rw-rw-r-- 1 xubo xubo 930K May 23 22:41 jersey-server-2.22.2.jar
-rw-rw-r-- 1 xubo xubo 369K May 23 22:41 jets3t-0.7.1.jar
-rw-rw-r-- 1 xubo xubo 173K May 23 22:41 jetty-util-6.1.26.jar
-rw-rw-r-- 1 xubo xubo 81K May 23 22:41 json4s-ast_2.11-3.2.11.jar
-rw-rw-r-- 1 xubo xubo 576K May 23 22:41 json4s-core_2.11-3.2.11.jar
-rw-rw-r-- 1 xubo xubo 40K May 23 22:41 json4s-jackson_2.11-3.2.11.jar
-rw-rw-r-- 1 xubo xubo 33K May 23 22:41 jsr305-1.3.9.jar
-rw-rw-r-- 1 xubo xubo 747K May 23 22:41 jtransforms-2.4.0.jar
-rw-rw-r-- 1 xubo xubo 4.5K May 23 22:41 jul-to-slf4j-1.7.16.jar
-rw-rw-r-- 1 xubo xubo 350K May 23 22:41 kryo-shaded-3.0.3.jar
-rw-rw-r-- 1 xubo xubo 1022K May 23 22:41 leveldbjni-all-1.8.jar
-rw-rw-r-- 1 xubo xubo 479K May 23 22:41 log4j-1.2.17.jar
-rw-rw-r-- 1 xubo xubo 232K May 23 22:41 lz4-1.3.0.jar
-rw-rw-r-- 1 xubo xubo 1.3M May 23 22:41 mesos-0.21.1-shaded-protobuf.jar
-rw-rw-r-- 1 xubo xubo 110K May 23 22:41 metrics-core-3.1.2.jar
-rw-rw-r-- 1 xubo xubo 21K May 23 22:41 metrics-graphite-3.1.2.jar
-rw-rw-r-- 1 xubo xubo 16K May 23 22:41 metrics-json-3.1.2.jar
-rw-rw-r-- 1 xubo xubo 39K May 23 22:41 metrics-jvm-3.1.2.jar
-rw-rw-r-- 1 xubo xubo 5.6K May 23 22:41 minlog-1.3.0.jar
-rw-rw-r-- 1 xubo xubo 1.2M May 23 22:41 netty-3.8.0.Final.jar
-rw-rw-r-- 1 xubo xubo 2.0M May 23 22:41 netty-all-4.0.29.Final.jar
-rw-rw-r-- 1 xubo xubo 41K May 23 22:41 objenesis-2.1.jar
-rw-rw-r-- 1 xubo xubo 20K May 23 22:41 opencsv-2.3.jar
-rw-rw-r-- 1 xubo xubo 64K May 23 22:41 oro-2.0.8.jar
-rw-rw-r-- 1 xubo xubo 20K May 23 22:41 osgi-resource-locator-1.0.1.jar
-rw-rw-r-- 1 xubo xubo 33K May 23 22:41 paranamer-2.6.jar
-rw-rw-r-- 1 xubo xubo 896K May 23 22:41 parquet-column-1.7.0.jar
-rw-rw-r-- 1 xubo xubo 22K May 23 22:41 parquet-common-1.7.0.jar
-rw-rw-r-- 1 xubo xubo 279K May 23 22:41 parquet-encoding-1.7.0.jar
-rw-rw-r-- 1 xubo xubo 379K May 23 22:41 parquet-format-2.3.0-incubating.jar
-rw-rw-r-- 1 xubo xubo 21K May 23 22:41 parquet-generator-1.7.0.jar
-rw-rw-r-- 1 xubo xubo 205K May 23 22:41 parquet-hadoop-1.7.0.jar
-rw-rw-r-- 1 xubo xubo 1.0M May 23 22:41 parquet-jackson-1.7.0.jar
-rw-rw-r-- 1 xubo xubo 7.7K May 23 22:41 pmml-agent-1.2.7.jar
-rw-rw-r-- 1 xubo xubo 586K May 23 22:41 pmml-model-1.2.7.jar
-rw-rw-r-- 1 xubo xubo 4.5K May 23 22:41 pmml-schema-1.2.7.jar
-rw-rw-r-- 1 xubo xubo 521K May 23 22:41 protobuf-java-2.5.0.jar
-rw-rw-r-- 1 xubo xubo 105K May 23 22:41 py4j-0.10.1.jar
-rw-rw-r-- 1 xubo xubo 92K May 23 22:41 pyrolite-4.9.jar
-rw-rw-r-- 1 xubo xubo 198K May 23 22:41 RoaringBitmap-0.5.11.jar
-rw-rw-r-- 1 xubo xubo 15M May 23 22:41 scala-compiler-2.11.8.jar
-rw-rw-r-- 1 xubo xubo 5.5M May 23 22:41 scala-library-2.11.8.jar
-rw-rw-r-- 1 xubo xubo 785K May 23 22:41 scalap-2.11.8.jar
-rw-rw-r-- 1 xubo xubo 414K May 23 22:41 scala-parser-combinators_2.11-1.0.4.jar
-rw-rw-r-- 1 xubo xubo 4.4M May 23 22:41 scala-reflect-2.11.8.jar
-rw-rw-r-- 1 xubo xubo 634K May 23 22:41 scala-xml_2.11-1.0.2.jar
-rw-rw-r-- 1 xubo xubo 40K May 23 22:41 slf4j-api-1.7.16.jar
-rw-rw-r-- 1 xubo xubo 9.8K May 23 22:41 slf4j-log4j12-1.7.16.jar
-rw-rw-r-- 1 xubo xubo 1.1M May 23 22:41 snappy-java-1.1.2.4.jar
-rw-rw-r-- 1 xubo xubo 6.2M May 23 22:41 spark-catalyst_2.11-2.0.0-preview.jar
-rw-rw-r-- 1 xubo xubo 12M May 23 22:41 spark-core_2.11-2.0.0-preview.jar
-rw-rw-r-- 1 xubo xubo 664K May 23 22:41 spark-graphx_2.11-2.0.0-preview.jar
-rw-rw-r-- 1 xubo xubo 64K May 23 22:41 spark-launcher_2.11-2.0.0-preview.jar
-rw-rw-r-- 1 xubo xubo 5.5M May 23 22:41 spark-mllib_2.11-2.0.0-preview.jar
-rw-rw-r-- 1 xubo xubo 172K May 23 22:41 spark-mllib-local_2.11-2.0.0-preview.jar
-rw-rw-r-- 1 xubo xubo 2.3M May 23 22:41 spark-network-common_2.11-2.0.0-preview.jar
-rw-rw-r-- 1 xubo xubo 58K May 23 22:41 spark-network-shuffle_2.11-2.0.0-preview.jar
-rw-rw-r-- 1 xubo xubo 62K May 23 22:41 spark-repl_2.11-2.0.0-preview.jar
-rw-rw-r-- 1 xubo xubo 29K May 23 22:41 spark-sketch_2.11-2.0.0-preview.jar
-rw-rw-r-- 1 xubo xubo 5.6M May 23 22:41 spark-sql_2.11-2.0.0-preview.jar
-rw-rw-r-- 1 xubo xubo 2.0M May 23 22:41 spark-streaming_2.11-2.0.0-preview.jar
-rw-rw-r-- 1 xubo xubo 15K May 23 22:41 spark-tags_2.11-2.0.0-preview.jar
-rw-rw-r-- 1 xubo xubo 41K May 23 22:41 spark-unsafe_2.11-2.0.0-preview.jar
-rw-rw-r-- 1 xubo xubo 7.0M May 23 22:41 spire_2.11-0.7.4.jar
-rw-rw-r-- 1 xubo xubo 85K May 23 22:41 spire-macros_2.11-0.7.4.jar
-rw-rw-r-- 1 xubo xubo 171K May 23 22:41 stream-2.7.0.jar
-rw-rw-r-- 1 xubo xubo 285K May 23 22:41 univocity-parsers-2.1.0.jar
-rw-rw-r-- 1 xubo xubo 63K May 23 22:41 validation-api-1.1.0.Final.jar
-rw-rw-r-- 1 xubo xubo 142K May 23 22:41 xbean-asm5-shaded-4.4.jar
-rw-rw-r-- 1 xubo xubo 15K May 23 22:41 xmlenc-0.52.jar
-rw-rw-r-- 1 xubo xubo 93K May 23 22:41 xz-1.0.jar
-rw-rw-r-- 1 xubo xubo 762K May 23 22:41 zookeeper-3.4.5.jar