2. 程式人生 > >建立Spark 2.1.0 Docker映象

建立Spark 2.1.0 Docker映象

阿新 • • 發佈：2018-12-26

前言

大資料與容器是近年來的兩個熱點技術，大資料平臺的容器化部署自然格外被關注。關於Apache Spark的容器化方案，目前使用最多的是sequenceiq/spark，在Docker Hub上有330K的下載量。

sequenceiq/spark映象中包含了Hadoop/Yarn，雖然採用的是一種“偽叢集”的部署方式，但是用來做開發和測試還是非常便利的。遺憾的是sequenceiq的更新速度不是很給力，目前最新的版本是sequenceiq/spark:1.6.0，想要體驗Spark 2.1.0就得自己動動手了。

執行環境

作業系統 核心版本 Docker版本
Ubuntu 15.10 4.2.0-42 1.12.5

環境準備

1) 下載sequenceiq/spark映象構建原始碼

$ git clone https://github.com/sequenceiq/docker-spark
正克隆到 'docker-spark'...
remote: Counting objects: 211, done.
remote: Total 211 (delta 0), reused 0 (delta 0), pack-reused 211
接收物件中: 100% (211/211), 55.20 KiB | 71.00 KiB/s, 完成.
處理 delta 中: 100
 
% (108/108), 完成.
檢查連線... 完成。

2) 從Spark官網下載Spark 2.1.0安裝包

這裡寫圖片描述

因為我們用sequenceiq的Dockerfile來構建Spark 2.1.0映象，需要使用基礎映象sequenceiq/hadoop:2.6.0，所以在下載選項中“2. Choose a package type”要選擇“Pre-built for Hadoop 2.6”。

注意：下載的檔案需要放到docker-spark目錄下。

3) 快取sequenceiq/hadoop-docker:2.6.0映象

  • 執行以下命令，拉取hadoop-docker 2.6.0版本映象：
$ docker pull sequenceiq/hadoop-docker:2.6.0
2.6.0: Pulling from sequenceiq/hadoop-docker
b253335dcf03: Already exists 
a3ed95caeb02: Pull complete 
3452351686f4: Pull complete 
dfb6df69b64d: Pull complete 
...
bae586fb2d97: Pull complete 
Digest: sha256:2b95f51b7f0ddf0d7bb2c2cfa793bae3298fcda5523783155a2db9430cba494a
Status: Downloaded newer image for sequenceiq/hadoop-docker:2.6.0
  • 檢視本地快取Docker映象，確認sequenceiq/hadoop-docker:2.6.0拉取成功：
$ docker images
REPOSITORY                 TAG                 IMAGE ID            CREATED             SIZE
hello-world                latest              c54a2cc56cbb        6 months ago        1.848 kB
sequenceiq/hadoop-docker   2.6.0               140b265bd62a        24 months ago       1.624 GB

映象構建

1) 進入docker-spark目錄，確認所有用於映象構建的檔案已經準備好。

$ cd docker-spark/
$ ls
總用量 188856
drwxrwxr-x 4 farawayzheng farawayzheng      4096  1月 10 23:10 ./
drwxrwxr-x 9 farawayzheng farawayzheng      4096  1月 10 23:06 ../
-rwxrwxr-x 1 farawayzheng farawayzheng       901  1月 10 23:06 bootstrap.sh*
-rw-rw-r-- 1 farawayzheng farawayzheng       970  1月 10 23:16 Dockerfile
drwxrwxr-x 8 farawayzheng farawayzheng      4096  1月 10 23:06 .git/
-rw-rw-r-- 1 farawayzheng farawayzheng        18  1月 10 23:06 .gitignore
-rw-rw-r-- 1 farawayzheng farawayzheng     71624  1月 10 23:06 LICENSE
-rw-rw-r-- 1 farawayzheng farawayzheng      3454  1月 10 23:06 README.md
-rwxrwx--- 1 farawayzheng farawayzheng 193281941  1月 10 23:04 spark-2.1.0-bin-hadoop2.6.tgz*
drwxrwxr-x 2 farawayzheng farawayzheng      4096  1月 10 23:06 yarn-remote-client/

2) 修改Dockerfile和bootstrap.sh啟動指令碼

  • 修改Dockerfile為以下內容
FROM sequenceiq/hadoop-docker:2.6.0
#MAINTAINER SequenceIQ
MAINTAINER farawayzheng

#support for Hadoop 2.6.0
#RUN curl -s http://d3kbcqa49mib13.cloudfront.net/spark-1.6.1-bin-hadoop2.6.tgz | tar -xz -C /usr/local/
ADD spark-2.1.0-bin-hadoop2.6.tgz /usr/local/
RUN cd /usr/local && ln -s spark-2.1.0-bin-hadoop2.6 spark
ENV SPARK_HOME /usr/local/spark
RUN mkdir $SPARK_HOME/yarn-remote-client
ADD yarn-remote-client $SPARK_HOME/yarn-remote-client

RUN $BOOTSTRAP && $HADOOP_PREFIX/bin/hadoop dfsadmin -safemode leave && $HADOOP_PREFIX/bin/hdfs dfs -put $SPARK_HOME-2.1.0-bin-hadoop2.6/jars /spark && $HADOOP_PREFIX/bin/hdfs dfs -put $SPARK_HOME-2.1.0-bin-hadoop2.6/examples/jars /spark 

ENV YARN_CONF_DIR $HADOOP_PREFIX/etc/hadoop
ENV PATH $PATH:$SPARK_HOME/bin:$HADOOP_PREFIX/bin
# update boot script
COPY bootstrap.sh /etc/bootstrap.sh
RUN chown root.root /etc/bootstrap.sh
RUN chmod 700 /etc/bootstrap.sh

#install R
RUN rpm -ivh http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm
RUN yum -y install R

ENTRYPOINT ["/etc/bootstrap.sh"]
  • 修改bootstrap.sh為以下內容
#!/bin/bash

: ${HADOOP_PREFIX:=/usr/local/hadoop}

$HADOOP_PREFIX/etc/hadoop/hadoop-env.sh

rm /tmp/*.pid

# installing libraries if any - (resource urls added comma separated to the ACP system variable)
cd $HADOOP_PREFIX/share/hadoop/common ; for cp in ${ACP//,/ }; do  echo == $cp; curl -LO $cp ; done; cd -

# altering the core-site configuration
sed s/HOSTNAME/$HOSTNAME/ /usr/local/hadoop/etc/hadoop/core-site.xml.template > /usr/local/hadoop/etc/hadoop/core-site.xml

# setting spark defaults
echo spark.yarn.jars hdfs:///spark/* > $SPARK_HOME/conf/spark-defaults.conf
cp $SPARK_HOME/conf/metrics.properties.template $SPARK_HOME/conf/metrics.properties

service sshd start
$HADOOP_PREFIX/sbin/start-dfs.sh
$HADOOP_PREFIX/sbin/start-yarn.sh



CMD=${1:-"exit 0"}
if [[ "$CMD" == "-d" ]];
then
    service sshd stop
    /usr/sbin/sshd -D -d
else
    /bin/bash -c "$*"
fi

3) 構建Spark 2.1.0映象

$ docker build --rm -t farawayzheng/spark:2.1.0 .
Sending build context to Docker daemon 193.5 MB
Step 1 : FROM sequenceiq/hadoop-docker:2.6.0
 ---> 140b265bd62a
Step 2 : MAINTAINER farawayzheng
 ---> Running in 12a47858c223
 ---> 04b98762d0b7
Removing intermediate container 12a47858c223
Step 3 : ADD spark-2.1.0-bin-hadoop2.6.tgz /usr/local/
 ---> 07eab98fe3f9
Removing intermediate container 3533899c0e8e
Step 4 : RUN cd /usr/local && ln -s spark-2.1.0-bin-hadoop2.6 spark
 ---> Running in 8dbcac623198
 ---> f7d68c7d52f4
Removing intermediate container 8dbcac623198
Step 5 : ENV SPARK_HOME /usr/local/spark
 ---> Running in 55a56f466fcb
 ---> 7f891e362f29
Removing intermediate container 55a56f466fcb
Step 6 : RUN mkdir $SPARK_HOME/yarn-remote-client
 ---> Running in e989ef3d7d67
 ---> 85485e987afd
Removing intermediate container e989ef3d7d67
Step 7 : ADD yarn-remote-client $SPARK_HOME/yarn-remote-client
 ---> f14d86c9f5c0
Removing intermediate container bae32c1ae32a
Step 8 : RUN $BOOTSTRAP && $HADOOP_PREFIX/bin/hadoop dfsadmin -safemode leave && $HADOOP_PREFIX/bin/hdfs dfs -put $SPARK_HOME-2.1.0-bin-hadoop2.6/jars /spark && $HADOOP_PREFIX/bin/hdfs dfs -put $SPARK_HOME-2.1.0-bin-hadoop2.6/examples/jars /spark
 ---> Running in ed073536dd11
/
Starting sshd: [  OK  ]
Starting namenodes on [70b4a57bb473]
70b4a57bb473: starting namenode, logging to /usr/local/hadoop/logs/hadoop-root-namenode-70b4a57bb473.out
localhost: starting datanode, logging to /usr/local/hadoop/logs/hadoop-root-datanode-70b4a57bb473.out
Starting secondary namenodes [0.0.0.0]
0.0.0.0: starting secondarynamenode, logging to /usr/local/hadoop/logs/hadoop-root-secondarynamenode-70b4a57bb473.out
starting yarn daemons
starting resourcemanager, logging to /usr/local/hadoop/logs/yarn--resourcemanager-70b4a57bb473.out
localhost: starting nodemanager, logging to /usr/local/hadoop/logs/yarn-root-nodemanager-70b4a57bb473.out
DEPRECATED: Use of this script to execute hdfs command is deprecated.
Instead use the hdfs command for it.

Safe mode is OFF
 ---> e4bdf8a1628d
Removing intermediate container ed073536dd11
Step 9 : ENV YARN_CONF_DIR $HADOOP_PREFIX/etc/hadoop
 ---> Running in ea435f5b6141
 ---> 07083ac117c2
Removing intermediate container ea435f5b6141
Step 10 : ENV PATH $PATH:$SPARK_HOME/bin:$HADOOP_PREFIX/bin
 ---> Running in 0dabc7dd5211
 ---> c55b79a1e670
Removing intermediate container 0dabc7dd5211
Step 11 : COPY bootstrap.sh /etc/bootstrap.sh
 ---> e942148ae10f
Removing intermediate container 996819338fda
Step 12 : RUN chown root.root /etc/bootstrap.sh
 ---> Running in 7a8c32d8ddaa
 ---> 12cbdc408ed4
Removing intermediate container 7a8c32d8ddaa
Step 13 : RUN chmod 700 /etc/bootstrap.sh
 ---> Running in f833cda3afb5
 ---> d8d17a1babbf
Removing intermediate container f833cda3afb5
Step 14 : RUN rpm -ivh http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm
 ---> Running in 5c35660f3e9b
warning: /var/tmp/rpm-tmp.ByIPjn: Header V3 RSA/SHA256 Signature, key ID 0608b895: NOKEY
Retrieving http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm
Preparing...                ##################################################
epel-release                ##################################################
 ---> 666a2cbda116
Removing intermediate container 5c35660f3e9b
Step 15 : RUN yum -y install R
 ---> Running in 7192828863d7
Loaded plugins: fastestmirror, keys, protect-packages, protectbase
Determining fastest mirrors
 * base: mirrors.btte.net
 * epel: mirrors.tuna.tsinghua.edu.cn
 * extras: mirrors.btte.net
 * updates: mirrors.yun-idc.com
0 packages excluded due to repository protections
Setting up Install Process
Resolving Dependencies
--> Running transaction check
---> Package R.x86_64 0:3.3.2-3.el6 will be installed
......
......
......
---> Package xz-lzma-compat.x86_64 0:4.999.9-0.3.beta.20091007git.el6 will be updated
---> Package xz-lzma-compat.x86_64 0:4.999.9-0.5.beta.20091007git.el6 will be an update
--> Finished Dependency Resolution

Dependencies Resolved

================================================================================
 Package               Arch    Version                           Repository
                                                                           Size
================================================================================
Installing:
 R                     x86_64  3.3.2-3.el6                       epel      26 k
Installing for dependencies:
 R-core                x86_64  3.3.2-3.el6                       epel      53 M
......
Updating for dependencies:
 cpp                   x86_64  4.4.7-17.el6                      base     3.7 M
......

Transaction Summary
================================================================================
Install      69 Package(s)
Upgrade      19 Package(s)

Total download size: 145 M
Downloading Packages:
--------------------------------------------------------------------------------
Total                                           494 kB/s | 145 MB     05:01     
warning: rpmts_HdrFromFdno: Header V3 RSA/SHA256 Signature, key ID 0608b895: NOKEY
Retrieving key from file:///etc/pki/rpm-gpg/RPM-GPG-KEY-EPEL-6
Importing GPG key 0x0608B895:
 Userid : EPEL (6) <[email protected]>
 Package: epel-release-6-8.noarch (installed)
 From   : /etc/pki/rpm-gpg/RPM-GPG-KEY-EPEL-6
Running rpm_check_debug
Running Transaction Test
Transaction Test Succeeded
Running Transaction
Warning: RPMDB altered outside of yum.
  Updating   : libgcc-4.4.7-17.el6.x86_64                                 1/107 
  ......  
  Cleanup    : glib2-2.26.1-3.el6.x86_64                                107/107 
  Verifying  : acl-2.2.49-6.el6.x86_64                                    1/107 
  ......  
Installed:
  R.x86_64 0:3.3.2-3.el6                                                        

Dependency Installed:
  R-core.x86_64 0:3.3.2-3.el6                                                   
  ......                                                 
  zlib-devel.x86_64 0:1.2.3-29.el6                                              

Dependency Updated:
  cpp.x86_64 0:4.4.7-17.el6                                                     
  ......                          
  xz-lzma-compat.x86_64 0:4.999.9-0.5.beta.20091007git.el6                      

Complete!
 ---> ed7e19858dc9
Removing intermediate container 7192828863d7
Step 16 : ENTRYPOINT /etc/bootstrap.sh
 ---> Running in 31d75ee50b7d
 ---> 4eb30ebd34a2
Removing intermediate container 31d75ee50b7d
Successfully built 4eb30ebd34a2

4) 檢視新建Spark 2.1.0映象

$ docker images
REPOSITORY                 TAG                 IMAGE ID            CREATED             SIZE
farawayzheng/spark         2.1.0               4eb30ebd34a2        4 hours ago         2.649 GB
hello-world                latest              c54a2cc56cbb        6 months ago        1.848 kB
sequenceiq/hadoop-docker   2.6.0               140b265bd62a        24 months ago       1.624 GB

測試映象

1) 啟動一個Spark 2.1.0容器

$ docker run -it -p 8088:8088 -p 8042:8042 -p 4040:4040 -h sandbox farawayzheng/spark:2.1.0 bash
/
Starting sshd:                                             [  OK  ]
Starting namenodes on [sandbox]
sandbox: starting namenode, logging to /usr/local/hadoop/logs/hadoop-root-namenode-sandbox.out
localhost: starting datanode, logging to /usr/local/hadoop/logs/hadoop-root-datanode-sandbox.out
Starting secondary namenodes [0.0.0.0]
0.0.0.0: starting secondarynamenode, logging to /usr/local/hadoop/logs/hadoop-root-secondarynamenode-sandbox.out
starting yarn daemons
starting resourcemanager, logging to /usr/local/hadoop/logs/yarn--resourcemanager-sandbox.out
localhost: starting nodemanager, logging to /usr/local/hadoop/logs/yarn-root-nodemanager-sandbox.out
bash-4.1#

出現“bash-4.1#”提示符說明Spark 2.1.0容器啟動成功了！

2) 使用YARN-client模式驗證Spark叢集是否工作正常

bash-4.1# spark-shell --master yarn --deploy-mode client --driver-memory 1g --executor-memory 1g --executor-cores 1
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
17/01/11 05:00:45 WARN spark.SparkContext: Support for Java 7 is deprecated as of Spark 2.0.0
17/01/11 05:00:45 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
17/01/11 05:01:10 WARN DataNucleus.General: Plugin (Bundle) "org.datanucleus.api.jdo" is already registered. Ensure you dont have multiple JAR versions of the same plugin in the classpath. The URL "file:/usr/local/spark-2.1.0-bin-hadoop2.6/jars/datanucleus-api-jdo-3.2.6.jar" is already registered, and you are trying to register an identical plugin located at URL "file:/usr/local/spark/jars/datanucleus-api-jdo-3.2.6.jar."
17/01/11 05:01:10 WARN DataNucleus.General: Plugin (Bundle) "org.datanucleus.store.rdbms" is already registered. Ensure you dont have multiple JAR versions of the same plugin in the classpath. The URL "file:/usr/local/spark-2.1.0-bin-hadoop2.6/jars/datanucleus-rdbms-3.2.9.jar" is already registered, and you are trying to register an identical plugin located at URL "file:/usr/local/spark/jars/datanucleus-rdbms-3.2.9.jar."
17/01/11 05:01:10 WARN DataNucleus.General: Plugin (Bundle) "org.datanucleus" is already registered. Ensure you dont have multiple JAR versions of the same plugin in the classpath. The URL "file:/usr/local/spark/jars/datanucleus-core-3.2.10.jar" is already registered, and you are trying to register an identical plugin located at URL "file:/usr/local/spark-2.1.0-bin-hadoop2.6/jars/datanucleus-core-3.2.10.jar."
17/01/11 05:01:18 WARN metastore.ObjectStore: Version information not found in metastore. hive.metastore.schema.verification is not enabled so recording the schema version 1.2.0
17/01/11 05:01:18 WARN metastore.ObjectStore: Failed to get database default, returning NoSuchObjectException
17/01/11 05:01:19 WARN metastore.ObjectStore: Failed to get database global_temp, returning NoSuchObjectException
Spark context Web UI available at http://172.17.0.3:4040
Spark context available as 'sc' (master = yarn, app id = application_1484126893491_0005).
Spark session available as 'spark'.
Welcome to
      ____              __
     / __/__  ___ _____/ /__
    _\ \/ _ \/ _ `/ __/  '_/
   /___/ .__/\_,_/_/ /_/\_\   version 2.1.0
      /_/

Using Scala version 2.11.8 (Java HotSpot(TM) 64-Bit Server VM, Java 1.7.0_51)
Type in expressions to have them evaluated.
Type :help for more information.
scala>

出現“scala>”提示符說明spark shell正常運行了，但是輸出幾條WARN級別的LOG，雖然不影響我們做些簡單測試，後續還是需要對配置進行調整和校正。

關於“WARN metastore.ObjectStore: Failed to get database default, returning NoSuchObjectException”的解釋：
https://issues.apache.org/jira/browse/SPARK-14067

“This is expected behavior. We need the default database for a number of operations. We try to look it up in the metastore, if it does not exist the metastore gives a warning and we will create a default database.”

輸入scala命令測試Spark能否工作：

scala> sc.parallelize(1 to 1000).count()
res0: Long = 1000                                                               

scala>

驗證通過，大功告成！

相關推薦

建立Spark 2.1.0 Docker映象

前言 大資料與容器是近年來的兩個熱點技術，大資料平臺的容器化部署自然格外被關注。關於Apache Spark的容器化方案，目前使用最多的是sequenceiq/spark，在Docker Hub上有330K的下載量。 sequenceiq/spark映象中包

spark(2.1.0) 操作hbase(1.0.2)

hadoop mon per bsp trac 事先 com maker scala 1、spark中引入外部jar包 　　1）創建/usr/software/spark_jars目錄，放入spark操作hbase的jar包：hbase-annotations-1.0.2.

Spark 2.1.0整合CarbonData 1.1.0

1.新建專案 <?xml version="1.0" encoding="UTF-8"?> <project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http:

3臺機器配置spark-2.1.0叢集

一. 環境介紹 三臺主機，主機名和ip分別為： ubuntu1  10.3.19.171 ubuntu2  10.3.19.172 ubuntu3  10.3.19.173 三臺主機的登入使用者名稱是bigdata，home目錄是/home/bigdata 現在三臺主機上部

Spark RDD的預設分割槽數：（spark 2.1.0）

本文基於Spark 2.1.0版本 新手首先要明白幾個配置： spark.default.parallelism：（預設的併發數）     如果配置檔案spark-default.conf中沒有顯示的配置，則按照如下規則取值：  

基於CentOS6.4環境編譯Spark-2.1.0原始碼

基於CentOS6.4環境編譯Spark-2.1.0原始碼   1 寫在前面的話 有些小夥伴可能會問：Spark官網不是已經提供了Spark針對不同版本的安裝包了嗎，我們為什麼還需要對Spark原始碼進行編譯呢？針對這個問題我們到Spark官網: spark.a

Spark-2.1.0-hadooop-2.6.0-cdh5.7.0原始碼編譯

       目前 Spark 編譯指令碼已經將Maven 整合進來了，以方便編譯以及部署。這個指令碼將會在它本地 build/ 編譯目錄自動下載和安裝所有編譯過程中所必需的( Maven，Scala 和 Zinc )。可以手動修改dev/make-distribution

spark 2.1.1訪問hive2.3.0

新增jdbc依賴 <dependency> <groupId>mysql</groupId> <artifactId>mysql-connector-java</artif

Docker學習（2）：Docker映象介紹和容器的兩種建立方式

1.什麼是Docker映象     Docker映象是啟動容器構建的基石，是由檔案系統疊加而成，最底端是一個引導檔案系統，即bootfs，這很像典型的Linux的引導檔案系統，但是Docker使用者幾

Spark 2.4.0 整合Hive 1.2.1

Spark 2.4.0 整合Hive 1.2.1 更多資源 github: https://github.com/opensourceteams/spark-scala-maven-2.4.0 apache-hive-1.2.1-bin 安裝: https://gith

Hadoop-3.0.0 + spark-2.3.0 +storm-1.2.1 的安裝心得

因為前段時間比賽用到spark，而實驗室叢集的spark版本還是1.6，帶來了不少麻煩，於是便想著把叢集的Hadoop和spark更新一下版本，另外，因為專案需要，再補裝個storm，一邊日後要用。說句題外話。spark，storm，Hadoop三者取首字母是SSH，這讓我想

速Geometric.Stackup.2.1.0.15228公差分析

速Geometric.Stackup.2.1.0.15228公差分析 使用 Geometric.Stackup.2.1.0.15228 的好處有：集成的CAD平臺；多格式CAD文件支持；自動尺寸標註捕捉；交互式尺寸環；連續選擇功能。 Geometric.Stackup.2.1.0.15228可

tengine2.1.0RPM包制做 tengine-2.1.0.spec配置

c-c malloc con file tar.gz 3.6 release 1.2 attr [[email protected]/* */ SPECS]# cat tengine-2.1.0.spec Name: tengine Version: 2.1.

AppCrawler自動化遍歷使用詳解(版本2.1.0 )

穩定 second 而是 assert 重新 app awl 好用 國內 AppCrawle是自動遍歷的app爬蟲工具，最大的特點是靈活性，實現：對整個APP的所有可點擊元素進行遍歷點擊。 優點： 1.支持android和iOS, 支持真機和模擬器 2.可通過配置來設定

建立最小的Go docker 映象

雖然曾有一些文章介紹瞭如何建立一個最小的Go Docker映象，我也曾寫過一篇文章，但是隨著Go的新的版本的釋出， 以及docker本身的進化，有些技巧已經發生了變化， 本文介紹了最新的建立超小的Go映象的方法。 一個簡單Go程式的映象 首先讓我們建立一個很簡單的Go程式: 1package

理解Docker（2）：Docker 映象

來源：http://www.cnblogs.com/sammyliu/p/5877964.html 對於每個軟體，除了它自身的程式碼以外，它的執行還需要有一個執行環境和依賴。不管這個軟體是象往常一樣執行在物理機或者虛機之中，還是執行在現在的容器之中，這些都是不變的。在傳統環境中，軟體在執行之前也

【重磅】Spring Boot 2.1.0 權威釋出

如果這兩天登入 start.spring.io/ 就會發現，Spring Boot 預設版本已經升到了 2.1.0。這是因為 Spring Boot 剛剛釋出了 2.1.0 版本，我們來看下 Spring Boot 2 釋出以來第一個子版本都發布了哪些內容？ 2.1 中的新特性 將spring-bo

【重磅】Spring Boot 2.1.0 權威發布

-o 發布 cond apache 免費 servle executor 朋友 情況下 如果這兩天登錄 https://start.spring.io/ 就會發現，Spring Boot 默認版本已經升到了 2.1.0。這是因為 Spring Boot 剛剛發布了 2.1.

tengine-2.1.0的安裝編譯過程

目錄 1 先上傳壓縮包 2 解壓縮 tar -xf不看過程，tar -zxvf有詳細過程 3 檢視安裝步驟 3.1 cd tengine-2.1.0進入解壓後的資料夾 3.2  ls 發現README.txt檔案 3.3 vi README 4 按照上

[Spark版本更新]--Spark-2.4.0 釋出說明

2018-11-02 Apache Spark 官方釋出了 2.4.0版本，以下是 Release Notes，供參考：  Sub-task [ SPARK-6236 ] - 支援大於2G的快取塊 [ SPARK-6237 ] -