|NO.Z.00090|——————————|^^ 升級 ^^|——|KuberNetes&二進位制升級.V01|-----------------------|kubernetes_master|etcd.v3.4.13——>v3.4.7|
阿新 • • 發佈：2022-03-29
[CloudNative：KuberNetes&二進位制升級.V01] [Applications.KuberNetes] [|DevOps|kubernetes|二進位制升級|] [kubernetes.v1.17.0——>v1.19.5|Kubernetes_master|etcd.v3.4.13——>v3.4.7|]
一、二進位制kubernetes升級說明
### --- kubernetes升級說明 ~~~ # kubeadm方式： ~~~ kubernetes官方不建議跨大版本升級，建議升級小版本升級:1.17.0——>1.17.1
~~~ # 二進位制的方式： ~~~ 可以直接進行跨大版本升級，直接替換配置檔案即可:1.17——>.1.19 ~~~ kubernetes是節點，在1.16之前是可以使用bata，而1.16之後直接啟用了， ~~~ 升級的過程中要注意apiversion更改，防止升級完成之後不能增刪改查。 ~~~ 升級的過程中，停掉完所有的節點再啟動controller-manager ~~~ # 升級是從下往上升級： ~~~ etcd——>k8s-master元件：apiserver、controller-manager、scheduler——>kubelet：升級時涉及到容器的遷移——>END
### --- 檢視kubernetes版本並確認升級的版本號 ~~~ 檢視kubernetes版本號 ~~~ 將kubernetes版本升級為v1.17.0——>1.19.5版本 [root@k8s-master01 ~]# kubectl version Client Version: version.Info{Major:"1", Minor:"20", GitVersion:"v1.17.0", GitCommit:"8a62859e515889f07e3e3be6a1080413f17cf2c3", GitTreeState:"clean", BuildDate:"2021-04-15T03:28:42Z", GoVersion:"go1.15.10", Compiler:"gc", Platform:"linux/amd64"} Server Version: version.Info{Major:"1", Minor:"20", GitVersion:"v1.17.0", GitCommit:"8a62859e515889f07e3e3be6a1080413f17cf2c3", GitTreeState:"clean", BuildDate:"2021-04-15T03:19:55Z", GoVersion:"go1.15.10", Compiler:"gc", Platform:"linux/amd64"}
### --- 檢視kubernetes升級版本所對應的元件版本
~~~ https://github.com/kubernetes/kubernetes/blob/master/CHANGELOG/CHANGELOG-1.19.md二、kubernetes-etcd升級說明
### --- 升級etcd流etcd升級流程
~~~ ——>備份etcd資料
~~~ ——>下載新版etcd包
~~~ ——>停止etcd
~~~ ——>替換etcd和etcdctl
~~~ ——>啟動etcd### --- 檢視kubernetes1.19下etcd對應的版本號
~~~ # kubernetes升級到1.19版本對應可升級的etcd版本為3.4.7
~~~ 注：kubernetes.V1.19.5版本對應的etcd版本號為3.4.7
Update corefile-migration library to 1.0.8 (#91856, @wawa0210) [SIG Node]
Update default etcd server version to 3.4.4 (#89214, @jingyih) [SIG API Machinery, Cluster Lifecycle and Testing]
Update default etcd server version to 3.4.7 (#89895, @jingyih) [SIG API Machinery, Cluster Lifecycle and Testing]
Update default etcd server version to 3.4.9 (#92349, @jingyih) [SIG API Machinery, Cloud Provider, Cluster Lifecycle and Testing]
Update go.etcd.io/bbolt to v1.3.5 (#92350, @justaugustus) [SIG API Machinery and Cloud Provider]
Update opencontainers/runtime-spec dependency to v1.0.2 (#89644, @saschagrunert) [SIG Node]
beta.kubernetes.io/os and beta.kubernetes.io/arch node labels are deprecated. Update node selectors to use kubernetes.io/os and kubernetes.io/arch. (#91046, @wawa0210) [SIG Apps and Node]
kubectl config view now redacts bearer tokens by default, similar to client certificates. The --raw flag can still be used to output full content. (#88985, @puerco) ### --- 下載etcd.v3.4.7版本包
~~~ # 下載etcd版本包
[root@k8s-master01 etcd]# wget https://github.com/etcd-io/etcd/releases/download/v3.4.7/etcd-v3.4.7-linux-amd64.tar.gz~~~ # 檢視下載的版本包
[root@k8s-master01 etcd]# ll
-rw-r--r-- 1 root root 17310840 Apr 2 2020 etcd-v3.4.7-linux-amd64.tar.gz~~~ # 解壓版本包
[root@k8s-master01 etcd]# tar -zxvf etcd-v3.4.7-linux-amd64.tar.gz### --- 檢視etcd叢集狀態
~~~ # 使用etcdctl命令V2版本檢視etcd叢集資訊
[root@k8s-master01 etcd]# export ETCDCTL_API=2
[root@k8s-master01 etcd]# etcdctl --ca-file /etc/kubernetes/pki/etcd/etcd-ca.pem --key-file /etc/kubernetes/pki/etcd/etcd-key.pem --cert-file /etc/kubernetes/pki/etcd/etcd.pem --endpoints https://192.168.1.11:2379,https://192.168.1.12:2379,https://192.168.1.13:2379 member list
ac7e57d44f030e8: name=k8s-master02 peerURLs=https://192.168.1.12:2380 clientURLs=https://192.168.1.12:2379 isLeader=false
40ba37809e1a423f: name=k8s-master03 peerURLs=https://192.168.1.13:2380 clientURLs=https://192.168.1.13:2379 isLeader=true
ace8d5b0766b3d92: name=k8s-master01 peerURLs=https://192.168.1.11:2380 clientURLs=https://192.168.1.11:2379 isLeader=false~~~ # 使用etcdctl命令V3版本檢視etcd叢集資訊
~~~ 注：可以確定k8s-master03為主節點
~~~ 注：可以先升級k8s-master02和k8s-master03節點的etcd版本
[root@k8s-master01 etcd]# etcdctl --cacert=/etc/kubernetes/pki/etcd/etcd-ca.pem --key=/etc/kubernetes/pki/etcd/etcd-key.pem --cert=/etc/kubernetes/pki/etcd/etcd.pem --endpoints https://192.168.1.11:2379,https://192.168.1.12:2379,https://192.168.1.13:2379 member list
ac7e57d44f030e8, started, k8s-master02, https://192.168.1.12:2380, https://192.168.1.12:2379
40ba37809e1a423f, started, k8s-master03, https://192.168.1.13:2380, https://192.168.1.13:2379
ace8d5b0766b3d92, started, k8s-master01, https://192.168.1.11:2380, https://192.168.1.11:2379### --- 備份etcd叢集儲存資料
~~~ # 備份所有節點etcd叢集儲存資料
[root@k8s-master01 etcd]# etcdctl --cacert=/etc/kubernetes/pki/etcd/etcd-ca.pem --key=/etc/kubernetes/pki/etcd/etcd-key.pem --cert=/etc/kubernetes/pki/etcd/etcd.pem --endpoints https://192.168.1.11:2379,https://192.168.1.12:2379,https://192.168.1.13:2379 snapshot -h
COMMANDS:
restore Restores an etcd member snapshot to an etcd directory // 回滾
save Stores an etcd node backend snapshot to a given file // 儲存
status Gets backend snapshot status of a given file // 狀態
[root@k8s-master01 etcd]# etcdctl --cacert=/etc/kubernetes/pki/etcd/etcd-ca.pem --key=/etc/kubernetes/pki/etcd/etcd-key.pem --cert=/etc/kubernetes/pki/etcd/etcd.pem --endpoints https://192.168.1.11:2379 snapshot save 20210701-0701-11.db
Snapshot saved at 20210701-0701-11.db
[root@k8s-master01 etcd]# etcdctl --cacert=/etc/kubernetes/pki/etcd/etcd-ca.pem --key=/etc/kubernetes/pki/etcd/etcd-key.pem --cert=/etc/kubernetes/pki/etcd/etcd.pem --endpoints https://192.168.1.12:2379 snapshot save 20210701-0701-12.db
Snapshot saved at 20210701-0701-12.db
[root@k8s-master01 etcd]# etcdctl --cacert=/etc/kubernetes/pki/etcd/etcd-ca.pem --key=/etc/kubernetes/pki/etcd/etcd-key.pem --cert=/etc/kubernetes/pki/etcd/etcd.pem --endpoints https://192.168.1.13:2379 snapshot save 20210701-0701-13.db
Snapshot saved at 20210701-0701-13.db### --- 備份版本包
~~~ # 檢視etcd部署在什麼位置
[root@k8s-master01 ~]# which etcd
/usr/local/bin/etcd~~~ # 備份版本包
[root@k8s-master01 ~]# mkdir /usr/local/bin/bak/
[root@k8s-master01 ~]# cp /usr/local/bin/* /usr/local/bin/bak/### --- 停止當前節點etcd服務
~~~ # 停止當前節點etcd服務
[root@k8s-master01 ~]# systemctl stop etcd~~~ # 檢視etcd叢集狀態
~~~ 注：11狀態不健康，已經被停止執行狀態
[root@k8s-master01 ~]# etcdctl --endpoints="192.168.1.13:2379,192.168.1.12:2379,192.168.1.11:2379" --cacert=/etc/kubernetes/pki/etcd/etcd-ca.pem --cert=/etc/kubernetes/pki/etcd/etcd.pem --key=/etc/kubernetes/pki/etcd/etcd-key.pem endpoint status --write-out=table
+-------------------+------------------+---------+---------+-----------+------------+-----------+------------+--------------------+--------+
| ENDPOINT | ID | VERSION | DB SIZE | IS LEADER | IS LEARNER | RAFT TERM | RAFT INDEX | RAFT APPLIED INDEX | ERRORS |
+-------------------+------------------+---------+---------+-----------+------------+-----------+------------+--------------------+--------+
| 192.168.1.13:2379 | 40ba37809e1a423f | 3.4.13 | 9.5 MB | true | false | 248 | 223109 | 223109 | |
| 192.168.1.12:2379 | ac7e57d44f030e8 | 3.4.13 | 9.5 MB | false | false | 248 | 223109 | 223109 | |
+-------------------+------------------+---------+---------+-----------+------------+-----------+------------+--------------------+--------+
~~~ # OR
[root@k8s-master01 ~]# etcdctl --cacert=/etc/kubernetes/pki/etcd/etcd-ca.pem --key=/etc/kubernetes/pki/etcd/etcd-key.pem --cert=/etc/kubernetes/pki/etcd/etcd.pem --endpoints https://192.168.1.11:2379,https://192.168.1.12:2379,https://192.168.1.13:2379 endpoint health
https://192.168.1.13:2379 is healthy: successfully committed proposal: took = 37.560337ms
https://192.168.1.12:2379 is healthy: successfully committed proposal: took = 43.665877ms
https://192.168.1.11:2379 is unhealthy: failed to commit proposal: context deadline exceeded~~~ # 升級etcd版本
~~~ 切換到etcd版本包目錄下
[root@k8s-master01 ~]# cd /root/upgrade/etcd-v3.4.7-linux-amd64~~~ 拷貝etcd etcdctl檔案到/usr/local/bin目錄下
[root@k8s-master01 etcd-v3.4.7-linux-amd64]# cp etcd* /usr/local/bin/
cp: overwrite ‘/usr/local/bin/etcd’? y
cp: overwrite ‘/usr/local/bin/etcdctl’? y
~~~ 檢視配置檔案是否為切片形式
[root@k8s-master01 ~]# vim /etc/etcd/etcd.config.yml
log-outputs: ["default"] ~~~ # 啟動etcd服務
[root@k8s-master01 ~]# systemctl restart etcd~~~ # 檢視更新後etcd版本
[root@k8s-master01 ~]# etcdctl version
etcdctl version: 3.4.7
API version: 3.4### --- 檢視叢集狀態
~~~ # 檢視etcd叢集狀態
[root@k8s-master01 ~]# etcdctl --endpoints="192.168.1.13:2379,192.168.1.12:2379,192.168.1.11:2379" --cacert=/etc/kubernetes/pki/etcd/etcd-ca.pem --cert=/etc/kubernetes/pki/etcd/etcd.pem --key=/etc/kubernetes/pki/etcd/etcd-key.pem endpoint status --write-out=table
+-------------------+------------------+---------+---------+-----------+------------+-----------+------------+--------------------+--------+
| ENDPOINT | ID | VERSION | DB SIZE | IS LEADER | IS LEARNER | RAFT TERM | RAFT INDEX | RAFT APPLIED INDEX | ERRORS |
+-------------------+------------------+---------+---------+-----------+------------+-----------+------------+--------------------+--------+
| 192.168.1.13:2379 | 40ba37809e1a423f | 3.4.13 | 9.5 MB | true | false | 248 | 226533 | 226533 | |
| 192.168.1.12:2379 | ac7e57d44f030e8 | 3.4.13 | 9.5 MB | false | false | 248 | 226533 | 226533 | |
| 192.168.1.11:2379 | ace8d5b0766b3d92 | 3.4.7 | 9.8 MB | false | false | 248 | 226533 | 226533 | |
+-------------------+------------------+---------+---------+-----------+------------+-----------+------------+--------------------+--------+
~~~ # OR
[root@k8s-master01 ~]# etcdctl --cacert=/etc/kubernetes/pki/etcd/etcd-ca.pem --key=/etc/kubernetes/pki/etcd/etcd-key.pem --cert=/etc/kubernetes/pki/etcd/etcd.pem --endpoints https://192.168.1.11:2379,https://192.168.1.12:2379,https://192.168.1.13:2379 endpoint health
https://192.168.1.12:2379 is healthy: successfully committed proposal: took = 31.109889ms
https://192.168.1.13:2379 is healthy: successfully committed proposal: took = 32.625376ms
https://192.168.1.11:2379 is healthy: successfully committed proposal: took = 32.204066ms### --- 備份版本包
~~~ # 檢視etcd部署在什麼位置
[root@k8s-master02 ~]# which etcd
/usr/local/bin/etcd~~~ # 備份版本包
[root@k8s-master02 ~]# mkdir /usr/local/bin/bak/
[root@k8s-master02 ~]# cp /usr/local/bin/* /usr/local/bin/bak/### --- 停止當前節點etcd服務
[root@k8s-master02 ~]# systemctl stop etcd~~~ # 檢視etcd叢集狀態
~~~ 注：12狀態不健康，已經被停止執行狀態
[root@k8s-master01 ~]# etcdctl --endpoints="192.168.1.13:2379,192.168.1.12:2379,192.168.1.11:2379" --cacert=/etc/kubernetes/pki/etcd/etcd-ca.pem --cert=/etc/kubernetes/pki/etcd/etcd.pem --key=/etc/kubernetes/pki/etcd/etcd-key.pem endpoint status --write-out=table
+-------------------+------------------+---------+---------+-----------+------------+-----------+------------+--------------------+--------+
| ENDPOINT | ID | VERSION | DB SIZE | IS LEADER | IS LEARNER | RAFT TERM | RAFT INDEX | RAFT APPLIED INDEX | ERRORS |
+-------------------+------------------+---------+---------+-----------+------------+-----------+------------+--------------------+--------+
| 192.168.1.13:2379 | 40ba37809e1a423f | 3.4.13 | 9.5 MB | true | false | 248 | 223109 | 223109 | |
| 192.168.1.11:2379 | ac7e57d44f030e8 | 3.4.17 | 9.5 MB | false | false | 248 | 223109 | 223109 | |
+-------------------+------------------+---------+---------+-----------+------------+-----------+------------+--------------------+--------+
~~~ # OR
[root@k8s-master01 ~]# etcdctl --cacert=/etc/kubernetes/pki/etcd/etcd-ca.pem --key=/etc/kubernetes/pki/etcd/etcd-key.pem --cert=/etc/kubernetes/pki/etcd/etcd.pem --endpoints https://192.168.1.11:2379,https://192.168.1.12:2379,https://192.168.1.13:2379 endpoint health
https://192.168.1.13:2379 is healthy: successfully committed proposal: took = 22.136296ms
https://192.168.1.11:2379 is healthy: successfully committed proposal: took = 26.003475ms
https://192.168.1.12:2379 is unhealthy: failed to commit proposal: context deadline exceeded### --- 升級etcd版本
~~~ # 檢視當前節點etcd叢集版本
[root@k8s-master02 ~]# etcdctl version
etcdctl version: 3.4.13
API version: 3.4 ~~~ # 升級etcd版本
~~~ 切換到版本包目錄
[root@k8s-master01 ~]# cd /root/upgrade/etcd-v3.4.7-linux-amd64 ~~~ 拷貝etcd etcdctl檔案到/usr/local/bin目錄下
[root@k8s-master01 etcd-v3.4.7-linux-amd64]# scp etcd* k8s-master03:/usr/local/bin/
etcd 100% 23MB 21.9MB/s 00:01
etcdctl
~~~ 檢視配置檔案是否為切片形式
[root@k8s-master02 ~]# vim /etc/etcd/etcd.config.yml
log-outputs: ["default"] ~~~ # 啟動etcd服務
[root@k8s-master02 ~]# systemctl restart etcd~~~ # 檢視更新後etcd版本
[root@k8s-master02 ~]# etcdctl version
etcdctl version: 3.4.7
API version: 3.4### --- 檢視叢集狀態
~~~ # 檢視etcd叢集狀態
[root@k8s-master01 ~]# etcdctl --endpoints="192.168.1.13:2379,192.168.1.12:2379,192.168.1.11:2379" --cacert=/etc/kubernetes/pki/etcd/etcd-ca.pem --cert=/etc/kubernetes/pki/etcd/etcd.pem --key=/etc/kubernetes/pki/etcd/etcd-key.pem endpoint status --write-out=table
+-------------------+------------------+---------+---------+-----------+------------+-----------+------------+--------------------+--------+
| ENDPOINT | ID | VERSION | DB SIZE | IS LEADER | IS LEARNER | RAFT TERM | RAFT INDEX | RAFT APPLIED INDEX | ERRORS |
+-------------------+------------------+---------+---------+-----------+------------+-----------+------------+--------------------+--------+
| 192.168.1.13:2379 | 40ba37809e1a423f | 3.4.13 | 9.5 MB | true | false | 248 | 227928 | 227928 | |
| 192.168.1.12:2379 | ac7e57d44f030e8 | 3.4.7 | 9.5 MB | false | false | 248 | 227928 | 227928 | |
| 192.168.1.11:2379 | ace8d5b0766b3d92 | 3.4.7 | 9.8 MB | false | false | 248 | 227928 | 227928 | |
+-------------------+------------------+---------+---------+-----------+------------+-----------+------------+--------------------+--------+
~~~ # OR
[root@k8s-master01 ~]# etcdctl --cacert=/etc/kubernetes/pki/etcd/etcd-ca.pem --key=/etc/kubernetes/pki/etcd/etcd-key.pem --cert=/etc/kubernetes/pki/etcd/etcd.pem --endpoints https://192.168.1.11:2379,https://192.168.1.12:2379,https://192.168.1.13:2379 endpoint health
https://192.168.1.11:2379 is healthy: successfully committed proposal: took = 28.622819ms
https://192.168.1.13:2379 is healthy: successfully committed proposal: took = 57.660454ms
https://192.168.1.12:2379 is healthy: successfully committed proposal: took = 65.698448ms### --- 備份版本包
~~~ # 檢視etcd部署在什麼位置
[root@k8s-master03 ~]# which etcd
/usr/local/bin/etcd~~~ # 備份版本包
[root@k8s-master03 ~]# mkdir /usr/local/bin/bak/
[root@k8s-master03 ~]# cp /usr/local/bin/* /usr/local/bin/bak/### --- 停止當前節點etcd服務
~~~ # 停止當前節點etcd服務
~~~ 升級主節點：主節點被stop後會重新選主，重新選擇出來一個新的主節點
[root@k8s-master03 ~]# systemctl stop etcd~~~ # 檢視etcd叢集狀態
~~~ 注：13狀態不健康，已經被停止執行狀態
[root@k8s-master01 ~]# etcdctl --endpoints="192.168.1.13:2379,192.168.1.12:2379,192.168.1.11:2379" --cacert=/etc/kubernetes/pki/etcd/etcd-ca.pem --cert=/etc/kubernetes/pki/etcd/etcd.pem --key=/etc/kubernetes/pki/etcd/etcd-key.pem endpoint status --write-out=table
+-------------------+------------------+---------+---------+-----------+------------+-----------+------------+--------------------+--------+
| ENDPOINT | ID | VERSION | DB SIZE | IS LEADER | IS LEARNER | RAFT TERM | RAFT INDEX | RAFT APPLIED INDEX | ERRORS |
+-------------------+------------------+---------+---------+-----------+------------+-----------+------------+--------------------+--------+
| 192.168.1.12:2379 | ac7e57d44f030e8 | 3.4.7 | 9.5 MB | false | false | 249 | 228492 | 228492 | |
| 192.168.1.11:2379 | ace8d5b0766b3d92 | 3.4.7 | 9.8 MB | true | false | 249 | 228492 | 228492 | |
+-------------------+------------------+---------+---------+-----------+------------+-----------+------------+--------------------+--------+
~~~ # OR
[root@k8s-master01 ~]# etcdctl --cacert=/etc/kubernetes/pki/etcd/etcd-ca.pem --key=/etc/kubernetes/pki/etcd/etcd-key.pem --cert=/etc/kubernetes/pki/etcd/etcd.pem --endpoints https://192.168.1.11:2379,https://192.168.1.12:2379,https://192.168.1.13:2379 endpoint health
https://192.168.1.11:2379 is healthy: successfully committed proposal: took = 39.586651ms
https://192.168.1.12:2379 is healthy: successfully committed proposal: took = 41.327247ms
https://192.168.1.13:2379 is unhealthy: failed to commit proposal: context deadline exceeded### --- 升級etcd版本
~~~ # 檢視當前節點etcd叢集版本
[root@k8s-master03 ~]# etcdctl version
etcdctl version: 3.4.13
API version: 3.4 ~~~ # 升級etcd版本
~~~ 切換到版本包目錄
[root@k8s-master01 ~]# cd /root/upgrade/etcd-v3.4.7-linux-amd64 ~~~ 拷貝etcd etcdctl檔案到/usr/local/bin目錄下
[root@k8s-master01 etcd-v3.4.7-linux-amd64]# scp etcd* k8s-master02:/usr/local/bin/
etcd 100% 23MB 21.9MB/s 00:01
etcdctl
~~~ 檢視配置檔案是否為切片形式
[root@k8s-master03 ~]# vim /etc/etcd/etcd.config.yml
log-outputs: ["default"] ~~~ # 啟動etcd服務
[root@k8s-master03 ~]# systemctl restart etcd~~~ # 檢視更新後etcd版本
[root@k8s-master03 ~]# etcdctl version
etcdctl version: 3.4.7
API version: 3.4### --- 檢視叢集狀態
~~~ # 檢視etcd叢集狀態
[root@k8s-master01 ~]# etcdctl --endpoints="192.168.1.13:2379,192.168.1.12:2379,192.168.1.11:2379" --cacert=/etc/kubernetes/pki/etcd/etcd-ca.pem --cert=/etc/kubernetes/pki/etcd/etcd.pem --key=/etc/kubernetes/pki/etcd/etcd-key.pem endpoint status --write-out=table
+-------------------+------------------+---------+---------+-----------+------------+-----------+------------+--------------------+--------+
| ENDPOINT | ID | VERSION | DB SIZE | IS LEADER | IS LEARNER | RAFT TERM | RAFT INDEX | RAFT APPLIED INDEX | ERRORS |
+-------------------+------------------+---------+---------+-----------+------------+-----------+------------+--------------------+--------+
| 192.168.1.13:2379 | 40ba37809e1a423f | 3.4.7 | 9.5 MB | false | false | 249 | 229007 | 229007 | |
| 192.168.1.12:2379 | ac7e57d44f030e8 | 3.4.7 | 9.5 MB | false | false | 249 | 229007 | 229007 | |
| 192.168.1.11:2379 | ace8d5b0766b3d92 | 3.4.7 | 9.8 MB | true | false | 249 | 229007 | 229007 | |
+-------------------+------------------+---------+---------+-----------+------------+-----------+------------+--------------------+--------+
~~~ # OR
[root@k8s-master01 ~]# etcdctl --cacert=/etc/kubernetes/pki/etcd/etcd-ca.pem --key=/etc/kubernetes/pki/etcd/etcd-key.pem --cert=/etc/kubernetes/pki/etcd/etcd.pem --endpoints https://192.168.1.11:2379,https://192.168.1.12:2379,https://192.168.1.13:2379 endpoint health
https://192.168.1.11:2379 is healthy: successfully committed proposal: took = 33.137392ms
https://192.168.1.13:2379 is healthy: successfully committed proposal: took = 34.387544ms
https://192.168.1.12:2379 is healthy: successfully committed proposal: took = 34.056139ms===============================END===============================
Walter Savage Landor:strove with none,for none was worth my strife.Nature I loved and, next to Nature, Art:I warm'd both hands before the fire of life.It sinks, and I am ready to depart ——W.S.Landor
來自為知筆記(Wiz)