1.先看看文字，40多萬行的log資訊。處理要求：將第6列列印資訊tbmt：後面的數值按照十六進位制排序

2.shell指令碼如下圖，40萬行文字，指令碼沒關列印要執行6-8個小時左右才能處理完。

#! /bin/bash

# --------------------------------------------------------------------------------
# File name   : sort_beta.sh
# Date        : 2018/07/28
# Author      : Gick
# Mail        : [email protected]
 

# Usage       : Sort the logFile in ascending
# Version     : 1.0
# --------------------------------------------------------------------------------

#################### test weather file exists or not #####################
if test -z "$1"
then
    echo "please input your log_file!"
    exit 0
fi

if test -z "$2"
then
    echo "please input your log_file for storing the fixed data!"
    exit 0
fi

#################### classified according to the length of string of last column #####################
cat $1 | while read line
do
    echo $line > temp.txt
    ColumnData=`awk '{print $6}' ./temp.txt`
    echo $ColumnData
    ColumnData=`echo ${#ColumnData}`
    case $ColumnData in
    6)
        echo "================= SIZE = 6 ===================="
        echo $line >> temp1.txt
        ;;
    7)
        echo "================= SIZE = 7 ===================="
        echo $line >> temp2.txt
        ;;
    8)
        echo "================= SIZE = 8 ===================="
        echo $line >> temp3.txt
        ;;

    9)
        echo "================= SIZE = 6 ===================="
        echo $line >> temp4.txt
        ;;
    esac
done

#################### sort data of different string lengths separately #####################
echo "================= SIZE = 6 ===================="
sort -k 6.6 temp1.txt > $2

echo "================= SIZE = 7 ===================="
sort -k 6.6 temp2.txt >> $2

echo "================= SIZE = 8 ===================="
sort -k 6.6 temp3.txt >> $2

echo "================= SIZE = 9 ===================="
sort -k 6.6 temp4.txt >> $2

#################### remove temporary files #####################
rm temp*


 

3.再來看看python指令碼，執行時間未測，但應該比上面少。別人寫的，先mark，回頭學習，是時候轉python了。