2. 程式人生 > >Python小程序

Python小程序

阿新 • • 發佈：2017-11-10
cnblogs color bsp auth spa except code soft 問題

需求：統計每分鐘有多少行；及23:59有多少行，00:00有多少行，文件過大每個文件2G，共5個文件

文件：access_log.2017-11-06-00_00_00文件內容如下：

21.123.42.233 - - [05/Nov/2017:23:59:59 +0800] "POST /IPPSRemote/remoting/RemoteCfcaQryCert4softCertInvoker HTTP/1.1" 200 TIME: 11637 1388               
21.123.42.233 - - [06/Nov/2017:00:00:00 +0800] "POST /IPPSRemote/remoting/RemoteCFCAP1VerifySignMsgInvoker HTTP/1.1" 200 TIME: 7223 150                  
21.123.42.235 - - [05/Nov/2017:23:59:59 +0800] "POST /IPPSRemote/remoting/RemoteIps35062Invoker HTTP/1.1" 200 TIME: 185121 135                           
21.123.42.235 - - [06/Nov/2017:00:00:00 +0800] "POST /IPPSRemote/remoting/RemoteCFCAP1SignMsgInvoker HTTP/1.1" 200 TIME: 7998 330                        
21.123.42.232 - - [06/Nov/2017:00:00:00 +0800] "POST /IPPSRemote/remoting/RemoteCfcaQryCert4softCertInvoker HTTP/1.1" 200 TIME: 29833 1388               
21.123.42.232 - - [06/Nov/2017:00:00:00 +0800] "POST /IPPSRemote/remoting/RemoteCFCAP1VerifySignMsgInvoker HTTP/1.1" 200 TIME: 20608 150                 
21.123.42.232 - - [05/Nov/2017:23:59:59 +0800] "POST /IPPSRemote/remoting/RemoteIps35062Invoker HTTP/1.1" 200 TIME: 252234 139                           
21.123.42.232 - - [05/Nov/2017:23:59:59 +0800] "POST /IPPSRemote/remoting/RemoteIps35062Invoker HTTP/1.1" 200 TIME: 230661 135                           
21.123.42.232 - - [06/Nov/2017:00:00:00 +0800] "POST /IPPSRemote/remoting/RemoteCfcaQryCert4softCertInvoker HTTP/1.1" 200 TIME: 33536 1388               
21.123.42.233 - - [06/Nov/2017:00:00:00 +0800] "POST /IPPSRemote/remoting/RemoteIps35062Invoker HTTP/1.1" 200 TIME: 138429 139                           
21.123.42.232 - - [06/Nov/2017:00:00:00 +0800] "POST /IPPSRemote/remoting/RemoteCFCAP1VerifySignMsgInvoker HTTP/1.1" 200 TIME: 24368 150                 
21.123.42.233 - - [06/Nov/2017:00:00:00 +0800] "POST /IPPSRemote/remoting/RemoteCFCAP1SignMsgInvoker HTTP/1.1" 200 TIME: 7075 330                        
21.123.42.232 - - [06/Nov/2017:00:00:00 +0800] "POST /IPPSRemote/remoting/RemoteCFCAP1SignMsgInvoker HTTP/1.1" 200 TIME: 23221 330                       
21.123.42.232 - - [06/Nov/2017:00:00:00 +0800] "POST /IPPSRemote/remoting/RemoteCFCAP1SignMsgInvoker HTTP/1.1" 200 TIME: 19719 330                       
21.123.42.232 - - [06/Nov/2017:00:00:00 +0800] "POST /IPPSRemote/remoting/RemoteIps35062Invoker HTTP/1.1" 200 TIME: 85528 135                            
21.123.42.232 - - [06/Nov/2017:00:00:00 +0800] "POST /IPPSRemote/remoting/RemoteCfcaQryCert4softCertInvoker HTTP/1.1" 200 TIME: 22324 1388               
21.123.42.232 - - [06/Nov/2017:00:00:00 +0800] "POST /IPPSRemote/remoting/RemoteCFCAP1VerifySignMsgInvoker HTTP/1.1" 200 TIME: 15338 150                 
21.123.42.232 - - [06/Nov/2017:00:00:00 +0800] "POST /IPPSRemote/remoting/RemoteCfcaQryCert4softCertInvoker HTTP/1.1" 200 TIME: 20461 1388               
21.123.42.232 - - [06/Nov/2017:00:00:00 +0800] "POST /IPPSRemote/remoting/RemoteCFCAP1SignMsgInvoker HTTP/1.1" 200 TIME: 24474 330                       
21.123.42.235 - - [06/Nov/2017:00:00:00 +0800] "POST /IPPSRemote/remoting/RemoteCfcaQryCert4softCertInvoker HTTP/1.1" 200 TIME: 10589 1388               
21.123.42.232 - - [06/Nov/2017:00:00:00 +0800] "POST /IPPSRemote/remoting/RemoteCFCAP1VerifySignMsgInvoker HTTP/1.1" 200 TIME: 24163 150                 
21.123.42.235 - - [06/Nov/2017:00:00:00 +0800] "POST /IPPSRemote/remoting/RemoteCFCAP1VerifySignMsgInvoker HTTP/1.1" 200 TIME: 4449 150                  
21.123.42.236 - - [06/Nov/2017:00:00:00 +0800] "POST /IPPSRemote/remoting/RemoteIps35062Invoker HTTP/1.1" 200 TIME: 345698 139                           
21.123.42.236 - - [06/Nov/2017:00:00:00 +0800] "POST /IPPSRemote/remoting/RemoteCFCAP1SignMsgInvoker HTTP/1.1" 200 TIME: 19886 330                       
21.123.42.233 - - [06/Nov/2017:04:02:04 +0800] "POST /IPPSRemote/remoting/RemoteCFCAP1VerifySignMsgInvoker HTTP/1.1" 200 TIME: 5096 150                     
21.123.42.232 - - [06/Nov/2017:04:02:04 +0800] "POST /IPPSRemote/remoting/RemoteCFCAP1VerifySignMsgInvoker HTTP/1.1" 200 TIME: 5755 150                     
21.123.42.235 - - [06/Nov/2017:04:02:04 +0800] "POST /IPPSRemote/remoting/RemoteCFCAP1SignMsgInvoker HTTP/1.1" 200 TIME: 7182 330                           
21.123.42.235 - - [06/Nov/2017:04:02:04 +0800] "POST /IPPSRemote/remoting/RemoteCFCAP1VerifySignMsgInvoker HTTP/1.1" 200 TIME: 4752 150                     
21.123.42.233 - - [06/Nov/2017:04:02:04 +0800] "POST /IPPSRemote/remoting/RemoteIps35062Invoker HTTP/1.1" 200 TIME: 101802 139                              
21.123.42.232 - - [06/Nov/2017:04:02:04 +0800] "POST /IPPSRemote/remoting/RemoteCFCAP1SignMsgInvoker HTTP/1.1" 200 TIME: 7666 330                           
21.123.42.236 - - [06/Nov/2017:04:02:04 +0800] "POST /IPPSRemote/remoting/RemoteCfcaQryCert4softCertInvoker HTTP/1.1" 200 TIME: 11735 1388                  
21.123.42.232 - - [06/Nov/2017:04:02:04 +0800] "POST /IPPSRemote/remoting/RemoteCFCAP1VerifySignMsgInvoker HTTP/1.1" 200 TIME: 5376 150                     
21.123.42.234 - - [06/Nov/2017:04:02:04 +0800] "POST /IPPSRemote/remoting/RemoteCfcaQryCert4softCertInvoker HTTP/1.1" 200 TIME: 19922 1388                  
21.123.42.236 - - [06/Nov/2017:04:02:04 +0800] "POST /IPPSRemote/remoting/RemoteCfcaQryCert4softCertInvoker HTTP/1.1" 200 TIME: 8779 1388                   
21.123.42.235 - - [06/Nov/2017:04:02:04 +0800] "POST /IPPSRemote/remoting/RemoteIps35062Invoker HTTP/1.1" 200 TIME: 99890 135                               
21.123.42.234 - - [06/Nov/2017:04:02:04 +0800] "POST /IPPSRemote/remoting/RemoteCFCAP1VerifySignMsgInvoker HTTP/1.1" 200 TIME: 5242 150                     
21.123.42.236 - - [06/Nov/2017:04:02:04 +0800] "POST /IPPSRemote/remoting/RemoteCfcaQryCert4softCertInvoker HTTP/1.1" 200 TIME: 16658 1388                  
21.123.42.233 - - [06/Nov/2017:04:02:04 +0800] "POST /IPPSRemote/remoting/RemoteCFCAP1VerifySignMsgInvoker HTTP/1.1" 200 TIME: 4977 150      
21.123.42.234 - - [06/Nov/2017:12:12:32 +0800] "POST /IPPSRemote/remoting/RemoteCFCAP1SignMsgInvoker HTTP/1.1" 200 TIME: 5559 3
21.123.42.232 - - [06/Nov/2017:12:12:32 +0800] "POST /IPPSRemote/remoting/RemoteCFCAP1SignMsgInvoker HTTP/1.1" 200 TIME: 5176 3
21.123.42.234 - - [06/Nov/2017:12:12:32 +0800] "POST /IPPSRemote/remoting/RemoteCfcaQryCert4softCertInvoker HTTP/1.1" 200 TIME:
21.123.42.234 - - [06/Nov/2017:12:12:32 +0800] "POST /IPPSRemote/remoting/RemoteCfcaQryCert4softCertInvoker HTTP/1.1" 200 TIME:
21.123.42.234 - - [06/Nov/2017:12:12:32 +0800] "POST /IPPSRemote/remoting/RemoteCfcaQryCert4softCertInvoker HTTP/1.1" 200 TIME:
21.123.42.234 - - [06/Nov/2017:12:12:32 +0800] "POST /IPPSRemote/remoting/RemoteCFCAP1VerifySignMsgInvoker HTTP/1.1" 200 TIME: 
21.123.42.234 - - [06/Nov/2017:12:12:32 +0800] "POST /IPPSRemote/remoting/RemoteCFCAP1VerifySignMsgInvoker HTTP/1.1" 200 TIME: 
21.123.42.235 - - [06/Nov/2017:12:12:31 +0800] "POST /IPPSRemote/remoting/RemoteIps35062Invoker HTTP/1.1" 200 TIME: 136333 135 
21.123.42.234 - - [06/Nov/2017:12:12:32 +0800] "POST /IPPSRemote/remoting/RemoteCFCAP1SignMsgInvoker HTTP/1.1" 200 TIME: 8429 3
21.123.42.233 - - [06/Nov/2017:12:12:32 +0800] "POST /IPPSRemote/remoting/RemoteCfcaQryCert4softCertInvoker HTTP/1.1" 200 TIME:
21.123.42.236 - - [06/Nov/2017:12:12:31 +0800] "POST /IPPSRemote/remoting/RemoteIps35062Invoker HTTP/1.1" 200 TIME: 147556 135 
21.123.42.233 - - [06/Nov/2017:12:12:32 +0800] "POST /IPPSRemote/remoting/RemoteCFCAP1VerifySignMsgInvoker HTTP/1.1" 200 TIME: 
21.123.42.235 - - [06/Nov/2017:12:12:32 +0800] "POST /IPPSRemote/remoting/RemoteIps35062Invoker HTTP/1.1" 200 TIME: 119417 135 
21.123.42.233 - - [06/Nov/2017:12:12:31 +0800] "POST /IPPSRemote/remoting/RemoteIps35062Invoker HTTP/1.1" 200 TIME: 194970 135 
21.123.42.235 - - [06/Nov/2017:12:12:32 +0800] "POST /IPPSRemote/remoting/RemoteIps35062Invoker HTTP/1.1" 200 TIME: 76006 135  
21.123.42.236 - - [06/Nov/2017:12:12:32 +0800] "POST /IPPSRemote/remoting/RemoteCFCAP1SignMsgInvoker HTTP/1.1" 200 TIME: 5892 3
21.123.42.233 - - [06/Nov/2017:12:12:32 +0800] "POST /IPPSRemote/remoting/RemoteCFCAP1SignMsgInvoker HTTP/1.1" 200 TIME: 4904 3
21.123.42.235 - - [06/Nov/2017:12:12:31 +0800] "POST /IPPSRemote/remoting/RemoteIps35963Invoker HTTP/1.1" 200 TIME: 297515 369 
21.123.42.236 - - [06/Nov/2017:12:12:31 +0800] "POST /IPPSRemote/remoting/RemoteIps35062Invoker HTTP/1.1" 200 TIME: 402771 135 
21.123.42.233 - - [06/Nov/2017:12:12:32 +0800] "POST /IPPSRemote/remoting/RemoteCfcaQryCert4softCertInvoker HTTP/1.1" 200 TIME:
21.123.42.234 - - [06/Nov/2017:12:12:32 +0800] "POST /IPPSRemote/remoting/RemoteIps35062Invoker HTTP/1.1" 200 TIME: 135743 135 
21.123.42.235 - - [06/Nov/2017:12:12:32 +0800] "POST /IPPSRemote/remoting/RemoteCFCAP1SignMsgInvoker HTTP/1.1" 200 TIME: 5853 3
21.123.42.235 - - [06/Nov/2017:12:12:32 +0800] "POST /IPPSRemote/remoting/RemoteCFCAP1SignMsgInvoker HTTP/1.1" 200 TIME: 14536 
21.123.42.233 - - [06/Nov/2017:12:12:32 +0800] "POST /IPPSRemote/remoting/RemoteCFCAP1VerifySignMsgInvoker HTTP/1.1" 200 TIME: 
21.123.42.233 - - [06/Nov/2017:12:12:32 +0800] "POST /IPPSRemote/remoting/RemoteCfcaQryCert4softCertInvoker HTTP/1.1" 200 TIME:
21.123.42.233 - - [06/Nov/2017:12:12:31 +0800] "POST /IPPSRemote/remoting/RemoteIps35062Invoker HTTP/1.1" 200 TIME: 186202 135 　

Python代碼如下所示：

#!/usr/bin/env python
# -*- coding:utf-8 -*-
__author__ = ‘40kuai‘
li = [0 for i in range(1440)]
with open(‘/root/access_log.2017-11-06-00_00_00‘) as file:
    for line in file:
        hour = line.split(‘:‘)[1]
        mins = line.split(‘:‘)[2]
        haha =  int(hour)*60+int(mins)
        li[haha] 
 
+=1


for index,i in enumerate(li):
    try:
        a,b=divmod(index,60)
        print ‘%s:%s‘ % (a, b), i
    except ZeroDivisionError as e:
        print ‘00:00‘, i

又用Shell編了一個簡單Shell腳本，腳本如下：

#!/bin/bash
for i in {00..23} ;do
  for j in {00..59} ;do 
    echo $i:$j  `awk ‘{print $4}‘ /root/access_log.2017-11-06-00_00_00|awk -F ‘:‘ ‘{print $2$3}‘|grep $i$j|wc -l`>>/lines.txt
  done
done

兩個腳本的效率差別很大。。。哪位大神可以幫忙看看能不能優化一下Shell腳本，Shell主要問題為循環讀文件進行過濾

Python小程序

相關推薦

Python 小程序-微信AI自動回復

ges images 微信 ccf try 消息 .post style register 一簡介 　　使用itcha實現微信登錄及消息發送接收，使用圖靈AI實現智能回復。 參考API： http://www.tuling123.com/ https://itchat.re

python小程序（模擬用戶登陸系統）

賬號 this src 使用 div [0 please one str 模擬登陸1.用戶輸入賬號密碼進行登陸2.用戶信息存在文件內3.用戶密碼輸錯三次後鎖定用戶 知識點：strip()、split()、while、for循環混用以及布爾值的使用 strip() 方法用於

我的第一個Python小程序

接收 bigger all 類型 pre author code ger 知識點 猜年齡，如果大了提示小點，如果小了，提示大點 涉及的知識點： 1、變量 2、註釋 3、接收交互式的輸入 4、類型轉換 5、while循環 6、if..elif..else多條件分支語句 #

Day1:第一個python小程序

col rip 3.6.2 寫代碼 技術分享 spa 選項 emp win Day1:第一個python小程序與開發工具Pycharm 一、Hello World C:\Users\wenxh>python Python 3.6.2 (v3.6.2:5fd33b5,

Python小程序

cnblogs color bsp auth spa except code soft 問題 需求：統計每分鐘有多少行；及23:59有多少行，00:00有多少行，文件過大每個文件2G，共5個文件 文件：access_log.2017-11-06-00_00_00文件內容如下

Python小程序—修改haproxy配置文件

format not num org list for choice ces div 程序2:修改haproxy配置文件 需求： 1 1、查 2 輸入：www.oldboy.org 3 獲取當前backend下的所有記錄 4 5 2、新建

windows上快速調用自己寫的python小程序

python 密碼箱 工具制作 windows平臺上快速調用python程序 場景1：某雲平臺的賬號/或密碼比較長，一旦瀏覽器緩存失效，就要去郵件/文件查找，費時費力 場景2：由於某些場景，強制每N天更換密碼。簡單密碼箱，密碼保存，自動copy到粘貼板 場景3：python功能強大，寫了個小程序，

Python小程序練習一之登陸接口

AD lse aps 錯誤 用戶名 添加 admin 賬戶 AS 登陸接口並實現猜數字遊戲 輸入用戶名密碼 認證成功後顯示歡迎信息 進行猜數字遊戲，可猜三次 輸錯三次後鎖定 1、Adduser.py 1 # The author is tou

Python小程序練習二之裝飾器小例子

現實 none align style args ldap .net dad 現在 Python小程序練習二之裝飾器小例子 裝飾器： 裝飾器實際上就是為了給某程序增添功能，但該程序已經上線或已經被使用，那麽就不能大批量的修改源代碼，這樣是不科學的也是不現實的

小豬佩奇社會人專用服務器，有意思的python小程序，附python代碼

小程序 image 一個 CA 都在 pytho GC 有意 ima 最近社會人小豬佩奇挺熱門的，大家都在說社會人，那麽我們作為IT人，怎麽讓我們的服務器也蹭一下社會人的熱點的？下面來給大家說說。 先來個效果圖： 小豬佩奇社會人專用服務器 哈哈，這樣是不是挺有意思的？工

第一個python小程序

ali for pytho .com login format == gin log 一 第一個Python程序 _username=‘liu‘;_password=‘1234‘ username=input(‘username:‘) password=input(‘pa

使用pyinstaller打包python小程序（沒有使用第三方模塊）

con 技術 http 自定義 bubuko 成功 三方 適應 格式 準備： 1，xxx.py程序文件 2，自定義的圖標文件:xxx.ico 圖標文件應該包含常見的多分辨率格式，以便適應在不同場合顯示，不能是單一圖片。 你可以用專用的軟件處理生成圖標，不過少量的圖標生產，其

第一個python小程序——即時動態時鐘(開始階段)

arm 識別 使用 file 及其 階段 pychar odin 語句 開發歷程： 一、python開發環境 在安裝了python2.7和python3.7的基礎上，使用pycharm進行編碼。 （1）閱讀代碼敲進去後，出現第一個問題：ImportError: No mod

Python小程序之「讀取站點地圖 自動為Gitalk創建Issues」

lose lec des hashlib token ont repos 閱讀 md5 首發於個人博客 想獲得更好的閱讀體驗，煩請移步?? 前言 前些天給博客加了評論功能，試了Disqus、Valine等一幹評論系統，最後還是選擇了在大陸相對友好而且符合技術博客風格的Git

Python實現購物車小程序

輸入密碼 print 文件的 enc break aps ast utf log 開發環境，win7、Python3.6、Pycharm社區版2017 作業需求： 購物車程序：1、啟動程序後，輸入用戶名密碼後，如果是第一次登錄，讓用戶輸入工資，然後打印商品列表 #再次

最近開始努力學python 寫了一個python小代碼：判斷一個登陸程序，如果賬號密碼輸錯3次，鎖定賬號無法再登陸

登陸 readlines 輸入 連續 nbsp 努力 一個 取數據 lis 1 count = 0 2 username = ‘zhangsan‘ 3 userpassword = ‘111111‘ 4 5 f = open(‘lock.txt‘,‘r+‘

python簡單小程序（99乘法表）

while 解釋 兩個 位與 顯示 con pri 數字 i+1 1. #99乘法表#第一種 for i in range(1,10): s=‘‘ for j in range (1,i+1): s+=str(j)+‘*‘+str(i)+‘

python練習冊 每天一個小程序

註釋 and ati 註意 繪圖 windows 操作 jpeg odi PIL庫學習鏈接：http://blog.csdn.net/column/details/pythonpil.html?&page=1 1 #-*-coding:utf-8-*- 2 _

python練習冊 每天一個小程序 第0002題

color == oot 關系型數據庫 auth creat user root mdb 1 #-*-coding:utf-8-*- 2 __author__ = ‘Deen‘ 3 ‘‘‘ 4 題目描述： 5 將 0001 題生成的 200 個激活碼

python練習冊 每天一個小程序 第0010題

rgb pytho 進行 lur return n) dom randint window # -*-coding:utf-8-*- ‘‘‘ 題目描述： 使用 Python 生成類似於下圖中的字母驗證碼圖片 思路： 運用PIL庫加random 隨機字母進行生成