1. 程式人生 > >百度文庫爬取分析

百度文庫爬取分析

see ken 分析 auth -a ons res sep 頁面

3個url 會返回頁面的文字數據,

https://wkbjbos.bdimg.com/v1/docconvert814//wk/01ac47857af54eff3e3481af99446a6b/0.json?responseCacheControl=max-age%3D3888000&responseExpires=Thu%2C%2013%20Sep%202018%2010%3A38%3A19%20%2B0800&authorization=bce-auth-v1%2Ffa1126e91489401fa7cc85045ce7179e%2F2018-07-30T02%3A38%3A19Z%2F3600%2Fhost%2Fc9b4fcf4e4e77d1042543c6a83da1e74065600f7c255ecdce498186074542150&x-bce-range=0-14266&token=159ae1ea7d0b347cf13ec6fa241bce5e113afb1752c4c6dac71976c313bd2ed6&expire=2018-07-30T03:38:19Z

https://wkbjbos.bdimg.com/v1/docconvert814//wk/01ac47857af54eff3e3481af99446a6b/0.json?responseCacheControl=max-age%3D3888000&responseExpires=Thu%2C%2013%20Sep%202018%2011%3A03%3A57%20%2B0800&authorization=bce-auth-v1%2Ffa1126e91489401fa7cc85045ce7179e%2F2018-07-30T03%3A03%3A57Z%2F3600%2Fhost%2F30127d1b5507924ef3b040033705c159687e06d5c8322019625bb89383620696&x-bce-range=0-14266&token=31693fe9a9ec072fccc63da2db3258c52589d28e1039d41ab19730f39e75626a&expire=2018-07-30T04:03:57Z

0.json?responseCacheControl=max-age%3D3888000&responseExpires=Thu%2C%2013%20Sep%202018%2010%3A38%3A19%20%2B0800&authorization=bce-auth-v1%2Ffa1126e91489401fa7cc85045ce7179e%2F2018-07-30T02%3A38%3A19Z%2F3600%2Fhost%2Fc9b4fcf4e4e77d1042543c6a83da1e74065600f7c255ecdce498186074542150&x-bce-range=0-14266&token=159ae1ea7d0b347cf13ec6fa241bce5e113afb1752c4c6dac71976c313bd2ed6&expire=2018-07-30T03:38:19Z

可在網頁源代碼內找到,,get即可!

懶癌發作,,程序懶得寫了,只寫一點分析過程吧

百度文庫爬取分析