1. 程式人生 > >【udacity】機器學習

【udacity】機器學習

Evernote Export

2.人工智慧簡介

機器學習源自於人工智慧,在此方向上,該領域有分為不同學派,機器學習主要關注的是製造能夠自主動作的機器

3.人工智慧難題

1.所有智慧體都只有很少的計算資源、很低的處理速度和很小的記憶體,如何能讓AI實時提供作用?
2.所有的計算都是區域性的,但是大多數AI問題都具有全域性約束,如何才能讓AI解決全域性問題?
3.計算邏輯基本上是演繹邏輯,但是許多AI本質上是溯因性或歸納性的,如何解決AI的溯因性問題?
4.世界是動態變化的,知識是有限的,但是AI智慧體必須始終從它已知的東西開始,如何讓AI解決新問題?
5.推理和學習已經使事務變的複雜,但是解釋和證明增加了這種複雜性,如何讓AI解決複雜問題?

4.人工智慧問題的特點

1.在許多AI問題中,資料是陸續出現的,而不是一開始就有所有的資料
2.問題往往會重複出現,同類問題一再出現
3.問題在許多不同的抽象層面上出現
4.許多引人關注的AI問題難以通過計算來解決
5.外界是動態的,它不斷變化,但是有關外界的知識是相對不變的
6.外界是開放式的,但是有關外界的問題是有限的

5.人工智慧和不確定性

1.感測器無法識別系統以外的資訊
2.對手限制資訊
3.資訊的隨機性無法預測
4.計算機運算能力限制
5.全然無知情況

6.有哪些人工智慧問題

8.什麼是基於知識的人工智慧?

基於知識的三個基本過程
1.推理
2.學習
3.記憶

9.人工智慧的四個學派

Academic Application
Thinking semantic web
acting airplane autopilot
optimally machine learning
like humans improvisational robots

 

10.什麼是基於知識的人工智慧
觀察人類的行為可以幫助我們設計一個機器人觀察機器人設計可以幫助識別人類的認知模式
12.貝葉斯公式
貝葉斯描述:
P(A|B)中B是已知事件,A是我們關心的變數

P(AB)=P(B)P(BA) P(A)

24.機器學習的定義

什麼是機器學習?
計算應用統計學

25.監督學習

監督學習:獲取已經標記的資料集,通過收集資訊以便標記新的資料集(函式逼近)

26.非監督學習

沒有樣本,只有輸入的關係,只能通過檢視輸入本身的關係來推匯出某些結構(簡潔的影響描述)。
 

27.強化學習

強化學習常常被描述為通過延遲獎賞(reward)進行學習,強化學習的反饋可能是你實際做出決策後經過幾個步驟才產生的。

28.歸納法與演繹法

所有的機器學習都是一種歸納法而不是演繹法
歸納是從一個示例得出更普遍規則的問題
演繹是從普通規則得到結果

29.歸納法、演繹法與溯因法

診斷就是溯因法的例項,歸納法不能保證結果是否適用於整個整體,溯因法也是一樣。
探尋一個結果是否正確的過程就是,追溯->歸納->演繹不斷迴圈的過程
35.分類法
引數、資料結構、隱含概念
資料標記、資料標記缺失、反饋
預測、關注事件、主動性、被動性
分類與迴歸

what what from what for how output detail  
parameter supervised prediction passive classification generative  
hidden unsupervised diagnose active regression discriminative  
certain reinforcement summarize online      
parameter     offline      

36.監督學習
在監督學習中,每一個特徵例項都提供了一個特徵向量,以及以Y命名的目標符號

Occams Razor
奧卡姆剃刀定律:在其他條件一樣的情況下,選擇較不復雜的假設
38.分類和迴歸
分類的特點是目標標籤或目標類是離散的
迴歸問題與分類問題有本質上的區別,溫度是一個連續值,我們的貝葉斯網路不能預測溫度,而只能預測離散類
39.線性迴歸

f(x)=w1x+w0

40.更多線性迴歸
損失函式

loss=j(yjw1xjw0)2

**2.%E4%BA%BA%E5%B7%A5%E6%99%BA%E8%83%BD%E7%AE%80%E4%BB%8B**%0A%60%60%60%0A%E6%9C%BA%E5%99%A8%E5%AD%A6%E4%B9%A0%E6%BA%90%E8%87%AA%E4%BA%8E%E4%BA%BA%E5%B7%A5%E6%99%BA%E8%83%BD%EF%BC%8C%E5%9C%A8%E6%AD%A4%E6%96%B9%E5%90%91%E4%B8%8A%EF%BC%8C%E8%AF%A5%E9%A2%86%E5%9F%9F%E6%9C%89%E5%88%86%E4%B8%BA%E4%B8%8D%E5%90%8C%E5%AD%A6%E6%B4%BE%EF%BC%8C%E6%9C%BA%E5%99%A8%E5%AD%A6%E4%B9%A0%E4%B8%BB%E8%A6%81%E5%85%B3%E6%B3%A8%E7%9A%84%E6%98%AF%E5%88%B6%E9%80%A0%E8%83%BD%E5%A4%9F%E8%87%AA%E4%B8%BB%E5%8A%A8%E4%BD%9C%E7%9A%84%E6%9C%BA%E5%99%A8%0A%60%60%60%0A**3.%E4%BA%BA%E5%B7%A5%E6%99%BA%E8%83%BD%E9%9A%BE%E9%A2%98**%0A%60%60%60%0A1.%E6%89%80%E6%9C%89%E6%99%BA%E8%83%BD%E4%BD%93%E9%83%BD%E5%8F%AA%E6%9C%89%E5%BE%88%E5%B0%91%E7%9A%84%E8%AE%A1%E7%AE%97%E8%B5%84%E6%BA%90%E3%80%81%E5%BE%88%E4%BD%8E%E7%9A%84%E5%A4%84%E7%90%86%E9%80%9F%E5%BA%A6%E5%92%8C%E5%BE%88%E5%B0%8F%E7%9A%84%E5%86%85%E5%AD%98%EF%BC%8C%E5%A6%82%E4%BD%95%E8%83%BD%E8%AE%A9AI%E5%AE%9E%E6%97%B6%E6%8F%90%E4%BE%9B%E4%BD%9C%E7%94%A8%EF%BC%9F%0A2.%E6%89%80%E6%9C%89%E7%9A%84%E8%AE%A1%E7%AE%97%E9%83%BD%E6%98%AF%E5%B1%80%E9%83%A8%E7%9A%84%EF%BC%8C%E4%BD%86%E6%98%AF%E5%A4%A7%E5%A4%9A%E6%95%B0AI%E9%97%AE%E9%A2%98%E9%83%BD%E5%85%B7%E6%9C%89%E5%85%A8%E5%B1%80%E7%BA%A6%E6%9D%9F%EF%BC%8C%E5%A6%82%E4%BD%95%E6%89%8D%E8%83%BD%E8%AE%A9AI%E8%A7%A3%E5%86%B3%E5%85%A8%E5%B1%80%E9%97%AE%E9%A2%98%EF%BC%9F%0A3.%E8%AE%A1%E7%AE%97%E9%80%BB%E8%BE%91%E5%9F%BA%E6%9C%AC%E4%B8%8A%E6%98%AF%E6%BC%94%E7%BB%8E%E9%80%BB%E8%BE%91%EF%BC%8C%E4%BD%86%E6%98%AF%E8%AE%B8%E5%A4%9AAI%E6%9C%AC%E8%B4%A8%E4%B8%8A%E6%98%AF%E6%BA%AF%E5%9B%A0%E6%80%A7%E6%88%96%E5%BD%92%E7%BA%B3%E6%80%A7%E7%9A%84%EF%BC%8C%E5%A6%82%E4%BD%95%E8%A7%A3%E5%86%B3AI%E7%9A%84%E6%BA%AF%E5%9B%A0%E6%80%A7%E9%97%AE%E9%A2%98%EF%BC%9F%0A4.%E4%B8%96%E7%95%8C%E6%98%AF%E5%8A%A8%E6%80%81%E5%8F%98%E5%8C%96%E7%9A%84%EF%BC%8C%E7%9F%A5%E8%AF%86%E6%98%AF%E6%9C%89%E9%99%90%E7%9A%84%EF%BC%8C%E4%BD%86%E6%98%AFAI%E6%99%BA%E8%83%BD%E4%BD%93%E5%BF%85%E9%A1%BB%E5%A7%8B%E7%BB%88%E4%BB%8E%E5%AE%83%E5%B7%B2%E7%9F%A5%E7%9A%84%E4%B8%9C%E8%A5%BF%E5%BC%80%E5%A7%8B%EF%BC%8C%E5%A6%82%E4%BD%95%E8%AE%A9AI%E8%A7%A3%E5%86%B3%E6%96%B0%E9%97%AE%E9%A2%98%EF%BC%9F%0A5.%E6%8E%A8%E7%90%86%E5%92%8C%E5%AD%A6%E4%B9%A0%E5%B7%B2%E7%BB%8F%E4%BD%BF%E4%BA%8B%E5%8A%A1%E5%8F%98%E7%9A%84%E5%A4%8D%E6%9D%82%EF%BC%8C%E4%BD%86%E6%98%AF%E8%A7%A3%E9%87%8A%E5%92%8C%E8%AF%81%E6%98%8E%E5%A2%9E%E5%8A%A0%E4%BA%86%E8%BF%99%E7%A7%8D%E5%A4%8D%E6%9D%82%E6%80%A7%EF%BC%8C%E5%A6%82%E4%BD%95%E8%AE%A9AI%E8%A7%A3%E5%86%B3%E5%A4%8D%E6%9D%82%E9%97%AE%E9%A2%98%EF%BC%9F%0A%60%60%60%0A**4.%E4%BA%BA%E5%B7%A5%E6%99%BA%E8%83%BD%E9%97%AE%E9%A2%98%E7%9A%84%E7%89%B9%E7%82%B9**%0A%60%60%60%0A1.%E5%9C%A8%E8%AE%B8%E5%A4%9AAI%E9%97%AE%E9%A2%98%E4%B8%AD%EF%BC%8C%E6%95%B0%E6%8D%AE%E6%98%AF%E9%99%86%E7%BB%AD%E5%87%BA%E7%8E%B0%E7%9A%84%EF%BC%8C%E8%80%8C%E4%B8%8D%E6%98%AF%E4%B8%80%E5%BC%80%E5%A7%8B%E5%B0%B1%E6%9C%89%E6%89%80%E6%9C%89%E7%9A%84%E6%95%B0%E6%8D%AE%0A2.%E9%97%AE%E9%A2%98%E5%BE%80%E5%BE%80%E4%BC%9A%E9%87%8D%E5%A4%8D%E5%87%BA%E7%8E%B0%EF%BC%8C%E5%90%8C%E7%B1%BB%E9%97%AE%E9%A2%98%E4%B8%80%E5%86%8D%E5%87%BA%E7%8E%B0%0A3.%E9%97%AE%E9%A2%98%E5%9C%A8%E8%AE%B8%E5%A4%9A%E4%B8%8D%E5%90%8C%E7%9A%84%E6%8A%BD%E8%B1%A1%E5%B1%82%E9%9D%A2%E4%B8%8A%E5%87%BA%E7%8E%B0%0A4.%E8%AE%B8%E5%A4%9A%E5%BC%95%E4%BA%BA%E5%85%B3%E6%B3%A8%E7%9A%84AI%E9%97%AE%E9%A2%98%E9%9A%BE%E4%BB%A5%E9%80%9A%E8%BF%87%E8%AE%A1%E7%AE%97%E6%9D%A5%E8%A7%A3%E5%86%B3%0A5.%E5%A4%96%E7%95%8C%E6%98%AF%E5%8A%A8%E6%80%81%E7%9A%84%EF%BC%8C%E5%AE%83%E4%B8%8D%E6%96%AD%E5%8F%98%E5%8C%96%EF%BC%8C%E4%BD%86%E6%98%AF%E6%9C%89%E5%85%B3%E5%A4%96%E7%95%8C%E7%9A%84%E7%9F%A5%E8%AF%86%E6%98%AF%E7%9B%B8%E5%AF%B9%E4%B8%8D%E5%8F%98%E7%9A%84%0A6.%E5%A4%96%E7%95%8C%E6%98%AF%E5%BC%80%E6%94%BE%E5%BC%8F%E7%9A%84%EF%BC%8C%E4%BD%86%E6%98%AF%E6%9C%89%E5%85%B3%E5%A4%96%E7%95%8C%E7%9A%84%E9%97%AE%E9%A2%98%E6%98%AF%E6%9C%89%E9%99%90%E7%9A%84%0A%60%60%60%0A**5.%E4%BA%BA%E5%B7%A5%E6%99%BA%E8%83%BD%E5%92%8C%E4%B8%8D%E7%A1%AE%E5%AE%9A%E6%80%A7**%0A%60%60%60%0A1.%E4%BC%A0%E6%84%9F%E5%99%A8%E6%97%A0%E6%B3%95%E8%AF%86%E5%88%AB%E7%B3%BB%E7%BB%9F%E4%BB%A5%E5%A4%96%E7%9A%84%E4%BF%A1%E6%81%AF%0A2.%E5%AF%B9%E6%89%8B%E9%99%90%E5%88%B6%E4%BF%A1%E6%81%AF%0A3.%E4%BF%A1%E6%81%AF%E7%9A%84%E9%9A%8F%E6%9C%BA%E6%80%A7%E6%97%A0%E6%B3%95%E9%A2%84%E6%B5%8B%0A4.%E8%AE%A1%E7%AE%97%E6%9C%BA%E8%BF%90%E7%AE%97%E8%83%BD%E5%8A%9B%E9%99%90%E5%88%B6%0A5.%E5%85%A8%E7%84%B6%E6%97%A0%E7%9F%A5%E6%83%85%E5%86%B5%0A%60%60%60%0A**6.%E6%9C%89%E5%93%AA%E4%BA%9B%E4%BA%BA%E5%B7%A5%E6%99%BA%E8%83%BD%E9%97%AE%E9%A2%98**%0A!%5Bbba9a479a3886896e64e40a791679cd0.png%5D(en-resource%3A%2F%2Fdatabase%2F1210%3A1)%0A%0A**8.%E4%BB%80%E4%B9%88%E6%98%AF%E5%9F%BA%E4%BA%8E%E7%9F%A5%E8%AF%86%E7%9A%84%E4%BA%BA%E5%B7%A5%E6%99%BA%E8%83%BD%EF%BC%9F**%0A%60%60%60%0A%E5%9F%BA%E4%BA%8E%E7%9F%A5%E8%AF%86%E7%9A%84%E4%B8%89%E4%B8%AA%E5%9F%BA%E6%9C%AC%E8%BF%87%E7%A8%8B%0A1.%E6%8E%A8%E7%90%86%0A2.%E5%AD%A6%E4%B9%A0%0A3.%E8%AE%B0%E5%BF%86%0A%60%60%60%0A**9.%E4%BA%BA%E5%B7%A5%E6%99%BA%E8%83%BD%E7%9A%84%E5%9B%9B%E4%B8%AA%E5%AD%A6%E6%B4%BE**%0AAcademic%7CApplication%7C%0A----------%7C------------%7C%0AThinking%7Csemantic%20web%7C%0Aacting%7Cairplane%C2%A0autopilot%7C%0Aoptimally%7Cmachine%C2%A0learning%7C%0Alike%C2%A0humans%7Cimprovisational%C2%A0robots%7C%0A!%5Bbf607ab0c238e637e2ab8f7d629b81a0.png%5D(en-resource%3A%2F%2Fdatabase%2F1212%3A1)%0A%0A**10.%E4%BB%80%E4%B9%88%E6%98%AF%E5%9F%BA%E4%BA%8E%E7%9F%A5%E8%AF%86%E7%9A%84%E4%BA%BA%E5%B7%A5%E6%99%BA%E8%83%BD**%0A%E8%A7%82%E5%AF%9F%E4%BA%BA%E7%B1%BB%E7%9A%84%E8%A1%8C%E4%B8%BA%E5%8F%AF%E4%BB%A5%E5%B8%AE%E5%8A%A9%E6%88%91%E4%BB%AC%E8%AE%BE%E8%AE%A1%E4%B8%80%E4%B8%AA%E6%9C%BA%E5%99%A8%E4%BA%BA%E8%A7%82%E5%AF%9F%E6%9C%BA%E5%99%A8%E4%BA%BA%E8%AE%BE%E8%AE%A1%E5%8F%AF%E4%BB%A5%E5%B8%AE%E5%8A%A9%E8%AF%86%E5%88%AB%E4%BA%BA%E7%B1%BB%E7%9A%84%E8%AE%A4%E7%9F%A5%E6%A8%A1%E5%BC%8F%0A**12.%E8%B4%9D%E5%8F%B6%E6%96%AF%E5%85%AC%E5%BC%8F**%0A%E8%B4%9D%E5%8F%B6%E6%96%AF%E6%8F%8F%E8%BF%B0%EF%BC%9A%0AP(A%7CB)%E4%B8%ADB%E6%98%AF%E5%B7%B2%E7%9F%A5%E4%BA%8B%E4%BB%B6%EF%BC%8CA%E6%98%AF%E6%88%91%E4%BB%AC%E5%85%B3%E5%BF%83%E7%9A%84%E5%8F%98%E9%87%8F%0A%24%24P(A%7CB)%3D%5Cfrac%7BP(B%7CA)%20%5Ccdot%5C%20P(A)%7D%7BP(B)%7D%24%24%0A%0A**24.%E6%9C%BA%E5%99%A8%E5%AD%A6%E4%B9%A0%E7%9A%84%E5%AE%9A%E4%B9%89**%0A%60%60%60%0A%E4%BB%80%E4%B9%88%E6%98%AF%E6%9C%BA%E5%99%A8%E5%AD%A6%E4%B9%A0%EF%BC%9F%0A%E8%AE%A1%E7%AE%97%E5%BA%94%E7%94%A8%E7%BB%9F%E8%AE%A1%E5%AD%A6%0A%60%60%60%0A**25.%E7%9B%91%E7%9D%A3%E5%AD%A6%E4%B9%A0**%0A%60%60%60%0A%E7%9B%91%E7%9D%A3%E5%AD%A6%E4%B9%A0%EF%BC%9A%E8%8E%B7%E5%8F%96%E5%B7%B2%E7%BB%8F%E6%A0%87%E8%AE%B0%E7%9A%84%E6%95%B0%E6%8D%AE%E9%9B%86%EF%BC%8C%E9%80%9A%E8%BF%87%E6%94%B6%E9%9B%86%E4%BF%A1%E6%81%AF%E4%BB%A5%E4%BE%BF%E6%A0%87%E8%AE%B0%E6%96%B0%E7%9A%84%E6%95%B0%E6%8D%AE%E9%9B%86(%E5%87%BD%E6%95%B0%E9%80%BC%E8%BF%91)%0A%60%60%60%0A**26.%E9%9D%9E%E7%9B%91%E7%9D%A3%E5%AD%A6%E4%B9%A0**%0A%60%60%60%0A%E6%B2%A1%E6%9C%89%E6%A0%B7%E6%9C%AC%EF%BC%8C%E5%8F%AA%E6%9C%89%E8%BE%93%E5%85%A5%E7%9A%84%E5%85%B3%E7%B3%BB%EF%BC%8C%E5%8F%AA%E8%83%BD%E9%80%9A%E8%BF%87%E6%9F%A5%E7%9C%8B%E8%BE%93%E5%85%A5%E6%9C%AC%E8%BA%AB%E7%9A%84%E5%85%B3%E7%B3%BB%E6%9D%A5%E6%8E%A8%E5%AF%BC%E5%87%BA%E6%9F%90%E4%BA%9B%E7%BB%93%E6%9E%84(%E7%AE%80%E6%B4%81%E7%9A%84%E5%BD%B1%E5%93%8D%E6%8F%8F%E8%BF%B0)%E3%80%82%0A%60%60%60%0A%60%60%60mermaid%0Agraph%20TD%0AA%5B%E8%BE%93%E5%85%A5A%5D%20--%3E%7C%E6%9D%A1%E4%BB%B61%7C%20B%5B%E8%BE%93%E5%87%BAB%5D%0AA%5B%E8%BE%93%E5%85%A5A%5D%20--%3E%7C%E6%9D%A1%E4%BB%B62%7C%20C%5B%E8%BE%93%E5%87%BAC%5D%0A%60%60%60%0A**27.%E5%BC%BA%E5%8C%96%E5%AD%A6%E4%B9%A0**%0A%60%60%60%0A%E5%BC%BA%E5%8C%96%E5%AD%A6%E4%B9%A0%E5%B8%B8%E5%B8%B8%E8%A2%AB%E6%8F%8F%E8%BF%B0%E4%B8%BA%E9%80%9A%E8%BF%87%E5%BB%B6%E8%BF%9F%E5%A5%96%E8%B5%8F(reward)%E8%BF%9B%E8%A1%8C%E5%AD%A6%E4%B9%A0%EF%BC%8C%E5%BC%BA%E5%8C%96%E5%AD%A6%E4%B9%A0%E7%9A%84%E5%8F%8D%E9%A6%88%E5%8F%AF%E8%83%BD%E6%98%AF%E4%BD%A0%E5%AE%9E%E9%99%85%E5%81%9A%E5%87%BA%E5%86%B3%E7%AD%96%E5%90%8E%E7%BB%8F%E8%BF%87%E5%87%A0%E4%B8%AA%E6%AD%A5%E9%AA%A4%E6%89%8D%E4%BA%A7%E7%94%9F%E7%9A%84%E3%80%82%0A%60%60%60%0A**28.%E5%BD%92%E7%BA%B3%E6%B3%95%E4%B8%8E%E6%BC%94%E7%BB%8E%E6%B3%95**%0A%60%60%60%0A%E6%89%80%E6%9C%89%E7%9A%84%E6%9C%BA%E5%99%A8%E5%AD%A6%E4%B9%A0%E9%83%BD%E6%98%AF%E4%B8%80%E7%A7%8D%E5%BD%92%E7%BA%B3%E6%B3%95%E8%80%8C%E4%B8%8D%E6%98%AF%E6%BC%94%E7%BB%8E%E6%B3%95%0A%E5%BD%92%E7%BA%B3%E6%98%AF%E4%BB%8E%E4%B8%80%E4%B8%AA%E7%A4%BA%E4%BE%8B%E5%BE%97%E5%87%BA%E6%9B%B4%E6%99%AE%E9%81%8D%E8%A7%84%E5%88%99%E7%9A%84%E9%97%AE%E9%A2%98%0A%E6%BC%94%E7%BB%8E%E6%98%AF%E4%BB%8E%E6%99%AE%E9%80%9A%E8%A7%84%E5%88%99%E5%BE%97%E5%88%B0%E7%BB%93%E6%9E%9C%0A%60%60%60%0A**29.%E5%BD%92%E7%BA%B3%E6%B3%95%E3%80%81%E6%BC%94%E7%BB%8E%E6%B3%95%E4%B8%8E%E6%BA%AF%E5%9B%A0%E6%B3%95**%0A%60%60%60mermaid%0Agraph%20TD%0ARule(Rule)--%3ECause(Cause)%0ARule(Rule)--%3EEffect(Effect)%0A%60%60%60%0A%E8%AF%8A%E6%96%AD%E5%B0%B1%E6%98%AF%E6%BA%AF%E5%9B%A0%E6%B3%95%E7%9A%84%E5%AE%9E%E4%BE%8B%EF%BC%8C%E5%BD%92%E7%BA%B3%E6%B3%95%E4%B8%8D%E8%83%BD%E4%BF%9D%E8%AF%81%E7%BB%93%E6%9E%9C%E6%98%AF%E5%90%A6%E9%80%82%E7%94%A8%E4%BA%8E%E6%95%B4%E4%B8%AA%E6%95%B4%E4%BD%93%EF%BC%8C%E6%BA%AF%E5%9B%A0%E6%B3%95%E4%B9%9F%E6%98%AF%E4%B8%80%E6%A0%B7%E3%80%82%0A%E6%8E%A2%E5%AF%BB%E4%B8%80%E4%B8%AA%E7%BB%93%E6%9E%9C%E6%98%AF%E5%90%A6%E6%AD%A3%E7%A1%AE%E7%9A%84%E8%BF%87%E7%A8%8B%E5%B0%B1%E6%98%AF%EF%BC%8C%E8%BF%BD%E6%BA%AF-%3E%E5%BD%92%E7%BA%B3-%3E%E6%BC%94%E7%BB%8E%E4%B8%8D%E6%96%AD%E5%BE%AA%E7%8E%AF%E7%9A%84%E8%BF%87%E7%A8%8B%0A**35.%E5%88%86%E7%B1%BB%E6%B3%95**%0A%E5%8F%82%E6%95%B0%E3%80%81%E6%95%B0%E6%8D%AE%E7%BB%93%E6%9E%84%E3%80%81%E9%9A%90%E5%90%AB%E6%A6%82%E5%BF%B5%0A%E6%95%B0%E6%8D%AE%E6%A0%87%E8%AE%B0%E3%80%81%E6%95%B0%E6%8D%AE%E6%A0%87%E8%AE%B0%E7%BC%BA%E5%A4%B1%E3%80%81%E5%8F%8D%E9%A6%88%0A%E9%A2%84%E6%B5%8B%E3%80%81%E5%85%B3%E6%B3%A8%E4%BA%8B%E4%BB%B6%E3%80%81%E4%B8%BB%E5%8A%A8%E6%80%A7%E3%80%81%E8%A2%AB%E5%8A%A8%E6%80%A7%0A%E5%88%86%E7%B1%BB%E4%B8%8E%E5%9B%9E%E5%BD%92%0Awhat%7Cwhat%20from%7Cwhat%20for%7Chow%7Coutput%7Cdetail%7C%0A----%7C----%7C----%7C----%7C----%7C----%7C----%7C%0Aparameter%7Csupervised%7Cprediction%7Cpassive%7Cclassification%7Cgenerative%7C%0Ahidden%7Cunsupervised%7Cdiagnose%20%7C%20active%7Cregression%20%7Cdiscriminative%20%7C%0Acertain%7Creinforcement%20%7Csummarize%20%7Conline%20%7C%20%7C%20%7C%0Aparameter%7C%20%7C%20%7Coffline%20%7C%20%7C%20%7C%0A%0A*%20*%20*%0A**36.%E7%9B%91%E7%9D%A3%E5%AD%A6%E4%B9%A0**%0A%E5%9C%A8%E7%9B%91%E7%9D%A3%E5%AD%A6%E4%B9%A0%E4%B8%AD%EF%BC%8C%E6%AF%8F%E4%B8%80%E4%B8%AA%E7%89%B9%E5%BE%81%E5%AE%9E%E4%BE%8B%E9%83%BD%E6%8F%90%E4%BE%9B%E4%BA%86%E4%B8%80%E4%B8%AA%E7%89%B9%E5%BE%81%E5%90%91%E9%87%8F%EF%BC%8C%E4%BB%A5%E5%8F%8A%E4%BB%A5Y%E5%91%BD%E5%90%8D%E7%9A%84%E7%9B%AE%E6%A0%87%E7%AC%A6%E5%8F%B7%0A%5BOccams%20Razor%5D(https%3A%2F%2Fsimple.wikipedia.org%2Fwiki%2FOccam%2527s_razor)%0A%E5%A5%A5%E5%8D%A1%E5%A7%86%E5%89%83%E5%88%80%E5%AE%9A%E5%BE%8B%EF%BC%9A%E5%9C%A8%E5%85%B6%E4%BB%96%E6%9D%A1%E4%BB%B6%E4%B8%80%E6%A0%B7%E7%9A%84%E6%83%85%E5%86%B5%E4%B8%8B%EF%BC%8C%E9%80%89%E6%8B%A9%E8%BE%83%E4%B8%8D%E5%A4%8D%E6%9D%82%E7%9A%84%E5%81%87%E8%AE%BE%0A**38.%E5%88%86%E7%B1%BB%E5%92%8C%E5%9B%9E%E5%BD%92**%0A%E5%88%86%E7%B1%BB%E7%9A%84%E7%89%B9%E7%82%B9%E6%98%AF%E7%9B%AE%E6%A0%87%E6%A0%87%E7%AD%BE%E6%88%96%E7%9B%AE%E6%A0%87%E7%B1%BB%E6%98%AF%E7%A6%BB%E6%95%A3%E7%9A%84%0A%E5%9B%9E%E5%BD%92%E9%97%AE%E9%A2%98%E4%B8%8E%E5%88%86%E7%B1%BB%E9%97%AE%E9%A2%98%E6%9C%89%E6%9C%AC%E8%B4%A8%E4%B8%8A%E7%9A%84%E5%8C%BA%E5%88%AB%EF%BC%8C%E6%B8%A9%E5%BA%A6%E6%98%AF%E4%B8%80%E4%B8%AA%E8%BF%9E%E7%BB%AD%E5%80%BC%EF%BC%8C%E6%88%91%E4%BB%AC%E7%9A%84%E8%B4%9D%E5%8F%B6%E6%96%AF%E7%BD%91%E7%BB%9C%E4%B8%8D%E8%83%BD%E9%A2%84%E6%B5%8B%E6%B8%A9%E5%BA%A6%EF%BC%8C%E8%80%8C%E5%8F%AA%E8%83%BD%E9%A2%84%E6%B5%8B%E7%A6%BB%E6%95%A3%E7%B1%BB%0A**39.%E7%BA%BF%E6%80%A7%E5%9B%9E%E5%BD%92**%0A%24%24f(x)%3Dw_1x%2Bw_0%24%24%0A**40.%E6%9B%B4%E5%A4%9A%E7%BA%BF%E6%80%A7%E5%9B%9E%E5%BD%92**%0A%E6%8D%9F%E5%A4%B1%E5%87%BD%E6%95%B0%0A%24%24loss%3D%0A%5Csum_j(y_j-w_1x_j-w_0)%5E2%0A%24%24%0A%0A%0A%0A%0A%0A%0A