temp ide 屬性 增加 mes 時間 kerberos 動態更新 lap

14/04/04 17:15:12 INFO mapreduce.Job: map 0% reduce 0% 14/04/04 17:19:42 INFO mapreduce.Job: map 41% reduce 0% 14/04/04 17:19:53 INFO mapreduce.Job: map 64% reduce 0% 14/04/04 17:19:55 INFO mapreduce.Job: map 52% reduce 0% 14/04/04 17:19:57 INFO mapreduce.Job: map 25% reduce 0% 14/04/04 17:20:00 INFO mapreduce.Job: map 36% reduce 0% 14/04/04 17:20:00 INFO mapreduce.Job: Task Id : attempt_1396530865591_0003_m_000011_0, Status : FAILED 14/04/04 17:20:05 INFO mapreduce.Job: Task Id : attempt_1396530865591_0003_m_000012_0, Status : FAILED 14/04/04 17:20:05 INFO mapreduce.Job: Task Id : attempt_1396530865591_0003_m_000014_0, Status : FAILED 14/04/04 17:20:05 INFO mapreduce.Job: Task Id : attempt_1396530865591_0003_m_000015_0, Status : FAILED 14/04/04 17:20:05 INFO mapreduce.Job: Task Id : attempt_1396530865591_0003_m_000008_0, Status : FAILED 14/04/04 17:20:05 INFO mapreduce.Job: Task Id : attempt_1396530865591_0003_m_000005_0, Status : FAILED 14/04/04 17:20:05 INFO mapreduce.Job: Task Id : attempt_1396530865591_0003_m_000004_0, Status : FAILED 14/04/04 17:20:05 INFO mapreduce.Job: Task Id : attempt_1396530865591_0003_m_000007_0, Status : FAILED 14/04/04 17:20:05 INFO mapreduce.Job: Task Id : attempt_1396530865591_0003_m_000006_0, Status : FAILED 14/04/04 17:20:06 INFO mapreduce.Job: map 47% reduce 0% 14/04/04 17:20:16 INFO mapreduce.Job: map 48% reduce 0% 14/04/04 17:20:46 INFO mapreduce.Job: map 50% reduce 0% 14/04/04 17:20:47 INFO mapreduce.Job: map 52% reduce 0% 14/04/04 17:20:49 INFO mapreduce.Job: map 53% reduce 0% 14/04/04 17:21:21 INFO mapreduce.Job: map 55% reduce 0% 14/04/04 17:21:25 INFO mapreduce.Job: map 56% reduce 0% 14/04/04 17:21:26 INFO mapreduce.Job: map 59% reduce 0% 14/04/04 17:26:20 INFO mapreduce.Job: map 62% reduce 0% 14/04/04 17:26:32 INFO mapreduce.Job: map 67% reduce 0% 14/04/04 17:26:44 INFO mapreduce.Job: map 68% reduce 0% 14/04/04 17:27:10 INFO mapreduce.Job: map 70% reduce 0% 14/04/04 17:27:30 INFO mapreduce.Job: map 71% reduce 0% 14/04/04 17:27:52 INFO mapreduce.Job: map 74% reduce 2% 14/04/04 17:27:57 INFO mapreduce.Job: map 75% reduce 2% 14/04/04 17:27:59 INFO mapreduce.Job: map 79% reduce 2% 14/04/04 17:28:01 INFO mapreduce.Job: map 80% reduce 2% 14/04/04 17:28:02 INFO mapreduce.Job: map 81% reduce 2% 14/04/04 17:28:05 INFO mapreduce.Job: map 83% reduce 2% 14/04/04 17:28:17 INFO mapreduce.Job: map 84% reduce 2% 14/04/04 17:28:26 INFO mapreduce.Job: map 84% reduce 3% 14/04/04 17:28:29 INFO mapreduce.Job: map 85% reduce 3% 14/04/04 17:28:38 INFO mapreduce.Job: map 85% reduce 5% 14/04/04 17:28:52 INFO mapreduce.Job: map 86% reduce 5% 14/04/04 17:29:00 INFO mapreduce.Job: map 88% reduce 5% 14/04/04 17:29:12 INFO mapreduce.Job: map 89% reduce 5% 14/04/04 17:29:22 INFO mapreduce.Job: map 90% reduce 5% 14/04/04 17:29:29 INFO mapreduce.Job: map 91% reduce 5% 14/04/04 17:29:37 INFO mapreduce.Job: map 92% reduce 5% 14/04/04 17:29:45 INFO mapreduce.Job: map 93% reduce 5% 14/04/04 17:29:56 INFO mapreduce.Job: map 94% reduce 6% 14/04/04 17:30:00 INFO mapreduce.Job: map 95% reduce 6% 14/04/04 17:30:01 INFO mapreduce.Job: map 95% reduce 8% 14/04/04 17:30:10 INFO mapreduce.Job: map 97% reduce 8% 14/04/04 17:30:16 INFO mapreduce.Job: map 97% reduce 11% 14/04/04 17:30:23 INFO mapreduce.Job: map 98% reduce 11% 14/04/04 17:30:37 INFO mapreduce.Job: map 98% reduce 12% 14/04/04 17:30:55 INFO mapreduce.Job: map 98% reduce 17% 14/04/04 17:30:58 INFO mapreduce.Job: map 98% reduce 20% 14/04/04 17:31:04 INFO mapreduce.Job: map 98% reduce 21% 14/04/04 17:31:07 INFO mapreduce.Job: map 98% reduce 26% 14/04/04 17:31:10 INFO mapreduce.Job: map 98% reduce 32% 14/04/04 17:31:13 INFO mapreduce.Job: map 100% reduce 32% 14/04/04 17:31:19 INFO mapreduce.Job: map 100% reduce 38% 14/04/04 17:31:22 INFO mapreduce.Job: map 100% reduce 49% 14/04/04 17:31:25 INFO mapreduce.Job: map 100% reduce 67% 14/04/04 17:31:31 INFO mapreduce.Job: map 100% reduce 68% 14/04/04 17:31:34 INFO mapreduce.Job: map 100% reduce 70% 14/04/04 17:31:37 INFO mapreduce.Job: map 100% reduce 71% 14/04/04 17:31:40 INFO mapreduce.Job: map 100% reduce 73% 14/04/04 17:31:44 INFO mapreduce.Job: map 100% reduce 75% 14/04/04 17:31:47 INFO mapreduce.Job: map 100% reduce 77% 14/04/04 17:31:50 INFO mapreduce.Job: map 100% reduce 78% 14/04/04 17:31:53 INFO mapreduce.Job: map 100% reduce 80% 14/04/04 17:31:56 INFO mapreduce.Job: map 100% reduce 82% 14/04/04 17:31:58 INFO mapreduce.Job: map 100% reduce 84% 14/04/04 17:32:01 INFO mapreduce.Job: map 100% reduce 85% 14/04/04 17:32:04 INFO mapreduce.Job: map 100% reduce 87% 14/04/04 17:32:07 INFO mapreduce.Job: map 100% reduce 89% 14/04/04 17:32:10 INFO mapreduce.Job: map 100% reduce 91% 14/04/04 17:32:13 INFO mapreduce.Job: map 100% reduce 93% 14/04/04 17:32:16 INFO mapreduce.Job: map 100% reduce 95% 14/04/04 17:32:19 INFO mapreduce.Job: map 100% reduce 96% 14/04/04 17:32:22 INFO mapreduce.Job: map 100% reduce 98% 14/04/04 17:32:25 INFO mapreduce.Job: map 100% reduce 100% 14/04/04 17:32:34 INFO mapred.ClientServiceDelegate: Application state is completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history server 14/04/04 17:32:35 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:10020. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS) 14/04/04 17:32:36 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:10020. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS) 14/04/04 17:32:37 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:10020. Already tried 2 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS) 14/04/04 17:32:38 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:10020. Already tried 3 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS) 14/04/04 17:32:39 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:10020. Already tried 4 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS) 14/04/04 17:32:40 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:10020. Already tried 5 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS) 14/04/04 17:32:41 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:10020. Already tried 6 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS) 14/04/04 17:32:42 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:10020. Already tried 7 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS) 14/04/04 17:32:43 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:10020. Already tried 8 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS) 14/04/04 17:32:44 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:10020. Already tried 9 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS) 14/04/04 17:32:44 INFO mapred.ClientServiceDelegate: Application state is completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history server 14/04/04 17:32:45 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:10020. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS) 14/04/04 17:32:46 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:10020. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS) 14/04/04 17:32:47 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:10020. Already tried 2 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS) 14/04/04 17:32:48 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:10020. Already tried 3 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS) 14/04/04 17:32:49 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:10020. Already tried 4 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS) 14/04/04 17:32:50 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:10020. Already tried 5 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS) 14/04/04 17:32:51 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:10020. Already tried 6 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS) 14/04/04 17:32:52 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:10020. Already tried 7 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS) 14/04/04 17:32:53 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:10020. Already tried 8 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS) 14/04/04 17:32:54 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:10020. Already tried 9 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS) 14/04/04 17:32:54 INFO mapred.ClientServiceDelegate: Application state is completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history server 14/04/04 17:32:55 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:10020. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS) 14/04/04 17:32:56 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:10020. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS) 14/04/04 17:32:57 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:10020. Already tried 2 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS) 14/04/04 17:32:58 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:10020. Already tried 3 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS) 14/04/04 17:32:59 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:10020. Already tried 4 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS) 14/04/04 17:33:00 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:10020. Already tried 5 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS) 14/04/04 17:33:01 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:10020. Already tried 6 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS) 14/04/04 17:33:02 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:10020. Already tried 7 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS) 14/04/04 17:33:03 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:10020. Already tried 8 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS) 14/04/04 17:33:04 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:10020. Already tried 9 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS) 14/04 /04 17:33:05 ERROR security.UserGroupInformation: PriviledgedActionException as:hadoop (auth:SIMPLE) cause:java.io.IOException: java.net.ConnectException: Call From sjfx /192.168.52.170 to 0.0.0.0:10020 failed on connection exception: java.net.ConnectException: 拒 絕連接; For more details see: http://wiki.apache.org/hadoop /ConnectionRefused Exception in thread "main" java.io.IOException: java.net.ConnectException: Call From sjfx/192.168.52.170 to 0.0.0.0:10020 failed on connection exception: java.net.ConnectException: 拒 絕連接; For more details see: http://wiki.apache.org/hadoop /ConnectionRefused at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:331) at org.apache.hadoop.mapred.ClientServiceDelegate.getTaskCompletionEvents(ClientServiceDelegate.java:383) at org.apache.hadoop.mapred.YARNRunner.getTaskCompletionEvents(YARNRunner.java:529) at org.apache.hadoop.mapreduce.Job$5.run(Job.java:668) at org.apache.hadoop.mapreduce.Job$5.run(Job.java:665) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491) at org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:665) at org.apache.hadoop.mapreduce.Job.monitorAndPrintJob(Job.java:1349) at org.apache.hadoop.mapred.JobClient$NetworkedJob.monitorAndPrintJob(JobClient.java:407) at org.apache.hadoop.mapred.JobClient.monitorAndPrintJob(JobClient.java:855) at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:835) at com.fiveone.game.GameLoginLog.main(GameLoginLog.java:38) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.main(RunJar.java:212) Caused by: java.net.ConnectException: Call From sjfx/192.168.52.170 to 0.0.0.0:10020 failed on connection exception: java.net.ConnectException: 拒 絕連接; For more details see: http://wiki.apache.org/hadoop /ConnectionRefused at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:783) at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:730) at org.apache.hadoop.ipc.Client.call(Client.java:1351) at org.apache.hadoop.ipc.Client.call(Client.java:1300) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:206) at com.sun.proxy.$Proxy12.getTaskAttemptCompletionEvents(Unknown Source) at org.apache.hadoop.mapreduce.v2.api.impl.pb.client.MRClientProtocolPBClientImpl.getTaskAttemptCompletionEvents(MRClientProtocolPBClientImpl.java:177) at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:317) ... 18 more Caused by: java.net.ConnectException: 拒絕連接 at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:735) at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206) at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:529) at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:493) at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:547) at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:642) at org.apache.hadoop.ipc.Client$Connection.access$2600(Client.java:314) at org.apache.hadoop.ipc.Client.getConnection(Client.java:1399) at org.apache.hadoop.ipc.Client.call(Client.java:1318) ... 26 more 1、14/04/04 17:32:35 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:10020. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS) 這個問題是由於沒有啟動historyserver引起的，解決辦法： 在mapred-site.xml配置文件中添加： <property> <name>mapreduce.jobhistory.address</name> <value>sjfx:10020</value> </property> 在namenode上執行命令：mr-jobhistory-daemon.sh start historyserver 這樣在，namenode上會啟動JobHistoryServer服務，可以在historyserver的日誌中查看運行情況 2、14/04/04 17:20:00 INFO mapreduce.Job: Task Id : attempt_1396530865591_0003_m_000011_0, Status : FAILED 出現這個問題可能是由於集群性能瓶頸造成的（IO或網絡問題等等） 之前在臺式機上虛擬出三個slave的集群，數據量稍微大點就會出現這個問題，後來換了臺服務器虛擬出兩個slave的集群，沒有出現這個問題。 3、mapreduce歷史作業管理器相關知識（出自：董成西《Hadoop技術內幕 深入解析yarn架構設計與實現原理》）： 為了方便用戶查看MapReduce歷史作業信息，MRAppMaster提供了一個JobHistoryServer服務，該服務主要由四個子服務組成，具體如下： a、HistoryClientService.為Web界面展示歷史作業信息提供後端實現，它通過調用JobHistory中的相關API獲取作業信息，比如提交時間、提交用戶、Counter值等，並將這些信息發送到前端。 b、HSAdminServer。管理員可使用“bin/mapred hsadmin” 命令動態更新JobHistoryServer訪問和管理權限信息。用戶輸入該命令後，後端的HSAdminService服務將執行該命令，當前該命令可動態更新以下幾種信息： ①管理員列表。歷史作業查看器的管理員列表（具有啟動和停止JobHistoryServer服務、更新權限信息等權限）是通過core-site.xml中的mapreduce.jobhistory.admin.acl屬性（默認是“*”,表示任何人都是管理員）設置的。 ②超級用戶組列表。超級用戶組信息是通過core-site.xml中的hadoop.proxyuser.groups和hadoop.proxyuser.hosts屬性設置的，超級用戶組是hadoop引入Kerberos安全機制後，為方便上層應用（比如HBase、Oozie等）訪問Hadoop內核服務而新增加的配置項。 ④用戶與用戶組映射關系。用戶與用戶組映射關系是通過core-site.xml中的hadoop.security.group.mapping屬性設置的，它需要是一個實現了GroupMappingServiceProvider接口的類，默認實現是ShellBasedUnixGroupsMapping，即采用Linux操作系統的用戶和用戶組映射關系。 c、AggregatedLogDeletionService。該服務周期性掃描所有歷史作業日誌目錄，如果一個日誌目錄存放時間超過yarn.nodemanager.log.retain-seconds（單位是秒，默認為3*60*60，即三個小時），則直接將其從HDFS上刪除。 d、JobHistory。該服務從HDFS上讀取MapReduce歷史作業日誌，並將其解析成格式化信息，供前端查看。MRAppMaster將執行完成的作業信息保存到mapreduce.jobhistory.intermediate-done-dir指定的目錄中，如果用戶未設置該屬性，則保存到${yarn.app.mapreduce.am.staging-dir}/history/done_intermediate目錄中，其中每個作業保存作業配置文件（後綴為.xml）和作業執行日誌（後綴為.jhist）兩個文件，通過解析作業執行日誌，JobHistory能獲取作業執行時的所有信息，包括作業提交時間、作業Counter、每個任務提交時間和運行時間、每個任務的Counter等。

[轉]hadoop運行mapreduce作業無法連接0.0.0.0/0.0.0.0:10020