1. 程式人生 > 其它 >通過剖析原始碼單步除錯詳解MapReduce分組group遍歷

通過剖析原始碼單步除錯詳解MapReduce分組group遍歷

通過剖析原始碼單步除錯詳解MapReduce分組group遍歷

通過剖析原始碼單步除錯詳解MapReduce分組group遍歷:
馬克-to-win @ 馬克java社群:mapreduce的group知識點是最難理解的,本小節將通過仔細剖析原始碼,單步除錯,來詳解之。
另外注意:資料檔案寫時一定注意:結尾不能有回車和空格,通過在map裡面加斷點,F8(resume),一輪一輪,除錯一行一行的資料,才發現最後一行資料出毛病了,只有是多了一個換行符的毛病。

package com;
import org.apache.hadoop.io.WritableComparable;
import java.io.DataInput;
import java.io.DataOutput;
import java.io.IOException;

public class OrderBean implements WritableComparable<OrderBean>{
private String orderId;
private Double amount;

public OrderBean() {
}

public OrderBean(String orderId, Double amount) {
this.orderId = orderId;
this.amount = amount;
}
public void set(String orderId, Double amount) {
this.orderId = orderId;
this.amount = amount;
}
public String getOrderId() {
return orderId;
}

public void setOrderId(String orderId) {
this.orderId = orderId;
}

public Double getAmount() {
return amount;
}

public void setAmount(Double amount) {
this.amount = amount;
}

@Override
public int compareTo(OrderBean o) {
/*馬克-to-win: 如orderId相等,則比較amount,否則比較id即可,這樣id相同的連在一起了。因為id先比,amount後比*/
int cmp = this.getOrderId().compareTo(o.getOrderId());

更多內容請見原文,文章轉載自:

https://blog.csdn.net/qq_44594249/article/details/97616735