ALINK(十四):資料處理(一)資料拆分 (SplitBatchOp)
阿新 • • 發佈:2021-06-15
Java 類名:com.alibaba.alink.operator.batch.dataproc.SplitBatchOp
Python 類名:SplitBatchOp
功能介紹
本運算元將輸入資料按比例拆分為兩部分。
引數說明
名稱 |
中文名稱 |
描述 |
型別 |
是否必須? |
預設值 |
fraction |
拆分到左端的資料比例 |
拆分到左端的資料比例 |
Double |
✓ |
|
randomSeed |
隨機數種子 |
隨機數種子 |
Integer |
null |
程式碼示例
Python 程式碼
from pyalink.alink import* import pandas as pd useLocalEnv(1) df_data = pd.DataFrame([['Ohio', 2000, 1.5], ['Ohio', 2001, 1.7], ['Ohio', 2002, 3.6], ['Nevada', 2001, 2.4], ['Nevada', 2002, 2.9], ['Nevada', 2003, 3.2],]) batch_data= BatchOperator.fromDataframe(df_data, schemaStr='f1 string, f2 bigint, f3 double') spliter = SplitBatchOp().setFraction(0.5) spliter.linkFrom(batch_data) spliter.print()
Java 程式碼
import org.apache.flink.types.Row; import com.alibaba.alink.operator.batch.BatchOperator; import com.alibaba.alink.operator.batch.dataproc.SplitBatchOp;import com.alibaba.alink.operator.batch.source.MemSourceBatchOp; import org.junit.Test; import java.util.Arrays; import java.util.List; public class SplitBatchOpTest { @Test public void testSplitBatchOp() throws Exception { List <Row> df_data = Arrays.asList( Row.of("Ohio", 2001, 1.7), Row.of("Ohio", 2002, 3.6), Row.of("Nevada", 2001, 2.4), Row.of("Nevada", 2002, 2.9) ); BatchOperator <?> batch_data = new MemSourceBatchOp(df_data, "f1 string, f2 int, f3 double"); BatchOperator <?> spliter = new SplitBatchOp().setFraction(0.5); spliter.linkFrom(batch_data); spliter.print(); } }