Caused by: java.lang.RuntimeException: Can‘t parse input data: ‘碩士19.64294.6515‘
阿新 • • 發佈:2020-12-27
使用sqoop向mysql匯入資料出現了問題
20/12/25 16:03:30 INFO mapreduce.Job: Task Id : attempt_1608882642389_0001_m_000000_2, Status : FAILED
Error: java.io.IOException: Can't export data, please check failed map task logs
at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:112)
at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:39)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at org.apache.hadoop.mapred.YarnChild$2 .run(YarnChild.java:164)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1762)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
Caused by: java.lang.RuntimeException: Can' t parse input data: '碩士19.64294.6515'
at education.__loadFromFields(education.java:335)
at education.parse(education.java:268)
at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:83)
... 10 more
Caused by: java.util.NoSuchElementException
at java.util.ArrayList$Itr.next(ArrayList.java:862)
at education.__loadFromFields(education.java:320)
... 12 more
結果我去看hive中的資料是這樣的,不能用\t分割
解決方案
使用\001分隔符