2. 程式人生 > >KYlin build cube時出現問題的彙總

KYlin build cube時出現問題的彙總

阿新 • • 發佈：2019-01-06

1.在單條非空資料時出現null值而導致報錯

Vertex failed, vertexName=Map 1, vertexId=vertex_1494251465823_0017_1_01, diagnostics=[Task failed, taskId=task_1494251465823_0017_1_01_000021, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:java.lang.RuntimeException: java.lang.RuntimeException: org.apache
 
.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row {"weibo_id":"3959784874733088","content":null,"json_file":null,"geohash":null,"user_id":"3190257607","time_id":null,"city_id":null,"province_id":null,"country_id":null,"unix_time":null,"pic_url":null,"lat":null,"lon":null}
    at org.apache
 
.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:173)
    at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:139)
    at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:347)
    at org.apache.tez.runtime
 
.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:194)
    at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:185)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:422)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724)
    at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:185)
    at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:181)
    at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
    at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
    at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row {"weibo_id":"3959784874733088","content":null,"json_file":null,"geohash":null,"user_id":"3190257607","time_id":null,"city_id":null,"province_id":null,"country_id":null,"unix_time":null,"pic_url":null,"lat":null,"lon":null}
    at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.processRow(MapRecordSource.java:91)
    at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.pushRecord(MapRecordSource.java:68)
    at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.run(MapRecordProcessor.java:325)
    at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:150)
    ... 14 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row {"weibo_id":"3959784874733088","content":null,"json_file":null,"geohash":null,"user_id":"3190257607","time_id":null,"city_id":null,"province_id":null,"country_id":null,"unix_time":null,"pic_url":null,"lat":null,"lon":null}
    at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:565)
    at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.processRow(MapRecordSource.java:83)
    ... 17 more

實際檢索Hive時發現該條微博是非空的

select * from check_in_table where weibo_id = '3959784874733088';

result:
3959784874733088    #清明祭英烈#今天的和平安定是先烈們用生命換來的，我們要珍惜今天的和平生活，努力學習，早日實現中國夢。 http://t.cn/R2dLEhU {...}   wtn901f5q32n    3190257607  1459526400000   1901    19    00    2016-04-02 12:02:26 0   28.31096    121.64364

修改星型模型得以解決

2.在Kylin Build時失敗，顯示了一個Hbase scan超時的錯誤

報錯如下：

Vertex re-running, vertexName=Map 2, vertexId=vertex_1494251465823_0016_1_00
Vertex failed, vertexName=Map 1, vertexId=vertex_1494251465823_0016_1_01, diagnostics=[Task failed, taskId=task_1494251465823_0016_1_01_000015, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: java.io.IOException: org.apache.hadoop.hbase.client.ScannerTimeoutException: 425752ms passed since the last invocation, timeout is currently set to 60000
    at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:173)
    at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:139)
    at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:347)
    at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:194)
    at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:185)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:422)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724)
    at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:185)
    at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:181)
    at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
    at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
    at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.io.IOException: org.apache.hadoop.hbase.client.ScannerTimeoutException: 425752ms passed since the last invocation, timeout is currently set to 60000
    at ...

解決方法：

1方法.通過修改conf

Configuration conf = HBaseConfiguration.create()
conf.setLong(HConstants.HBASE_REGIONSERVER_LEASE_PERIOD_KEY,120000)

通過程式碼實現修改 時間、這個值是在客戶端應用中配置的，我測試的時候是不會被傳遞到遠端region伺服器，所以這樣的修改是無效的、不知是否人通過這種測試。

2方法直接修改配置檔案

<property>
    <name>hbase.regionserver.lease.period</name>    
    <value>900000</value> 
    <!-- 900 000, 15 minutes -->  
</property>  
<property>    
    <name>hbase.rpc.timeout</name>    
    <value>900000</value> 
    <!-- 15 minutes -->  
</property>

3.#4 Step Name: Build Dimension Dictionary 時出現cardinality Too high

java.lang.RuntimeException: Failed to create dictionary on WEIBODATA.CHECK_IN_TABLE.USER_ID
    at org.apache.kylin.dict.DictionaryManager.buildDictionary(DictionaryManager.java:325)
    at org.apache.kylin.cube.CubeManager.buildDictionary(CubeManager.java:222)
    at org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:50)
    at org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:41)
    at org.apache.kylin.engine.mr.steps.CreateDictionaryJob.run(CreateDictionaryJob.java:54)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:90)
    at org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:63)
    at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:113)
    at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:57)
    at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:113)
    at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:136)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
    at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.IllegalArgumentException: Too high cardinality is not suitable for dictionary -- cardinality: 11824431
    at org.apache.kylin.dict.DictionaryGenerator.buildDictionary(DictionaryGenerator.java:96)
    at org.apache.kylin.dict.DictionaryGenerator.buildDictionary(DictionaryGenerator.java:73)
    at org.apache.kylin.dict.DictionaryManager.buildDictionary(DictionaryManager.java:321)
    ... 14 more

result code:2

解決方法
手動修改Cube(JSON)
如果不修改，精確Count Distinct使用了Default dictionary來儲存編碼後的user_id，而Default dictionary的最大容量為500萬，並且，會為每個Segment生成一個Default dictionary，這樣的話，跨天進行UV分析的時候，便會產生錯誤的結果，如果每天不重複的user_id超過500萬，那麼build的時候會報錯。

該值由引數 kylin.dictionary.max.cardinality 來控制，當然，你可以修改該值為1億，但是Build時候可能會因為記憶體溢位而導致Kylin Server掛掉。

Apache Kylin中對上億字串的精確Count_Distinct示例
由於Global Dictionary 底層基於bitmap，其最大容量為Integer.MAX_VALUE，即21億多，如果全域性字典中，累計值超過Integer.MAX_VALUE，那麼在Build時候便會報錯。

其他請按實際業務需求配置。
手動修改Cube(JSON)
如果不修改，精確Count Distinct使用了Default dictionary來儲存編碼後的user_id，而Default dictionary的最大容量為500萬，並且，會為每個Segment生成一個Default dictionary，這樣的話，跨天進行UV分析的時候，便會產生錯誤的結果，如果每天不重複的user_id超過500萬，那麼build的時候會報錯：
java.lang.IllegalArgumentException: Too high cardinality is not suitable for dictionary — cardinality: 43377845
at org.apache.kylin.dict.DictionaryGenerator.buildDictionary(DictionaryGenerator.java:96)
at org.apache.kylin.dict.DictionaryGenerator.buildDictionary(DictionaryGenerator.java:73)
該值由引數 kylin.dictionary.max.cardinality 來控制，當然，你可以修改該值為1億，但是Build時候可能會因為記憶體溢位而導致Kylin Server掛掉：

因此，這種需求我們需要手動使用Global Dictionary，顧名思義，它是一個全域性的字典，不分Segments，同一個user_id，在全域性字典中只有一個ID。

新增JSON欄位

4.Dup key found問題

java.lang.IllegalStateException: Dup key found, key=[24], value1=[1456243200000,2016,02,24,0,1456272000000], value2=[1458748800000,2016,03,24,0,1458777600000]
    at org.apache.kylin.dict.lookup.LookupTable.initRow(LookupTable.java:85)
    at org.apache.kylin.dict.lookup.LookupTable.init(LookupTable.java:68)
    at org.apache.kylin.dict.lookup.LookupStringTable.init(LookupStringTable.java:79)
    at org.apache.kylin.dict.lookup.LookupTable.<init>(LookupTable.java:56)
    at org.apache.kylin.dict.lookup.LookupStringTable.<init>(LookupStringTable.java:65)
    at org.apache.kylin.cube.CubeManager.getLookupTable(CubeManager.java:674)
    at org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:60)
    at org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:41)
    at org.apache.kylin.engine.mr.steps.CreateDictionaryJob.run(CreateDictionaryJob.java:54)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:90)
    at org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:63)
    at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:113)
    at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:57)
    at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:113)
    at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:136)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecu`
or.java:1142)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
    at java.lang.Thread.run(Thread.java:745)

result code:2

修改model結構
從有重複行的形式=》 無重複行

5.USER_ID全域性dict構建失敗，提示/dict/WEIBODATA.USER_TABLE/USER_ID should have 0 or 1 append dict but 2

java.lang.RuntimeException: Failed to create dictionary on WEIBODATA.CHECK_IN_TABLE.USER_ID
    at org.apache.kylin.dict.DictionaryManager.buildDictionary(DictionaryManager.java:325)
    at org.apache.kylin.cube.CubeManager.buildDictionary(CubeManager.java:222)
    at org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:50)
    at org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:41)
    at org.apache.kylin.engine.mr.steps.CreateDictionaryJob.run(CreateDictionaryJob.java:54)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:90)
    at org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:63)
    at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:113)
    at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:57)
    at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:113)
    at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:136)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
    at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.IllegalStateException: GlobalDict /dict/WEIBODATA.USER_TABLE/USER_ID should have 0 or 1 append dict but 2
    at org.apache.kylin.dict.GlobalDictionaryBuilder.build(GlobalDictionaryBuilder.java:68)
    at org.apache.kylin.dict.DictionaryGenerator.buildDictionary(DictionaryGenerator.java:81)
    at org.apache.kylin.dict.DictionaryManager.buildDictionary(DictionaryManager.java:323)
    ... 14 more

result code:2

這個網站 提到了這個問題，有一個解決了這個問題的人用的解決方法是：

1.檢查metadata

scan 'kylin_metadata', {STARTROW=>'/dict/WEIBODATA.USER_TABLE/USER_ID', ENDROW=> '/dict/WEIBODATA.USER_TABLE/USER_ID', FILTER=>"KeyOnlyFilter()"}

使用該方法對dict的metadata進行檢查，該網站中說他這次scan出了兩個metadata，清理後就不報這個錯了
但是我掃描的時候的結果是

hbase(main):011:0> scan 'kylin_metadata', {STARTROW=>'/dict/WEIBODATA.USER_TABLE/USER_ID', ENDROW=> '/dict/WEIBODATA.USER_TABLE/USER_ID', FILTER=>"KeyOnlyFilter()"} 
ROW                                                                  COLUMN+CELL                                                                                                                                                                                              
0 row(s) in 0.0220 seconds

和

hbase(main):010:0> scan 'kylin_metadata', {STARTROW=>'/dict/WEIBODATA.USER_TABLE/USER_ID', ENDROW=> '/dict/WEIBODATA.USER_TABLE/USER_ID'}
ROW                                                                  COLUMN+CELL                                                                                                                                                                                              
0 row(s) in 0.0190 seconds

甚至沒有出現這一行
使用Kylin自帶的clean快取功能

${KYLIN_HOME}/bin/kylin.sh org.apache.kylin.storage.hbase.util.StorageCleanupJob --delete false
${KYLIN_HOME}/bin/kylin.sh org.apache.kylin.storage.hbase.util.StorageCleanupJob --delete true

re-build無效

在那個網頁中發現其提到把USER_ID設定為distinct_count方法，這一點跟我一樣，在去除這個count欄位後再次rebuild

無效，證明不是這個的原因

暫時無法解決這個問題

6.Reduce階段出現OOM

2017-05-24 06:31:27,282 ERROR [main] org.apache.kylin.engine.mr.KylinReducer: 
java.lang.OutOfMemoryError: GC overhead limit exceeded
    at org.apache.kylin.dict.TrieDictionaryBuilder$Node.reset(TrieDictionaryBuilder.java:60)
    at org.apache.kylin.dict.TrieDictionaryBuilder.addValueR(TrieDictionaryBuilder.java:125)
    at org.apache.kylin.dict.TrieDictionaryBuilder.addValueR(TrieDictionaryBuilder.java:155)
    at org.apache.kylin.dict.TrieDictionaryBuilder.addValueR(TrieDictionaryBuilder.java:155)
    at org.apache.kylin.dict.TrieDictionaryBuilder.addValueR(TrieDictionaryBuilder.java:155)
    at org.apache.kylin.dict.TrieDictionaryBuilder.addValueR(TrieDictionaryBuilder.java:155)
    at org.apache.kylin.dict.TrieDictionaryBuilder.addValueR(TrieDictionaryBuilder.java:155)
    at org.apache.kylin.dict.TrieDictionaryBuilder.addValueR(TrieDictionaryBuilder.java:155)
    at org.apache.kylin.dict.TrieDictionaryBuilder.addValue(TrieDictionaryBuilder.java:92)
    at org.apache.kylin.dict.TrieDictionaryForestBuilder.addValue(TrieDictionaryForestBuilder.java:97)
    at org.apache.kylin.dict.TrieDictionaryForestBuilder.addValue(TrieDictionaryForestBuilder.java:78)
    at org.apache.kylin.dict.DictionaryGenerator$StringTrieDictForestBuilder.addValue(DictionaryGenerator.java:212)
    at org.apache.kylin.engine.mr.steps.FactDistinctColumnsReducer.doReduce(FactDistinctColumnsReducer.java:197)
    at org.apache.kylin.engine.mr.steps.FactDistinctColumnsReducer.doReduce(FactDistinctColumnsReducer.java:60)
    at org.apache.kylin.engine.mr.KylinReducer.reduce(KylinReducer.java:48)
    at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:171)
    at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:627)
    at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:389)
    at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:422)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724)
    at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)
2017-05-24 06:31:44,672 ERROR [main] org.apache.kylin.engine.mr.KylinReducer: 
java.lang.OutOfMemoryError: GC overhead limit exceeded
    at java.util.Arrays.copyOf(Arrays.java:3210)
    at java.util.Arrays.copyOf(Arrays.java:3181)
    at java.util.ArrayList.toArray(ArrayList.java:376)
    at java.util.LinkedList.addAll(LinkedList.java:408)
    at java.util.LinkedList.addAll(LinkedList.java:387)
    at java.util.LinkedList.<init>(LinkedList.java:119)
    at org.apache.kylin.dict.TrieDictionaryBuilder.checkOverflowParts(TrieDictionaryBuilder.java:384)
    at org.apache.kylin.dict.TrieDictionaryBuilder.checkOverflowParts(TrieDictionaryBuilder.java:400)
    at org.apache.kylin.dict.TrieDictionaryBuilder.checkOverflowParts(TrieDictionaryBuilder.java:400)
    at org.apache.kylin.dict.TrieDictionaryBuilder.checkOverflowParts(TrieDictionaryBuilder.java:400)
    at org.apache.kylin.dict.TrieDictionaryBuilder.checkOverflowParts(TrieDictionaryBuilder.java:400)
    at org.apache.kylin.dict.TrieDictionaryBuilder.checkOverflowParts(TrieDictionaryBuilder.java:400)
    at org.apache.kylin.dict.TrieDictionaryBuilder.checkOverflowParts(TrieDictionaryBuilder.java:400)
    at org.apache.kylin.dict.TrieDictionaryBuilder.checkOverflowParts(TrieDictionaryBuilder.java:400)
    at org.apache.kylin.dict.TrieDictionaryBuilder.buildTrieBytes(TrieDictionaryBuilder.java:424)
    at org.apache 
 

            
  

           

              
              

            

            
相關推薦

			   
            
            
            
 

    


    
    
KYlin build cube時出現問題的彙總

     
 
							
							
							1.在單條非空資料時出現null值而導致報錯



Vertex failed, vertexName=Map 1, vertexId=vertex_1494251465823_0017_1_01, diagnostics=[Task failed, taskI 



  
 

    


    
    
kylin build cube  #3 Step Name: Extract Fact Table Distinct Columns

     
 kylin build cubejava.lang.NoSuchMethodError: org.apache.hadoop.yarn.proto.YarnProtos$LocalResourceProto.hashLong(J)I
	at org.apache.hadoop.yarn.proto.YarnP 



  
 

    


    
    
多專案、依賴專案在Build APK時出現duplicate entry錯誤

     
 
                
環境：
　　Android Studio Version: 2.3.1
　　Compile Sdk Version: API 17: Android 4.2 (Jelly Bean)
　　Build Tools Version: 25.0.2

　　先說說起因吧。最近有個專 



  
 

    


    
    
kylin構建cube時step1報錯MoveTask

     
 
                今天在CDH上執行hive sql的時候報了一個錯。錯誤內容為：FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask錯誤語句：    INSERT OVERWRI 



  
 

    


    
    
gradle 添加jar依賴，執行grade build時出現“程序包不存在”問題

     
 rep   div   epo   5.4   程序包   yun   pan   引用   問題    
引用的第三方依賴的包都找不到了 解決辦法

group‘com.suneony‘
version‘1.0.0‘
 
apply plugin:‘java‘
 
repositories {
    ma 



  
 

    


    
    
centos虛擬機器無法選擇無縫模式，在安裝增強功能時出現報錯This system is currently not set up to build kernel modules.

     
  
 
   
   
   
 在centos虛擬機器中，如果無法顯示無縫模式，介面看起來會非常奇怪。因此為了使用無縫模式，我們需要安裝centos的增強功能。 
 具體安裝步驟如下： 
     1.在cenos系統介面選擇【裝置】 
   &n 



  
 

    


    
    
安裝notedown時出現"python setup.py egg_info" failed with error code 1 in /tmp/pip-req-build-By7yob/

     
  
 
 notedown外掛可以開啟Markdown檔案，用起來很方便。可是最近在Python2.7+caffe2環境下安裝notedown的時候卻出現了很多問題。 
   
 1.  Python3.6 + notedown 
 對於Python3.0以上的版本，可以直接 
 使用下面 



  
 

    


    
    
Kylin增量cube build的restAPI的時間不準確的BUG

     
 
                Kylin1.6增量cube build的restAPI的時間不準確的bug:

描述：使用restAPI:curl -X PUT -u "ADMIN:KYLIN" -H "Content-Type:application/json;charset=utf-8" -d '{" 



  
 

    


    
    
Android編譯時出現Process 'command 'build-tools\27.0.3\aapt.exe'' finished with non-zero exit value 1報錯

     
 
							
							
							首先說下自己的解決方案：
1，電腦當時執行的記憶體不夠，導致了這個問題
2，這個才是重點   AndroidManifest.xml資原始檔中引用有錯誤（搜狗渠道的資源配置引用了愛遊戲渠道的資源配置）刪除錯誤的資源配置就可以了，資源報錯的方式是通過以下一篇部落格 



  
 

    


    
    
1、webpack搭建專案時出現的報錯“Module build failed (from ./node_modules/css-loader/dist/cjs.js) CssSyntaxError”

     
 控制檯出現的錯誤如下： 
                 
  
webpack.config.js中的配置如下： 
 
 module.exports={
    entry:'./src/main.js 



  
 

    


    
    
intellij idea build時出現illegal character的解決

     
 
                
碰到有中文的專案，有可能包名、類名或者方法名都會包含中文，這時在build的時候會出現 illegal charater 這樣的錯誤。這種情況，可能有兩種原因，
1. 儲存程式碼檔案的時候出現了BOM頭
關於BOM頭及去除方法，網上有非常多的文章，比如這裡：http://m 



  
 

    


    
    
AndroidStudio進行Build時出現DexArchiveMergerException異常的解決辦法

     
  
 
 
 今天在AndroidStudio中匯入了一個專案，編譯的時候沒有什麼問題，但是在執行Rebuild Project 和 Build APK(s)時報錯了，提示：
 Error:Execution failed for task ':app:transformDexArchiveWithExter 



  
 

    


    
    
pip安裝軟體時出現Command "python setup.py egg_info" failed with error code 1 in /tmp/pip-build*的解決方案

     
 
                本文只提供本人的一些經驗，不代表可以解決所有人的問題。

pip安裝軟體時出現：Command "python setup.py egg_info" failed with error code 1 in /tmp/pip-build-*(其中×與要安裝的軟體有關)

比如安 



  
 

    


    
    
Maven專案在編譯及匯入Eclipse時出現的錯誤彙總處理

     
 
                
Maven專案在編譯及匯入Eclipse時出現的錯誤處理彙總

Maven在構建專案時確實是比較強大，而且也越來越流行，目前不但越來越多的開源專案，甚至越來越多的商業專案都在使用Maven。但是不得不說Maven裡面的坑真心的多，最近手頭的幾個專案都是使用Maven進行構建 



  
 

    


    
    
kylin填坑記--建立cube時遇到的兩個坑

     
 
                建立cube時，最容易出錯的地方就是在Build Dimension Dictionary這步，也就是第四步。如下圖這步，kylin後臺會做很多關於欄位的檢查。遇到的兩個坑，正是發生在這步，因為資料本身有這樣的問題：第一，維度表中型別為longtext的欄位descripti 



  
 

    


    
    
Android專案執行時出現 Failed to load F:\eclipse\android-sdk-windows\build-tools\28.0.0-preview\lib\dx.jar

     
 
                執行時出現錯誤： Failed to load F:\eclipse\android-sdk-windows\build-tools\28.0.0-preview\lib\dx.jar                          Unknown error: Unabl 



  
 

    


    
    
安裝notedown時出現"python setup.py egg_info" failed with error code 1 in /tmp/pip-req-build-By7yob/

     
 
                notedown外掛可以開啟Markdown檔案，用起來很方便。可是最近在Python2.7+caffe2環境下安裝notedown的時候卻出現了很多問題。



1.  Python3.6 + notedown

對於Python3.0以上的版本，可以直接

使用下面的指令 



  
 

    


    
    
Android Studio中的控制元件初始化疑問：build沒問題，但執行模擬器時出現問題。錯誤程式碼：java.lang.RuntimeException: Unable to instant

     
 
                在使用Android Studio，啟動模擬器時，出現如下錯誤：Logcat中的資訊如下：java.lang.RuntimeException:Unable to instantiate activityComponentInfo{com.example.dcyyw.appl 



  
 

    


    
    
Eclipse建立Maven工程時出現的Java Build path 問題

     
 
								
								            
							
							
							問題描述



  使用eclipse建立Maven工程時，出現如下錯誤：



Description Resource    Path    Location    Type
Build path  



  
 

    


    
    
Maven專案build時出現No compiler is provided in this environment. Perhaps you are running on a JRE rather

     
 
                Maven專案執行測試時報錯：No compiler is provided in this environment. Perhaps you are running on a JRE rather than a JDK?