2. 程式人生 > >Spark-shell啟動的時候報Error while instantiating ‘org.apache.spark.sql.hive.HiveSessionStateBuilder’錯誤

Spark-shell啟動的時候報Error while instantiating ‘org.apache.spark.sql.hive.HiveSessionStateBuilder’錯誤

阿新 • • 發佈：2019-01-27
call(Client.java:1475) at org.apache.hadoop.ipc.Client.call(Client.java:1408) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:230) at com.sun.proxy.$Proxy21.getFileInfo(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:757
) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:256
) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:104) at com.sun.proxy.$Proxy22.getFileInfo(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:2102) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:1215
) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:1211) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1211) at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1412) at org.apache.hadoop.hive.ql.session.SessionState.createRootHDFSDir(SessionState.java:596) at org.apache.hadoop.hive.ql.session.SessionState.createSessionDirs(SessionState.java:554) at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:508) ... 84 more Caused by: java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206) at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:530) at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:494) at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:614) at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:713) at org.apache.hadoop.ipc.Client$Connection.access$2900(Client.java:375) at org.apache.hadoop.ipc.Client.getConnection(Client.java:1524) at org.apache.hadoop.ipc.Client.call(Client.java:1447) ... 104 more <console>:14: error: not found: value spark import spark.implicits._ ^ <console>:14: error: not found: value spark import spark.sql ^ Welcome to ____ __ / __/__ ___ _____/ /__ _\ \/ _ \/ _ `/ __/ '_/ /___/ .__/\_,_/_/ /_/\_\ version 2.2.0 /_/ Using Scala version 2.11.8 (Java HotSpot(TM) 64-Bit Server VM, Java 1.8.0_161) Type in expressions to have them evaluated. Type :help for more information.

相關推薦

Spark-shell啟動的時候報Error while instantiating ‘org.apache.spark.sql.hive.HiveSessionStateBuilder’錯誤

call(Client.java:1475) at org.apache.hadoop.ipc.Client.call(Client.java:1408) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngi

spark-shell啟動報錯：Yarn application has already ended! It might have been killed or unable to launch application master

name limits nor bsp closed pre opened 頁面 loading spark-shell不支持yarn cluster，以yarn client方式啟動 spark-shell --master=yarn --deploy-mode=cli

解決軟件啟動報error while loading shared libraries: libgd.so.2: cannot open shared object錯誤

data dso htm inux libpcre 通過 libc.so.6 code 相關 解決軟件啟動報error while loading shared libraries: libgd.so.2: cannot open shared object錯誤 今天安

spark-shell啟動報錯解決辦法

spark-shell啟動報錯解決辦法: scala版本不相容問題 這是因為加入了專案依賴庫到/usr/cwgis/app/spark/jars/lib/中 刪除相關的scala開頭的jar檔案即可啟動spark-shell [[email protected] ~]# run

[CDH] CDH5整合Spark2.2後spark-shell啟動報錯解決

CDH5已整合Spark2.2，spark-shell啟動報錯： [[email protected] bin]# ./spark2-shell Exception in thread "main" java.lang.NoClassDefFoundError: org/apac

Spark升級到2.0後測試stream-kafka測試報java.lang.NoClassDefFoundError: org/apache/spark/Logging錯誤

- 最近從Spark 1.5.2升級到2.0之後，執行測試程式碼spark-stream-kafka報以下錯誤： java.lang.NoClassDefFoundError: org/apache/spark/Logging at java.lang.ClassLo

idae執行spark程式碼報錯ERROR MetricsSystem: Sink class org.apache.spark.metrics.sink.MetricsServlet cannot b

1.問題描述 在idea中編寫，streaming處理伺服器socket傳遞的資料，結果報錯： "C:\Program Files\Java\jdk1.8.0_91\bin\java" -Didea.launcher.port=7534 "-Didea.launcher.bin.path=C

Error :spark-shell模式報錯：java.sql.SQLException: A read-only user or a user in a read-only database

1.問題描述： 啟動spark-shell local的模式 bin/spark-shell --master local[2] 報錯： [[email protected] spark-2.1.0-bin-hadoop2.6]$ bin/spark-she

Spark提交任務到YARN cluster中，提示An error occurred while calling z:org.apache.spark.api.python.PythonRDD

報錯日誌擷取部分如下： XXXXXXXXXX ERROR YarnSchedulerBackend$YarnSchedulerEndpoint:91 - Sending RequestExecutors(0,0,Map(),Set()) to AM was unsuccessful java.i

Spark Shell啟動時遇到:14: error: not found: value spark import spark.implicits._ :14: error: not found: value spa

　　不多說，直接上乾貨！ 　　最近，開始，進一步學習spark的最新版本。由原來經常使用的spark-1.6.1，現在來使用spark-2.2.0-bin-hadoop2.6.tgz。 前期部落格 　　這裡我，使用的是spark-2.2.0-bin-hadoop2.6.tgz

Eclipse啟動Maven項目報java.lang.ClassNotFoundException: org.springframework.web.context.ContextLoaderListener的錯誤

ade term add listener context out contex style org 今天用Eclipse導入了一個Maven項目，啟動tomcat時卻報java.lang.ClassNotFoundException: org.springframewor

物理機（服務器）安裝centos6.5 無法啟動報Error loading operating--

ble ssi exists color 無法 服務 partition stage2 art 故障分析用U盤安裝CENTOS 6.5 GURB 啟動文件默認安裝在U盤裏面，把UP盤插上能正常啟動 拔掉就出現一些錯誤如下圖1,設置從U盤正常進入系統 2，輸入GRUB gru

Tomcat啟動報Error listenerStart錯誤

grails 錯誤 too 內容 format 日誌 -h list tomcat 文章轉自 http://xpenxpen.iteye.com/blog/1545648 今天啟動Tomcat啟動不了，報以下錯： org.apache.catalina.core.Stan

spark-shell啟動錯誤

HR driver 退出 HA invoke OS ctu adc default 18/06/24 16:41:40 ERROR spark.SparkContext: Error initializing SparkContext.java.net.BindExcept

關於在使用sparksql寫程序是報錯以及解決方案：org.apache.spark.sql.AnalysisException: Duplicate column(s): "name" found, cannot save to file.

文件加載 mod 但是 路徑 win 錯誤 寫入 技術分享 over 說明： 　　spark --version : 2.2.0 　　我有兩個json文件，分別是emp和dept： emp內容如下： {"name": "zhangsan", "age": 26, "dep

hbase shell啟動報錯(KeeperException$ConnectionLossException）

hbase shell啟動報錯 問題：執行hbase shell的時候報錯 org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/

Tomcat7啟動報Error starting static Resources錯誤

就是 靜態 eclips nbsp tro color 使用 cat col 一、問題描述： 　　啟動tomcat報錯，大概的意思是webapps目錄下找不到我的工程目錄。 二、問題排查。（因為對tomcat不太熟悉所以導致問題排查方向有點迷惑） 　　問題排查分為：1、wa

mycat啟動報錯 Caused by: org.opencloudb.config.util.ConfigException: dataNode node_db01 reference dataHo

環境：mycat 1.5 作業系統：Redhat 6.5 64位 JDK：1.8.0_181 mysql：5.6.35 現象描述：當啟動mycat時，提示： Caused by: org.opencloudb.config.util.ConfigException: dataNode

問題定位分享（9）oozie提交spark任務報 java.lang.NoClassDefFoundError: org/apache/kafka/clients/producer/KafkaProducer

oozie中支援很多的action型別，比如spark、hive，對應的標籤為： <spark xmlns="uri:oozie:spark-action:0.1">  ... oozie中sharelib用於存放每個action型別需要的依賴，可以檢視當前所有的acti

org.apache.spark.SparkException: Exception thrown in awaitResult （Spark報錯）

WARN StandaloneAppClient$ClientEndpoint: Failed to connect to master node1:7077 org.apache.spark.SparkException: Exception thrown i