hadoop - hive 壳在我的 hive 3.1.2中显示了许多日志/警告

Question

我在hadoop 3.1上的配置单元shell(3.1.2)在启动和执行任何查询期间都显示了许多日志/警告。

启动

2020-05-10 12:10:26,988 INFO [main] session.SessionState:创建的HDFS目录:/tmp/hive-hduser/hduser/022ddbe2-5580-4b63-be1b-2cd82dfe9f0f/_tmp_space.db
2020-05-10 12:10:27,037 INFO [main] conf.HiveConf:使用为日志ID传递的默认值:022ddbe2-5580-4b63-be1b-2cd82dfe9f0f
2020-05-10 12:10:27,038 INFO [main] session.SessionState:将线程名称更新为022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main
2020-05-10 12:10:3​​0,631信息[022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] metastore.HiveMetaStore:0:使用实现类:org.apache.hadoop.hive.metastore.ObjectStore打开原始存储
2020-05-10 12:10:3​​0,779警告[022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] metastore.ObjectStore:datanucleus.autoStartMechanismMode设置为不受支持的值null。将其设置为值:已忽略
2020-05-10 12:10:3​​0,791 INFO [022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] metastore.ObjectStore:ObjectStore，初始化称为
2020-05-10 12:10:3​​0,794 INFO [022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] conf.MetastoreConf:找到的配置文件文件:/home/hduser/apache-hive-3.1.2-bin/conf/hive -site.xml
2020-05-10 12:10:3​​0,796 INFO [022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] conf.MetastoreConf:无法找到配置文件hivemetastore-site.xml
2020-05-10 12:10:3​​0,797 INFO [022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] conf.MetastoreConf:找到的配置文件为空
2020-05-10 12:10:3​​0,799 INFO [022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] conf.MetastoreConf:无法找到配置文件metastore-site.xml
2020-05-10 12:10:3​​0,799 INFO [022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] conf.MetastoreConf:找到的配置文件为空
2020-05-10 12:10:3​​1,951 INFO [022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] DataNucleus.Persistence:属性datanucleus.cache.level2未知-将被忽略
2020-05-10 12:10:3​​5,553信息[022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] metastore.ObjectStore:使用hive.metastore.cache.pinobjtypes =“Table，StorageDescriptor，SerDeInfo，Partition，数据库，类型，FieldSchema，顺序”
2020-05-10 12:10:3​​6,071信息[022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] metastore.MetaStoreDirectSql:使用直接SQL，底层数据库是MYSQL
2020-05-10 12:10:3​​6,077 INFO [022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] metastore.ObjectStore:初始化的ObjectStore
2020-05-10 12:10:3​​6,865警告[022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] DataNucleus.MetaData:元数据的jdbc类型为null，但这无效。被忽略
2020-05-10 12:10:3​​6,867警告[022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] DataNucleus.MetaData:元数据的jdbc类型为null，但这无效。被忽略
2020-05-10 12:10:3​​6,869警告[022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] DataNucleus.MetaData:元数据的jdbc类型为null，但这无效。被忽略
2020-05-10 12:10:3​​6,870警告[022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] DataNucleus.MetaData:元数据的jdbc类型为null，但这无效。被忽略
2020-05-10 12:10:3​​6,871警告[022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] DataNucleus.MetaData:元数据的jdbc类型为null，但这无效。被忽略
2020-05-10 12:10:3​​6,871警告[022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] DataNucleus.MetaData:元数据的jdbc类型为null，但这无效。被忽略
2020-05-10 12:10:41,551警告[022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] DataNucleus.MetaData:元数据的jdbc类型为null，但这无效。被忽略
2020-05-10 12:10:41,561警告[022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] DataNucleus.MetaData:元数据的jdbc类型为null，但这无效。被忽略
2020-05-10 12:10:41,563警告[022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] DataNucleus.MetaData:元数据的jdbc类型为null，但这无效。被忽略
2020-05-10 12:10:41,563警告[022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] DataNucleus.MetaData:元数据的jdbc类型为null，但这无效。被忽略
2020-05-10 12:10:41,564警告[022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] DataNucleus.MetaData:元数据的jdbc类型为null，但这无效。被忽略
2020-05-10 12:10:41,565警告[022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] DataNucleus.MetaData:元数据的jdbc类型为null，但这无效。被忽略
2020-05-10 12:10:46,889 INFO [022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] metastore.HiveMetaStore:在metastore中添加了管理员角色
2020-05-10 12:10:46,903信息[022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] metastore.HiveMetaStore:在metastore中添加了公共(public)角色
2020-05-10 12:10:46,992信息[022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] metastore.HiveMetaStore:由于配置为空，因此未在管理员角色中添加任何用户
2020-05-10 12:10:47,483 INFO [022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] metastore.RetryingMetaStoreClient:RetryingMetaStoreClient proxy = class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi = hduser(auth: SIMPLE)重试= 1延迟= 1寿命= 0
2020-05-10 12:10:47,613信息[022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] metastore.HiveMetaStore:0:get_all_functions
2020-05-10 12:10:47,617信息[022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] HiveMetaStore.audit:ugi = hduser ip = unknown-ip-addr cmd = get_all_functions
Hive-on-MR在Hive 2中已弃用，在以后的版本中可能不可用。考虑使用其他执行引擎(例如spark，tez)或使用Hive 1.X版本。
2020-05-10 12:10:47,734信息[022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] CliDriver:Hive-on-MR在Hive 2中已弃用，在以后的版本中可能不可用。考虑使用其他执行引擎(例如spark，tez)或使用Hive 1.X版本。

执行期间

hive >显示数据库

; 2020-05-10 12:12:11,062 INFO [022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] conf.HiveConf: Using the default value passed in for log id: 022ddbe2-5580-4b63-be1b-2cd82dfe9f0f 2020-05-10 12:12:11,356 INFO [022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] ql.Driver: Compiling command(queryId=hduser_20200510121211_0213cb21-be5b-462d-9040-0f87736b9889): show databases

2020-05-10 12:12:13,078 INFO [022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] ql.Driver:并发模式已禁用，未创建锁管理器
2020-05-10 12:12:13,143信息[022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] ql.Driver:语义分析完成(重试=假)
2020-05-10 12:12:13,244信息[022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] ql.Driver:返回Hive模式:Schema(fieldSchemas:[FieldSchema(name:database_name，type:string，comment:来自解串器)]，属性:null)
2020-05-10 12:12:14,270 INFO [022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] exec.ListSinkOperator:初始化运算符LIST_SINK [0]
2020-05-10 12:12:14,295 INFO [022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] ql.Driver:完成的编译命令(queryId = hduser_20200510121211_0213cb21-be5b-462d-9040-0f87736b9889)；耗时:3.002秒
2020-05-10 12:12:14,297 INFO [022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] reexec.ReExecDriver:执行＃1查询
2020-05-10 12:12:14,298信息[022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] ql.Driver:并发模式已禁用，未创建锁管理器
2020-05-10 12:12:14,298 INFO [022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] ql.Driver:执行命令(queryId = hduser_20200510121211_0213cb21-be5b-462d-9040-0f87736b9889):显示数据库

2020-05-10 12:12:14,328 INFO [022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] ql.Driver:以串行模式启动任务[Stage-0:DDL]
2020-05-10 12:12:14,339信息[022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] metastore.HiveMetaStore:0:get_databases:@ hive＃
2020-05-10 12:12:14,339信息[022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] HiveMetaStore.audit:ugi = hduser ip = unknown-ip-addr cmd = get_databases:@ hive＃
2020-05-10 12:12:14,355 INFO [022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] exec.DDLTask:结果:3
2020-05-10 12:12:14,407 INFO [022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] ql.Driver:完成了执行命令(queryId = hduser_20200510121211_0213cb21-be5b-462d-9040-0f87736b9889)；花费时间:0.109秒
好
2020-05-10 12:12:14,408信息[022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] ql.Driver:确定
2020-05-10 12:12:14,408信息[022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] ql.Driver:并发模式已禁用，未创建锁管理器
2020-05-10 12:12:14,427 INFO [022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] Configuration.deprecation:mapred.input.dir已弃用。而是使用mapreduce.input.fileinputformat.inputdir
2020-05-10 12:12:14,604 INFO [022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] mapred.FileInputFormat:要处理的输入文件总数:1
2020-05-10 12:12:14,675 INFO [022ddbe2-5580-4b63-be1b-2cd82dfe9f0f main] exec.ListSinkOperator:RECORDS_OUT_INTERMEDIATE:0，RECORDS_OUT_OPERATOR_LIST_SINK_0:3，
d1
默认
演示
花费时间:3.123秒，获取:3行

请建议如何摆脱这些信息。

Answer 1

添加必要的log4j-sl4j jar文件。我也面临同样的问题。一旦添加了jar文件，日志和警告消息将被最小化。