Failed to get minimum memory reservation of 102.00 MB on daemon


impala查询hive报错

[09/Aug/2021 00:45:10 -0700] decorators   ERROR    Error running check_status
Traceback (most recent call last):
  File "/opt/cloudera/parcels/CDH-6.3.2-1.cdh6.3.2.p0.1605554/lib/hue/desktop/libs/notebook/src/notebook/decorators.py", line 98, in decorator
    return func(*args, **kwargs)
  File "/opt/cloudera/parcels/CDH-6.3.2-1.cdh6.3.2.p0.1605554/lib/hue/desktop/libs/notebook/src/notebook/api.py", line 204, in check_status
    response['query_status'] = get_api(request, snippet).check_status(notebook, snippet)
  File "/opt/cloudera/parcels/CDH-6.3.2-1.cdh6.3.2.p0.1605554/lib/hue/desktop/libs/notebook/src/notebook/connectors/hiveserver2.py", line 83, in decorator
    return func(*args, **kwargs)
  File "/opt/cloudera/parcels/CDH-6.3.2-1.cdh6.3.2.p0.1605554/lib/hue/desktop/libs/notebook/src/notebook/connectors/hiveserver2.py", line 288, in check_status
    raise QueryError(operation.errorMessage)
QueryError: ExecQueryFInstances rpc query_id=35415bf7ba63b1e2:778ea8aa00000000 failed: Failed to get minimum memory reservation of 102.00 MB on daemon slave3:22000 for query 35415bf7ba63b1e2:778ea8aa00000000 due to following error: Memory limit exceeded: Could not allocate memory while trying to increase reservation.
Query(35415bf7ba63b1e2:778ea8aa00000000) could not allocate 102.00 MB without exceeding limit.
Error occurred on backend slave3:22000
Memory left in process limit: 120.90 MB
Query(35415bf7ba63b1e2:778ea8aa00000000): Reservation=0 ReservationLimit=204.80 MB OtherMemory=0 Total=0 Peak=0
Memory is likely oversubscribed. Reducing query concurrency or configuring admission control may help avoid this error.

原因:报错是内存原因导致的

解决:

一、可以重新启动impala;

二、如果重启不行,增大mem_limit内存,默认256M,根据自己内存调节。

 

 

注:impala内存配置

change those setting 

memory.soft_limit_in_bytes 

memory.limit_in_bytes 

mem_limit

default_pool_mem_limit

value to 0 or -1 无限制配置值

 


免责声明!

本站转载的文章为个人学习借鉴使用,本站对版权不负任何法律责任。如果侵犯了您的隐私权益,请联系本站邮箱yoyou2525@163.com删除。



 
粤ICP备18138465号  © 2018-2025 CODEPRJ.COM