Failed to get minimum memory reservation of 102.00 MB on daemon


impala查詢hive報錯

[09/Aug/2021 00:45:10 -0700] decorators   ERROR    Error running check_status
Traceback (most recent call last):
  File "/opt/cloudera/parcels/CDH-6.3.2-1.cdh6.3.2.p0.1605554/lib/hue/desktop/libs/notebook/src/notebook/decorators.py", line 98, in decorator
    return func(*args, **kwargs)
  File "/opt/cloudera/parcels/CDH-6.3.2-1.cdh6.3.2.p0.1605554/lib/hue/desktop/libs/notebook/src/notebook/api.py", line 204, in check_status
    response['query_status'] = get_api(request, snippet).check_status(notebook, snippet)
  File "/opt/cloudera/parcels/CDH-6.3.2-1.cdh6.3.2.p0.1605554/lib/hue/desktop/libs/notebook/src/notebook/connectors/hiveserver2.py", line 83, in decorator
    return func(*args, **kwargs)
  File "/opt/cloudera/parcels/CDH-6.3.2-1.cdh6.3.2.p0.1605554/lib/hue/desktop/libs/notebook/src/notebook/connectors/hiveserver2.py", line 288, in check_status
    raise QueryError(operation.errorMessage)
QueryError: ExecQueryFInstances rpc query_id=35415bf7ba63b1e2:778ea8aa00000000 failed: Failed to get minimum memory reservation of 102.00 MB on daemon slave3:22000 for query 35415bf7ba63b1e2:778ea8aa00000000 due to following error: Memory limit exceeded: Could not allocate memory while trying to increase reservation.
Query(35415bf7ba63b1e2:778ea8aa00000000) could not allocate 102.00 MB without exceeding limit.
Error occurred on backend slave3:22000
Memory left in process limit: 120.90 MB
Query(35415bf7ba63b1e2:778ea8aa00000000): Reservation=0 ReservationLimit=204.80 MB OtherMemory=0 Total=0 Peak=0
Memory is likely oversubscribed. Reducing query concurrency or configuring admission control may help avoid this error.

原因:報錯是內存原因導致的

解決:

一、可以重新啟動impala;

二、如果重啟不行,增大mem_limit內存,默認256M,根據自己內存調節。

 

 

注:impala內存配置

change those setting 

memory.soft_limit_in_bytes 

memory.limit_in_bytes 

mem_limit

default_pool_mem_limit

value to 0 or -1 無限制配置值

 


免責聲明!

本站轉載的文章為個人學習借鑒使用,本站對版權不負任何法律責任。如果侵犯了您的隱私權益,請聯系本站郵箱yoyou2525@163.com刪除。



 
粵ICP備18138465號   © 2018-2025 CODEPRJ.COM