ActiveMQ隊列消息過期時間設置和自動清除解決方案


版本 apache-activemq-5.15.3

1、消息過期設置

參數詳情

1)message過期則客戶端不能接收

2)ttlCeiling:表示過期時間上限(程序寫的過期時間不能超過此時間,超過則以此時間為准)

3)zeroExpirationOverride:表示過期時間(給未分配過期時間的消息分配過期時間)

配置示例


   
   
  
  
          
  1. <broker>
  2. ...
  3. <plugins>
  4. <!-- 86,400,000ms = 1 day -->
  5. <timeStampingBrokerPluginttlCeiling="30000" zeroExpirationOverride="30000" />
  6. </plugins>
  7. ...
  8. </broker>

2、死信隊列設置

消息過期后會進入死信隊列,如不想拋棄死信隊列,默認進入ACTIVEMQ.DLQ隊列,且不會自動清除;對於過期的消息進入死信隊列還有一些可選的策略:放入各自的死信通道、保存在一個共享的隊列(默認),且可以設置是否將過期消息放入隊列的開關以及死信隊列消息過期時間。

1)直接拋棄死信隊列

AcitveMQ提供了一個便捷的插件:DiscardingDLQBrokerPlugin,來拋棄DeadLetter。如果開發者不需要關心DeadLetter,可以使用此策略。

配置示例


   
   
  
  
          
  1. <broker>
  2. ...
  3. <plugins>
  4.      <!-- 丟棄所有死信-->
  5. <discardingDLQBrokerPlugindropAll="true" dropTemporaryTopics="true" dropTemporaryQueues="true" />
  6. <!-- 丟棄指定死信-->
  7. <!-- <discardingDLQBrokerPlugindropOnly="MY.EXAMPLE.TOPIC.29 MY.EXAMPLE.QUEUE.87" reportInterval="1000" />-->
  8.      <!--使用丟棄正則匹配到死信-->
  9. <!--<discardingDLQBrokerPlugindropOnly="MY.EXAMPLE.TOPIC.[0-9]{3} MY.EXAMPLE.QUEUE.[0-9]{3}" reportInterval="3000"/>-->
  10. </plugins>
  11. ...
  12. </broker>

2)定時拋棄死信隊列

默認情況下,ActiveMQ永遠不會過期發送到DLQ的消息。但是,從ActiveMQ 5.12開始,deadLetterStrategy支持expiration屬性,其值以毫秒為單位。

配置示例


   
   
  
  
          
  1. <policyEntryqueue=">"…>
  2. ...
  3. <deadLetterStrategy>
  4.      <sharedDeadLetterStrategy processExpired="true" expiration="30000"/>
  5. </deadLetterStrategy>
  6. ...
  7. </policyEntry>

3、慢消費者策略設置

Broker將會啟動一個后台線程用來檢測所有的慢速消費者,並定期關閉關閉它們;中斷慢速消費者,慢速消費將會被關閉。abortConnection是否關閉連接;如果慢速消費者最后一個ACK距離現在的時間間隔超過閥maxTimeSinceLastAck,則中斷慢速消費者。

配置示例


   
   
  
  
          
  1. <policyEntryqueue=">"…>
  2.      <slowConsumerStrategy>
  3.          <abortSlowConsumerStrategyabortConnection="false"/> <!--不關閉底層鏈接-->
  4.      </slowConsumerStrategy>
  5.     …
  6. </policyEntry>

4、測試

1)配置activemq.xml;

2)批量消息發送;

3)等待若干秒,消息減少;



4)等待若干秒,消息隊列清除(設置了拋棄死信隊列);

5)等待若干秒,消息隊列清除(未設置拋棄死信隊列,設置了死信隊列過期時間);



6)等待若干秒,消息隊列清除(不拋棄死信隊列,死信隊列不過期);

5、參考網址

https://my.oschina.net/coderedrain/blog/724943?utm_source=tuicool&utm_medium=referral

http://ask.csdn.net/questions/376817

http://activemq.apache.org/message-redelivery-and-dlq-handling.html

完整配置


   
   
  
  
          
  1. <!--
  2. Licensed to the Apache Software Foundation (ASF) under one or more
  3. contributor license agreements. See the NOTICE file distributed with
  4. this work for additional information regarding copyright ownership.
  5. The ASF licenses this file to You under the Apache License, Version 2.0
  6. (the "License"); you may not use this file except in compliance with
  7. the License. You may obtain a copy of the License at
  8. http://www.apache.org/licenses/LICENSE-2.0
  9. Unless required by applicable law or agreed to in writing, software
  10. distributed under the License is distributed on an "AS IS" BASIS,
  11. WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
  12. See the License for the specific language governing permissions and
  13. limitations under the License.
  14. -->
  15. <!-- START SNIPPET: example -->
  16. <beans
  17. xmlns= "http://www.springframework.org/schema/beans"
  18. xmlns:xsi= "http://www.w3.org/2001/XMLSchema-instance"
  19. xsi:schemaLocation= "http://www.springframework.org/schema/beans http://www.springframework.org/schema/beans/spring-beans.xsd
  20. http://activemq.apache.org/schema/core http://activemq.apache.org/schema/core/activemq-core.xsd">
  21. <!-- Allows us to use system properties as variables in this configuration file -->
  22. <bean class="org.springframework.beans.factory.config.PropertyPlaceholderConfigurer">
  23. <property name="locations">
  24. <value>file:${activemq.conf}/credentials.properties </value>
  25. </property>
  26. </bean>
  27. <!-- Allows accessing the server log -->
  28. <bean id="logQuery" class="io.fabric8.insight.log.log4j.Log4jLogQuery"
  29. lazy-init= "false" scope= "singleton"
  30. init-method= "start" destroy-method= "stop">
  31. </bean>
  32. <!--
  33. The <broker> element is used to configure the ActiveMQ broker.
  34. -->
  35. <broker xmlns="http://activemq.apache.org/schema/core" brokerName="localhost" dataDirectory="${activemq.data}" schedulePeriodForDestinationPurge="10000">
  36. <destinationPolicy>
  37. <policyMap>
  38. <policyEntries>
  39. <policyEntry queue=">" gcInactiveDestinations="true" inactiveTimoutBeforeGC="30000">
  40. <deadLetterStrategy>
  41. <sharedDeadLetterStrategy processExpired="true" expiration="30000"/>
  42. </deadLetterStrategy>
  43. </policyEntry>
  44. <policyEntry topic=">" >
  45. <!-- The constantPendingMessageLimitStrategy is used to prevent
  46. slow topic consumers to block producers and affect other consumers
  47. by limiting the number of messages that are retained
  48. For more information, see:
  49. http://activemq.apache.org/slow-consumer-handling.html
  50. -->
  51. <pendingMessageLimitStrategy>
  52. <constantPendingMessageLimitStrategy limit="1000"/>
  53. </pendingMessageLimitStrategy>
  54. </policyEntry>
  55. </policyEntries>
  56. </policyMap>
  57. </destinationPolicy>
  58. <!--
  59. The managementContext is used to configure how ActiveMQ is exposed in
  60. JMX. By default, ActiveMQ uses the MBean server that is started by
  61. the JVM. For more information, see:
  62. http://activemq.apache.org/jmx.html
  63. -->
  64. <managementContext>
  65. <managementContext createConnector="false"/>
  66. </managementContext>
  67. <!--
  68. Configure message persistence for the broker. The default persistence
  69. mechanism is the KahaDB store (identified by the kahaDB tag).
  70. For more information, see:
  71. http://activemq.apache.org/persistence.html
  72. -->
  73. <persistenceAdapter>
  74. <kahaDB directory="${activemq.data}/kahadb"/>
  75. </persistenceAdapter>
  76. <!--
  77. The systemUsage controls the maximum amount of space the broker will
  78. use before disabling caching and/or slowing down producers. For more information, see:
  79. http://activemq.apache.org/producer-flow-control.html
  80. -->
  81. <systemUsage>
  82. <systemUsage>
  83. <memoryUsage>
  84. <memoryUsage percentOfJvmHeap="70" />
  85. </memoryUsage>
  86. <storeUsage>
  87. <storeUsage limit="100 gb"/>
  88. </storeUsage>
  89. <tempUsage>
  90. <tempUsage limit="50 gb"/>
  91. </tempUsage>
  92. </systemUsage>
  93. </systemUsage>
  94. <!--
  95. The transport connectors expose ActiveMQ over a given protocol to
  96. clients and other brokers. For more information, see:
  97. http://activemq.apache.org/configuring-transports.html
  98. -->
  99. <transportConnectors>
  100. <!-- DOS protection, limit concurrent connections to 1000 and frame size to 100MB -->
  101. <transportConnector name="openwire" uri="tcp://0.0.0.0:61616?maximumConnections=1000&wireFormat.maxFrameSize=104857600"/>
  102. <transportConnector name="amqp" uri="amqp://0.0.0.0:5672?maximumConnections=1000&wireFormat.maxFrameSize=104857600"/>
  103. <transportConnector name="stomp" uri="stomp://0.0.0.0:61613?maximumConnections=1000&wireFormat.maxFrameSize=104857600"/>
  104. <transportConnector name="mqtt" uri="mqtt://0.0.0.0:1883?maximumConnections=1000&wireFormat.maxFrameSize=104857600"/>
  105. <transportConnector name="ws" uri="ws://0.0.0.0:61614?maximumConnections=1000&wireFormat.maxFrameSize=104857600"/>
  106. </transportConnectors>
  107. <!-- destroy the spring context on shutdown to stop jetty -->
  108. <shutdownHooks>
  109. <bean xmlns="http://www.springframework.org/schema/beans" class="org.apache.activemq.hooks.SpringContextHook" />
  110. </shutdownHooks>
  111. <plugins>
  112. <!-- 86,400,000ms = 1 day -->
  113. <timeStampingBrokerPlugin ttlCeiling="30000" zeroExpirationOverride="30000" />
  114. <!-- <discardingDLQBrokerPlugin dropAll="true" dropTemporaryTopics="true" dropTemporaryQueues="true" />-->
  115. </plugins>
  116. </broker>
  117. <!--
  118. Enable web consoles, REST and Ajax APIs and demos
  119. The web consoles requires by default login, you can disable this in the jetty.xml file
  120. Take a look at ${ACTIVEMQ_HOME}/conf/jetty.xml for more details
  121. -->
  122. <import resource="jetty.xml"/>
  123. </beans>
  124. <!-- END SNIPPET: example -->


免責聲明!

本站轉載的文章為個人學習借鑒使用,本站對版權不負任何法律責任。如果侵犯了您的隱私權益,請聯系本站郵箱yoyou2525@163.com刪除。



 
粵ICP備18138465號   © 2018-2025 CODEPRJ.COM