kafka 按照主题消费 和 按照分区消费

一次项目想，多线程消费主题的中的数据，百度了一波之后，可以按分区进行单独消费，记录一下

首先，传统按照主题消费：

@KafkaListener(topics = {Constants.KAFKA_TOPIC_PISHH}, containerFactory = "kafkaListenerMonitorFactory")  2     public void listenDataInfo(List<ConsumerRecord> records, Acknowledgment ack) {
        try {
            long beginTime = System.currentTimeMillis();
            batchList.clear();
            for (ConsumerRecord record : records) {
                count++;
                Optional<?> kafkaMessage = Optional.ofNullable(record.value());
                //获取kafka消息
               logger.info(kafkaMessage.get().toString());
            }
        } catch (Exception e){
            e.printStackTrace();
        } finally {
            ack.acknowledge();//手动提交偏移量
        }
    }

 

按照主题分区消费：

@KafkaListener(id = "id0", topicPartitions = { @TopicPartition(topic = Constants.KAFKA_TOPIC_PISHH, partitions = { "0" }) }, containerFactory = "kafkaListenerMonitorFactory")
public void listenDataInfo0(List<ConsumerRecord> records, Acknowledgment ack) {  3 try {  4 long beginTime = System.currentTimeMillis();  5  batchList.clear();  6 for (ConsumerRecord record : records) {  7 count++;  8 Optional<?> kafkaMessage = Optional.ofNullable(record.value());  9 //获取kafka消息 10  logger.info(kafkaMessage.get().toString()); 11  } 12 13 } catch (Exception e){ 14  e.printStackTrace(); 15 } finally { 16 ack.acknowledge();//手动提交偏移量 17  } 18 }

 

参考：https://blog.csdn.net/russle/article/details/81258590