springboot kafka怎样进行消息反序列化

在Spring Boot中,使用Kafka进行消息反序列化的方法如下:

首先,确保你的项目中已经添加了Kafka和Jackson-dataformat-kafka的依赖。在Maven项目的pom.xml文件中添加以下依赖:


    org.springframework.kafka
    spring-kafka


    com.fasterxml.jackson.datatype
    jackson-datatype-kafka

在application.properties或application.yml文件中配置Kafka消费者属性,例如:

spring.kafka.bootstrap-servers=localhost:9092
spring.kafka.consumer.group-id=my-group
spring.kafka.consumer.auto-offset-reset=earliest
spring.kafka.consumer.key-deserializer=org.apache.kafka.common.serialization.StringDeserializer
spring.kafka.consumer.value-deserializer=org.apache.kafka.common.serialization.StringDeserializer

这里我们使用StringDeserializer作为键和值的反序列化器,你可以根据需要替换为其他反序列化器。

创建一个Java类,用于表示从Kafka接收到的消息。这个类的属性应该与Kafka消息中的键和值的数据结构相匹配。使用@JsonDeserialize注解来指定自定义的反序列化器(如果有)。

例如,假设你从Kafka接收到的消息是一个JSON对象,包含一个名为"name"的字符串字段和一个名为"age"的整数字段。你可以创建如下Java类:

import com.fasterxml.jackson.databind.annotation.JsonDeserialize;
public class User {
    @JsonDeserialize(using = StringDeserializer.class)
    private String name;
    @JsonDeserialize(using = IntegerDeserializer.class)
    private int age;
    // Getters and setters
}

注意:这里我们使用了StringDeserializer和IntegerDeserializer,你需要根据实际数据类型选择合适的反序列化器。

创建一个Kafka消费者配置类,继承AbstractKafkaConsumerFactory,并指定反序列化器。

import org.apache.kafka.common.serialization.StringDeserializer;
import org.springframework.beans.factory.annotation.Value;
import org.springframework.context.annotation.Bean;
import org.springframework.context.annotation.Configuration;
import org.springframework.kafka.annotation.KafkaListenerConfigurer;
import org.springframework.kafka.config.ConcurrentKafkaListenerContainerFactory;
import org.springframework.kafka.config.KafkaListenerEndpointRegistrar;
import org.springframework.kafka.config.MethodKafkaListenerEndpoint;
import org.springframework.kafka.core.ConsumerFactory;
import org.springframework.kafka.listener.ConcurrentMessageListenerContainer;
import org.springframework.kafka.listener.config.MethodKafkaListenerEndpointRegistrar;
import org.springframework.kafka.listener.config.KafkaListenerEndpoint;
@Configuration
public class KafkaConsumerConfig implements KafkaListenerConfigurer {
    @Value("${spring.kafka.bootstrap-servers}")
    private String bootstrapServers;
    @Bean
    public ConsumerFactory consumerFactory() {
        return new DefaultKafkaConsumerFactory<>(consumerConfigs());
    }
    private Map consumerConfigs() {
        Map props = new HashMap<>();
        props.put(ConsumerConfig.BOOTSTRAP_SERVERS_CONFIG, bootstrapServers);
        props.put(ConsumerConfig.GROUP_ID_CONFIG, "my-group");
        props.put(ConsumerConfig.KEY_DESERIALIZER_CLASS_CONFIG, StringDeserializer.class);
        props.put(ConsumerConfig.VALUE_DESERIALIZER_CLASS_CONFIG, StringDeserializer.class);
        return props;
    }
    @Override
    public void configureKafkaListeners(KafkaListenerEndpointRegistrar registrar) {
        MethodKafkaListenerEndpointRegistrar methodRegistrar = new MethodKafkaListenerEndpointRegistrar(registrar);
        methodRegistrar.setBeanFactory(applicationContext);
        methodRegistrar.setMethod(ConsumerRecordListener.class.getDeclaredMethods()[0]);
        methodRegistrar.setTopics("my-topic");
        methodRegistrar.setGroup("my-group");
        methodRegistrar.setConsumerFactory(consumerFactory());
        methodRegistrar.afterPropertiesSet();
    }
    @Bean
    public ConcurrentKafkaListenerContainerFactory kafkaListenerContainerFactory() {
        ConcurrentKafkaListenerContainerFactory factory = new ConcurrentKafkaListenerContainerFactory<>();
        factory.setConsumerFactory(consumerFactory());
        return factory;
    }
}

创建一个Kafka消息监听器类,实现ConsumerRecordListener接口。在这个类中,你可以处理从Kafka接收到的消息,并进行反序列化。

import org.apache.kafka.clients.consumer.ConsumerRecord;
import org.springframework.kafka.listener.ConsumerRecordListener;
public class ConsumerRecordListener implements ConsumerRecordListener {
    @Override
    public void onMessage(ConsumerRecord record) {
        User user = record.value();
        System.out.println("Received user: " + user);
    }
}

在Kafka消息监听器类上添加@KafkaListener注解,指定要监听的Kafka主题。

import org.springframework.kafka.annotation.KafkaListener;
public class ConsumerRecordListener implements ConsumerRecordListener {
    @Override
    public void onMessage(ConsumerRecord record) {
        User user = record.value();
        System.out.println("Received user: " + user);
    }
    @KafkaListener(topics = "my-topic", groupId = "my-group")
    public void listen(ConsumerRecord record) {
        onMessage(record);
    }
}

现在,当你的应用程序从Kafka接收到消息时,它会自动反序列化为User对象,并调用ConsumerRecordListener类中的onMessage方法进行处理。