java - 如何使用spring在kafka中创建两个接受不同数据类型的生产者kafka模板，一个是JsonNode，另一个是Avro？

Question

我正在尝试开发两个具有不同序列化类型(JSONNode、Avro)的生产者配置类，但是在运行时我只能实例化一个，另一个不起作用。

头等舱:

@Configuration
@EnableKafka
public class KafkaProducerConfig extends SomeClassConfig{
@Autowired
    private SomeClassProps someClassProps ;

@Bean
    public ProducerFactory<JsonNode, JsonNode> eventProducerFactory() throws UnknownHostException{
    return new DefaultKafkaProducerFactory<JsonNode, JsonNode>(producerConfigs(someClassProps ));
}

@Bean
public Map<String, Object> producerConfigs(SomeClassProps someClassProps ) throws UnknownHostException{
    Properties props = this.initProps(someClassProps );
    props.put(ProducerConfig.BOOTSTRAP_SERVERS_CONFIG, ***.getBootstrapServers());      
    props.put(ProducerConfig.KEY_SERIALIZER_CLASS_CONFIG, "org.apache.kafka.connect.json.JsonSerializer");
    props.put(ProducerConfig.VALUE_SERIALIZER_CLASS_CONFIG,"org.apache.kafka.connect.json.JsonSerializer");
    Map<String, Object> map = new HashMap<>();
    for (final String name: props.stringPropertyNames()) {
        map.put(name, props.getProperty(name));         
    }
    
    return map;
}

@Bean(name="eventProducerKafkaTemplate")
public KafkaTemplate<JsonNode,JsonNode> eventProducerKafkaTemplate() throws UnknownHostException{       
    return new KafkaTemplate<JsonNode,JsonNode>(eventProducerFactory());
}

}

第二类:

@Configuration("avroKafkaProducerConfig")
@EnableKafka
public class AvroKafkaProducerConfig extends SomeClassConfig{

    //private static final org.slf4j.Logger LOG = LoggerFactory.getLogger(KafkaProducerConfig.class);
        @Autowired
private SomeClassProps someClassProps ;
    
    @Bean(name = KafkaStreamsDefaultConfiguration.DEFAULT_STREAMS_CONFIG_BEAN_NAME)
    public StreamsConfig kafkaStreamsConfig(SomeClassProps someClassProps ) throws UnknownHostException {
        Map<String, Object> props = producerConfigs(someClassProps );
        return new StreamsConfig(props);
    }
    
    @Bean
    public ProducerFactory<SpecificRecord, SpecificRecord> eventProducerFactory() throws UnknownHostException{
        return new DefaultKafkaProducerFactory<SpecificRecord, SpecificRecord>(producerConfigs(someClassProps ));
    }
    
    @Bean
    public Map<String, Object> producerConfigs(SomeClassProps someClassProps ) throws UnknownHostException{
        Properties props = this.initProps(someClassProps );
        props.put(ProducerConfig.BOOTSTRAP_SERVERS_CONFIG, ***.getBootstrapServers());      
        props.put(ProducerConfig.KEY_SERIALIZER_CLASS_CONFIG, io.confluent.kafka.serializers.KafkaAvroSerializer.class);
        props.put(ProducerConfig.VALUE_SERIALIZER_CLASS_CONFIG,io.confluent.kafka.serializers.KafkaAvroSerializer.class);
        Map<String, Object> map = (Map) props;
        System.out.println("Avro"+map.values());
        
        return map;
    }
    
    @Bean(name="eventAvroProducerKafkaTemplate")
    public KafkaTemplate<SpecificRecord,SpecificRecord> eventProducerKafkaTemplate() throws UnknownHostException{       
        return new KafkaTemplate<SpecificRecord,SpecificRecord>(eventProducerFactory());
    }

}

当我尝试在 Controller 类中使用这些 kafka 模板时，它只是初始化 Json 序列化器，而不是 avro 序列化器。

这就是我在其他类中使用这些 kafka 模板的方式

@Autowired
    @Qualifier("eventProducerKafkaTemplate")
    private KafkaTemplate<JsonNode, JsonNode> eventProducerKafkaTemplate;

    @Autowired
     @Qualifier("eventAvroProducerKafkaTemplate")
    private KafkaTemplate<SpecificRecord,SpecificRecord> eventAvroProducerKafkaTemplate;


public ReturnTYpe methodName() {

eventProducerKafkaTemplate.send(****, ****, ****);
eventAvroProducerKafkaTemplate.send(****, ****, ****);
}

Answer 1

您必须为 2 个 ProducerConfigs 和 2 个 eventProducerFactory bean 提供不同的方法(bean)名称。否则，一个会覆盖另一个。