Jonathan Munz
2018-11-23 19:54:34 UTC
Hi,
I was looking to upgrade from 1.0.5 to 1.2.2. One thing I noticed is that
the 'kafkaOffset' metric is no longer being reported by the Kafka Trident
spout. In 1.0.5 it was being registered here:
https://github.com/apache/storm/blob/v1.0.5/external/storm-kafka/src/jvm/org/apache/storm/kafka/trident/TridentKafkaEmitter.java#L60
But in 1.2.2. that's no longer the case:
https://github.com/apache/storm/blob/v1.2.2/external/storm-kafka-client/src/main/java/org/apache/storm/kafka/spout/trident/KafkaTridentSpoutEmitter.java#L90
I don't see any mention in the PR that added the new implementation of the
Kafka Trident spout about why this was removed:
https://github.com/apache/storm/pull/1687
Was there a particular reason for this? Would you have any recommendations
about how to get this back or alternative ways to get at the same metric?
Thanks!
I was looking to upgrade from 1.0.5 to 1.2.2. One thing I noticed is that
the 'kafkaOffset' metric is no longer being reported by the Kafka Trident
spout. In 1.0.5 it was being registered here:
https://github.com/apache/storm/blob/v1.0.5/external/storm-kafka/src/jvm/org/apache/storm/kafka/trident/TridentKafkaEmitter.java#L60
But in 1.2.2. that's no longer the case:
https://github.com/apache/storm/blob/v1.2.2/external/storm-kafka-client/src/main/java/org/apache/storm/kafka/spout/trident/KafkaTridentSpoutEmitter.java#L90
I don't see any mention in the PR that added the new implementation of the
Kafka Trident spout about why this was removed:
https://github.com/apache/storm/pull/1687
Was there a particular reason for this? Would you have any recommendations
about how to get this back or alternative ways to get at the same metric?
Thanks!