[STORM-4036] Apache Storm 2.5.0 not able to start with Kafka 3.6.1

[jira-importer]

Hi Team,

We are trying to use Apache Storm to pump in data using Kafka to another component. But as soon as we add the Kafka.properties to the storm conf folder, NMStormTopology and other processes fails with following error

Exception in thread "main" java.lang.NoClassDefFoundError: org.apache.kafka.clients.producer.Producer
at com.ibm.csi.nm.storm.app.NMStormTopology.validateKafkaConnection(NMStormTopology.java:126)
at com.ibm.csi.nm.storm.app.NMStormTopology.main(NMStormTopology.java:170)
Caused by: java.lang.ClassNotFoundException: org.apache.kafka.clients.producer.Producer
at java.net.URLClassLoader.findClass(URLClassLoader.java:610)
at java.lang.ClassLoader.loadClassHelper(ClassLoader.java:948)
at java.lang.ClassLoader.loadClass(ClassLoader.java:893)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:353)
at java.lang.ClassLoader.loadClass(ClassLoader.java:876)

We first start Kafka 3.6.1 server and then start storm 2.5.0.

We are trying to understand which version of Kafka is compatible Storm 2.5.0? or this is a bug in storm which is not able to integrate with Kafka 3.6.1?

with earlier version we didn't this issue but with this version we are seeing this. Help us to understand how to resolve this issue.

---

Originally reported by adisang, imported from: Apache Storm 2.5.0 not able to start with Kafka 3.6.1

• status: Open
• priority: Major
• resolution: Unresolved
• imported: 2025-01-24

[jira-importer]

rzo1:

Can you test with Storm 2.6.1 ? We updated the Kafka version, cf. https://storm.apache.org/2024/02/02/storm261-released.html