Not able to get mesmer metrics

[NandiniMN]

We have written simple akka application in scala with a scheduled actor calling another actor for every 5 minutes. We have deployed this application in aws. Currently we are using datadog to check the logs and metrics details. Looking for some help, what we are missing to get the mesmer metrics

Added below dependencies in pom

io.opentelemetry.javaagent
opentelemetry-javaagent
${opentelemetry-javaagent.version}


io.scalac
mesmer-otel-extension_${scala.binary.version}
${mesmer-akka.version}


io.scalac
mesmer-akka-extension_${scala.binary.version}
${mesmer-akka.version}


io.opentelemetry
opentelemetry-exporter-otlp
1.13.0


io.opentelemetry
opentelemetry-sdk-extension-autoconfigure
1.13.0-alpha

This the vm args
"RuntimeParameters": "-javaagent:/opt/opentelemetry-javaagent-1.18.0.jar -Dotel.exporter.otlp.endpoint=http://127.0.0.1:4317 -Dotel.metric.export.interval=10000 -Dotel.service.name=mesmer-example -Dotel.metrics.exporter=otlp -Dotel.javaagent.extensions=/opt/mesmer-otel-extension_2.13-0.7.0.jar -Xlog:gc*=warning -Dio.scalac.mesmer.module.akkapersistence.recovery.time=false"

And we have this file added
https://github.com/ScalaConsultants/mesmer/blob/main/extension/src/main/resources/reference.conf

[lgajowy]

Try to add -Dotel.javaagent.debug=false parameter. Do you see the agent/extension starting in the logs right after the start of your application? You should get a whole bunch of (something similar):

[otel.javaagent 2022-11-23 11:02:50:009 +0100] [main] DEBUG io.opentelemetry.javaagent.tooling.AgentInstaller - Loading extension instrumentation-loader [class io.opentelemetry.javaagent.tooling.instrumentation.InstrumentationLoader]
[otel.javaagent 2022-11-23 11:02:50:079 +0100] [main] DEBUG io.opentelemetry.javaagent.tooling.instrumentation.InstrumentationLoader - Loading instrumentation mesmer-akka-http [class io.scalac.mesmer.otelextension.akka.MesmerAkkaHttpInstrumentationModule]
[otel.javaagent 2022-11-23 11:02:50:114 +0100] [main] DEBUG io.opentelemetry.javaagent.tooling.instrumentation.InstrumentationLoader - Loading instrumentation opentelemetry-annotations [class io.opentelemetry.javaagent.instrumentation.otelannotations.WithSpanInstrumentationModule]

[NandiniMN]

No not getting the extension logs

[lgajowy]

This can mean that:

• the javaagent is not being detected (is the path correct)
• the extension is not detected (again, path, but does it point to the jar from our release?

Are you able to get other opentelemetry metrics? Not the ones from our extension but the ones the opentelemetry agent provides? If not, that might be the problem with the way you add your agent to your application.

[NandiniMN]

we could see only below metrics from datadog

And the extension jar version is mesmer-otel-extension_2.13-0.7.0. Do you want me to try with any specific version?