Ask HN: What is your LLM monitoring stack? 5 pointsaiunboxed2 years ago1 commentSaveHideCopy link On HNWhat do you use for tracing llm calls etc ?Comments−chitraa2yConsider using resources like TensorFlow Profiler, PyTorch Profiler, and Spark MLlib's profiler. you can also take advantage from the capabilities of tracing libraries like TensorBoard or Prometheus.
Comments
Consider using resources like TensorFlow Profiler, PyTorch Profiler, and Spark MLlib's profiler. you can also take advantage from the capabilities of tracing libraries like TensorBoard or Prometheus.