ONNX is an emerging standard format for serializing machine learning models. This talk will introduce Agate, Stripe's library for scoring ONNX models on the JVM in pure Scala. Stripe uses Agate to score deep learning models in batch in spark and scalding, and also in real-time using our scala-based scoring service. We'll talk about performance, how Agate was developed, and how we use graal native-image built binaries to interop with python.
