https://www.infoq.com InfoQ ONNX Articles feed https://www.infoq.com/articles/onnx-ai-inference-with-java/?utm_campaign=infoq_content&utm_source=infoq&utm_medium=feed&utm_term=ONNX-articles <img src="https://res.infoq.com/articles/onnx-ai-inference-with-java/en/headerimage/Bringing-AI-Inference-to-Java-with-ONNX-image-header-1759229686552.jpg"/><p>Java applications can now run transformer-based AI models directly within the JVM—without Python, REST wrappers, or microservices. This guide shows how to integrate ONNX-powered inference with tokenizer support, GPU acceleration, modular deployment, and observability, enabling architects in regulated domains to adopt AI without disrupting compliance or CI/CD workflows.</p> <i>By Syed Danish Ali</i> Java ONNX Architecture & Design Development article Fri, 03 Oct 2025 09:00:00 GMT https://www.infoq.com/articles/onnx-ai-inference-with-java/?utm_campaign=infoq_content&utm_source=infoq&utm_medium=feed&utm_term=ONNX-articles Syed Danish Ali 2025-10-03T09:00:00Z /articles/onnx-ai-inference-with-java/en