AWS Neuron is a software development kit (SDK) enabling high-performance deep learning and generative AI using AWS Inferentia and Trainium accelerators. With Neuron, you can develop, profile, and deploy machine learning workloads on accelerated EC2 instances (Inf1, Inf2, Trn1, Trn2, Trn3).
Neuron includes a graph compiler, runtime, developer tools (Neuron Explorer, agentic development tools), and integrates with PyTorch, JAX, and vLLM Neuron for inference serving. The Neuron Kernel Interface (NKI) provides direct NeuronCore programming for custom kernels.
For full documentation including user guides, tutorials, and API references, see Neuron SDK documentation.
If none of the GitHub and online resources have an answer to your question, visit AWS re:Post for community support.