Llama 3.1 Nemotron 70B Instruct
Custom NVIDIA LLM optimized to enhance the helpfulness and relevance of generated responses to user queries.
LLM
API Usage
How to use Llama 3.1 Nemotron 70B InstructModel CardPrompting Llama 3.1 Nemotron 70B InstructApplications & Use CasesAPI Usage
Endpoint
nvidia/Llama-3.1-Nemotron-70B-Instruct-HF
RUN INFERENCE
curl -X POST "https://aitradestore.com/api/v1/chat/completions"
-H "Authorization: Bearer $AITRADESTORE_API_KEY"
-H "Content-Type: application/json"
-d '{
"model": "nvidia/Llama-3.1-Nemotron-70B-Instruct-HF",
"messages": [{"role": "user", "content": "What are some fun things to do in New York?"}]
}' JSON RESPONSE
RUN INFERENCE
from aitradestore import AiTradeStore client = AiTradeStore()
response = client.chat.completions.create(
model="nvidia/Llama-3.1-Nemotron-70B-Instruct-HF",
messages=[{"role": "user", "content": "What are some fun things to do in New York?"}], ) print(response.choices[0].message.content) JSON RESPONSE
RUN INFERENCE
import AiTradeStore from "ai-tradestore"; const aitradestore = new AiTradeStore(); const response = await aitradestore.chat.completions.create({
messages: [{"role": "user", "content": "What are some fun things to do in New York?"}],
model: "nvidia/Llama-3.1-Nemotron-70B-Instruct-HF", });
console.log(response.choices[0].message.content) JSON RESPONSE
Model Provider:
Meta
Type:
Chat
Variant:
Nemotron
Parameters:
70B
Deployment:
✔ Serverless
Quantization
FP16
Context length:
128K
Pricing:
$0.88
