Granite-3.1-8B-Instruct is a 8B parameter long-context instruct model finetuned from Granite-3.1-8B-Base using a combination of open source instruction datasets with permissive license and internally collected synthetic datasets tailored for solving long context problems. This model is developed using a diverse set of techniques with a structured chat format, including supervised finetuning, model alignment using reinforcement learning, and model merging.

Model Farm provides optimized model resources and test code, which can be obtained through the following two methods:

• Obtain via Model Farm page: Click Models & Test Code in the Performance Reference section on the right to obtain model resources and code packages.

• Obtain via command line (Recommand): Users with APLUX development boards can obtain model resources and code packages through the built-in MMS tool.

# Search Models
mms list [model name]

# Get Models
mms get -m [model name] -p [precision] -c [soc] -b [backend] -d [file path]

For MMS usage, please refer to: MMS Usage & Access to Preview Models

• Developers: Granite Team, IBM
• GitHub Repository: ibm-granite/granite-3.1-language-models
• Website: Granite Docs
• Paper: Granite 3.1 Language Models (coming soon)
• Release Date: December 18th, 2024
• License: Apache 2.0

Supported Languages: English, German, Spanish, French, Japanese, Portuguese, Arabic, Czech, Italian, Korean, Dutch, and Chinese. Users may finetune Granite 3.1 models for languages beyond these 12 languages.

Note: This table showed source model instead of quantized model evaluation. Source Model Evaluation refer to Granite-3.1-8b-Instruct Evaluation Result

Please refer to the model inference tags at the top to select an appropriate inference SDK.

Recommended to use AidGen & AidGenSE for inference