Text Generation
KerasHub
English
text-generation-inference
text-to-text-generation
text-conversation
Instructions to use keras/llama3_instruct_8b_en_int8 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- KerasHub
How to use keras/llama3_instruct_8b_en_int8 with KerasHub:
import keras_hub # Create a LlamaCausalLM model task = keras_hub.models.LlamaCausalLM.from_preset("hf://keras/llama3_instruct_8b_en_int8")import keras_hub # Create a Backbone model unspecialized for any task backbone = keras_hub.models.Backbone.from_preset("hf://keras/llama3_instruct_8b_en_int8") - Keras
How to use keras/llama3_instruct_8b_en_int8 with Keras:
# !pip install -U keras tensorflow huggingface_hub # Keras needs TensorFlow installed to read "hf://" paths, so the tensorflow backend is selected here; # "jax" and "torch" also work for computation once TensorFlow is installed. import os os.environ["KERAS_BACKEND"] = "tensorflow" import keras model = keras.saving.load_model("hf://keras/llama3_instruct_8b_en_int8") - Notebooks
- Google Colab
- Kaggle
Ctrl+K