README.md

metadata

license: gemma
language:
  - en
base_model: google/gemma-4-12B
base_model_relation: adapter
library_name: peft
tags:
  - lora
  - peft
  - text-generation
  - social-media
  - gemma4
  - generated_from_trainer

micic-mihajlo/gemma-4-12b-social-post-lora

LoRA adapter for general-purpose social media post drafting.

Base

• Base model: google/gemma-4-12B
• Adapter: micic-mihajlo/gemma-4-12b-social-post-lora
• Training method: QLoRA + FSDP + MMD/JMQ

Data

• Train examples: 3
• Validation examples: 1
• Generated eval posts: 10

Objective

The adapter is optimized for brief-to-post generation with supervised cross-entropy plus distribution-alignment regularizers over token-logit shape.

Evaluation

Metric	Value
avg_sentence_length	15.7489
avg_word_length	5.0170
char_count	429.6000
cta_marker_count	0.2000
hashtag_count	0.0000
mention_count	0.0000
punctuation_rate	0.0228
sentence_count	4.4000
type_token_ratio	0.7624
url_count	0.0000
word_count	68.3000

Base Comparison

• Style distance improvement: 661.4012
• Adapter-target distance: 282.1723
• Base-target distance: 943.5735

Limitations

• This adapter should not be used to imitate a private person, brand, or protected identity.
• Quality depends on the human-reference corpus and held-out brief coverage.
• Distribution metrics are diagnostic signals, not a substitute for human review.