Wish I had the VRAM to run this model but my 3090 and an added 32GB shared memory doesn't cut it. I have a 4070 too but the container won't start up with dual GPU's unless you have identical cards. Thinking about just biting the bullet and buying an A100.
Travis Lelle PRO
info5ec
Β·
AI & ML interests
None yet
Recent Activity
commented on
an
article
5 days ago
The Open Evaluation Standard: Benchmarking NVIDIA Nemotron 3 Nano with NeMo Evaluator
updated
a Space
20 days ago
info5ec/First_agent_template
upvoted
a
paper
24 days ago
Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memory
Organizations
None yet