I wouldn't be surprised if they encrypt them at rest, but at some point the weig... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		Retr0id 5 days ago \| parent \| context \| favorite \| on: Cybersecurity researchers aren't happy about the g... I wouldn't be surprised if they encrypt them at rest, but at some point the weights have to be loaded into vram.
		help

05 5 days ago [–]

Newer NVidia cards (H100 and up) support both in-memory model encryption and ‘trusted’ execution environment/remote attestation, not sure how widely used in frontier model deployments, but at least vendor claimed perf overhead is ‘3%’ [0]

[0] https://www.spheron.network/blog/confidential-gpu-computing-...

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact