How to use embeddings with PyTorch

• stablediffusion

  108 36,226 0.0 Python

  High-Resolution Image Synthesis with Latent Diffusion Models

  

So we have FrozenCLIPEmbedder inside the stablediffusion repo, which uses the transformers from huggingface. I do not think the CLIPTokenizer or CLIPTextModel would be perfect, but gives some idea how that works. Possibly the BasicTokenizer as a simpler starting point.

• transformers

  175 125,021 10.0 Python

  🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

  

So we have FrozenCLIPEmbedder inside the stablediffusion repo, which uses the transformers from huggingface. I do not think the CLIPTokenizer or CLIPTextModel would be perfect, but gives some idea how that works. Possibly the BasicTokenizer as a simpler starting point.

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• textual_inversion

  30 2,743 0.8 Jupyter Notebook

Checking out https://github.com/rinongal/textual_inversion, which has some possibly informative examples and scripts.

Suggest a related project