Rakesh Matthew   •   about 2 years ago

Content Around Setting up Snowflake Arctic Locally?

Hi there! I am a snowflake enthusiast and new to LLMs. So I am looking for a general guide how to use Snowflake Arctic locally on a system. Does anyone has article/content around it? I went through the Langchain snowflake integration how ever it's more on embeddings and the code is not in detail on how to use Arctic on a dataframe

• 1 comment
• 

  Anna Filippova Manager   •   about 2 years ago

  Hey there Rakesh!

  Check out this tutorial for how to get set up with the LLM https://discuss.streamlit.io/t/faq-how-to-build-an-arctic-chatbot/68300. We highly recommend accessing Snowflake Arctic Instruct via an API because of the large size of the model.

  If you'd like to instead leverage the embed model, you can definitely run this locally by pulling it down from Hugging Face directly e.g. https://huggingface.co/Snowflake/snowflake-arctic-embed-xs . Note that the embed model does not output text, it is recommended for retrieval operations.

  Hope this helps!

Comments are closed.