TDA4VM: Compile Microsoft small language model Phi3 Small (7B) or Phi3 Medium (14B) for TDA4VM

Jason Kridner1

Part Number: TDA4VM

Tool/software:

I've tried exploring Edge AI Studio, but I don't see a practical approach for translating Phi3 to a compiled model for TDA4VM.

Background:

https://azure.microsoft.com/en-us/blog/new-models-added-to-the-phi-3-family-available-on-microsoft-azure/

https://news.microsoft.com/source/features/ai/the-phi-3-small-language-models-with-big-potential/

over 1 year ago

0 Pratik Kedar over 1 year ago

TI__Mastermind 24041 points

Hi,

EdgeAI studio is limited to support standard models which are visible in model selection tab.

Our analytics offering is focused towards vision usecases like, object detection, semantic segmentation and object classification tasks.

You are more than welcome to explore our edgeai tidl tools for custom model compilation which falls under our supported use case, here is the link for edgeai tidl tools : https://github.com/TexasInstruments/edgeai-tidl-tools

Processors

Processors forum

TDA4VM: Compile Microsoft small language model Phi3 Small (7B) or Phi3 Medium (14B) for TDA4VM