Skip to content

Add filtered_txn.zip feature for VitisAI#2368

Open
anilmartha wants to merge 3 commits intomicrosoft:mainfrom
anilmartha:filtered_zip
Open

Add filtered_txn.zip feature for VitisAI#2368
anilmartha wants to merge 3 commits intomicrosoft:mainfrom
anilmartha:filtered_zip

Conversation

@anilmartha
Copy link

Summary

  • Add optional filtered_zip_path parameter to the VitisGenerateModelLLM pass to automatically copy filtered transaction data (e.g. filtered_txn.zip) into the model output directory during NPU model generation
  • When filtered_zip_path is specified in the pass config, the file is copied to the output directory after generate_npu_model completes, enabling a single-step pipeline for VitisAI NPU deployment

Changes

File Change
olive/passes/onnx/vitis_ai/vitis_generate_model_llm.py Added shutil import, new optional filtered_zip_path config parameter, and post-generation copy logic

Details

  • filtered_zip_path is an optional str parameter (defaults to None), so existing configs are unaffected
  • When provided, the pass resolves the path, validates the file exists, and copies it into the output directory alongside the generated model
  • Raises FileNotFoundError if the specified file does not exist

Test plan

  • Run olive run --config Llama-3.1-8B-Instruct_quark_vitisai_llm.json with filtered_zip_path set and verify the zip is copied to the output directory
  • Run an existing config without filtered_zip_path and verify no regression (pass behaves as before)

@anilmartha
Copy link
Author

@microsoft-github-policy-service agree company="AMD"

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant