Skip to content

Add download bar to puma pull#11

Merged
InftyAI-Agent merged 1 commit intoInftyAI:mainfrom
kerthcet:feat/model-management
Feb 24, 2025
Merged

Add download bar to puma pull#11
InftyAI-Agent merged 1 commit intoInftyAI:mainfrom
kerthcet:feat/model-management

Conversation

@kerthcet
Copy link
Member

@kerthcet kerthcet commented Feb 24, 2025

What this PR does / why we need it

RUST_LOG=info ./puma pull --provider=ollama --model=qwen2.5:3b generally looks like:

[2025-02-24T13:29:26Z INFO  puma::downloader::ollama] Downloading model qwen2.5:3b from ollama provider...
[2025-02-24T13:29:26Z INFO  puma::downloader::ollama] Querying the manifest...
  [00:00:00] [########################################] 1.45 KiB/1.45 KiB  template
  [00:00:01] [########################################] 7.21 KiB/7.21 KiB  license
  [00:00:01] [########################################] 68 B/68 B  system
  [00:01:17] [########################################] 1.80 GiB/1.80 GiB  model                                                                                                                                                              
[2025-02-24T13:30:45Z INFO  puma::downloader::ollama] Download model qwen2.5:3b totally takes 78.97s.

Which issue(s) this PR fixes

Fixes #

Special notes for your reviewer

Does this PR introduce a user-facing change?

NOne

Signed-off-by: kerthcet <kerthcet@gmail.com>
@InftyAI-Agent InftyAI-Agent added needs-triage Indicates an issue or PR lacks a label and requires one. needs-priority Indicates a PR lacks a label and requires one. do-not-merge/needs-kind Indicates a PR lacks a label and requires one. labels Feb 24, 2025
@kerthcet
Copy link
Member Author

/kind feature
/lgtm
/approve

@InftyAI-Agent InftyAI-Agent added feature Categorizes issue or PR as related to a new feature. lgtm Looks good to me, indicates that a PR is ready to be merged. approved Indicates a PR has been approved by an approver from all required OWNERS files. and removed do-not-merge/needs-kind Indicates a PR lacks a label and requires one. labels Feb 24, 2025
@InftyAI-Agent InftyAI-Agent merged commit 860a1ab into InftyAI:main Feb 24, 2025
40 checks passed
@kerthcet kerthcet deleted the feat/model-management branch February 24, 2025 13:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by an approver from all required OWNERS files. feature Categorizes issue or PR as related to a new feature. lgtm Looks good to me, indicates that a PR is ready to be merged. needs-priority Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants