Skip to content

Faster tar-ro through indexing at initialization#698

Open
jaybosamiya-ms wants to merge 1 commit intomainfrom
jayb/tarro-cached-data
Open

Faster tar-ro through indexing at initialization#698
jaybosamiya-ms wants to merge 1 commit intomainfrom
jayb/tarro-cached-data

Conversation

@jaybosamiya-ms
Copy link
Member

This PR optimizes our tar_ro file-system by switching O(n) to O(1) lookups through an initialization+indexing pass.

This corresponds to a ~146x speedup on some tar-file heavy situations (such as loading Python), changing it (on some systems) from taking minutes to load to fraction of a second.

@jaybosamiya-ms jaybosamiya-ms marked this pull request as ready for review March 3, 2026 01:31
@github-actions
Copy link

github-actions bot commented Mar 3, 2026

🤖 SemverChecks 🤖 No breaking API changes detected

Note: this does not mean API is unchanged, or even that there are no breaking changes; simply, none of the detections triggered.

Copy link
Member

@wdcui wdcui left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Thank you for the performance improvement!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants