Skip to content

Semantic segmentation example #33

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
crapthings opened this issue May 7, 2025 · 1 comment
Open

Semantic segmentation example #33

crapthings opened this issue May 7, 2025 · 1 comment
Assignees
Labels
PE Perception Encoder question Further information is requested

Comments

@crapthings
Copy link

How to use PE-Spatial-G14-448 to get binary mask?

a photo of an apple

input apple, then get the mask?

@dbolya dbolya self-assigned this May 8, 2025
@dbolya dbolya added question Further information is requested PE Perception Encoder labels May 8, 2025
@dbolya
Copy link
Contributor

dbolya commented May 8, 2025

Both PE core and PE lang are feature extractors. They output features useful for downstream tasks, but they themselves don't do any tasks like zero-shot semantic segmentation. You'll either have to train a semantic segmentation head yourself or plug PE spatial into a zero-shot method (see #20).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
PE Perception Encoder question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants