Skip to content

various issues #2006

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
PsyChip opened this issue Feb 18, 2025 · 0 comments
Open

various issues #2006

PsyChip opened this issue Feb 18, 2025 · 0 comments
Assignees
Labels
bug Something isn't working

Comments

@PsyChip
Copy link

PsyChip commented Feb 18, 2025

  1. database is obsolete: i examined the url list, there is more than 1700~ site entries but only around 500 of them is active (got screenshots)
  2. false positives: some websites redirecting to main page when there is no username, maigret assuming it's a profile page
  3. consider puppeteer: most websites using client side rendering now, showing empty content to command line scrapers.
  4. consider 2b llm agents: it's almost impossible to maintain repository to align with 500~ websites, create a pipeline to a low latency agent to verify profile exists or not
@PsyChip PsyChip added the bug Something isn't working label Feb 18, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants