Idea: Xquik public X/Twitter data integration

[kriptoburak]

Current behavior

Prefect has first-party and third-party integrations for workflow systems such as GitHub, Slack, AWS, and data platforms. I did not find an integration for read-only public X/Twitter data tasks.

Proposed behavior

Consider a Prefect integration or documented recipe for Xquik that exposes read-only tasks for public X/Twitter research workflows:

• Search public tweets with GET /x/tweets/search
• Fetch tweet details with GET /x/tweets/{id}
• Look up users with GET /x/users/{id} and GET /x/users/search
• List user tweets with GET /x/users/{id}/tweets
• Read trends with GET /x/trends

This would let Prefect flows collect public social signals, persist results, and trigger downstream enrichment without maintaining scraper code inside each flow.

Example use

A flow could run on a schedule, call Xquik with a Prefect Secret or block-backed API key, normalize matching tweets, and pass the rows to a warehouse or notification task.

Additional context

Xquik Prefect guide: https://docs.xquik.com/guides/prefect
External collection: https://github.com/Xquik-dev/prefect-xquik
SDK and skill repo: https://github.com/Xquik-dev/x-twitter-scraper

I am opening this as an Ideas discussion because the integration contribution guide says new integration ideas should be discussed first. If maintainers prefer this as an external collection or recipe rather than a core integration, that works too.

[zzstoatzz]

hi @kriptoburak generally we will promote well-adopted integrations to official, and otherwise encourage interested folks to make and use their own collection. we'd be happy to help with any questions you have if you choose to build it!

[kriptoburak]

Thanks, that guidance makes sense. I will treat this as an external collection or recipe path first, and not push for official integration placement unless there is adoption data or a maintainer asks for it.

[kriptoburak]

Thanks again for the guidance. I built the external collection here:

https://github.com/Xquik-dev/prefect-xquik

PyPI package:
https://pypi.org/project/prefect-xquik/

Guide:
https://docs.xquik.com/guides/prefect

Current shape:

• standalone Prefect collection layout with prefect_xquik
• XquikCredentials block using Prefect's CredentialsBlock
• async tasks for tweet search, tweet lookup, user search, user lookup, user tweets, and trends
• Prefect prefect.collections entry point
• BlockStandardTestSuite, endpoint/unit tests, CI, package build checks, and PyPI trusted publishing
• install path: pip install prefect-xquik

I'm not asking for official promotion yet. This is the external collection path first; if there are conventions you want adjusted before adoption work, I can align it.