-
Notifications
You must be signed in to change notification settings - Fork 768
Flyte 2 WIP #6583
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Flyte 2 WIP #6583
Conversation
* Add flyteidl and minimal publishing workflows Signed-off-by: Haytham Abuelfutuh <[email protected]> * pretend version for buf python Signed-off-by: Haytham Abuelfutuh <[email protected]> --------- Signed-off-by: Haytham Abuelfutuh <[email protected]>
|
Bito Automatic Review Skipped - Branch Excluded |
* python version fix and use OIDC to authenticate crates Signed-off-by: Haytham Abuelfutuh <[email protected]> * Fix python versioning Signed-off-by: Haytham Abuelfutuh <[email protected]> * Set version before setting up env Signed-off-by: Haytham Abuelfutuh <[email protected]> * echo version Signed-off-by: Haytham Abuelfutuh <[email protected]> * Write to GITHUB_ENV Signed-off-by: Haytham Abuelfutuh <[email protected]> * Use env: Signed-off-by: Haytham Abuelfutuh <[email protected]> * buf generate Signed-off-by: Haytham Abuelfutuh <[email protected]> --------- Signed-off-by: Haytham Abuelfutuh <[email protected]>
|
Bito Automatic Review Skipped - Branch Excluded |
Signed-off-by: Haytham Abuelfutuh <[email protected]>
|
Bito Automatic Review Skipped - Branch Excluded |
* Mark go package as /v2 to be able to import both at the same time Signed-off-by: Haytham Abuelfutuh <[email protected]> * Upgrade to go 1.24 Signed-off-by: Haytham Abuelfutuh <[email protected]> * Rename python, rust and npm to flyteidl2 Signed-off-by: Haytham Abuelfutuh <[email protected]> --------- Signed-off-by: Haytham Abuelfutuh <[email protected]>
|
Bito Automatic Review Skipped - Branch Excluded |
…6610) * trying idl2 Signed-off-by: Haytham Abuelfutuh <[email protected]> * wip Signed-off-by: Haytham Abuelfutuh <[email protected]> * wip Signed-off-by: Haytham Abuelfutuh <[email protected]> * Update trace def Signed-off-by: Haytham Abuelfutuh <[email protected]> * refactor: rename idl2 to flyteidl2 Signed-off-by: machichima <[email protected]> * generate -> buf Signed-off-by: Haytham Abuelfutuh <[email protected]> * refactor: rename idl2 to flyteidl2 Signed-off-by: machichima <[email protected]> * build: re-gen Signed-off-by: machichima <[email protected]> * fix: exclude python venv Signed-off-by: machichima <[email protected]> * Add translator service Signed-off-by: Haytham Abuelfutuh <[email protected]> * Regen Signed-off-by: Haytham Abuelfutuh <[email protected]> * buf gen Signed-off-by: Haytham Abuelfutuh <[email protected]> * refactor Signed-off-by: Haytham Abuelfutuh <[email protected]> * wip Signed-off-by: Haytham Abuelfutuh <[email protected]> * remove node execution service proto Signed-off-by: Haytham Abuelfutuh <[email protected]> * Breakup task service into a separate package Signed-off-by: Haytham Abuelfutuh <[email protected]> * Help strings for make file targets Signed-off-by: Haytham Abuelfutuh <[email protected]> * Update TaskLog with read bool Signed-off-by: Haytham Abuelfutuh <[email protected]> * Trying the updated protovalidate plugin Signed-off-by: Haytham Abuelfutuh <[email protected]> * protovalidate with semver Signed-off-by: Haytham Abuelfutuh <[email protected]> * try claude :shrug Signed-off-by: Haytham Abuelfutuh <[email protected]> * add buf Signed-off-by: Haytham Abuelfutuh <[email protected]> * update Signed-off-by: Haytham Abuelfutuh <[email protected]> * update deps Signed-off-by: Haytham Abuelfutuh <[email protected]> * build: remove generate validate for python Signed-off-by: machichima <[email protected]> * build: use managed mode on buf.gen.yaml Signed-off-by: machichima <[email protected]> * Update validate go plugin Signed-off-by: Haytham Abuelfutuh <[email protected]> * Update imagebuild Signed-off-by: Haytham Abuelfutuh <[email protected]> * Fix oneof buf lint Signed-off-by: Haytham Abuelfutuh <[email protected]> * wip Signed-off-by: Haytham Abuelfutuh <[email protected]> * Add deps to generated python code Signed-off-by: Haytham Abuelfutuh <[email protected]> * Be explicit about the index Signed-off-by: Haytham Abuelfutuh <[email protected]> * updated idl Signed-off-by: Haytham Abuelfutuh <[email protected]> * Catch up to main Signed-off-by: Haytham Abuelfutuh <[email protected]> * Generate mocks for workflow package Signed-off-by: Haytham Abuelfutuh <[email protected]> * generate mocks for other packages Signed-off-by: Haytham Abuelfutuh <[email protected]> * buf improvements Signed-off-by: Haytham Abuelfutuh <[email protected]> * updates Signed-off-by: Haytham Abuelfutuh <[email protected]> * feat: generate mock for common Signed-off-by: machichima <[email protected]> * use make gen in GH Actions Signed-off-by: Haytham Abuelfutuh <[email protected]> * Do not setup python env in generation CI Signed-off-by: Haytham Abuelfutuh <[email protected]> * setup uv Signed-off-by: Haytham Abuelfutuh <[email protected]> * set working directory Signed-off-by: Haytham Abuelfutuh <[email protected]> * Try to reference files by path Signed-off-by: Haytham Abuelfutuh <[email protected]> * wip Signed-off-by: Haytham Abuelfutuh <[email protected]> * Explicitly move .venv to root Signed-off-by: Haytham Abuelfutuh <[email protected]> * try exclude in buf.yaml Signed-off-by: Haytham Abuelfutuh <[email protected]> * set UV_PROJECT_ENVIRONMENT Signed-off-by: Haytham Abuelfutuh <[email protected]> * wip Signed-off-by: Haytham Abuelfutuh <[email protected]> * download tooling Signed-off-by: Haytham Abuelfutuh <[email protected]> * add which mockery Signed-off-by: Haytham Abuelfutuh <[email protected]> * wip Signed-off-by: Haytham Abuelfutuh <[email protected]> --------- Signed-off-by: Haytham Abuelfutuh <[email protected]> Signed-off-by: machichima <[email protected]> Co-authored-by: machichima <[email protected]>
|
Bito Automatic Review Skipped - Branch Excluded |
* Add Trigger APIs Signed-off-by: Haytham Abuelfutuh <[email protected]> * update triggers Signed-off-by: Haytham Abuelfutuh <[email protected]> * wip Signed-off-by: Haytham Abuelfutuh <[email protected]> * refactor Signed-off-by: Haytham Abuelfutuh <[email protected]> --------- Signed-off-by: Haytham Abuelfutuh <[email protected]>
|
Bito Automatic Review Skipped - Branch Excluded |
* Fix cargo build and add CI check Signed-off-by: Haytham Abuelfutuh <[email protected]> * lint lib.rs Signed-off-by: Haytham Abuelfutuh <[email protected]> * Update Readme and contributing guides Signed-off-by: Haytham Abuelfutuh <[email protected]> * signed? Signed-off-by: Haytham Abuelfutuh <[email protected]> * fix build target Signed-off-by: Haytham Abuelfutuh <[email protected]> * fix build-crate target Signed-off-by: Haytham Abuelfutuh <[email protected]> * fix included ts files in npm Signed-off-by: Haytham Abuelfutuh <[email protected]> --------- Signed-off-by: Haytham Abuelfutuh <[email protected]>
|
Bito Automatic Review Skipped - Branch Excluded |
Signed-off-by: Yee Hing Tong <[email protected]>
|
Bito Automatic Review Skipped - Branch Excluded |
* Add device class to `GpuAccelerator` Signed-off-by: Jeev B <[email protected]> * make gen Signed-off-by: Jeev B <[email protected]> * Add HABANA_GAUDI as supported device class Signed-off-by: Jeev B <[email protected]> --------- Signed-off-by: Jeev B <[email protected]>
|
Bito Automatic Review Skipped - Branch Excluded |
Signed-off-by: Haytham Abuelfutuh <[email protected]>
Signed-off-by: Haytham Abuelfutuh <[email protected]>
Signed-off-by: Haytham Abuelfutuh <[email protected]>
Signed-off-by: Haytham Abuelfutuh <[email protected]>
Signed-off-by: Haytham Abuelfutuh <[email protected]>
|
Bito Automatic Review Skipped - Branch Excluded |
Signed-off-by: Iaroslav Ciupin <[email protected]>
|
Bito Automatic Review Skipped - Branch Excluded |
Signed-off-by: Iaroslav Ciupin <[email protected]>
|
Bito Automatic Review Skipped - Branch Excluded |
* Clean up triggers api Signed-off-by: Iaroslav Ciupin <[email protected]> * make gen Signed-off-by: Iaroslav Ciupin <[email protected]> --------- Signed-off-by: Iaroslav Ciupin <[email protected]>
|
Bito Automatic Review Skipped - Branch Excluded |
* copy over flyteplugins Signed-off-by: Paul Dittamo <[email protected]> * remove secret manager Signed-off-by: Paul Dittamo <[email protected]> * remove array plugin Signed-off-by: Paul Dittamo <[email protected]> * delete hive Signed-off-by: Paul Dittamo <[email protected]> * remove athena, databricks, snowflake, big query Signed-off-by: Paul Dittamo <[email protected]> * remove presto Signed-off-by: Paul Dittamo <[email protected]> * copy over coreutils Signed-off-by: Paul Dittamo <[email protected]> * temp delete webapi Signed-off-by: Paul Dittamo <[email protected]> * delete auto refresh cache Signed-off-by: Paul Dittamo <[email protected]> * Revert "delete auto refresh cache" This reverts commit fe08f12. * delete kfoperators Signed-off-by: Paul Dittamo <[email protected]> * delete echo Signed-off-by: Paul Dittamo <[email protected]> * copy over plugins Signed-off-by: Paul Dittamo <[email protected]> * gen mocks Signed-off-by: Paul Dittamo <[email protected]> * simplify modules Signed-off-by: Paul Dittamo <[email protected]> * copy over flytestdlib Signed-off-by: Paul Dittamo <[email protected]> * copy over event and cache proto + point flyteplugin and flytestdlib imports to v2 Signed-off-by: Paul Dittamo <[email protected]> * add RawOutputDataConfig Signed-off-by: Paul Dittamo <[email protected]> * copy over kubeflow operators + non connector/agent web api plugins Signed-off-by: Paul Dittamo <[email protected]> * Revert "add RawOutputDataConfig" This reverts commit e260772. * make gen Signed-off-by: Paul Dittamo <[email protected]> * clean up Signed-off-by: Paul Dittamo <[email protected]> * gen Signed-off-by: Paul Dittamo <[email protected]> * remove web api Signed-off-by: Paul Dittamo <[email protected]> * gen Signed-off-by: Paul Dittamo <[email protected]> --------- Signed-off-by: Paul Dittamo <[email protected]>
|
Bito Automatic Review Skipped - Branch Excluded |
* feat: add short name to watch group task group response Signed-off-by: machichima <[email protected]> * build: make gen Signed-off-by: machichima <[email protected]> --------- Signed-off-by: machichima <[email protected]>
Signed-off-by: machichima <[email protected]>
|
Bito Automatic Review Skipped - Branch Excluded |
flyteidl crate remove extension module Signed-off-by: Yee Hing Tong <[email protected]>
|
Bito Automatic Review Skipped - Branch Excluded |
Signed-off-by: Haytham Abuelfutuh <[email protected]>
|
Bito Automatic Review Skipped - Branch Excluded |
* feat(queue): add Dockerfile and K8s deployment for Queue service Signed-off-by: WangWang0226 <[email protected]> * refactor(queue/k8s): migrate manifests to Kustomize layout and enable kubectl apply -k Signed-off-by: WangWang0226 <[email protected]> * chore(queue): drop Dockerfile healthcheck and align RBAC with executor style Signed-off-by: WangWang0226 <[email protected]> --------- Signed-off-by: WangWang0226 <[email protected]>
Signed-off-by: Iaroslav Ciupin <[email protected]>
|
Bito Automatic Review Skipped - Branch Excluded |
Signed-off-by: Kevin Su <[email protected]>
|
Bito Automatic Review Skipped - Branch Excluded |
Signed-off-by: Iaroslav Ciupin <[email protected]>
|
Bito Automatic Review Skipped - Branch Excluded |
Signed-off-by: Kevin Su <[email protected]>
This reverts commit ab2f36b.
|
Bito Automatic Review Skipped - Branch Excluded |
Signed-off-by: Kevin Su <[email protected]>
|
Bito Automatic Review Skipped - Branch Excluded |
* refactor: split out action and general interfaces Signed-off-by: machichima <[email protected]> * refactor: update state service Signed-off-by: machichima <[email protected]> * chore: remove cmd in gitignore Signed-off-by: machichima <[email protected]> * fix: add repository.go as entry point for repository inerface Signed-off-by: machichima <[email protected]> * build: make gen Signed-off-by: machichima <[email protected]> --------- Signed-off-by: machichima <[email protected]>
|
Bito Automatic Review Skipped - Branch Excluded |
Signed-off-by: machichima <[email protected]>
|
Bito Automatic Review Skipped - Branch Excluded |
* Migrate CoPilot Signed-off-by: Barry Wu <[email protected]> * Update: Add cmd/ and delete go.mod and go.sum in copilot Signed-off-by: Barry Wu <[email protected]> * Fix CI error Signed-off-by: Barry Wu <[email protected]> * Update make gen changes Signed-off-by: Barry Wu <[email protected]> --------- Signed-off-by: Barry Wu <[email protected]>
|
Bito Automatic Review Skipped - Branch Excluded |
* feat: add task model and use db&gorm tag together Signed-off-by: machichima <[email protected]> * docs: update development guidance Signed-off-by: machichima <[email protected]> * feat: init moving task service Signed-off-by: machichima <[email protected]> * feat: add filter and sort for task service Signed-off-by: machichima <[email protected]> * feat: mount task service Signed-off-by: machichima <[email protected]> * refactor: clean up Signed-off-by: machichima <[email protected]> * docs: add task service api endpoint docs Signed-off-by: machichima <[email protected]> * test: add unit test for repository/impl Signed-off-by: machichima <[email protected]> * test: unit test for task transformers Signed-off-by: machichima <[email protected]> * feat: add mocks for repo interfaces Signed-off-by: machichima <[email protected]> * test: unit test for runs/service Signed-off-by: machichima <[email protected]> * build: make gen Signed-off-by: machichima <[email protected]> * fix: add migration for task and task spec Signed-off-by: machichima <[email protected]> * refactor: format Signed-off-by: machichima <[email protected]> * docs: add example script for create and list task Signed-off-by: machichima <[email protected]> * fix: remove unused impl/constant.go Signed-off-by: machichima <[email protected]> * fix: prevent overwrite filter Signed-off-by: machichima <[email protected]> * refactor: move To... function to transformers Signed-off-by: machichima <[email protected]> * build: make gen Signed-off-by: machichima <[email protected]> --------- Signed-off-by: machichima <[email protected]>
|
Bito Automatic Review Skipped - Branch Excluded |
* refactor: rename tests/ to test/ Signed-off-by: machichima <[email protected]> * feat: add test setup and cleanp Signed-off-by: machichima <[email protected]> * test: add deploy task api test Signed-off-by: machichima <[email protected]> * docs: update make commands and docs Signed-off-by: machichima <[email protected]> * build: make gen Signed-off-by: machichima <[email protected]> --------- Signed-off-by: machichima <[email protected]>
Tracking issue
Why are the changes needed?
What changes were proposed in this pull request?
How was this patch tested?
Labels
Please add one or more of the following labels to categorize your PR:
This is important to improve the readability of release notes.
Setup process
Screenshots
Check all the applicable boxes
Related PRs
Docs link