Skip to content

Conversation

@EngHabu
Copy link
Contributor

@EngHabu EngHabu commented Aug 22, 2025

  • Add flyteidl and minimal publishing workflows

Tracking issue

Why are the changes needed?

What changes were proposed in this pull request?

How was this patch tested?

Labels

Please add one or more of the following labels to categorize your PR:

  • added: For new features.
  • changed: For changes in existing functionality.
  • deprecated: For soon-to-be-removed features.
  • removed: For features being removed.
  • fixed: For any bug fixed.
  • security: In case of vulnerabilities

This is important to improve the readability of release notes.

Setup process

Screenshots

Check all the applicable boxes

  • I updated the documentation accordingly.
  • All new and existing tests passed.
  • All commits are signed-off.

Related PRs

Docs link

* Add flyteidl and minimal publishing workflows

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* pretend version for buf python

Signed-off-by: Haytham Abuelfutuh <[email protected]>

---------

Signed-off-by: Haytham Abuelfutuh <[email protected]>
@flyte-bot
Copy link
Collaborator

Bito Automatic Review Skipped - Branch Excluded

Bito didn't auto-review because the source or target branch is excluded from automatic reviews.
No action is needed if you didn't intend for the agent to review it. Otherwise, to manually trigger a review, type /review in a comment and save.
You can change the branch exclusion settings here, or contact your Bito workspace admin at [email protected].

* python version fix and use OIDC to authenticate crates

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Fix python versioning

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Set version before setting up env

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* echo version

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Write to GITHUB_ENV

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Use env:

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* buf generate

Signed-off-by: Haytham Abuelfutuh <[email protected]>

---------

Signed-off-by: Haytham Abuelfutuh <[email protected]>
@flyte-bot
Copy link
Collaborator

Bito Automatic Review Skipped - Branch Excluded

Bito didn't auto-review because the source or target branch is excluded from automatic reviews.
No action is needed if you didn't intend for the agent to review it. Otherwise, to manually trigger a review, type /review in a comment and save.
You can change the branch exclusion settings here, or contact your Bito workspace admin at [email protected].

Signed-off-by: Haytham Abuelfutuh <[email protected]>
@flyte-bot
Copy link
Collaborator

Bito Automatic Review Skipped - Branch Excluded

Bito didn't auto-review because the source or target branch is excluded from automatic reviews.
No action is needed if you didn't intend for the agent to review it. Otherwise, to manually trigger a review, type /review in a comment and save.
You can change the branch exclusion settings here, or contact your Bito workspace admin at [email protected].

* Mark go package as /v2 to be able to import both at the same time

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Upgrade to go 1.24

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Rename python, rust and npm to flyteidl2

Signed-off-by: Haytham Abuelfutuh <[email protected]>

---------

Signed-off-by: Haytham Abuelfutuh <[email protected]>
@flyte-bot
Copy link
Collaborator

Bito Automatic Review Skipped - Branch Excluded

Bito didn't auto-review because the source or target branch is excluded from automatic reviews.
No action is needed if you didn't intend for the agent to review it. Otherwise, to manually trigger a review, type /review in a comment and save.
You can change the branch exclusion settings here, or contact your Bito workspace admin at [email protected].

…6610)

* trying idl2

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* wip

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* wip

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Update trace def

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* refactor: rename idl2 to flyteidl2

Signed-off-by: machichima <[email protected]>

* generate -> buf

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* refactor: rename idl2 to flyteidl2

Signed-off-by: machichima <[email protected]>

* build: re-gen

Signed-off-by: machichima <[email protected]>

* fix: exclude python venv

Signed-off-by: machichima <[email protected]>

* Add translator service

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Regen

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* buf gen

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* refactor

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* wip

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* remove node execution service proto

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Breakup task service into a separate package

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Help strings for make file targets

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Update TaskLog with read bool

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Trying the updated protovalidate plugin

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* protovalidate with semver

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* try claude :shrug

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* add buf

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* update

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* update deps

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* build: remove generate validate for python

Signed-off-by: machichima <[email protected]>

* build: use managed mode on buf.gen.yaml

Signed-off-by: machichima <[email protected]>

* Update validate go plugin

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Update imagebuild

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Fix oneof buf lint

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* wip

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Add deps to generated python code

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Be explicit about the index

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* updated idl

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Catch up to main

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Generate mocks for workflow package

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* generate mocks for other packages

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* buf improvements

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* updates

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* feat: generate mock for common

Signed-off-by: machichima <[email protected]>

* use make gen in GH Actions

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Do not setup python env in generation CI

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* setup uv

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* set working directory

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Try to reference files by path

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* wip

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Explicitly move .venv to root

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* try exclude in buf.yaml

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* set UV_PROJECT_ENVIRONMENT

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* wip

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* download tooling

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* add which mockery

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* wip

Signed-off-by: Haytham Abuelfutuh <[email protected]>

---------

Signed-off-by: Haytham Abuelfutuh <[email protected]>
Signed-off-by: machichima <[email protected]>
Co-authored-by: machichima <[email protected]>
@flyte-bot
Copy link
Collaborator

Bito Automatic Review Skipped - Branch Excluded

Bito didn't auto-review because the source or target branch is excluded from automatic reviews.
No action is needed if you didn't intend for the agent to review it. Otherwise, to manually trigger a review, type /review in a comment and save.
You can change the branch exclusion settings here, or contact your Bito workspace admin at [email protected].

* Add Trigger APIs

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* update triggers

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* wip

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* refactor

Signed-off-by: Haytham Abuelfutuh <[email protected]>

---------

Signed-off-by: Haytham Abuelfutuh <[email protected]>
@bito-code-review
Copy link

Bito Automatic Review Skipped - Branch Excluded

Bito didn't auto-review because the source or target branch is excluded from automatic reviews.
No action is needed if you didn't intend for the agent to review it. Otherwise, to manually trigger a review, type /review in a comment and save.
You can change the branch exclusion settings here, or contact your Bito workspace admin at [email protected].

* Fix cargo build and add CI check

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* lint lib.rs

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* Update Readme and contributing guides

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* signed?

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* fix build target

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* fix build-crate target

Signed-off-by: Haytham Abuelfutuh <[email protected]>

* fix included ts files in npm

Signed-off-by: Haytham Abuelfutuh <[email protected]>

---------

Signed-off-by: Haytham Abuelfutuh <[email protected]>
@bito-code-review
Copy link

Bito Automatic Review Skipped - Branch Excluded

Bito didn't auto-review because the source or target branch is excluded from automatic reviews.
No action is needed if you didn't intend for the agent to review it. Otherwise, to manually trigger a review, type /review in a comment and save.
You can change the branch exclusion settings here, or contact your Bito workspace admin at [email protected].

@bito-code-review
Copy link

Bito Automatic Review Skipped - Branch Excluded

Bito didn't auto-review because the source or target branch is excluded from automatic reviews.
No action is needed if you didn't intend for the agent to review it. Otherwise, to manually trigger a review, type /review in a comment and save.
You can change the branch exclusion settings here, or contact your Bito workspace admin at [email protected].

* Add device class to `GpuAccelerator`

Signed-off-by: Jeev B <[email protected]>

* make gen

Signed-off-by: Jeev B <[email protected]>

* Add HABANA_GAUDI as supported device class

Signed-off-by: Jeev B <[email protected]>

---------

Signed-off-by: Jeev B <[email protected]>
@bito-code-review
Copy link

Bito Automatic Review Skipped - Branch Excluded

Bito didn't auto-review because the source or target branch is excluded from automatic reviews.
No action is needed if you didn't intend for the agent to review it. Otherwise, to manually trigger a review, type /review in a comment and save.
You can change the branch exclusion settings here, or contact your Bito workspace admin at [email protected].

Signed-off-by: Haytham Abuelfutuh <[email protected]>
Signed-off-by: Haytham Abuelfutuh <[email protected]>
Signed-off-by: Haytham Abuelfutuh <[email protected]>
Signed-off-by: Haytham Abuelfutuh <[email protected]>
Signed-off-by: Haytham Abuelfutuh <[email protected]>
@bito-code-review
Copy link

Bito Automatic Review Skipped - Branch Excluded

Bito didn't auto-review because the source or target branch is excluded from automatic reviews.
No action is needed if you didn't intend for the agent to review it. Otherwise, to manually trigger a review, type /review in a comment and save.
You can change the branch exclusion settings here, or contact your Bito workspace admin at [email protected].

Signed-off-by: Iaroslav Ciupin <[email protected]>
@bito-code-review
Copy link

Bito Automatic Review Skipped - Branch Excluded

Bito didn't auto-review because the source or target branch is excluded from automatic reviews.
No action is needed if you didn't intend for the agent to review it. Otherwise, to manually trigger a review, type /review in a comment and save.
You can change the branch exclusion settings here, or contact your Bito workspace admin at [email protected].

@bito-code-review
Copy link

Bito Automatic Review Skipped - Branch Excluded

Bito didn't auto-review because the source or target branch is excluded from automatic reviews.
No action is needed if you didn't intend for the agent to review it. Otherwise, to manually trigger a review, type /review in a comment and save.
You can change the branch exclusion settings here, or contact your Bito workspace admin at [email protected].

* Clean up triggers api

Signed-off-by: Iaroslav Ciupin <[email protected]>

* make gen

Signed-off-by: Iaroslav Ciupin <[email protected]>

---------

Signed-off-by: Iaroslav Ciupin <[email protected]>
@bito-code-review
Copy link

Bito Automatic Review Skipped - Branch Excluded

Bito didn't auto-review because the source or target branch is excluded from automatic reviews.
No action is needed if you didn't intend for the agent to review it. Otherwise, to manually trigger a review, type /review in a comment and save.
You can change the branch exclusion settings here, or contact your Bito workspace admin at [email protected].

* copy over flyteplugins

Signed-off-by: Paul Dittamo <[email protected]>

* remove secret manager

Signed-off-by: Paul Dittamo <[email protected]>

* remove array plugin

Signed-off-by: Paul Dittamo <[email protected]>

* delete hive

Signed-off-by: Paul Dittamo <[email protected]>

* remove athena, databricks, snowflake, big query

Signed-off-by: Paul Dittamo <[email protected]>

* remove presto

Signed-off-by: Paul Dittamo <[email protected]>

* copy over coreutils

Signed-off-by: Paul Dittamo <[email protected]>

* temp delete webapi

Signed-off-by: Paul Dittamo <[email protected]>

* delete auto refresh cache

Signed-off-by: Paul Dittamo <[email protected]>

* Revert "delete auto refresh cache"

This reverts commit fe08f12.

* delete kfoperators

Signed-off-by: Paul Dittamo <[email protected]>

* delete echo

Signed-off-by: Paul Dittamo <[email protected]>

* copy over plugins

Signed-off-by: Paul Dittamo <[email protected]>

* gen mocks

Signed-off-by: Paul Dittamo <[email protected]>

* simplify modules

Signed-off-by: Paul Dittamo <[email protected]>

* copy over flytestdlib

Signed-off-by: Paul Dittamo <[email protected]>

* copy over event and cache proto + point flyteplugin and flytestdlib imports to v2

Signed-off-by: Paul Dittamo <[email protected]>

* add RawOutputDataConfig

Signed-off-by: Paul Dittamo <[email protected]>

* copy over kubeflow operators + non connector/agent web api plugins

Signed-off-by: Paul Dittamo <[email protected]>

* Revert "add RawOutputDataConfig"

This reverts commit e260772.

* make gen

Signed-off-by: Paul Dittamo <[email protected]>

* clean up

Signed-off-by: Paul Dittamo <[email protected]>

* gen

Signed-off-by: Paul Dittamo <[email protected]>

* remove web api

Signed-off-by: Paul Dittamo <[email protected]>

* gen

Signed-off-by: Paul Dittamo <[email protected]>

---------

Signed-off-by: Paul Dittamo <[email protected]>
@flyte-bot
Copy link
Collaborator

Bito Automatic Review Skipped - Branch Excluded

Bito didn't auto-review because the source or target branch is excluded from automatic reviews.
No action is needed if you didn't intend for the agent to review it. Otherwise, to manually trigger a review, type /review in a comment and save.
You can change the branch exclusion settings here, or contact your Bito workspace admin at [email protected].

* feat: add short name to watch group task group response

Signed-off-by: machichima <[email protected]>

* build: make gen

Signed-off-by: machichima <[email protected]>

---------

Signed-off-by: machichima <[email protected]>
@flyte-bot
Copy link
Collaborator

Bito Automatic Review Skipped - Branch Excluded

Bito didn't auto-review because the source or target branch is excluded from automatic reviews.
No action is needed if you didn't intend for the agent to review it. Otherwise, to manually trigger a review, type /review in a comment and save.
You can change the branch exclusion settings here, or contact your Bito workspace admin at [email protected].

flyteidl crate remove extension module

Signed-off-by: Yee Hing Tong <[email protected]>
@flyte-bot
Copy link
Collaborator

Bito Automatic Review Skipped - Branch Excluded

Bito didn't auto-review because the source or target branch is excluded from automatic reviews.
No action is needed if you didn't intend for the agent to review it. Otherwise, to manually trigger a review, type /review in a comment and save.
You can change the branch exclusion settings here, or contact your Bito workspace admin at [email protected].

Signed-off-by: Haytham Abuelfutuh <[email protected]>
@flyte-bot
Copy link
Collaborator

Bito Automatic Review Skipped - Branch Excluded

Bito didn't auto-review because the source or target branch is excluded from automatic reviews.
No action is needed if you didn't intend for the agent to review it. Otherwise, to manually trigger a review, type /review in a comment and save.
You can change the branch exclusion settings here, or contact your Bito workspace admin at [email protected].

WangWang0226 and others added 2 commits December 10, 2025 01:11
* feat(queue): add Dockerfile and K8s deployment for Queue service

Signed-off-by: WangWang0226 <[email protected]>

* refactor(queue/k8s): migrate manifests to Kustomize layout and enable kubectl apply -k

Signed-off-by: WangWang0226 <[email protected]>

* chore(queue): drop Dockerfile healthcheck and align RBAC with executor style

Signed-off-by: WangWang0226 <[email protected]>

---------

Signed-off-by: WangWang0226 <[email protected]>
@flyte-bot
Copy link
Collaborator

Bito Automatic Review Skipped - Branch Excluded

Bito didn't auto-review because the source or target branch is excluded from automatic reviews.
No action is needed if you didn't intend for the agent to review it. Otherwise, to manually trigger a review, type /review in a comment and save.
You can change the branch exclusion settings here, or contact your Bito workspace admin at [email protected].

@flyte-bot
Copy link
Collaborator

Bito Automatic Review Skipped - Branch Excluded

Bito didn't auto-review because the source or target branch is excluded from automatic reviews.
No action is needed if you didn't intend for the agent to review it. Otherwise, to manually trigger a review, type /review in a comment and save.
You can change the branch exclusion settings here, or contact your Bito workspace admin at [email protected].

@flyte-bot
Copy link
Collaborator

Bito Automatic Review Skipped - Branch Excluded

Bito didn't auto-review because the source or target branch is excluded from automatic reviews.
No action is needed if you didn't intend for the agent to review it. Otherwise, to manually trigger a review, type /review in a comment and save.
You can change the branch exclusion settings here, or contact your Bito workspace admin at [email protected].

@flyte-bot
Copy link
Collaborator

Bito Automatic Review Skipped - Branch Excluded

Bito didn't auto-review because the source or target branch is excluded from automatic reviews.
No action is needed if you didn't intend for the agent to review it. Otherwise, to manually trigger a review, type /review in a comment and save.
You can change the branch exclusion settings here, or contact your Bito workspace admin at [email protected].

@flyte-bot
Copy link
Collaborator

Bito Automatic Review Skipped - Branch Excluded

Bito didn't auto-review because the source or target branch is excluded from automatic reviews.
No action is needed if you didn't intend for the agent to review it. Otherwise, to manually trigger a review, type /review in a comment and save.
You can change the branch exclusion settings here, or contact your Bito workspace admin at [email protected].

* refactor: split out action and general interfaces

Signed-off-by: machichima <[email protected]>

* refactor: update state service

Signed-off-by: machichima <[email protected]>

* chore: remove cmd in gitignore

Signed-off-by: machichima <[email protected]>

* fix: add repository.go as entry point for repository inerface

Signed-off-by: machichima <[email protected]>

* build: make gen

Signed-off-by: machichima <[email protected]>

---------

Signed-off-by: machichima <[email protected]>
@flyte-bot
Copy link
Collaborator

Bito Automatic Review Skipped - Branch Excluded

Bito didn't auto-review because the source or target branch is excluded from automatic reviews.
No action is needed if you didn't intend for the agent to review it. Otherwise, to manually trigger a review, type /review in a comment and save.
You can change the branch exclusion settings here, or contact your Bito workspace admin at [email protected].

@flyte-bot
Copy link
Collaborator

Bito Automatic Review Skipped - Branch Excluded

Bito didn't auto-review because the source or target branch is excluded from automatic reviews.
No action is needed if you didn't intend for the agent to review it. Otherwise, to manually trigger a review, type /review in a comment and save.
You can change the branch exclusion settings here, or contact your Bito workspace admin at [email protected].

* Migrate CoPilot

Signed-off-by: Barry Wu <[email protected]>

* Update: Add cmd/ and delete go.mod and go.sum in copilot

Signed-off-by: Barry Wu <[email protected]>

* Fix CI error

Signed-off-by: Barry Wu <[email protected]>

* Update make gen changes

Signed-off-by: Barry Wu <[email protected]>

---------

Signed-off-by: Barry Wu <[email protected]>
@flyte-bot
Copy link
Collaborator

Bito Automatic Review Skipped - Branch Excluded

Bito didn't auto-review because the source or target branch is excluded from automatic reviews.
No action is needed if you didn't intend for the agent to review it. Otherwise, to manually trigger a review, type /review in a comment and save.
You can change the branch exclusion settings here, or contact your Bito workspace admin at [email protected].

* feat: add task model and use db&gorm tag together

Signed-off-by: machichima <[email protected]>

* docs: update development guidance

Signed-off-by: machichima <[email protected]>

* feat: init moving task service

Signed-off-by: machichima <[email protected]>

* feat: add filter and sort for task service

Signed-off-by: machichima <[email protected]>

* feat: mount task service

Signed-off-by: machichima <[email protected]>

* refactor: clean up

Signed-off-by: machichima <[email protected]>

* docs: add task service api endpoint docs

Signed-off-by: machichima <[email protected]>

* test: add unit test for repository/impl

Signed-off-by: machichima <[email protected]>

* test: unit test for task transformers

Signed-off-by: machichima <[email protected]>

* feat: add mocks for repo interfaces

Signed-off-by: machichima <[email protected]>

* test: unit test for runs/service

Signed-off-by: machichima <[email protected]>

* build: make gen

Signed-off-by: machichima <[email protected]>

* fix: add migration for task and task spec

Signed-off-by: machichima <[email protected]>

* refactor: format

Signed-off-by: machichima <[email protected]>

* docs: add example script for create and list task

Signed-off-by: machichima <[email protected]>

* fix: remove unused impl/constant.go

Signed-off-by: machichima <[email protected]>

* fix: prevent overwrite filter

Signed-off-by: machichima <[email protected]>

* refactor: move To... function to transformers

Signed-off-by: machichima <[email protected]>

* build: make gen

Signed-off-by: machichima <[email protected]>

---------

Signed-off-by: machichima <[email protected]>
@flyte-bot
Copy link
Collaborator

Bito Automatic Review Skipped - Branch Excluded

Bito didn't auto-review because the source or target branch is excluded from automatic reviews.
No action is needed if you didn't intend for the agent to review it. Otherwise, to manually trigger a review, type /review in a comment and save.
You can change the branch exclusion settings here, or contact your Bito workspace admin at [email protected].

* refactor: rename tests/ to test/

Signed-off-by: machichima <[email protected]>

* feat: add test setup and cleanp

Signed-off-by: machichima <[email protected]>

* test: add deploy task api test

Signed-off-by: machichima <[email protected]>

* docs: update make commands and docs

Signed-off-by: machichima <[email protected]>

* build: make gen

Signed-off-by: machichima <[email protected]>

---------

Signed-off-by: machichima <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.