Skip to content

[spike] Support standing-up clusters in Terraform (for AWS)#8642

Draft
agoose77 wants to merge 9 commits into
2i2c-org:mainfrom
agoose77:feat-create-neurohackademy
Draft

[spike] Support standing-up clusters in Terraform (for AWS)#8642
agoose77 wants to merge 9 commits into
2i2c-org:mainfrom
agoose77:feat-create-neurohackademy

Conversation

@agoose77

@agoose77 agoose77 commented Jun 29, 2026

Copy link
Copy Markdown
Contributor

This PR recreates the neurohackademy cluster.

I generally dislike the need to run eksctl — it's slow, and a separate workflow from our other clusters. I noticed #1924 today, and I think it still holds true.

Therefore, I'm taking this opportunity to rebuild neurohackademy using Terraform.

To Do

  • Support kubelet config via launch template
  • Support custom labels and tags
  • Implement User pool(s)
  • Implement Core pool
  • Implement Dask pool(s)
  • Implement GPU pool(s)

@agoose77 agoose77 marked this pull request as draft June 29, 2026 15:44
@github-actions

github-actions Bot commented Jun 29, 2026

Copy link
Copy Markdown
Contributor

Merging this PR will trigger the following deployment actions.

Support deployments

No support upgrades will be triggered

Staging deployments

Cloud Provider Cluster Name Hub Name Reason for Redeploy
aws nmfs-openscapes staging Core common infrastructure has been updated
aws bnext-bio staging Core common infrastructure has been updated
aws reflective staging Core common infrastructure has been updated
aws victor staging Core common infrastructure has been updated
aws nasa-veda staging Core common infrastructure has been updated
aws opensci staging Core common infrastructure has been updated
aws nasa-ghg-hub staging Core common infrastructure has been updated
aws earthscope staging Core common infrastructure has been updated
aws aimatx-2i2c-hub staging Core common infrastructure has been updated
aws projectpythia staging Core common infrastructure has been updated
aws maap staging Core common infrastructure has been updated
aws disasters staging Core common infrastructure has been updated
aws 2i2c-aws-us staging Core common infrastructure has been updated
aws ucmerced staging Core common infrastructure has been updated
aws openscapeshub staging Core common infrastructure has been updated
aws jupyter-health staging Core common infrastructure has been updated
aws temple staging Core common infrastructure has been updated
aws nasa-cryo staging Core common infrastructure has been updated

Production deployments

Cloud Provider Cluster Name Hub Name Reason for Redeploy
aws nmfs-openscapes prod Core common infrastructure has been updated
aws nmfs-openscapes workshop Core common infrastructure has been updated
aws nmfs-openscapes noaa-only Core common infrastructure has been updated
aws bnext-bio prod Core common infrastructure has been updated
aws reflective prod Core common infrastructure has been updated
aws reflective workshop Core common infrastructure has been updated
aws victor prod Core common infrastructure has been updated
aws nasa-veda prod Core common infrastructure has been updated
aws nasa-veda binder Core common infrastructure has been updated
aws opensci sciencecore Core common infrastructure has been updated
aws opensci climaterisk Core common infrastructure has been updated
aws opensci small-binder Core common infrastructure has been updated
aws opensci big-binder Core common infrastructure has been updated
aws nasa-ghg-hub prod Core common infrastructure has been updated
aws nasa-ghg-hub binder Core common infrastructure has been updated
aws earthscope prod Core common infrastructure has been updated
aws earthscope binder Core common infrastructure has been updated
aws aimatx-2i2c-hub prod Core common infrastructure has been updated
aws projectpythia prod Core common infrastructure has been updated
aws projectpythia pythia-binder Core common infrastructure has been updated
aws maap prod Core common infrastructure has been updated
aws disasters prod Core common infrastructure has been updated
aws 2i2c-aws-us showcase Core common infrastructure has been updated
aws 2i2c-aws-us orcid-demo Core common infrastructure has been updated
aws ucmerced prod Core common infrastructure has been updated
aws openscapeshub prod Core common infrastructure has been updated
aws openscapeshub workshop Core common infrastructure has been updated
aws jupyter-health prod Core common infrastructure has been updated
aws temple prod Core common infrastructure has been updated
aws temple advanced Core common infrastructure has been updated
aws temple research Core common infrastructure has been updated
aws nasa-cryo prod Core common infrastructure has been updated

@agoose77 agoose77 changed the title Create neurohackademy cluster Support standing-up clusters in Terraform (for AWS) Jun 30, 2026
@agoose77 agoose77 changed the title Support standing-up clusters in Terraform (for AWS) [spike] Support standing-up clusters in Terraform (for AWS) Jun 30, 2026
@yuvipanda

Copy link
Copy Markdown
Member

This was one of the reasons i moved us to using managed nodegroups! If this works, great :) But do timebox yourself, and make sure upgrades are possible

@yuvipanda

Copy link
Copy Markdown
Member

Also big +1 for just using the terraform resources directly rather than using a module like https://registry.terraform.io/modules/terraform-aws-modules/eks/aws/latest. Our needs are reasonably simple so this is ok.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants