Fix port binding with reduced privileges (#3574)

[sjberman]

Cherrypick of #3574

Problem: The nginx deployment was using extra privileges in order to bind to privileged ports (<1024). This included allowPrivilegeEscalation and NET_BIND_SERVICE. Sometimes this could cause issues in some secure environments.

Solution: Remove these extra privileges and take advantage of sysctls to lower the allowed port range for the pod its defined on.

Testing: Verified that everything still works, including in OpenShift.

Checklist

Before creating a PR, run through this checklist and mark each as complete.

• I have read the CONTRIBUTING doc
• I have added tests that prove my fix is effective or that my feature works
• I have checked that all unit tests pass after adding my changes
• I have updated necessary documentation
• I have rebased my branch onto main
• I will ensure my PR is targeting the main branch and pulling from my branch from my own fork

Release notes

If this PR introduces a change that affects users and needs to be mentioned in the release notes,
please add a brief note that summarizes the change.

Fix port binding with reduced privileges.

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 95.19%. Comparing base (166f68e) to head (d5040d4).
Report is 1 commits behind head on release-2.0.

Additional details and impacted files

@@               Coverage Diff               @@
##           release-2.0    #3590      +/-   ##
===============================================
+ Coverage        86.79%   95.19%   +8.40%     
===============================================
  Files              127        1     -126     
  Lines            15081      229   -14852     
  Branches            62       62              
===============================================
- Hits             13089      218   -12871     
+ Misses            1840       11    -1829     
+ Partials           152        0     -152     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.