fix: Netflow tweaks to collector conversions and bump 0.8.4 version #2826
Closed
mikemiles-dev wants to merge 2 commits from
refs/pull/2826/head into staging
pull from: refs/pull/2826/head
merge into: carverauto:staging
carverauto:staging
carverauto:demo/prod-release
carverauto:add-dashboard-srql-service-views
carverauto:enhance-dashboard-creator-visual-builder
carverauto:fix-release-1-2-78-ci-failures
carverauto:refactor-agent-plugin-runtime
carverauto:add-dashboard-creator
carverauto:update/plugin-system
carverauto:add-service-monitoring-foundation
carverauto:fix/cli-auth-settings-navigation
carverauto:fix/device-unknown-facet
carverauto:fix-plugin-assignment-upgrades
carverauto:fix/sweep-profile-mode-status
carverauto:fix/armis-northbound-fixes
carverauto:fix-proxmox-console-react-client-render
carverauto:fix-openbao-signing-job-token-mount
carverauto:fix-services-plugin-status-read-model
carverauto:fix-stream-status-final-chunk
carverauto:codex/fix-prod-armis-sync-icmp
carverauto:fix-demo-cnpg-operator-networkpolicy
carverauto:update/docs-cleanup
carverauto:fix-armis-northbound-raw-token-auth
carverauto:fix-armis-northbound-stuck-running
carverauto:update-manual-device-hostname-readd
carverauto:fix/observability-severity-card-links
carverauto:renovate/debian_testing_slim-testing-slim
carverauto:docs/kubernetes-ingestion-gateway
carverauto:fix/flow-collector-external-network-policy
carverauto:fix/armis-availability-and-stream-config
carverauto:refactor-fast-fresh-db-bootstrap
carverauto:fix/cnpg-not-found
carverauto:fix/docker-update/cnpg
carverauto:renovate/debian_bookworm_slim-bookworm-slim
carverauto:add-socket-firewall-ci
carverauto:add-ipv6-sweep-scanners
carverauto:fix-armis-northbound
carverauto:add-streamed-agent-config
carverauto:fix/sweep-ip-family-routing
carverauto:codex/fix-core-migration-hook-upgrade
carverauto:renovate/arc_runner
carverauto:renovate/actions_runner
carverauto:codex/remote-access-desktop-rdp
carverauto:updates/missing-fixes
carverauto:fix/batched-sweep-targets
carverauto:fix/agent-sysmon-memory-growth
carverauto:fix/armis-northbound-single-run-and-timestamps
carverauto:release/1.2.67
carverauto:fix/wasm-plugin-service-status
carverauto:fix/armis-names-string
carverauto:codex/harden-remote-access-app-tcp-followup
carverauto:codex/harden-remote-access-app-tcp
carverauto:codex/harden-gateway-proxy-auth
carverauto:codex/harden-remote-access-destroy-rbac
carverauto:codex/harden-ssh-ca-remote-access
carverauto:codex/harden-remote-access-broker-registry
carverauto:codex/harden-remote-access-approval-policy
carverauto:codex/harden-remote-access-file-transfer
carverauto:codex/harden-remote-access-attach-ticket
carverauto:fix-release-plugin-list-cleanup
carverauto:codex/harden-grpc-logger-payloads
carverauto:propose-interface-action-target-context
carverauto:add-signed-northbound-action-callbacks
carverauto:fix/reap-stale-self-scheduled-oban-jobs
carverauto:fix/device-logs-tab-async
carverauto:fix/device-metadata-summary
carverauto:fix/northbound-launch-target-auth
carverauto:fix/northbound-provider-atomic-read
carverauto:proposal/add-sample-northbound-wasm-plugin
carverauto:proposal/northbound-action-integrations
carverauto:fix/ansible-run-job-device-launch
carverauto:codex/fix-audit-events-shell-theme
carverauto:codex/fix-sweep-tcp-availability
carverauto:codex/fix-armis-names-string
carverauto:fix/update-nats-2-14
carverauto:fix/elixir-quality-release-blockers
carverauto:fix/latest-release-device-ingest-ui-bugs
carverauto:fix/release-1.2.61-ci-failures
carverauto:fix/web-ng-precommit-format
carverauto:fix/wasm-tinygo-go125
carverauto:fix/agent-file-transfer-bazel-src
carverauto:fix/release-key-stamp-root
carverauto:fix/release-1.2.59-staging
carverauto:main
carverauto:fix/agent-accept-deprecated-remote-access-config
carverauto:fix/device-results-count-facets
carverauto:fix/bazelisk-installer-retries
carverauto:fix/tinygo-host-toolchain-fetch
carverauto:add-per-agent-availability
carverauto:fix/forgejo-release-multipart-assets
carverauto:fix/agent-config-stale-session
carverauto:fix/mtr-hop-dns-resolution
carverauto:fix/hostname-only-device-create
carverauto:fix/otlp-log-metadata-sanitization
carverauto:fix/sweep-icmp-legacy-mode-classification
carverauto:add-nats-object-store-retention
carverauto:fix/helm-serviceradar-state-pvc
carverauto:harden/forgejo-ci-nonroot
carverauto:codex/expand-remote-access-teleport-parity
carverauto:fix/sweep-port-history-consistency
carverauto:fix/remote-access-ssh-feature-flag
carverauto:fix/devices-refresh-artifacts
carverauto:fix/identity-ingestion-sweep-availability
carverauto:spec/identity-cache-ingestion-correctness
carverauto:fix/sweep-mapper-promotion-stale-cache
carverauto:fix/sweep-provisional-duplicate-ip
carverauto:fix/sweep-target-invalid-ip-order
carverauto:fix/armis-large-sync-streaming
carverauto:fix/docusaurus-blog-build-date
carverauto:fix/armis-sync-compat-deep-dive
carverauto:fix/awx-controller-credential-secret
carverauto:fix/demo-release-source-branch
carverauto:demo/release-v1.2.44-source-fix
carverauto:codex/teleport-agent-routed-remote-access
carverauto:feature/agent-config-dependency-catalog
carverauto:proposal/agent-config-dependency-catalog
carverauto:bugfix/armis-credentials-save-display
carverauto:bugfix/armis-integration-credentials
carverauto:fix/web-ng-precommit-formatting
carverauto:bugfix/armis-secret-config-push
carverauto:feature/close-controllers-to-pipelines
carverauto:carverauto/extract-palisade
carverauto:feature/migrate-dashboard-cli-to-plugs
carverauto:feature/audit-history-page
carverauto:feature/migrate-controllers-to-security-pipelines
carverauto:fix/security-events-test-and-retention-worker
carverauto:feature/add-platform-security-hardening
carverauto:demo-rollout-proxmox-bazel-fix
carverauto:bug/armis-sync-issues
carverauto:add-virtualization-srql-queries
carverauto:add-proxmox-ingestion-hardening-tests
carverauto:add-ssh-private-key-credential-rules
carverauto:redact-plugin-credential-material
carverauto:add-credential-rules-settings-entry
carverauto:add-credential-rules-settings-flows
carverauto:require-network-credential-broker-grants
carverauto:preview-credential-rule-target-scope
carverauto:add-proxmox-credential-secret-preset
carverauto:harden-credential-rules-live-tests
carverauto:clarify-proxmox-plugin-credential-modes
carverauto:docs-proxmox-credential-operations
carverauto:fingerprint-proxmox-candidates
carverauto:proxmox-resource-efficiency-dashboard
carverauto:proxmox-console-security-docs
carverauto:proxmox-focused-quality-validation
carverauto:proxmox-metric-baseline-alerts
carverauto:proxmox-device-scoped-logs
carverauto:proxmox-defer-vector-log-forwarding
carverauto:proxmox-console-session-tickets
carverauto:proxmox-console-xterm-shell
carverauto:proxmox-console-websocket-broker
carverauto:proxmox-console-control-frames
carverauto:proxmox-console-agent-session-manager
carverauto:proxmox-console-plugin-pty-bridge
carverauto:proxmox-console-assignment-materializer
carverauto:proxmox-console-ssh-connector
carverauto:proxmox-console-agent-local-broker
carverauto:proxmox-console-device-actions
carverauto:proxmox-console-stream-timeouts
carverauto:proxmox-console-guest-mode-gating
carverauto:proxmox-console-ci-race-fix
carverauto:fix/falco-alert-routing-datasvc-channel
carverauto:fix-agent-release-page-bugs
carverauto:add-proxmox-device-details-summary
carverauto:add-proxmox-virtualization-ingestor
carverauto:add-virtualization-inventory-schema
carverauto:add-proxmox-infrastructure-inventory
carverauto:add-proxmox-plugin-live-smoke
carverauto:add-proxmox-local-api-smoke
carverauto:add-proxmox-credential-test-dispatch
carverauto:add-proxmox-credential-test-plan
carverauto:add-network-credential-rule-preview
carverauto:add-proxmox-plugin-inventory-details
carverauto:add-proxmox-credential-reconcile-worker
carverauto:add-proxmox-credential-assignment-materializer
carverauto:add-plugin-input-template-secret-refs
carverauto:add-proxmox-plugin-policy-inputs
carverauto:add-proxmox-wasm-plugin-scaffold
carverauto:add-network-credential-rules-model
carverauto:add-proxmox-plugin-credential-rules
carverauto:fix/rperf-rustls-provider-demo
carverauto:fix/dashboard-template-sdk-014
carverauto:fix/tinygo-go126-release
carverauto:fix/reqsign-provider-bazel-deps
carverauto:fix/release-bazel-rust-crates
carverauto:fix/core-coordinator-connection-leak
carverauto:chore/security-updates
carverauto:update/readme-versions-update
carverauto:docs/readme-dashboard-sdk
carverauto:chore/cli-0.1.5
carverauto:fix/dashboard-cli-local-map-dev
carverauto:fix/dashboard-cli-hmr-map-libraries
carverauto:chore/bump-serviceradar-cli-0.1.2
carverauto:fix/dashboard-cli-hmr-harness
carverauto:fix/helm-contour-liveview-websocket
carverauto:fix/helm-cnpg-pooler-defaults
carverauto:updates/helm-fixes
carverauto:update/fix-light-mode-analytics
carverauto:ual/dashboard-sdk-dx
carverauto:security/postgres-update
carverauto:update-falco-alert-diagnostics
carverauto:ual/react-dashboard-sdk
carverauto:fix/cnpg-saturation-fk-and-bootstrap
carverauto:ual/wifi-site-map
carverauto:fix-coraza-log-db-writer
carverauto:fix-log-viewer-syslog-processed
carverauto:plan-fieldsurvey-spatial-selection
carverauto:plan-envoy-coraza-waf
carverauto:plan-alienvault-otx-integration
carverauto:plan-fieldsurvey-sidekick-daemon
carverauto:cleanup-openspec-archive-closed-proposals
carverauto:bug-core-elx-ip-enrichment-reap
carverauto:fix-release-libcap2-pin-v125
carverauto:fix-camera-stream-gateway-route
carverauto:add-core-elx-prometheus-metrics
carverauto:add-serviceradar-observability-dashboards
carverauto:add-pgbouncer-helm-cnpg
carverauto:renovate/ghcr.io-actions-actions-runner
carverauto:feat/cluster-agent-runtime-metadata-stability
carverauto:feat/observability-shell-standardization
carverauto:feat/observability-live-log-toggle
carverauto:fix/mtr-bulk-queue-and-srql-targets
carverauto:fix/mtr-profile-protocol-keyerror
carverauto:fix/mtr-diagnostics-keyerror
carverauto:add-demo-rollout-skills
carverauto:fix-web-ng-test-support-dialyzer
carverauto:fix-web-ng-dialyzer-findings
carverauto:add-bulk-queued-mtr-diagnostics
carverauto:fix-serviceradar-core-integration-failures
carverauto:harden-agent-updater-exec-arguments
carverauto:harden-agent-release-trust-boundaries
carverauto:fix-compose-hermetic-nats-datasvc-bootstrap
carverauto:fix/openbao-release-issues
carverauto:elixir/formatting-updates
carverauto:codex/demo-cnpg-signing-release-fixes
carverauto:chore/lint-fixes
carverauto:fix/bazel-alpine-bump-and-cosign-skip
carverauto:update-event-alert-dedup-and-suppression
carverauto:armis-northbound-events
carverauto:armis-northbound-availability-updates
carverauto:push-owvypksrmooo
carverauto:codex/topology-endpoint-evidence-investigation
carverauto:codex/topology-bootstrap-and-layout-simplification
carverauto:codex/remove-ingress-nginx-edge
carverauto:fix/forgejo-ci-snmp-cache-and-ubuntu24
carverauto:bug/cnpg-mtls-failure
carverauto:bug/log-collector
carverauto:fix/forgejo-runner-labels
carverauto:fix/cargo-lock-sync
carverauto:remove-arc-runner-from-push-all
carverauto:fix-push-all-cosign-preflight
carverauto:fix-go-ci
carverauto:add-versioned-openapi-publish
carverauto:chore/forgejo-hardening
carverauto:security/k8s-hardening
carverauto:update/cluster-page-agents
carverauto:updates/helm-security-updates
carverauto:2406-feat-agent-fleet-management-secure-self-update-system
carverauto:bug/k8s-helm-deployments
carverauto:chore/k8s-arc-update
carverauto:rust-fix
carverauto:2371-analytics-stats-cards-should-abbreviate-numbers
carverauto:chore/perl-cleanup
carverauto:2942-featweb-ng-add-logs-tab-to-device-details-page
carverauto:192-feat-tftp-server
carverauto:mikemiles-dev/feature/netflow_collection
carverauto:testing
carverauto:dependabot/cargo/hostname-0.4.1
carverauto:dependabot/cargo/redis-1.0.1
carverauto:dependabot/cargo/bb8-0.9.0
carverauto:dependabot/cargo/rcgen-0.14.6
carverauto:dependabot/cargo/hyper-1.8.1
carverauto:dependabot/cargo/hyper-util-0.1.19
carverauto:dependabot/cargo/clap-4.5.51
carverauto:dependabot/cargo/thiserror-2.0.17
carverauto:dependabot/cargo/time-tz-2.0.0
carverauto:dependabot/cargo/tonic-build-0.14.2
carverauto:backup/main-pre-staging-sync-2026-04-02
carverauto:dependabot/npm_and_yarn/docs/mdast-util-to-hast-13.2.1
carverauto:815-feat-support-win32-for-agentpoller
carverauto:gh-pages
No reviewers
Labels
Clear labels
1week
2weeks
Failed compliance check
IP cameras
NATS
NATS JetStream
Possible security concern
Review effort 1/5
Review effort 2/5
Review effort 3/5
Review effort 4/5
Review effort 5/5
UI
aardvark
accessibility
amd64
api
arm64
auth
back-end
bgp
blog
bug
Something isn't working
build
checkers
ci-cd
continuous integration-continuous deployments
cleanup
cnpg
cloud-native postgres
codex
core
core service
dependencies
Pull requests that update a dependency file
device-management
documentation
Improvements or additions to documentation
duplicate
This issue or pull request already exists
dusk
ebpf
enhancement
New feature or request
eta 1d
eta 1hr
eta 3d
eta 3hr
feature
fieldsurvey
github_actions
Pull requests that update GitHub Actions code
go
Pull requests that update Go code
good first issue
Good for newcomers
help wanted
Extra attention is needed
invalid
This doesn't seem right
javascript
Pull requests that update Javascript code
k8s
log-collector
mapper
mtr
multi traceroute
needs-triage
netflow
network-sweep
observability
oracle
Oracle Linux related issues
otel
opentelemetry logs, traces, metrics
plug-in
proton
timeplus proton streaming database
python
question
Further information is requested
reddit
redhat
research
rperf
rperf-checker
rust
Pull requests that update rust code
sdk
security
serviceradar-agent
serviceradar-agent-gateway
serviceradar-web
serviceradar-web-ng
siem
snmp
sysmon
topology
ubiquiti
wasm
wontfix
This will not be worked on
zen-engine
No labels
1week
2weeks
Failed compliance check
IP cameras
NATS
Possible security concern
Review effort 1/5
Review effort 2/5
Review effort 3/5
Review effort 4/5
Review effort 5/5
UI
aardvark
accessibility
amd64
api
arm64
auth
back-end
bgp
blog
bug
build
checkers
ci-cd
cleanup
cnpg
codex
core
dependencies
device-management
documentation
duplicate
dusk
ebpf
enhancement
eta 1d
eta 1hr
eta 3d
eta 3hr
feature
fieldsurvey
github_actions
go
good first issue
help wanted
invalid
javascript
k8s
log-collector
mapper
mtr
needs-triage
netflow
network-sweep
observability
oracle
otel
plug-in
proton
python
question
reddit
redhat
research
rperf
rperf-checker
rust
sdk
security
serviceradar-agent
serviceradar-agent-gateway
serviceradar-web
serviceradar-web-ng
siem
snmp
sysmon
topology
ubiquiti
wasm
wontfix
zen-engine
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".
No due date set.
Dependencies
No dependencies set.
Reference
carverauto/serviceradar!2826
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "refs/pull/2826/head"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Imported from GitHub pull request.
Original GitHub pull request: #2658
Original author: @mikemiles-dev
Original URL: https://github.com/carverauto/serviceradar/pull/2658
Original created: 2026-02-01T18:34:33Z
Original updated: 2026-02-03T23:06:59Z
Original head: mikemiles-dev/serviceradar:fix/netflow_tweaks
Original base: staging
User description
IMPORTANT: Please sign the Developer Certificate of Origin
Thank you for your contribution to ServiceRadar. Please note, when contributing, the developer must include
a DCO sign-off statement indicating the DCO acceptance in one commit message. Here
is an example DCO Signed-off-by line in a commit message:
Describe your changes
Issue ticket number and link
Code checklist before requesting a review
PR Type
Enhancement, Bug fix
Description
Add protocol name field to NetFlow data collection and display
protocol_namefrom NetFlow packets in Rust collectorImprove field value conversion robustness in NetFlow parser
DataNumberandProtocolTypevariants explicitlyRefactor cache statistics structure for simplified reporting
CacheStatsVectype to use unifiedParserCacheStatsUpdate dependencies and add comprehensive test coverage
netflow_parserfrom 0.8.1 to 0.8.4Diagram Walkthrough
File Walkthrough
7 files
Add protocol name display with intelligent fallbackImplement protocol name extraction and robust field conversionsRefactor cache statistics to unified structureUpdate metrics logging for consolidated cache statsUse protocol_name field with fallback to numeric mappingUse protocol_name field with fallback to numeric mappingAdd protocol_name string field to FlowMessage1 files
Add missing nats_creds_file field to test config1 files
Bump netflow_parser dependency to 0.8.4Imported GitHub PR comment.
Original author: @CLAassistant
Original URL: https://github.com/carverauto/serviceradar/pull/2658#issuecomment-3831727232
Original created: 2026-02-01T18:34:39Z
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
mikemiles-dev seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.
You have signed the CLA already but the status is still pending? Let us recheck it.
Imported GitHub PR comment.
Original author: @qodo-code-review[bot]
Original URL: https://github.com/carverauto/serviceradar/pull/2658#issuecomment-3831728508
Original created: 2026-02-01T18:35:10Z
PR Compliance Guide 🔍
Below is a summary of compliance checks for this PR:
Log injection
Description: Untrusted NetFlow source identifiers are interpolated directly into log lines via
source(derived from parser keys) without sanitization, which could enable log forging/injection
(e.g., embedded newlines/control characters) if an attacker can influence the parsed
source key representation.
metrics.rs [34-63]
Referred Code
🎫 No ticket provided
Codebase context is not defined
Follow the guide to enable codebase context checks.
Generic: Comprehensive Audit Trails
Objective: To create a detailed and reliable record of critical system actions for security analysis
and compliance.
Status: Passed
Generic: Meaningful Naming and Self-Documenting Code
Objective: Ensure all identifiers clearly express their purpose and intent, making code
self-documenting
Status: Passed
Generic: Robust Error Handling and Edge Case Management
Objective: Ensure comprehensive error handling that provides meaningful context and graceful
degradation
Status: Passed
Generic: Secure Error Handling
Objective: To prevent the leakage of sensitive system information through error messages while
providing sufficient detail for internal debugging.
Status: Passed
Generic: Secure Logging Practices
Objective: To ensure logs are useful for debugging and auditing without exposing sensitive
information like PII, PHI, or cardholder data.
Status: Passed
Generic: Security-First Input Validation and Data Handling
Objective: Ensure all data inputs are validated, sanitized, and handled securely to prevent
vulnerabilities
Status: Passed
Compliance status legend
🟢 - Fully Compliant🟡 - Partial Compliant
🔴 - Not Compliant
⚪ - Requires Further Human Verification
🏷️ - Compliance label
Imported GitHub PR comment.
Original author: @qodo-code-review[bot]
Original URL: https://github.com/carverauto/serviceradar/pull/2658#issuecomment-3831730820
Original created: 2026-02-01T18:36:18Z
PR Code Suggestions ✨
Explore these optional code suggestions:
Consolidate protocol mapping logic
To improve maintainability, centralize the protocol number-to-name mapping
within the Rust collector. This involves removing the redundant fallback logic
from the OCSF mapping file and the Elixir web UI.
Examples:
packaging/zen/rules/netflow_to_ocsf.json [69]
web-ng/lib/serviceradar_web_ng_web/live/netflow_live/index.ex [264-275]
Solution Walkthrough:
Before:
After:
Suggestion importance[1-10]: 9
__
Why: This is a significant architectural suggestion that correctly identifies duplicated logic introduced in the PR across multiple components, proposing a cleaner, more maintainable single-source-of-truth design.
annotate async test properly
Add the
#[tokio::test]attribute to thetest_publisher_creationfunction toensure it is executed by the test runner.
rust/netflow-collector/src/publisher.rs [219-243]
[To ensure code accuracy, apply this suggestion manually]Suggestion importance[1-10]: 7
__
Why: The suggestion correctly identifies that the
test_publisher_creationfunction is not a runnable test and proposes adding the#[tokio::test]attribute to fix it.Imported GitHub PR comment.
Original author: @mfreeman451
Original URL: https://github.com/carverauto/serviceradar/pull/2658#issuecomment-3844288052
Original created: 2026-02-03T23:06:58Z
closing, stale, already merged with another PR
Pull request closed