Release notes

Changelog

See what's new in EdgeMQ - features, fixes, and docs across the ingest service, control-plane, and console.

v0.7.1

Console

  • featData Quality improvements: download DLQ files directly from the endpoint quality page, and follow contextual links to the Preview tab for faster troubleshooting.

Control plane

  • fixDLQ artifacts now correctly included for segments with 100% row rejection, and view stats are extracted from both Parquet and DLQ outputs.

Website

  • featBlog: new blog section with articles on why we built EdgeMQ and how schema-aware Parquet works. Retro bordered design with full SEO support.
  • featPricing redesign: plan comparison rebuilt as a bordered grid layout with clearer feature breakdowns and inline labels for trial and free tier inclusions.
  • featHomepage updates: added Data Quality screenshot to feature tabs, reorganized sections with clearer headings, and active navigation highlighting.

Tools

  • fixView compiler uses full column expressions in WHERE clauses, fixing incorrect filtering on computed columns.

v0.7.0

Console

  • featSchema inference: paste a sample JSON payload and EdgeMQ generates typed column definitions automatically - including nested object flattening, type detection, and camelCase-to-snake_case naming.
  • fixBilling page now uses the standard global sidebar navigation, and plan limits refresh correctly after endpoint deletion.

v0.6.9

Console

  • featRefreshed signup and login pages: OAuth buttons promoted above email/password fields, and a new benefits panel highlighting key platform differentiators.
  • fixOnboarding test step now respects plan-level payload size limits, preventing test failures on plans with lower thresholds.

Control plane

  • fixDestination ref counts now correctly exclude soft-deleted endpoints, preventing stale references from blocking destination updates.

v0.6.8

Console

  • featLive throughput chart: endpoint throughput is now streamed via SSE with real-time updates, plus a dry-run data generator for testing ingest without external tooling.
  • fixOutput format and view attachment fixes: saving output format and attaching views now behave consistently, and the sidebar views count includes all views (not just published).

Ingest

  • fixPreview improvements: BigInt serialization handled correctly, and sample timestamps now display as numeric values for clearer debugging.

v0.6.7

Console

  • featReal-time Data Quality streaming for materialized views: the view Data Quality page now uses SSE for live updates, matching the endpoint experience with a Live indicator.
  • featColor-coded quality indicators: red for render errors (view failed to execute), amber for high error rates (data quality issues). Tab indicators show issues at a glance without opening each page.
  • featError badges on the Views list page surface render errors and high error rates directly, including for older view versions that are no longer attached to endpoints.

v0.6.6

Console

  • featData Quality now surfaces view render errors prominently with user-friendly descriptions, error codes, and troubleshooting guidance. Failed views are easier to diagnose and fix.
  • featView editor improvements: comprehensive JSONPath validation catches invalid paths before publishing, immediate validation when switching to YAML mode, and clearer error states.
  • featDraft view versioning: discard unpublished changes with a single click, clear draft badges, and better navigation between published and draft versions.
  • featThroughput chart enhancements: time range filter now persists across tab navigation, and Y-axis scaling adapts to low-volume workloads for better visibility.

Ingest

  • fixView error handling hardening: syntax errors are now classified as terminal to prevent infinite retries, and all view errors are properly reported in metrics.

v0.6.5

Platform

  • featHybrid segment sealing: segments now seal when either the size threshold (512 KB) or time threshold is reached - whichever comes first. This ensures responsive data availability during testing while maintaining efficient batching at high throughput.

Console

  • featSegment timing configuration: new Data Processing settings let you adjust the segment max age per endpoint. Lower values give faster feedback during testing; higher values optimize for larger files.
  • featGoogle OAuth: sign in or sign up with your Google account. Existing users can link their Google account for faster authentication.
  • featData Quality empty states now show your current segment timing setting and explain why data takes time to appear during low-volume testing.

Docs

  • docsNew Segment Sealing documentation page explaining hybrid time + size sealing, self-balancing behavior, configuration options, and recommendations for different workloads.

v0.6.4

Console

  • featMaterialized Views now include a live preview canvas with streaming sample data, filter warnings, and consistent JSON generation so you can validate schemas before publishing.
  • featAuthoring workflow upgrades: YAML editing with two-tier validation, a unified Definition/Code toggle, and client-side payload guardrails keep large views safe before hitting the compiler.
  • featNew Data Quality tab streams metrics, DLQ stats, and SSE status live with a Live indicator and clearer placeholders when no data has landed yet.

Control plane

  • fixMetrics back end hardening: control-plane joins endpoints for tenant-scoped queries, filters out inactive view bindings, and ships the view-compiler inside the Docker image that powers previews.

v0.6.3

Platform

  • featPro 14-day trial: start a free trial with 200 GiB included, full access to Schema-Aware Parquet, up to 3 regions, and 99.9% SLA. Trial status and limits enforced end-to-end across Console and control-plane.
  • featData quality metrics pipeline: track view materialization success rates, row counts, and error details per segment. Metrics flow from ingest nodes through control-plane to Console.

Console

  • featData quality visibility: new metrics cards showing view health, success rates, and recent materialization results on endpoint pages.
  • featOutput format UX improvements: single-select radio buttons, syntax highlighting for YAML/JSON in view code tabs, and clearer guidance when Schema-Aware requires attached views.

Ingest

  • featDead letter queue (DLQ) artifact pipeline: failed events are captured with full context and can be downloaded for debugging and replay.

Website

  • chorePricing page updates: added fields-per-view limits to comparison table, and linked homepage badge to materialized views docs.

Docs

  • docsComprehensive Materialized Views documentation: YAML reference, function catalog, type system, partitioning guide, and worked examples. Syntax highlighting for YAML and SQL code blocks.

v0.6.2

Platform

  • featSchema-aware Parquet via Views: define a View Definition once, then EdgeMQ materializes typed, query-ready Parquet alongside payload-preserving artifacts.

Console

  • featViews UI: create/edit/publish Views and attach them to endpoints to produce schema-aware Parquet in your S3 prefixes.

Control plane

  • featView Definitions and endpoint bindings: control-plane now persists Views and distributes view configuration to ingest nodes.

Website

  • choreMarketing + IA updates: refreshed product pages and pricing to emphasize Parquet outputs and artifact-based consumption.

Docs

  • docsDocs updated for three output formats (segments, raw Parquet, schema-aware Parquet), including a dedicated /docs/output-formats page.

Tools

  • featView tooling: added compiler/materializer helpers to validate and run View Definitions during Parquet materialization.

v0.6.1

Platform

  • featConfigurable output formats per endpoint (segments, parquet, or both) - changes flow end‑to‑end from the Console to ingest nodes.
  • featCommit logs now capture multi‑artifact outputs with richer, format‑aware details in the Console.
  • featDeployment hardening: database migrations run automatically on startup to reduce schema drift issues.

Console

  • featS3 onboarding UX upgrades (clearer IAM policy guidance, smoother quickstart flow) plus global email‑verification gating for key actions.
  • featThroughput charts: selected time range now persists across tab navigation and is shareable via URL.

Ingest

  • fixPartitioning + format cleanup: simplified WAL/segment metadata and safer Parquet compatibility; docs updated to match the latest segment format.

Website

  • choreAgent & crawler discoverability: added robots.txt, sitemap.xml, and an llms.txt entrypoint for AI tools.

v0.6.0

Platform

  • featTrial cutoff for Starter plan: automatic enforcement at 10 GiB limit with email warnings, UI banners, and 402 Payment Required responses when limit exceeded without payment method.

Console

  • featBilling UX improvements: deleted endpoints now included in usage breakdown, improved terminology (free vs. additional usage), and ingest URL copy functionality.

Control plane

  • fixEndpoint usage data is now preserved when endpoints are deleted, ensuring accurate billing history and usage tracking.

Website

  • featHomepage redesign: new visual hierarchy, persona cards, and clearer messaging for ML teams, data engineers, and platform/infra audiences.

v0.5.9

Console

  • featQuickstart hardening: endpoint revalidation is now shared across Steps 3 & 4 with debounced control‑plane checks, soft warnings on transient errors, and instant sidebar downgrades when an endpoint is removed.
  • featEndpoint deletion workflow: progress‑aware modal, SSE status streaming.

v0.5.8

Website

  • docsNew tutorial: Expand EdgeMQ segments → NDJSON (event‑driven on AWS).
  • docsReadability upgrades across docs: responsive code font sizing, inline markdown fixes, cleaner headings, and removal of copy buttons on non‑reusable diagram blocks (frame layout, architecture).
  • featHomepage updates: new Who it’s for section with persona cards, improved visual hierarchy, and clearer audience messaging.

v0.5.7

Console

  • featBranding & footer refresh: removed quick links and status text; version now auto‑reads frompackage.json; updated sidebar logo (icon + wordmark, icon only when collapsed).

Website

  • docsCode snippet polish: shorter curl example to avoid overlap; improved readability on small screens.
  • choreVisual cleanup: removed experimental globe accent; minor spacing and contrast tweaks.

v0.5.6

Console

  • featAuthentication launched with email/password - includes signup and login flows.
  • featPassword reset (email token); improved mobile UX for auth pages.
  • fixBuild and routing fixes for App Router (root layout, directories, trustHost) and various polish (autofill styling, types).

v0.5.5

Platform

  • fixPrevent unintended deletion when a node is auto‑stopped by the platform; VMs are only removed on an explicit drain/delete.

Console

  • featCustomer console (developer preview).

Control plane

  • featStarter plan autosleep.
  • choreAPI cleanup: removed legacy “tier” from Endpoints; simpler model going forward.

Website

  • docsPricing FAQ: document Starter wake‑up behavior and that any inbound traffic keeps an endpoint warm.
  • docsContact page: updated Beta messaging - free instances during the beta and deploy in minutes.

v0.5.4

Control plane

  • featTenant cascade delete workflow - safe request with background finalization by the reconciler. Adds SLA guard for overdue deletions.
  • perfProvider hygiene and resilience: orphan IP sweep and delete operations use exponential backoff with jitter.
  • featCentralized plan‑based quota defaults and sizing helpers to remove magic numbers.

Website

  • docsQuickstart rewritten for clarity: copy‑paste IAM policies, explicit trust/permissions split, security posture. Retro list styling across docs.

v0.5.3

Control plane

  • fixProvider cleanup is now more reliable: volumes are deleted with retry/backoff and explicit logs to prevent orphaned storage.
  • fixDrain/delete hardening across orchestrator paths to reduce race conditions during machine removal.

v0.5.2

Control plane

  • featConfigurable WAL segment size per endpoint; applied on next rotation.

Ingest

  • featVersioned data‑plane: POST /v1/ingest (legacy path removed).

Tools

  • featSimple NDJSON load generator: auth options, periodic summary, safer defaults.

v0.5.1

Control plane

  • featProvider IP surfacing: sync public v4/v6 for ingest apps; shown on Endpoints.
  • fixReliable endpoint deletion: stop‑before‑delete, app cleanup, and full DB purge.
  • perfProvider sync improvements: immediate run on startup, jittered retry, deduped writes.

Website

  • docsPricing and docs updates: dedicated microVM language, DNS/TLS runbook.

v0.5.0

Control plane

  • featRuntime S3 credential issuance (STS) with least‑privilege policies and lease auditing.
  • featGuardrails for issuance: endpoint state checks, per‑node cooldown, and per‑destination rate limiting.

Ingest

  • featAutomatic credential retrieval and rotation; resilient backoff and continued operation on transient failures.

v0.4.0

Control plane

  • featS3 Destinations (B0) - create/list/update, AWS AssumeRole validation, endpoint binding.
  • featDistributed throttling for validation (Postgres) with Retry‑After cooldown.
  • featRBAC: admin tokens include destinations scopes by default (configurable extras).
  • fixReliability: rollout/stream schema fixes, query correctness, and minor error handling.

Docs

  • docsOpenAPI: bearer auth, route security annotations, concrete examples.

v0.3.0

Website

  • featImproved small‑screen readability.
  • featPricing: Starter includes 10 GiB/month free; banner and FAQ; units to GiB.
  • featUse Cases: redesigned cards.
  • featContact form.

v0.2.0

Control plane

  • featOrchestrator O1–O4: deploy, scale, rolling & blue/green rollout; drain & delete with reaper.
  • feat/v1/endpoints/:id/ready exposes k/N Ready for deploy progress.

Ingest

  • featGraceful drain: stop accepting, ship final segments, await drained ack (configurable timeout).
  • featHeartbeats: include writer_q and backlog_mb; visibility in /v1/nodes.

Docs

  • docsOpenAPI updates for orchestrator routes, drain hint, and revocation_epoch.

v0.1.0

Control plane

  • featToken exchange (API key → short‑lived tenant JWT) and node API key verification endpoint.

Ingest

  • featControl‑plane integration: node register/heartbeat/config; API key verify with revocation_epoch.
  • featQuotas: per‑tenant token bucket (reserved_mbps/burst_mb) with dynamic config.

Website

  • featWebsite: homepage, docs, pricing, and contact.