Skip to main content

Pipeline Examples

Browse simple, practical pipeline examples to help you get started with Expanso Edge. These examples demonstrate common patterns and best practices.

Quick Start with Examples​

All pipeline examples are available as downloadable YAML files. You can use them directly with curl:

# Download and run a pipeline in one command
curl -sSL https://docs.expanso.io/examples/basic-pipeline.yaml | expanso-edge run -

# Or download first, then run
curl -o my-pipeline.yaml https://docs.expanso.io/examples/basic-pipeline.yaml
expanso-edge run -f my-pipeline.yaml

Each example page below includes specific download and usage instructions.

Getting Started Examples​

Perfect for learning the basics:

Basic Pipeline​

A simple log processing pipeline that reads from a file, parses JSON, and outputs to stdout. Start here if you're new to Expanso.

What you'll learn:

  • Basic pipeline structure
  • Reading from files
  • JSON parsing
  • Simple transformations

HTTP to File​

Receive HTTP webhooks and write them to files. Shows how to set up an HTTP server input and file output.

What you'll learn:

  • HTTP server setup
  • Receiving webhooks
  • Writing to files
  • Path templating with timestamps

Data Transformer​

Transform JSON data using Bloblang. Demonstrates field mapping, filtering, and data enrichment.

What you'll learn:

  • Bloblang transformation language
  • Field mapping and renaming
  • Filtering and conditional logic
  • Data enrichment patterns

Metrics Collector​

Collect system metrics and send them to a monitoring service. Shows time-series data handling.

What you'll learn:

  • Periodic data generation
  • Metrics collection
  • Batching for performance
  • Sending to monitoring services

Advanced Pattern Examples​

Log Processing Patterns​

Multiple examples showing log aggregation, filtering, routing, and analysis patterns.

Patterns covered:

  • Multi-source log aggregation
  • Severity-based routing
  • PII masking and redaction
  • Log enrichment with metadata

Data Routing​

Examples of routing data to multiple destinations based on content, patterns, and conditions.

Patterns covered:

  • Content-based routing
  • Fan-out to multiple destinations
  • Switch/case routing logic
  • Fallback and retry patterns

Data Security​

Security-focused examples including encryption, PII masking, and data redaction.

Patterns covered:

  • PII detection and masking
  • Field-level encryption
  • Sensitive data redaction
  • Compliance patterns

Need More Complex Examples?​

These documentation examples are designed to be simple and easy to understand. For production-ready, complex examples with complete deployment configurations, visit:

🚀 Production Examples & Templates

Explore complete, production-ready pipeline examples with deployment configurations, monitoring setup, and best practices.

Visit examples.expanso.io →

Includes: Kubernetes deployments, CI/CD pipelines, multi-cloud examples, and more

What You'll Find at examples.expanso.io​

Production Deployments:

  • Complete Kubernetes manifests
  • Helm charts and operators
  • Docker Compose configurations
  • Terraform/CloudFormation templates

Complex Integrations:

  • Multi-stage data processing pipelines
  • Microservices communication patterns
  • Event-driven architectures
  • Real-time analytics systems

Advanced Use Cases:

  • MLOps and model deployment
  • Time-series data processing
  • Real-time fraud detection
  • IoT device management at scale
  • Multi-region data synchronization

DevOps & Operations:

  • CI/CD pipeline examples
  • Monitoring and alerting setup
  • High-availability configurations
  • Disaster recovery patterns

Example Categories​

Browse by category to find examples relevant to your use case:

📊 Data Processing

  • Log processing
  • Data transformation
  • ETL pipelines
  • Stream processing

🔌 Integrations

  • Database connectivity
  • API integrations
  • Message queues
  • Cloud services

🛡️ Security & Compliance

  • PII masking
  • Encryption
  • Access control
  • Audit logging

📡 IoT & Edge

  • Sensor data collection
  • Edge analytics
  • Device management
  • Offline processing

How to Use These Examples​

  1. Start Simple: Begin with Basic Pipeline to understand the fundamentals
  2. Learn Patterns: Explore specific pattern examples for your use case
  3. Adapt: Copy and modify examples for your needs
  4. Go Production: Visit examples.expanso.io for production-ready configurations

Community Examples​

Have an example to share? We'd love to feature it! Contribute your examples to help the community:

Next Steps​