Quick Start
This guide will walk you through creating your first Bizon pipeline.
Prerequisites
Section titled “Prerequisites”Make sure you have installed Bizon before continuing.
Create Your First Pipeline
Section titled “Create Your First Pipeline”-
List available sources
First, explore what sources are available:
Terminal window bizon sources list -
List streams for a source
Once you’ve chosen a source, list its available streams:
Terminal window bizon sources streams <source_name> -
Create a pipeline configuration
Create a
config.ymlfile with your pipeline configuration:name: my-first-pipelinesource:type: <source_type># Add source-specific configurationdestination:type: bigqueryconfig:project_id: your-projectdataset: your_datasettable: your_table# Optional: Configure queue and backendqueue:type: python # Use 'rabbitmq' or 'kafka' for productionbackend:type: sqlite # Use 'postgres' or 'bigquery' for production -
Run the pipeline
Execute your pipeline:
Terminal window bizon run config.yml
What’s Next?
Section titled “What’s Next?”Now that you’ve run your first pipeline, learn more about:
- Advanced Quick Start - Build a Kafka to BigQuery streaming pipeline
- Architecture - Understand how Bizon works
- Checkpointing - Learn about fault tolerance
- Queues - Configure different queue systems
- Tutorials - Step-by-step guides for common use cases