Skip to main content

Configuration

2 skills for understanding configuration options and setting up database connections.

Skills

config

Full configuration reference. Comprehensive guide to environment variables, application structure, attribute types, and best practices.

You: /config Show me all available environment variables for configuring Starlake

Covers:

  • Environment variablesSL_ROOT, SL_ENV, SL_DATASETS, and component-specific variables
  • Application configuration — Complete application.sl.yml structure with write formats, load strategies, timezone, storage paths, audit, connections, expectations, metrics
  • Attribute types catalog — Primitive types (string, int, long, decimal, boolean), date/time formats (ISO, RFC 1123), and custom types
  • Storage patterns — S3/MinIO/SeaweedFS configuration for Spark and DuckDB
  • Best practices — Variable substitution, environment separation, custom types, partitioning, privacy transformations

connection

Database connection configuration. Set up and manage connections to all supported data platforms.

You: /connection Configure a Snowflake connection with OAuth authentication

Supported databases:

DatabaseModes
BigQueryNative, Spark
SnowflakeJDBC, OAuth, Spark connector
DuckDBBasic, S3, MotherDuck, DuckLake
PostgreSQLNative, Spark
MySQL/MariaDBJDBC
Amazon RedshiftNative, Spark
DatabricksJDBC
Apache SparkLocal/file system
ElasticsearchREST
KafkaProducer/Consumer

Key features:

  • Connection pooling strategies per database type
  • Environment variable patterns for sensitive values
  • Multi-database project configurations
  • DuckLake secret setup for PostgreSQL + GCS/S3
  • Connection testing via CLI