Skip to main content

Snowflake

The Snowflake destination allows you to write data to a Snowflake data-warehouse.

To use the Snowflake destination, you will need to install the Mycelial Daemon on the computer that has access to the Snowflake data-warehouse. Refer to the CLI documentation for instructions on how to install the Mycelial Daemon.

Configuration​

The Mycelial Daemon uses a TOML configuration file to specify the data sources and destinations that it has available to it. To add Snowflake as a data destination, you will need to add a section to the TOML file (config.toml) that looks like this:

[[destinations]]
type = "snowflake"
display_name = "snowflake destination"
username = "username"
password = "password"
role = "role"
account_identifier = "myorg-account123"
warehouse = "warehouse"
database = "database"
schema = "schema"

type​

The type field specifies the type of data destination, in this case it is snowflake.

display_name​

The display_name field is the name that will be displayed in the Mycelial user interface and via the API.

username​

The username field is the username for Snowflake authentication.

password​

The password field is the password for the specified username.

role​

The role field is the Snowflake role you wish to assume.

account_identifier​

The account_identifier field is the Snowflake account identifier. The account identifier includes the name of the account along with its organization (e.g. myorg-account123).

warehouse​

The warehouse field is the Snowflake data warehouse you wish to use.

database​

The database field is the Snowflake database you wish to use.

schema​

The schema field is the Snowflake schema in the given database you wish to use.

Configuration via CLI​

You will need to have the Mycelial CLI installed. Refer to the CLI documentation for instructions on how to install the Mycelial CLI.

Create a new config.toml file or add to an existing one​

If you are creating a new config.toml file, you can use the Mycelial CLI init command to generate the file and add the source.

If you are adding to an existing config file you can use the Mycelial CLI add command to add the source to the existing config.

Choose source config options​

When prompted with What would you like to do?, press the down arrow to highlight Add Destination and press return (⏎).

? What would you like to do? ›
  Add Source 
❯ Add Destination ⏎
  Exit

When prompted with What type of destination would you like to add?, press the down arrow to highlight Postgres destination and press return (⏎).

? What type of destination would you like to add? ›
  SQLite destination
  Postgres destination 
  MySQL destination
❯ Kafka destination ⏎
  Snowflake destination
  File destination
  Cancel

When prompted for the Display Name: press return (⏎) to accept the default or enter a display name for your destination and press return (⏎).

? Display name: (Snowflake Destination) ›

When prompted for the Snowflake username: enter the username for the Snowflake account you wish to use.

? Snowflake username: › snowflake_user ⏎

When prompted for the Snowflake password: enter the password for the Snowflake account you wish to use.

? Snowflake password: › password ⏎

When prompted for the Snowflake role: enter the role for the Snowflake account you wish to use.

? Snowflake role: ACCOUNTADMIN ⏎

When prompted for the Snowflake account name: enter the account name for the Snowflake account you wish to use.

? Snowflake account name: › account123 ⏎

When prompted for the Snowflake orgnization name: enter the organization name for the Snowflake account you wish to use.

? Snowflake organization name: › myorg ⏎

When prompted for the Snowflake warehouse: enter the warehouse you wish to use.

? Snowflake warehouse: › COMPUTE_WH ⏎

When prompted for the Database name: enter the database you wish to use.

? Database name: › mydb ⏎

When prompted for the Schema: enter the schema you wish to use.

? Schema: › PUBLIC ⏎

When prompted with What would you like to do?, press the down arrow to highlight Exit and press return (⏎).

? What would you like to do? ›
  Add Source
  Add Destination
❯ Exit

After exiting the CLI will generate or save the modified config.toml.

Usage​

After you have added the Snowflake destination to the config.toml file, you can start the Mycelial Daemon. Once the daemon is running, you can open the Mycelial control plane web interface and you should see the Snowflake destination listed in the destinations section.