| MaidSafe website | Safe Dev Forum | Safe Network Forum |
|---|
- Safe Network CLI
- Table of contents
- Description
- Download
- Build
- Using the CLI
--help- Networks
- Auth
- The interactive shell
- SafeKeys
- Key-pair
- Wallet
- Files
- Files Put
- Files Sync
- Files Add
- Files Ls
- Files Get
- Example: retrieving contents of a file container to local working directory
- Example: retrieving subfolder in a file container to an existing local directory.
- Example: retrieving subfolder in a file container to a non-existent local directory (rename)
- Example: Retrieving individual file to an existing directory
- Example: Retrieving individual file to a new filename
- A performance note about very large FileContainers
- Files Tree
- Files Rm
- Xorurl
- Cat
- NRS (Name Resolution System)
- Safe-URLs
- Dog
- Seq (Sequence)
- Shell Completions
- Update
- Further Help
- License
- Contributing
This crate implements a CLI (Command Line Interface) for the Safe Network.
The Safe CLI provides all the tools necessary to interact with the Safe Network, including storing and browsing data of any kind, following links that are contained in the data and using their addresses on the network, using safecoin wallets, and much more. Using the CLI users have access to any type of operation that can be made on the Safe Network and the data stored on it, allowing them to also use it for automated scripts and piped chain of commands.
The latest version of the Safe CLI can be downloaded and installed using the install script.
The install script will not only download latest Safe CLI, but it will also unpack CLI binary onto ~/.safe/cli/ folder (C:\Users\<user>\.safe\cli in Windows), as well as set it in the PATH, so you can run the safe binary from any location when opening a console.
Open a new console and run any of the following curl or wget commands:
$ curl -so- https://sn-api.s3.amazonaws.com/install.sh | bash
or
$ wget -qO- https://sn-api.s3.amazonaws.com/install.sh | bash
If you are a Windows user, you'll need to open a Git BASH console with admin permissions.
Click the "Start" button and type "git-bash" in the search bar, then press the Shift+Ctrl+Enter keys to reach Git-Bash console. The Git-Bash icon may also be in the Start Menu. You can download Git Bash from here if you don't have in your PC.
Once you have a Git Bash console just run the above curl command:
$ curl -so- https://sn-api.s3.amazonaws.com/install.sh | bash
Once Safe CLI is downloaded and installed in your system, you can follow the steps in this User Guide by starting from the Using the CLI section below in this document.
You can alternatively download the latest version of the Safe CLI from the releases page and install it manually on your system.
If otherwise you prefer to build the Safe CLI from source code, please follow the instructions in the next two sections below.
In order to build this CLI from source code you need to make sure you have rustc v1.44.0 (or higher) installed. Please take a look at this notes about Rust installation if you need help with installing it. We recommend you install it with rustup which will install the cargo tool which this guide makes use of.
Once Rust and its toolchain are installed, run the following commands to clone this repository and build the sn_cli (the build process may take several minutes the first time you run it on this crate):
$ git clone https://github.com/maidsafe/sn_api.git
$ cd sn_api
$ cargo buildSince this project has a cargo workspace with the sn_cli as the default crate, when building from the root location it will build the Safe CLI. Once it's built, you can find the safe executable at target/debug/ or target/release if you built it with the --release flag.
Right now the CLI is under active development. Here we're listing commands ready to be tested.
In this guide we will assume from now on that you have navigated your terminal to the directory where the safe executable file you downloaded or built for your platform is located.
The base command, once built, is $ safe, or all commands can be run via $ cargo run -- <command>.
Various global flags are available:
-n, --dry-run Dry run of command. No data will be written. No coins spent.
-h, --help Prints help information
--json Sets JSON as output serialisation format (alias of '--output json')
-V, --version Prints version information
-o, --output <output_fmt> Output data serialisation: [json, jsoncompact, yaml]
--xorurl <xorurl_base> Base encoding to be used for XOR-URLs generated. Currently supported: base32z
(default), base32 and base64
All commands have a --help function which lists args, options and subcommands.
The CLI, like any other Safe application, can connect to different Safe networks that may be available. As the project advances several networks may coexist with the main Safe Network, there could be Safe networks available for testing upcoming features, or networks that are local to the user in their own computer or WAN/LAN.
The way Safe applications currently connect to a Safe network is by reading the connection information from a specific location in the system:
- Linux: from
~/.config/sn_node/ - macOS: from
/Users/<USERNAME>/Library/Preferences/net.MaidSafe.sn_node/ - Windows: from
C:\Users\<USERNAME>\AppData\Roaming\MaidSafe\sn_node\config\
Currently, there is a public test network accessible to anyone. Users may also have local nodes running in their own environment creating a local network. The CLI allows users to easily create a list of different Safe networks in its config settings, to then be able to switch between them with just a simple command.
Let's first look at how to run a local Safe network using the CLI. A local network is bootstrapped by running several Safe Network nodes which automatically interconnect forming a network. We therefore first need to install the Safe Network node in our system:
$ safe node install
Latest release found: sn_node v0.21.0
Downloading https://sn-node.s3.eu-west-2.amazonaws.com/sn_node-0.21.0-x86_64-unknown-linux-musl.zip...
[00:00:36] [========================================] 6.28MB/6.28MB (0s) Done
Installing sn_node binary at ~/.safe/node ...
Setting execution permissions to installed binary '~/.safe/node/sn_node'...
Done!At the current state of the Safe project, a single-section Safe network can be launched locally in our system. If the Safe Network node was installed in the system using the CLI as described in the previous section we can then launch it with a simple command:
$ safe node run-baby-fleming
Storing nodes' generated data at ~/.safe/node/baby-fleming-nodes
Launching local Safe network...
Launching with node executable from: ~/.safe/node/sn_node
Network size: 8 nodes
Launching genesis node (#1)...
Genesis node contact info: ["127.0.0.1:55851"]
Launching node #2...
Launching node #3...
Launching node #4...
Launching node #5...
Launching node #6...
Launching node #7...
Launching node #8...
Done!Once the local network is running, the connection configuration file will be already in the correct place for your applications (including the CLI) to connect to it. Thus from this point on, you can simply use the CLI or any application to connect to your local network. Note that depending on the application, you may need to restart it so it uses the new connection information for your local network.
In order to shutdown a running local network, the following CLI command can be invoked to kill all running sn_node processes:
$ safe node killall
Success, all processes instances of sn_node were stopped!The run-baby-fleming command accepts a --test or -t flag to automatically create a new account and log in the CLI for test purposes. This requires that the node, authd and cli themselves be installed in the correct locations on the system
Ready to play your part in a shared network by adding your node from home to a single section with other people's nodes? Keep reading...
MaidSafe are currently hosting some bootstrap nodes on Digital Ocean to kickstart a single section, you can bootstrap using these nodes as hardcoded contacts, then watch the logs as your node joins the network, progresses to Adult status, and plays its part in hosting Immutable Data Chunks. Of course you will also be able to create an account on this network, log in, upload data, create keys and wallets, and all the other commands described in this user guide. This guide will take you through connecting to this MaidSafe started network, but of course it can be applied to connecting to any shared section, hosted by anyone.
You will need the network configuration containing the details of the hardcoded contacts that will bootstrap you to the shared section. If you have connected to this or previous iterations of the MaidSafe shared section then you may already have a shared-section network profile saved on your machine. You can confirm this and update it to the latest configuration using safe networks check:
$ safe networks check
Checking current setup network connection information...
Fetching 'my-network' network connection information from '~/.config/sn_cli/networks/my-network_node_connection_info.config' ...
Fetching 'shared-section' network connection information from 'https://sn-node-config.s3.eu-west-2.amazonaws.com/shared-section/node_connection_info.config' ...
'shared-section' network matched. Current set network connection information at '~/.config/sn_node/node_connection_info.config' matches 'shared-section' network as per current configIf you don't have a configuration in your results which points to the exact S3 location listed in the results above, you can add using safe networks add:
$ safe networks add shared-section https://sn-node-config.s3.eu-west-2.amazonaws.com/shared-section/node_connection_info.config
Network 'shared-section' was added to the listNow you need to ensure you are set to use this shared-section configuration that we have updated/added, we can use safe networks switch shared-section for this:
$ safe networks switch shared-section
Switching to 'shared-section' network...
Fetching 'shared-section' network connection information from 'https://sn-node-config.s3.eu-west-2.amazonaws.com/shared-section/node_connection_info.config' ...
Successfully switched to 'shared-section' network in your system!
If you need write access to the 'shared-section' network, you'll need to restart authd, log in and re-authorise the CLI againWe're now ready to launch our node and add it as a node. This is achieved using safe node join as follows:
$ safe node join
Creating '/Users/maidsafe/.safe/node/local-node' folder
Storing nodes' generated data at /Users/maidsafe/.safe/node/local-node
Starting a node to join a Safe network...
Launching with node executable from: /Users/maidsafe/.safe/node/sn_node
Node started with hardcoded contact: 161.35.36.185:12000
Launching node...
Node logs are being stored at: /Users/maidsafe/.safe/node/local-node/sn_node.logYour node will now launch and attempt to connect to the shared network. You can keep an eye on its progress via its logs, which can be found at ~/.safe/node/local-node/sn_node.log.
Note that at the time of writing nodes from home is being restricted to those with home routers which correctly implement IGD. This will be expanded imminently to include those with routers which don't support IGD, with instructions added here for manual port forwarding at that point. If your log file states Automatic Port forwarding Failed then be on stand by for the next iteration.
MaidSafe currently hosts a single-section network for those who don't want to run a local network but still have a go at using the CLI and client applications. It's very common for users testing and experimenting with CLI and Safe applications to have a local network running, but switching to use the MaidSafe hosted network, back and forth, is also quite common.
The CLI allows you to set up a list of networks in its config settings for easily switching to connect to them. If you just launched a local network, you can keep current connection information as a configured network on CLI with the following command:
$ safe networks add my-network
Caching current network connection information into: ~/.config/sn_cli/networks/my-network_node_connection_info.config
Network 'my-network' was added to the list. Connection information is located at '~/.config/sn_cli/networks/my-network_node_connection_info.config'If you also would like to connect to the MaidSafe hosted test network, you would need to set it up in CLI settings as another network, specifying the URL where to fetch latest connection information from:
$ safe networks add shared-section https://sn-node-config.s3.eu-west-2.amazonaws.com/shared-section/node_connection_info.config
Network 'shared-section' was added to the listWe can also retrieve the list of the different networks that were set up in the CLI config:
$ safe networks
+----------------+--------------------------------------------------------------------------------------------------+
| Networks | |
+----------------+--------------------------------------------------------------------------------------------------+
| Network name | Connection info location |
+----------------+--------------------------------------------------------------------------------------------------+
| my-network | ~/.config/sn_cli/networks/my-network_node_connection_info.config |
+----------------+--------------------------------------------------------------------------------------------------+
| shared-section | https://sn-node-config.s3.eu-west-2.amazonaws.com/shared-section/node_connection_info.config |
+----------------+--------------------------------------------------------------------------------------------------+Once we have them in the CLI settings, we can use the CLI to automatically fetch the connection information data using the configured location, and place it at the right location in the system for Safe applications to connect to the selected network. E.g. let's switch to the 'shared-section' network we previously configured:
$ safe networks switch shared-section
Switching to 'shared-section' network...
Fetching 'shared-section' network connection information from 'https://sn-node-config.s3.eu-west-2.amazonaws.com/shared-section/node_connection_info.config' ...
Successfully switched to 'shared-section' network in your system!
If you need write access to the 'shared-section' network, you'll need to restart authd, log in and re-authorise the CLI againRemember that every time you launch a local network the connection configuration in your system is automatically overwritten with new connection information. Also, if the shared network was restarted by MaidSafe, the new connection information is published in the same URL and needs to be updated in your system to be able to successfully connect to it. Thus if you want to make sure your current setup network matches any of those set up in the CLI config, you can use the check subcommand:
$ safe networks check
Checking current setup network connection information...
Fetching 'my-network' network connection information from '~/.config/sn_cli/networks/my-network_node_connection_info.config' ...
Fetching 'shared-section' network connection information from 'https://sn-node-config.s3.eu-west-2.amazonaws.com/shared-section/node_connection_info.config' ...
'shared-section' network matched. Current set network connection information at '~/.config/sn_node/node_connection_info.config' matches 'shared-section' network as per current configNote that in the scenario that your current network is set to be the MaidSafe shared network, and that is restarted by MaidSafe (which causes new connection information to be published at the same URL), you then only need to re-run the networks switch command with the corresponding network name to update your system with the new connection information.
The node binary can be updated to the latest available version:
$ safe node updateThis command will check if a newer sn_node release is available on GitHub. After prompting to confirm if you want to take the latest version, it will be downloaded and the binary will be updated. By default it will assume the sn_node binary is at ~/.safe/node/, but you can override that path by providing --node-path <path> argument to the above command.
The CLI is just another client Safe application, therefore it needs to be authorised by the user to gain access to the Safe Network on behalf of the user. The auth command allows us to obtain such authorisation from the account owner (the user) via the Safe Authenticator.
This command simply sends an authorisation request to the Authenticator available, e.g. the sn_authd daemon (see further below for an explanation of how to run it), and it then stores the authorisation response (credentials) in the user's $XDG_DATA_DIRS/sn_cli/credentials file. Any subsequent CLI command will read this file to obtain the credentials and connect to the Safe Network for the corresponding operation.
In order to be able to allow any Safe application to connect to the Network and have access to your data, we need to start the Safe Authenticator daemon (authd). This application exposes an interface as a QUIC (Quick UDP Internet Connections) endpoint, which Safe applications will communicate with to request for access permissions. These permissions need to be reviewed by the user and approved, which can be all done with the Safe CLI as we'll see in this guide.
The Safe Authenticator, which runs as a daemon or as a service in Windows platforms, can be started and managed with the Safe CLI if the sn_authd/sn_authd.exe binary is properly installed in the system.
Downloading and installing the Authenticator daemon is very simple:
$ safe auth install
Latest release found: sn_authd v0.0.3
Downloading https://sn-api.s3.eu-west-2.amazonaws.com/sn_authd-0.0.3-x86_64-unknown-linux-gnu.tar.gz...
[00:00:25] [========================================] 6.16MB/6.16MB (0s) Done
Installing sn_authd binary at ~/.safe/authd ...
Setting execution permissions to installed binary '~/.safe/authd/sn_authd'...
Done!In order to start the Safe Authenticator daemon (sn_authd) so it can start receiving requests we simply need to run the following command:
$ safe auth start
Starting Safe Authenticator daemon (sn_authd)...
sn_authd started (PID: <pid>)Once we started the authd, it should be running in the background and ready to receive requests, we can send a status request to check it's up and running:
$ safe auth status
Sending request to authd to obtain a status report...
+------------------------------------------+-------+
| Safe Authenticator status | |
+------------------------------------------+-------+
| Authenticator daemon version | 0.0.3 |
+------------------------------------------+-------+
| Logged in to a Safe account? | No |
+------------------------------------------+-------+
| Number of pending authorisation requests | 0 |
+------------------------------------------+-------+
| Number of notifications subscribers | 0 |
+------------------------------------------+-------+Since we now have our Safe Authenticator running and ready to accept requests, we can start interacting with it by using other Safe CLI auth subcommands.
In order to create a Safe Network account we need some safecoins to pay with. Since this is still under development, we can have the CLI to generate some test-coins and use them for paying the cost of creating an account. We can do so by passing --test-coins flag to the create-acc subcommand. The CLI will request us to enter a passphrase and password for the new account to be created:
$ safe auth create-acc --test-coins
Passphrase:
Password:
Creating a SafeKey with test-coins...
Sending account creation request to authd...
Account was created successfully!
SafeKey created and preloaded with test-coins. Owner key pair generated:
Public Key = a42c991eb33c1e2530205bc726eba0279e151a334ba8dcd7212b131abb210145bc859ae5f6f5d4ce63ece54c64fe8792
Secret Key = 5cc0951bb95be85dec3f0358ddb40570d0e045b3ff0007562af9b5c9162f2518Alternatively, if we own some safecoins on a SafeKey already (see SafeKeys section for details about SafeKeys), we can provide the corresponding secret key to the safe CLI to use it for paying the cost of creating the account, as well as setting it as the default SafeKey for the account being created:
$ safe auth create-acc
Passphrase:
Password:
Enter SafeKey's secret key to pay with:
Sending account creation request to authd...
Account was created successfully!When a new account is created with CLI, as we've seen above, the authd will stay logged into that same account. However if we want to log in to a different account, or to the same account after the PC or authd was restarted, we can log in using the following command:
$ safe auth login
Passphrase:
Password:
Sending login action request to authd...
Logged in successfullyIf we now send a status report request to authd, it should now show that it's logged in to a Safe account:
$ safe auth status
Sending request to authd to obtain a status report...
+------------------------------------------+-------+
| Safe Authenticator status | |
+------------------------------------------+-------+
| Authenticator daemon version | 0.0.3 |
+------------------------------------------+-------+
| Logged in to a Safe account? | Yes |
+------------------------------------------+-------+
| Number of pending authorisation requests | 0 |
+------------------------------------------+-------+
| Number of notifications subscribers | 0 |
+------------------------------------------+-------+The Safe Authenticator is now ready to receive authorisation requests from any Safe application, including the Safe CLI which needs to also get permissions to perform any data operations on behalf of our account.
It's possible (though not secure) to use a simple json file to pass the passphrase and password to the auth commands, and so avoid having to manually input both, either when creating an account or when logging in.
// my-config.json
{
"passphrase": "mypassphrase"
"password": "mypassword",
}
And so you can log in with:
$ safe auth login --config ./my-config.json
Sending login action request to authd...
Logged in successfullyAnother method for passing passphrase/password involves using the environment variables SAFE_AUTH_PASSPHRASE and SAFE_AUTH_PASSWORD.
With those set (eg, on Linux/macOS: export SAFE_AUTH_PASSPHRASE="<your passphrase>;", and export SAFE_AUTH_PASSWORD="<your password>"), you can then log in without needing to enter login details, or pass a config file:
$ safe auth login
Sending login action request to authd...
Logged in successfullyOr, you can choose to pass the environment variables to the command directly (though this can be insecure):
$ SAFE_AUTH_PASSPHRASE="<passphrase>" SAFE_AUTH_PASSWORD="<password>" safe auth login
Sending login action request to authd...
Logged in successfullyPlease note, that both the passphrase and password environment variables must be set to use this method. If only one is set, an error will be thrown.
Now that the Authenticator is running and ready to authorise applications, we can try to authorise the CLI application.
In a normal scenario, an Authenticator GUI would be using authd as its backend process, e.g. the Safe Network Application provides such a GUI to review authorisation requests and allow the permissions requested to be granted.
For the purpose of making this guide self-contained with the Safe CLI application, we will now use also the CLI on a second console to review and allow/deny authorisation requests.
Let's first send an authorisation request from the current console by simply invoking the auth command with no subcommands:
$ safe auth
Authorising CLI application...The CLI application is now waiting for an authorisation response from the authd.
We can now open a second console which we'll use to query authd for pending authorisation requests, and also to allow/deny them (remember the following steps wouldn't be needed if we had any other Authenticator UI running, like the Safe Network App).
Once we have a second console, we can start by fetching from authd the list of authorisation requests pending for approval/denial:
$ safe auth reqs
Requesting list of pending authorisation requests from authd...
+--------------------------------+------------------+----------+------------------+-------------------------+
| Pending Authorisation requests | | | | |
+--------------------------------+------------------+----------+------------------+-------------------------+
| Request Id | App Id | Name | Vendor | Permissions requested |
+--------------------------------+------------------+----------+------------------+-------------------------+
| 584798987 | net.maidsafe.cli | Safe CLI | MaidSafe.net Ltd | Own container: No |
| | | | | Transfer coins: Yes |
| | | | | Mutations: Yes |
| | | | | Read coin balance: Yes |
| | | | | Containers: None |
+--------------------------------+------------------+----------+------------------+-------------------------+We see there is one authorisation request pending for approval/denial, which is the one requested by the CLI application from the other console.
In order to allow any pending authorisation request we use its request ID (e.g. '584798987' from above), the authd will then proceed to send a response back to the CLI with the corresponding credentials it can use to connect directly with the Network:
$ safe auth allow 584798987
Sending request to authd to allow an authorisation request...
Authorisation request was allowed.Note we could have otherwise decided to deny this authorisation request and invoke $ safe auth deny 584798987 instead, but let's allow it so we can continue with the next steps of this guide.
If we now switch back to our previous console, the one where we sent the authorisation request with $ safe auth command from, we will see the Safe CLI receiving the response from authd. You should see in that console a message like the following:
Safe CLI app was successfully authorised
Credentials were stored in <home directory>/.local/share/sn_cli/credentialsWe are now ready to start using the CLI to operate with the network, via its commands and supported operations!.
It could be the case the Safe CLI is the only Safe application that the user is intended to use to interact with the Safe Network. In such a case authorising the CLI application as explained above (when there is no other UI for the authd) using another instance of the CLI in a second console is not that comfortable.
Therefore there is an option which allows the Safe CLI to automatically self authorise when the user logs in using the CLI, which is as simple as:
$ safe auth login --self-auth
Passphrase:
Password:
Sending login action request to authd...
Logged in successfully
Authorising CLI application...
Safe CLI app was successfully authorised
Credentials were stored in <home directory>/.local/share/sn_cli/credentialsThe Authenticator binary (sn_authd/sn_authd.exe) can be updated to the latest available version using the CLI:
$ safe auth updateIt will check if a newer release is available on Amazon S3. After prompting to confirm if you want to take the latest version, it will be downloaded and the sn_authd binary will be updated.
After the sn_authd was updated, you'll need to restart it to start using new version:
$ safe auth restart
Stopping Safe Authenticator daemon (sn_authd)...
Success, sn_authd (PID: <pid>) stopped!
Starting Safe Authenticator daemon (sn_authd)...
sn_authd started (PID: <new pid>)
Success, sn_authd restarted!When the CLI is invoked without any command, it enters into an interactive shell, which allows the user to run commands within a shell:
$ safe
Welcome to Safe CLI interactive shell!
Type 'help' for a list of supported commands
Pass '--help' flag to any top level command for a complete list of supported subcommands and arguments
Type 'quit' to exit this shell. Enjoy it!
>The interactive shell supports all the same commands and operations that can be performed in the command line. E.g., we can use the auth status command to retrieve a status report from the authd:
> auth status
Sending request to authd to obtain a status report...
+------------------------------------------+-------+
| Safe Authenticator status | |
+------------------------------------------+-------+
| Authenticator daemon version | 0.0.3 |
+------------------------------------------+-------+
| Logged in to a Safe account? | No |
+------------------------------------------+-------+
| Number of pending authorisation requests | 0 |
+------------------------------------------+-------+
| Number of notifications subscribers | 0 |
+------------------------------------------+-------+As you can see, the commands operate in an analogous way as when they are invoked outside of the interactive shell. Although there are some operations which are only possible when they are executed from the interactive shell, one nice example is the possibility to subscribe to receive authorisation request notifications, let's see how that works.
In the previous section we've used the safe auth reqs command to obtain a list of the authorisation requests which are waiting for approval/denial. We could instead use the interactive shell to subscribe it as an endpoint to receive notifications when this authorisation requests are sent to the authd:
> auth subscribe
Sending request to subscribe...
Subscribed successfully
Keep this shell session open to receive the notificationsThis is telling us that as long as we keep this session of the interactive shell open, we will be notified of any new authorisation request, such notifications are being sent by the authd to our interactive shell session. Thus if we have any other Safe app which is sending an authorisation request to authd, e.g. the Safe Browser, a safe auth command invoked from another instance of the CLI, etc., we will be notified by the interactive shell:
>
A new application authorisation request was received:
+------------+------------------+---------+---------+-------------------------+
| Request Id | App Id | Name | Vendor | Permissions requested |
+------------+------------------+---------+---------+-------------------------+
| 754801191 | net.maidsafe.cli | Unknown | Unknown | Own container: No |
| | | | | Transfer coins: Yes |
| | | | | Mutations: Yes |
| | | | | Read coin balance: Yes |
| | | | | Containers: None |
+------------+------------------+---------+---------+-------------------------+
You can use "auth allow"/"auth deny" commands to allow/deny the request respectively, e.g.: auth allow 754801191
Press Enter to continueThe notification message contains the same information we can obtain with safe auth reqs command. We can now do the same as before and allow/deny such a request using its ID, in this case '754801191':
> auth allow 754801191
Sending request to authd to allow an authorisation request...
Authorisation request was allowedThe interactive shell will be expanded to support many more operations, and especially to cover the use cases which are not possible to cover with the non-interactive shell, like the use case we've seen of receiving notifications from authd.
It enables the possibility to also have a state in the session, e.g. allowing the user to set a wallet to be used for all operations within that session instead of using the default wallet from the account, ...or several other use cases and features we'll be adding as we move forward in its development.
SafeKey management allows users to generate sign/encryption key pairs that can be used for different types of operations, like choosing which sign key to use for uploading files (and therefore paying for the storage used), or signing a message posted on some social application when a SafeKey is linked from a public profile (e.g. a WebID/SAFE-ID), or even for encrypting messages that are privately sent to another party so it can verify the authenticity of the sender.
Users can record SafeKeys in a Wallet (see further below for more details about Wallets), having friendly names to refer to them, but they can also be created as throw away SafeKeys which are not linked from any Wallet, container, or any other type of data on the network.
Note that even though the key pair is automatically generated by the CLI, SafeKeys don’t hold the secret key on the network but just the public key, and SafeKeys can optionally have a safecoin balance attached to it. Thus SafeKeys can also be used for safecoin transfers. In this sense, a SafeKey can be compared to a Bitcoin address, it has a coin balance associated to it, such balance can be only queried using the secret key, and in order to spend its balance the corresponding secret key needs to be provided in the transfer request as well. The secret key can be provided by the user, or retrieved from a Wallet, at the moment of creating the transfer (again, see the Wallet section below for more details).
To generate a key pair and create a new SafeKey on the network, the secret key of another SafeKey is needed to pay for storage costs:
$ safe keys create --pay-with <secret key>But we can also create a SafeKey with test-coins to begin with (this is temporary and only for testing until farming is available):
$ safe keys create --test-coins --preload 15.342
New SafeKey created at: "safe://bbkulcbnrmdzhdkrfb6zbbf7fisbdn7ggztdvgcxueyq2iys272koaplks"
Preloaded with 15.342 coins
Key pair generated:
Public Key = b62c1e4e3544a1f64212fca89046df98d998ea615e84c4348c4b5fd29c07ad52a970539df819e31990c1edf09b882e61
Secret Key = c4cc596d7321a3054d397beff82fe64f49c3896a07a349d31f29574ac9f56965Once we have some SafeKeys with some test-coins we can use them to pay for the creation of a Safe Account (using the Safe Authenticator), or to pay for the creation of new SafeKeys. Thus if we use the SafeKey we just created with test-coins we can create a second SafeKey:
$ safe keys create --preload 8.15 --pay-with c4cc596d7321a3054d397beff82fe64f49c3896a07a349d31f29574ac9f56965
New SafeKey created at: "safe://bbkulcbf2uuqwawvuonevraqa4ieu375qqrdpwvzi356edwkdjhwgd4dum"
Preloaded with 8.15 coins
Key pair generated:
Public Key = 9754a42c0b568e692b10401c4129bff61088df6ae51bef883b28693d8c3e0e8ce23054e236bd64edc45791549ef60ce1
Secret Key = 2f211ad4606c716c2c2965e8ea2bd76a63bfc5a5936b792cda448ddea70a031cIn this case, the new SafeKey is preloaded with coins which are transferred from the SafeKey we pay the operation with. In the next section we'll see how to check the coin balance of them.
If we omit the --pay-with argument from the command above, or from any other command which supports it, the CLI will make use of the default SafeKey which is linked from the account for paying the costs of the operation. Upon the creation of a Safe Account, a default SafeKey is linked to it and used for paying the costs incurred in any operations made by the applications that have been authorised by the owner of that account, like it's the case of the sn_cli application. Currently it's not possible to change the default SafeKey linked from an account, but it will be possible with the sn_cli in the near future.
Other optional args that can be used with the keys create sub-command are:
--pk <pk> Don't generate a key pair and just use the provided public key
--preload <preload> Preload the SafeKey with a coin balance
We can retrieve a given SafeKey's balance simply using its secret key, which we can pass to keys balance subcommand with --sk <secret key> argument, or we can enter it when the CLI prompts us.
We can optionally also pass the SafeKey's XorUrl to have the CLI to verify they correspond to each other, i.e. if the SafeKey's XorUrl is provided, the CLI will check if it corresponds to the public key derived from the passed secret key, and throw an error if it doesn't.
The target SafeKey's secret key can be passed as an argument (or it will be retrieved from stdin). Let's check the balance of the SafeKey we created in the previous section:
$ safe keys balance
Enter secret key corresponding to the SafeKey to query the balance from: c4cc596d7321a3054d397beff82fe64f49c3896a07a349d31f29574ac9f56965
SafeKey's current balance: 15.342000000We now have a SafeKey with a positive balance, we can transfer --from a SafeKey (using its secret key), an <amount> of safecoins, --to another Wallet or SafeKey. The destination Wallet/SafeKey can be passed as an argument with --to, or it will be read from stdin. If we omit the --from argument, the Account's default SafeKey will be used as the source of funds for the transfer.
$ safe keys transfer <amount> --from <source SafeKey secret key> --to <destination Wallet/SafeKey URL>E.g.:
$ safe keys transfer 1.519 --from c4cc596d7321a3054d397beff82fe64f49c3896a07a349d31f29574ac9f56965 --to safe://bbkulcbf2uuqwawvuonevraqa4ieu375qqrdpwvzi356edwkdjhwgd4dum
Success. TX_ID: 12584479662656231449There are some scenarios that being able to generate a sign/encryption key-pair, without creating and/or storing a SafeKey on the network, is required.
As an example, if we want to have a friend to create a SafeKey for us, and preload it with some coins, we can generate a key-pair, and share with our friend only the public key so he/she can generate the SafeKey to be owned by it (this is where we can use the --pk argument on the keys create sub-command).
Thus, let's see how this use case would work. First we create a key-pair:
$ safe keypair
Key pair generated:
Public Key = b2371df48684dc9456988f45b56d7640df63895fea3d7cee45c79b26ba268d259b864330b83fa28669ab910a1725b833
Secret Key = 62e323615235122f7e20c7f05ddf56c5e5684853d21f65fca686b0bfb2ed851aWe now take note of both the public key, and the secret key. Now, we only share the public key with our friend, who can use it to generate a SafeKey to be owned by it and preload it with some test-coins:
$ safe keys create --test-coins --preload 64.24 --pk b2371df48684dc9456988f45b56d7640df63895fea3d7cee45c79b26ba268d259b864330b83fa28669ab910a1725b833
New SafeKey created at: "safe://hodby8y3qgina9nqzxmsoi8ytjfh6gwnia7hdupo49ibt8yy3ytgdq"
Preloaded with 64.24 coinsFinally, our friend gives us the XOR-URL of the SafeKey he/she has created for us. We own the balance this SafeKey holds since we have the secret key associated with it. Therefore we can now use the SafeKey for any operation, like creating an account with safe_auth CLI to then be able to store data on the Network.
A Wallet is a specific type of Container on the network, holding a set of spendable safecoin balances.
A Wallet effectively contains links to SafeKeys which have safecoin balances attached to them, but the Wallet also stores the secret keys needed to spend them, and this is why each of these links/items in a Wallet is called a spendable balances. Wallets are stored encrypted and only accessible to the owner by default.
Each of these links to SafeKeys (the spendable balances) can have a friendly name provided by the user, and these friendly names can then be used in different types of operations. E.g. one spendable balance in a Wallet can be named 'for-night-outs', while another one is named 'to-pay-the-rent', so when using the Wallet you could provide those names to the command in order to choose which spendable balance to use for the operation.
There are several sub-commands that can be used to manage the Wallets with the safe wallet command (those commented out are not yet implemented):
SUBCOMMANDS:
balance Query a Wallet's total balance
# check-tx Check the status of a given transfer
create Create a new Wallet
help Prints this message or the help of the given subcommand(s)
insert Insert a spendable balance into a Wallet
# sweep Move all coins within a Wallet to a second given Wallet or Key
transfer Transfer safecoins from one Wallet, SafeKey or pk, to another.
USAGE:
safe wallet create [FLAGS] [OPTIONS]
FLAGS:
-n, --dry-run Dry run of command. No data will be written. No coins spent
-h, --help Prints help information
--no-balance If true, do not create a spendable balance
--json Sets JSON as output serialisation format (alias of '--output json')
--test-coins Create a SafeKey, allocate test-coins onto it, and add the SafeKey to the Wallet
-V, --version Prints version information
OPTIONS:
--keyurl <keyurl> An existing SafeKey's safe://xor-url. If this is not supplied, a new SafeKey will be
automatically generated and inserted. The corresponding secret key will be prompted if
not provided with '--sk'
--name <name> The name to give the spendable balance
-o, --output <output_fmt> Output data serialisation. Currently only supported 'json'
-w, --pay-with <pay_with> The secret key of a SafeKey for paying the operation costs
--preload <preload> Preload with a balance
--sk <secret> Pass the secret key needed to make the balance spendable, it will be prompted if not
provided
--xorurl <xorurl_base> Base encoding to be used for XOR-URLs generated. Currently supported: base32z
(default), base32 and base64Right now, only a secret key (of a SafeKey with coins) can be used to pay for the costs, but in the future a Wallet will be also allowed for this purpose.
For example, if we use the secret key we obtained when creating a SafeKey in our example in the previous section to pay for the costs, we can create a Wallet with a new spendable balance by simply running:
$ safe wallet create --pay-with 62e323615235122f7e20c7f05ddf56c5e5684853d21f65fca686b0bfb2ed851a --name first-spendable-balance
Wallet created at: "safe://hnyybyqbp8d4u79f9sqhcxtdczgb76iif74cdsjif1wegik9t38diuk1yny9e"
New SafeKey created at: "safe://hbyyyybqk69tpm67ecnzjg66tcrja3ugq81oh6gfaffwaty614rmttmyeu"
Key pair generated:
Public Key = b95efc5abf750c15d26f7a2c22719999c79439e317052d31107a5a22e3158113d6003af4980b72ff076813eda30f1d8b
Secret Key = b9b2edffa8ef103dc98ba2160e295f98fdf981eb572bc2f8b018a12574ce435eThe balance of a given Wallet can be queried using its XorUrl. This returns the balance of the whole Wallet, i.e. the sum of the contained spendable balances. The target Wallet can be passed as an argument (or it will be retrieved from stdin):
$ safe wallet balance safe://hnyybyqbp8d4u79f9sqhcxtdczgb76iif74cdsjif1wegik9t38diuk1yny9e
Wallet at "safe://hnyybyqbp8d4u79f9sqhcxtdczgb76iif74cdsjif1wegik9t38diuk1yny9e" has a total balance of 0 safecoinsThe coin balance of an individual spendable balance can also be queried by providing its friendly name as part of the Wallet URL, e.g. the Wallet we created above contains a spendable balance named 'first-spendable-balance', so we can check the balance of it (instead of the total balance of the Wallet) with the following command:
$ safe wallet balance safe://hnyybyqbp8d4u79f9sqhcxtdczgb76iif74cdsjif1wegik9t38diuk1yny9e/first-spendable-balance
Wallet's spendable balance at "safe://hnyybyqbp8d4u79f9sqhcxtdczgb76iif74cdsjif1wegik9t38diuk1yny9e/first-spendable-balance" has a balance of 0 safecoinsAs mentioned before, a SafeKey doesn't hold the secret key on the network, therefore even if it has some non-zero coin balance, it cannot be spent. This is where the Wallet comes into play, holding the links to SafeKeys, and making their balances spendable by storing the corresponding secret keys.
Aside from at wallet creation, we can add more keys to use as spendable balances by insert-ing into a Wallet a link to a SafeKey, making it a spendable balance.
USAGE:
safe wallet insert [FLAGS] [OPTIONS] <target>
FLAGS:
--default Set the inserted SafeKey as the default one in the target Wallet
-n, --dry-run Dry run of command. No data will be written. No coins spent
-h, --help Prints help information
--json Sets JSON as output serialisation format (alias of '--output json')
-V, --version Prints version information
OPTIONS:
--keyurl <keyurl> The SafeKey's safe://xor-url to verify it matches/corresponds to the secret key provided.
The corresponding secret key will be prompted if not provided with '--sk'
--name <name> The name to give this spendable balance
-o, --output <output_fmt> Output data serialisation. Currently only supported 'json'
-w, --pay-with <pay_with> The secret key of a SafeKey for paying the operation costs. If not provided, the default
wallet from the account will be used
--sk <secret> Pass the secret key needed to make the balance spendable, it will be prompted if not
provided
--xorurl <xorurl_base> Base encoding to be used for XOR-URLs generated. Currently supported: base32z
(default), base32 and base64
ARGS:
<target> The target Wallet to insert the spendable balance- The
<target>is theWalletto insert the spendable balance to - The
--nameis an optional nickname to give a spendable balance for easy reference - The
--defaultflag sets this new spendable balance as the default for the containingWallet. This can be used by wallet applications to apply some logic on how to spend and/or choose the balances for a transfer
With the above options, the user will be prompted to input the secret key corresponding to the SafeKey to be inserted, unless it was already provided with --sk. This is stored in the Wallet.
The --sk argument can also be combined with --keyurl to pass the SafeKey's XorUrl as part of the command line instruction itself, e.g.:
$ safe wallet insert safe://<wallet-xorurl> --keyurl safe://<key-xor-url> --name my-default-balance --default
Enter secret key corresponding to public key at safe://<key-xor-url>:
b493a84e3b35239cbffdf10b8ebfa49c0013a5d1b59e5ef3c000320e2d303311
Spendable balance inserted with name 'my-default-balance' in Wallet located at "safe://<wallet-xorurl>"Once a Wallet contains some spendable balance/s, we can transfer --from a Wallet an <amount> of safecoins --to another Wallet or SafeKey. The destination Wallet/SafeKey can be passed as an argument with --to, or it will be read from stdin.
$ safe wallet transfer <amount> --from <source Wallet URL> --to <destination Wallet/SafeKey URL>If the Wallet being provided either as the source or destination of a transfer has a default spendable balance, we then only need to provide its URL, e.g.:
$ safe wallet transfer 323.23 --from safe://hnyybyqbp8d4u79f9sqhcxtdczgb76iif74cdsjif1wegik9t38diuk1yny9e --to safe://hbyek1io7m6we5ges83fcn16xd51bqrrjjea4yyhu4hbu9yunyc5mucjao
Success. TX_ID: 6183829450183485238If on the contrary a Wallet being used (either as the source or destination of a transfer) doesn't have a default spendable balance set, we can specify which spendable balance the operation should be applied to by passing its friendly name as the path of the Wallet URL. Or even if it has a default spendable balance set, we can still choose which spendable balance to use in the operation. E.g. we can transfer from 'for-night-outs' spendable balance of the source Wallet with the following command:
$ safe wallet transfer 0.053 --from safe://hnyybyqbp8d4u79f9sqhcxtdczgb76iif74cdsjif1wegik9t38diuk1yny9e/for-night-outs --to safe://hbyek1io7m6we5ges83fcn16xd51bqrrjjea4yyhu4hbu9yunyc5mucjao
Success. TX_ID: 277748716389078887Uploading files and folders onto the network is also possible with the CLI application, and as we'll see here it's extremely simple to not just upload them but also keep them in sync with any modifications made locally to the folders and files.
Files are uploaded on the Network and stored as Public Blob files, and the folders and sub-folders hierarchy is flattened out and stored in a container mapping each file's path with the corresponding Blob XOR-URL. This map is maintained on the Network in a special container called FilesContainer, which is stored as Public Sequence data. The data representation in the FilesContainer is planned to be implemented with RDF and the corresponding FilesContainer RFC will be submitted, but at this stage this is being done only using a simple serialised structure.
The most simple scenario is to upload all files and subfolders found within a local ./to-upload/ directory, recursively, onto a FilesContainer on the Network, obtaining the XOR-URL of the newly created container, as well as the XOR-URL of each of the files uploaded:
$ safe files put ./to-upload/ --recursive
FilesContainer created at: "safe://bbkulcb5hsl2zbsia4af5i7myv2ujbet7di4gx5bstduikwgobru67esqu"
+ ./to-upload/index.html safe://bbkulcax6ulw7ovqhpsindkybsum4tusmvuc7ovtr2bu5gj6m4ugtu7euh
+ ./to-upload/myfolder/notes.txt safe://bbkulcan3may5gmqxqonwaoz2cjlkuc4cflrhwitmzy7ur4paof4u57yxz
+ ./to-upload/img.jpeg safe://bbkulcbtiq3vg4xehqbrjd2gz4kljguqtds5ko5khexya3v3k7scymcphjNote that the + sign means the files were all added to the FilesContainer, which will make more sense later on when we see how to use the files sync command to update and/or delete files.
A single file can also be uploaded using the files put command, which will create a FilesContainer as well but this time only a single file will be added to the map:
$ safe files put ./to-upload/myfile.txt
FilesContainer created at: "safe://bbkulca25xhzwo6mcxlji7ocf5tm5hgn2x3mxtg62qzycculur4aixeywm"
+ ./to-upload/myfile.txt safe://bbkulcbxk23cfnj7gz3r4y7624kpb5spwf4b7jogu2rofhuj5xiqa5huh7When uploading files onto a FilesContainer with the CLI, the base path for the files in the container is set by default to be /. All the files at the source are published on the FilesContainer with an absolute path with base / path.
As an example, if we upload three files, which at source are located at /to-upload/file1.txt, /to-upload/myfolder/file2.txt, and /to-upload/myotherfolder/subfolder/file3.txt, the files will be published on the FilesContainer with paths /file1.txt, /myfolder/file2.txt, and /myotherfolder/subfolder/file3.txt respectively.
We can additionally pass a destination path argument to set a base path for each of the paths in the FilesContainer, e.g. if we provide /mychosenroot/ destination path argument to the files put command when uploading the above files, they will be published on the FilesContainer with paths /mychosenroot/file1.txt, /mychosenroot/myfolder/file2.txt, and /mychosenroot/myotherfolder/subfolder/file3.txt respectively. This can be verified by querying the FilesContainer content with the safe cat command, please see further below for details of how this command works.
Once a set of files, folders and subfolders, have been uploaded to the Network onto a FilesContainer using the files put command, local changes made to those files and folders can be easily synced up using the files sync command. This command takes care of finding the differences/changes on the local files and folders, creating new Public Blob files as necessary, and updating the FilesContainer by publishing a new version of it at the same location on the Network.
The files sync command follows a very similar logic to the well known rsync command, supporting a subset of its functionality. This subset will gradually be expanded with more supported features. Users knowing how to use rsync can easily start using the Safe CLI and the Safe Network for uploading files and folders, making it also easy to integrate existing automated systems which are currently making use of rsync.
As an example, let's suppose we upload all files and subfolders found within the ./to-upload/ local directory, recursively, using files put command:
$ safe files put ./to-upload/ --recursive
FilesContainer created at: "safe://hnyynyi6tgumo67yoauewe3ee3ojh37sbyr7rnh3nd6kkqhbo9decpjk64bnc"
+ ./to-upload/another.md safe://hbhyrydt5b95dmumcm8yig4u1keuuh8hgsr5yx39xn4mqikp91sbdhbpwp
+ ./to-upload/subfolder/subexists.md safe://hbhyryn9uodh1ju5uzyti3gmmtwburrssd89rcwcy3rzofdpypwomrzzte
+ ./to-upload/subfolder/note.md safe://hbhyryncjzga5uqp3ogeadqctigyaurpju8yauqptzgh5uyctogh3dkcbt
+ ./to-upload/test.md safe://hbhyrydpan7d94mwp1bun3mxfnrfrui131an7ihu11wsn8dkr8odab9qwnAll the content of the ./to-upload/ local directory is now stored and published on the Safe Network. Now, let's say we make the following changes to our local files within the ./to-upload/ folder:
- We edit
./to-upload/another.mdand change its content - We create a new file at
./to-upload/new.md - And we remove the file
./to-upload/test.md
We can now sync up all the changes we just made, recursively, with the FilesContainer we previously created:
$ safe files sync ./to-upload/ safe://hnyynyi6tgumo67yoauewe3ee3ojh37sbyr7rnh3nd6kkqhbo9decpjk64bnc --recursive --delete
FilesContainer synced up (version 1): "safe://hnyynyi6tgumo67yoauewe3ee3ojh37sbyr7rnh3nd6kkqhbo9decpjk64bnc?v=1"
* ./to-upload/another.md safe://hbhyrynyr3osimhxa3mfqok7tto6cf3hhjy4sp3wdri6ee46x8xg68r9mj
+ ./to-upload/new.md safe://hbhyrydky3ga3xgkneiy1y5o6513rq6wdipqthkhd3ujqci9qmy8weihom
- /test.md safe://hbhyrydpan7d94mwp1bun3mxfnrfrui131an7ihu11wsn8dkr8odab9qwnThe *, + and - signs mean that the files were updated, added, and removed respectively.
Also, please note we provided the optional --delete flag to the command above which forces the deletion of the files found at the targeted FilesContainer that are not found in the source location, like the case of ./to-upload/test.md file in our example above. If we didn't provide such flag, only the modification and creation of files would have been updated on the FilesContainer, like the case of ./to-upload/another.md and ./to-upload/new files in our example above. Note that --delete is only allowed if the --recursive flag is also provided.
The files sync command also supports to be passed a destination path as the files put command, but in this case the destination path needs to be provided as part of the target XOR-URL. E.g., we can sync a FilesContainer using the local path and provide a specific destination path new-files in the target XOR-URL:
$ safe files sync ./other-folder/ safe://hnyynyi6tgumo67yoauewe3ee3ojh37sbyr7rnh3nd6kkqhbo9decpjk64bnc/new-files
FilesContainer synced up (version 2): "safe://hnyynyi6tgumo67yoauewe3ee3ojh37sbyr7rnh3nd6kkqhbo9decpjk64bnc?v=2"
+ ./other-folder/file1.txt safe://hbhydyn6b5x9nqxt5escpuzy3axrcqb9dgs7p74izmpfkmmquwrdgjig4kThe ./other-folder/file1.txt file will be uploaded and published in the FilesContainer with path /new-files/file1.txt.
One more thing to note about files sync command is the use of the --update-nrs flag. When syncing content using an NRS-URL (see NRS section below for more information about NRS names and commands), if you want to update the NRS name to the new version generated after syncing the target FilesContainer, then it can be specified using the --update-nrs flag:
$ safe files sync ./to-upload/ safe://mywebsite --update-nrs
FilesContainer synced up (version 1): "safe://mywebsite"
* ./to-upload/another.md safe://hbhyrynyr3osimhxa3mfqok7tto6cf3hhjy4sp3wdri6ee46x8xg68r9mj
+ ./to-upload/new.md safe://hbhyrydky3ga3xgkneiy1y5o6513rq6wdipqthkhd3ujqci9qmy8weihomIt could be desirable in some scenarios to simply add a file to a FilesContainer rather than having the CLI to sync up a complete local folder, so the files add command could be used in such cases.
We can add a single file from a local path, let's say ./some-other-folder/file.txt, to our existing FilesContainer on the Safe Network with the following command:
$ safe files add ./some-other-folder/file.txt safe://hnyynyi6tgumo67yoauewe3ee3ojh37sbyr7rnh3nd6kkqhbo9decpjk64bnc/files-added/just-a-file.txt
FilesContainer updated (version 3): "safe://hnyynyi6tgumo67yoauewe3ee3ojh37sbyr7rnh3nd6kkqhbo9decpjk64bnc?v=3"
+ ./some-other-folder/file.txt safe://hbhydynx64dxu5594yunsu41dykxt3nu1be81cy9igqzz3qtqrq1w3y6d9If we have previously uploaded a file to the network, we can also add it to any existing FilesContainer by providing its XOR-URL as the <location> argument to the files add command. Let's add a file (the same file we uploaded in the previous command) to our FilesContainer again, but choosing a new destination filename, e.g. /files-added/same-file.txt:
$ safe files add safe://hbhydynx64dxu5594yunsu41dykxt3nu1be81cy9igqzz3qtqrq1w3y6d9 safe://hnyynyi6tgumo67yoauewe3ee3ojh37sbyr7rnh3nd6kkqhbo9decpjk64bnc/files-added/same-file.txt
FilesContainer updated (version 4): "safe://hnyynyi6tgumo67yoauewe3ee3ojh37sbyr7rnh3nd6kkqhbo9decpjk64bnc?v=4"
+ /files-added/same-file.txt safe://hbhydynx64dxu5594yunsu41dykxt3nu1be81cy9igqzz3qtqrq1w3y6d9We can list the files from a FilesContainer using the files ls command:
$ safe files ls safe://hnyynyi6tgumo67yoauewe3ee3ojh37sbyr7rnh3nd6kkqhbo9decpjk64bnc
Files of FilesContainer (version 4) at "safe://hnyynyi6tgumo67yoauewe3ee3ojh37sbyr7rnh3nd6kkqhbo9decpjk64bnc":
Total: 6
SIZE CREATED MODIFIED NAME
11 2020-01-28T20:26:05Z 2020-01-28T20:29:04Z another.md
38 2020-01-28T20:35:43Z 2020-01-28T20:35:43Z files-added/
30 2020-01-28T20:31:01Z 2020-01-28T20:31:01Z new-files/
10 2020-01-28T20:29:04Z 2020-01-28T20:29:04Z new.md
23 2020-01-28T20:26:05Z 2020-01-28T20:26:05Z subfolder/Note the size displayed for a subfolder is its total size taking into account all files contained within it.
If we provide a path to a subfolder of the FilesContainer, this command will resolve the path and list only those files which paths are a child of the provided path:
$ safe files ls safe://hnyynyi6tgumo67yoauewe3ee3ojh37sbyr7rnh3nd6kkqhbo9decpjk64bnc/subfolder
Files of FilesContainer (version 4) at "safe://hnyynyi6tgumo67yoauewe3ee3ojh37sbyr7rnh3nd6kkqhbo9decpjk64bnc/subfolder":
Total: 1
SIZE CREATED MODIFIED NAME
23 2020-01-28T20:26:05Z 2020-01-28T20:26:05Z subexists.md
8 2020-01-28T20:26:05Z 2020-01-28T20:26:05Z note.mdThe files get command copies file(s) from the network to the local filesystem.
This command works similarly to Unix cp or scp or the windows copy command. It accepts two arguments:
<source> The target FilesContainer to retrieve from, optionally including the path to the directory or file within
<dest> The local destination path for the retrieved files and folders (default is '.')note: Wildcards (eg, *.txt) and set/range expansion (eg photo{1-3}.jpg, photo{1,3,5}.jpg ) in the source URL path are not supported at this time, but are planned for a future release.
It also accepts some unique flags/options:
-e, --exists <exists> How to handle pre-existing files [default: ask] [possible values: ask, preserve, overwrite]
-i, --progress <progress> How to display progress [default: bars] [possible values: bars, text, none]$ safe files get safe://hnyynywwu865s4zgxj5z9gdjynpz9z93n8ru68931odfio7ogkjco7er7abnc
[00:00:00] [########################################] 45B/45B (329B/s, 0s) Transfer
Done. Retrieved 5 files to .$ safe files get safe://hnyynywwu865s4zgxj5z9gdjynpz9z93n8ru68931odfio7ogkjco7er7abnc/testdata/subfolder existing_dir
[00:00:00] [########################################] 27B/27B (425B/s, 0s) Transfer
Done. Retrieved 2 files to existing_dirWe see that subfolder has been placed inside existing_dir.
$ tree existing_dir
existing_dir
└── subfolder
├── sub2.md
└── subexists.md$ safe files get safe://hnyynywwu865s4zgxj5z9gdjynpz9z93n8ru68931odfio7ogkjco7er7abnc/testdata/subfolder nonexistent_dir
[00:00:00] [########################################] 27B/27B (425B/s, 0s) Transfer
Done. Retrieved 2 files to nonexistent_dirWe see that subfolder has been renamed to nonexistent_dir.
$ tree nonexistent_dir
nonexistent_dir
├── sub2.md
└── subexists.md$ safe files get safe://hnyynywwu865s4zgxj5z9gdjynpz9z93n8ru68931odfio7ogkjco7er7abnc/testdata/subfolder/sub2.md existing_dir/
[00:00:00] [########################################] 4B/4B (378B/s, 0s) Transfer
Done. Retrieved 1 files to existing_dir/We see that the file is now inside existing_dir.
$ tree existing_dir
existing_dir
└── sub2.md$ safe files get safe://hnyynywwu865s4zgxj5z9gdjynpz9z93n8ru68931odfio7ogkjco7er7abnc/testdata/subfolder/sub2.md existing_dir/new_filename
[00:00:00] [########################################] 4B/4B (374B/s, 0s) Transfer
Done. Retrieved 1 files to existing_dir/new_filenameWe see that new_filename is now inside existing_dir.
$ tree existing_dir
existing_dir
└── new_filenameSubfolder or single-file downloads from a FileContainer with thousands of files may be slower than expected.
This is because the entire FileContainer is fetched and locally filtered to obtain the XorUrl for each file that matches the source URL path.
Future releases may operate differently.
The files tree command displays a visual representation of an entire directory tree.
$ safe files tree safe://hnyynyiodw4extpc7xh3dncfgsg4sjzsygru9k8omo988brz688oxkxhxgbnc
safe://hnyynyiodw4extpc7xh3dncfgsg4sjzsygru9k8omo988brz688oxkxhxgbnc
└── testdata
├── another.md
├── noextension
├── subfolder
│ ├── sub2.md
│ └── subexists.md
└── test.md
2 directories, 5 filesIf we provide a path to a subfolder of the FilesContainer, this command will resolve the path and list only those files which paths are a child of the provided path:
$ safe files tree safe://hnyynyiodw4extpc7xh3dncfgsg4sjzsygru9k8omo988brz688oxkxhxgbnc/testdata/subfolder
safe://hnyynyiodw4extpc7xh3dncfgsg4sjzsygru9k8omo988brz688oxkxhxgbnc/testdata/subfolder
├── sub2.md
└── subexists.md
0 directories, 2 filesFile details can be displayed with the --details flag:
$ safe files tree --details safe://hnyynyiodw4extpc7xh3dncfgsg4sjzsygru9k8omo988brz688oxkxhxgbnc/testdata
SIZE CREATED MODIFIED NAME
safe://hnyynyiodw4extpc7xh3dncfgsg4sjzsygru9k8omo988brz688oxkxhxgbnc/testdata
6 2020-03-06T18:31:55Z 2020-03-06T18:31:55Z ├── another.md
0 2020-03-06T18:31:55Z 2020-03-06T18:31:55Z ├── noextension
├── subfolder
4 2020-03-06T18:31:55Z 2020-03-06T18:31:55Z │ ├── sub2.md
23 2020-03-06T18:31:55Z 2020-03-06T18:31:55Z │ └── subexists.md
12 2020-03-06T18:31:55Z 2020-03-06T18:31:55Z └── test.md
1 directory, 5 filesRemoving files from a FilesContainer which is in sync with a folder in the local file system can be done by simply removing them locally followed by a call to files sync command. If we otherwise are not in such a scenario and would like to remove files directly from a FilesContainer we can achieve it with the file rm command.
As an example, we can remove single file to our existing FilesContainer on the Safe Network with the following command:
$ safe files rm safe://hnyynyi6tgumo67yoauewe3ee3ojh37sbyr7rnh3nd6kkqhbo9decpjk64bnc/another.md
FilesContainer updated (version 5): "safe://hnyynyi6tgumo67yoauewe3ee3ojh37sbyr7rnh3nd6kkqhbo9decpjk64bnc?v=5"
- /another.md safe://hbhyrynyr3osimhxa3mfqok7tto6cf3hhjy4sp3wdri6ee46x8xg68r9mjRemoving an entire subfolder from a FilesContainer rather than a single file is also possible, we just need to pass the --recursive flag and the path to the subfolder we would like to remove:
$ safe files rm safe://hnyynyi6tgumo67yoauewe3ee3ojh37sbyr7rnh3nd6kkqhbo9decpjk64bnc/subfolder --recursive
FilesContainer updated (version 6): "safe://hnyynyi6tgumo67yoauewe3ee3ojh37sbyr7rnh3nd6kkqhbo9decpjk64bnc?v=6"
- /subfolder/subexists.md safe://hbhyryn9uodh1ju5uzyti3gmmtwburrssd89rcwcy3rzofdpypwomrzzte
- /subfolder/note.md safe://hbhyryncjzga5uqp3ogeadqctigyaurpju8yauqptzgh5uyctogh3dkcbtAs we've seen, when uploading files to the network, each file is uploaded as an Blob using the self-encryption algorithm in the client, splitting the files into encrypted chunks, and the resulting file's XOR-URL is linked from a FilesContainer.
The file's XOR-URL is deterministic based on its content, i.e. the location where each of its chunks are stored is determined based on the file's content, and performed at the client before uploading the chunks to the network. Therefore the XOR-URL is always the same if the content of a file doesn't change. All this means is we can know what the file's XOR-URL will be without uploading it to the network.
Obtaining local files' XOR-URLs without uploading them to the network can be done in two different ways. We can use the --dry-run flag in any of the files commands, e.g.:
$ safe files put ./to-upload/ --recursive --dry-run
NOTE the operation is being performed in dry-run mode, therefore no changes are committed to the network.
FilesContainer not created since running in dry-run mode
+ ./to-upload/another.md safe://hoxm5aps8my8he8cpgdqh8k5wuox5p7kzed6bsbajayc3gc8pgp36s
+ ./to-upload/subfolder/subexists.md safe://hoqc6etdwbx6s86u3bkxenos3rf7dtr51eqdt17smxsw7aejot81dc
+ ./to-upload/test.md safe://hoxibhqth9awkjgi35sz73u35wyyscuht65m3ztrznb6thd5z8hepxThere is also a handy safe xorurl command which allows us to provide a local path and obtain the XOR-URLs of the files found in such path, without uploading them to the network:
$ safe xorurl ./to-upload/ --recursive
3 file/s processed:
+ ./to-upload/another.md safe://hoxm5aps8my8he8cpgdqh8k5wuox5p7kzed6bsbajayc3gc8pgp36s
+ ./to-upload/subfolder/subexists.md safe://hoqc6etdwbx6s86u3bkxenos3rf7dtr51eqdt17smxsw7aejot81dc
+ ./to-upload/test.md safe://hoxibhqth9awkjgi35sz73u35wyyscuht65m3ztrznb6thd5z8hepxXOR-URLs encode not only information about the location of the content, but also about the content type, native data type the data is being held on, etc.
In some particular cases it may be useful for the user to be able to decode this type of information from a given XOR-URL:
$ safe xorurl decode safe://hnyynyzonskbrgd57kt8c1pnb14qg8oh8wjo7xiku4mh4tc67wjax3c54sbnc
Information decoded from XOR-URL: safe://hnyynyzonskbrgd57kt8c1pnb14qg8oh8wjo7xiku4mh4tc67wjax3c54sbnc
Xorname: e02b282430f7d544ec93441969c63c387a261d7d553d2f9a8b3dda270fcb37ab
Type tag: 1100
Native data type: PublicSequence
Path: none
Sub names: []
Content version: latestThe cat command is probably the most straight forward command, it allows users to fetch data from the Network using a URL, and render it according to the type of data being fetched:
$ safe cat safe://<NRS-URL or XOR-URL>If the URL targets a published FilesContainer, the cat command will fetch its content, and render it showing the list of files contained (linked) in it, along with the corresponding XOR-URLs for each of the linked files.
Let's see this in action, if we upload some folder using the files put command, e.g.:
$ safe files put ./to-upload/ --recursive
FilesContainer created at: "safe://hnyynyixxj9uewuhh64rgg9zsdhaynwhc88mpyfpor5carg8xx6qs6jknnbnc"
+ ./to-upload/another.md safe://hbhyrynyr3osimhxa3mfqok7tto6cf3hhjy4sp3wdri6ee46x8xg68r9mj
+ ./to-upload/subfolder/subexists.md safe://hbhyryn9uodh1ju5uzyti3gmmtwburrssd89rcwcy3rzofdpypwomrzzte
+ ./to-upload/test.md safe://hbhyrydpan7d94mwp1bun3mxfnrfrui131an7ihu11wsn8dkr8odab9qwnWe can then use safe cat command with the XOR-URL of the FilesContainer just created to render the list of files linked from it:
$ safe cat safe://hnyynyixxj9uewuhh64rgg9zsdhaynwhc88mpyfpor5carg8xx6qs6jknnbnc
Files of FilesContainer (version 0) at "safe://hnyynyixxj9uewuhh64rgg9zsdhaynwhc88mpyfpor5carg8xx6qs6jknnbnc":
+-------------------------+------+----------------------+----------------------+-------------------------------------------------------------------+
| Name | Size | Created | Modified | Link |
+-------------------------+------+----------------------+----------------------+-------------------------------------------------------------------+
| /another.md | 11 | 2020-01-28T20:51:05Z | 2020-01-28T20:51:05Z | safe://hbhyrynyr3osimhxa3mfqok7tto6cf3hhjy4sp3wdri6ee46x8xg68r9mj |
+-------------------------+------+----------------------+----------------------+-------------------------------------------------------------------+
| /test.md | 12 | 2020-01-28T20:51:05Z | 2020-01-28T20:51:05Z | safe://hbhyrydpan7d94mwp1bun3mxfnrfrui131an7ihu11wsn8dkr8odab9qwn |
+-------------------------+------+----------------------+----------------------+-------------------------------------------------------------------+
| /subfolder/subexists.md | 23 | 2020-01-28T20:51:05Z | 2020-01-28T20:51:05Z | safe://hbhyryn9uodh1ju5uzyti3gmmtwburrssd89rcwcy3rzofdpypwomrzzte |
+-------------------------+------+----------------------+----------------------+-------------------------------------------------------------------+We could also take any of the XOR-URLs of the individual files and have the cat command fetch the content of the file and show it in the output, e.g. let's use the XOR-URL of the /test.md file to fetch its content:
$ safe cat safe://hbhyrydpan7d94mwp1bun3mxfnrfrui131an7ihu11wsn8dkr8odab9qwn
hello tests!Alternatively, we could use the XOR-URL of the FilesContainer and provide the path of the file we are trying to fetch, in this case the cat command will resolve the path and follow the corresponding link to read the file's content directly for us. E.g. we can also read the content of the /test.md file with the following command:
$ safe cat safe://hnyynyixxj9uewuhh64rgg9zsdhaynwhc88mpyfpor5carg8xx6qs6jknnbnc/test.md
hello tests!A Wallet can be also fetched with cat to inspect its content, the list of spendable balances it holds will be listed, and we can see which of them is currently the default to be used in a transfer operation:
$ safe cat safe://hnyybyqbp8d4u79f9sqhcxtdczgb76iif74cdsjif1wegik9t38diuk1yny9e
Spendable balances of Wallet at "safe://hnyybyqbp8d4u79f9sqhcxtdczgb76iif74cdsjif1wegik9t38diuk1yny9e":
+---------+-------------------------+-------------------------------------------------------------------+
| Default | Friendly Name | SafeKey URL |
+---------+-------------------------+-------------------------------------------------------------------+
| * | my-default-balance | safe://hbyyyybffgc3smq1ynjewsbtqkm5h9rq367n6krzd9rz65p8684x9wy81m |
+---------+-------------------------+-------------------------------------------------------------------+
| | first-spendable-balance | safe://hbyyyybqk69tpm67ecnzjg66tcrja3ugq81oh6gfaffwaty614rmttmyeu |
+---------+-------------------------+-------------------------------------------------------------------+As seen above, the safe cat command can be used to fetch any type of content from the Safe Network. At this point it only supports files (Blob), FilesContainers, Wallets, and NRS-Containers (see further below about NRS Containers and commands), but it will be expanded as more types are supported by the CLI and its API.
By default, binary files are treated just like a plaintext file and will typically display unreadable garbage on the screen unless the output is redirected to a file, eg:
$ safe cat safe://hbwybynbbwotm5qykdfxuu4r4doogaywf8jupxats5zg39xjjtd8xmtpky > /tmp/favicon.icoHowever, the flag --hexdump is available which provides a more human-friendly hexadecimal dump, similar to that of the standard xxd Unix tool. Here's an example.
$ safe cat --hexdump safe://hbwybynbbwotm5qykdfxuu4r4doogaywf8jupxats5zg39xjjtd8xmtpky | head
Length: 1406 (0x57e) bytes
0000: 00 00 01 00 01 00 10 10 00 00 01 00 08 00 68 05 ..............h.
0010: 00 00 16 00 00 00 28 00 00 00 10 00 00 00 20 00 ......(....... .
0020: 00 00 01 00 08 00 00 00 00 00 00 01 00 00 00 00 ................
0030: 00 00 00 00 00 00 00 01 00 00 00 00 00 00 f4 cc ................
0040: a8 00 cb 7b 45 00 fb f2 e5 00 ab 62 46 00 ab 60 ...{E......bF..`
0050: 46 00 c0 a6 8e 00 f2 d9 c1 00 f5 e8 df 00 e0 9a F...............
0060: 5e 00 ea c0 9e 00 e8 ae 77 00 be 85 5d 00 bb 61 ^.......w...]..a
0070: 35 00 fa ed d7 00 ff fc f7 00 ce 88 4c 00 b0 56 5...........L..V
0080: 34 00 fe fa f6 00 bf 87 5b 00 b1 6b 50 00 dd 82 4.......[..kP...As we've seen above, we can use cat command to retrieve the latest/current version of any type of content from the Network using their URL. But every change made to content that is uploaded to the Network as Public data is perpetual, and therefore a new version is generated when performing any amendments to it, keeping older versions also available forever.
We can use the cat command to also retrieve any version of content that was uploaded by appending a query param to the URL. E.g. given the XOR-URL of the FilesContainer we created in previous sections (safe://hnyynyi6tgumo67yoauewe3ee3ojh37sbyr7rnh3nd6kkqhbo9decpjk64bnc), which reached version 2 after a couple of amendments we made with files sync command, we can retrieve the very first version (version 0) by using v=<version> query param:
$ safe cat "safe://hnyynyi6tgumo67yoauewe3ee3ojh37sbyr7rnh3nd6kkqhbo9decpjk64bnc?v=0"
Files of FilesContainer (version 0) at "safe://hnyynyi6tgumo67yoauewe3ee3ojh37sbyr7rnh3nd6kkqhbo9decpjk64bnc?v=0":
+-------------------------+------+----------------------+----------------------+-------------------------------------------------------------------+
| Name | Size | Created | Modified | Link |
+-------------------------+------+----------------------+----------------------+-------------------------------------------------------------------+
| /another.md | 6 | 2019-07-24T13:22:49Z | 2019-07-24T13:22:49Z | safe://hoxm5aps8my8he8cpgdqh8k5wuox5p7kzed6bsbajayc3gc8pgp36s |
+-------------------------+------+----------------------+----------------------+-------------------------------------------------------------------+
| /subfolder/subexists.md | 7 | 2019-07-24T13:22:49Z | 2019-07-24T13:22:49Z | safe://hoqc6etdwbx6s86u3bkxenos3rf7dtr51eqdt17smxsw7aejot81dc |
+-------------------------+------+----------------------+----------------------+-------------------------------------------------------------------+
| /test.md | 12 | 2019-07-24T13:22:49Z | 2019-07-24T13:22:49Z | safe://hoxibhqth9awkjgi35sz73u35wyyscuht65m3ztrznb6thd5z8hepx |
+-------------------------+------+----------------------+----------------------+-------------------------------------------------------------------+As we've seen in all the above sections, every piece of data on the Safe Network has a unique location. Such location is determined by the XoR name given to it in the Network's XoR address space, as well as some other information which depends on the native date type, like in the case of MutableData data type which also has a type tag associated to it apart from its XoR address.
So far all commands were using the XOR-URLs to either inform of the new data created/stored on the Network, as well as for retrieving data from the Network.
While XOR-URLs are simply a way to encode Safe Network data unique location into a URL, there are some incentives for having more human-friendly URLs that can be easily remembered and recognisable when trying to share them with other people, or use them with tools and applications like the Safe CLI or the Safe Browser.
This is why the Safe Network also supports having such human-friendly URLs through what it's called the Name Resolution System (NRS). The NRS allows users to create friendly names that are resolvable to a unique location on the Network. These friendly names can be used in the form of a URL (NRS-URL) to share with other people the location of websites, web applications, files and folders, safecoin wallets for receiving transfers, Safe IDs, etc.
In this section we will explore the CLI commands which allow users to generate, administer, and use the NRS and its NRS-URLs for publishing and retrieving data to/from the Safe Network.
Creating a friendly name on the Network can be achieved with the nrs create subcommand. This subcommand generates an NRS Container automatically linking it to any data we decide to link the friendly name to. An NRS Container is stored on the Network as a Public Sequence data, and it contains an NRS Map using RDF for its data representation (since this is still under development, pseudo-RDF data is now being used temporarily). This Map has a list of subnames and where each of them are being linked to, e.g. mysubname can be created as a subname of mywebsite NRS name by having mysubname linked to a particular FilesContainer XOR-URL so that it can be fetched with safe://mysubname.mywebsite.
Let's imagine we have uploaded the files and folders of a website we want to publish on the Safe Network with files put command:
$ safe files put ./website-to-publish/ --recursive
FilesContainer created at: "safe://hnyynyie8kccparz3pcxj9uisdc4gyzcpem9dfhehhjd6hpzwf8se5w1zobnc"
+ ./website-to-publish/index.html safe://hbyyyydhp7y3mb6zcj4herpqm53ywnbycstamb54yhniud1cij7frjfe8c
+ ./website-to-publish/image.jpg safe://hbyyyynkt8ak5mxmbqkdt81hqceota8fu83e49gi3weszddujfc8fxcugp
+ ./website-to-publish/contact/form.html safe://hbyyyyd1sw4dd57k1xeeijukansatia6mthaz1h6htnb8pjoh9naskoaksAs we know that website is now publicly available on the Safe Network for anyone who wants to visit using its XOR-URL "safe://hnyynyie8kccparz3pcxj9uisdc4gyzcpem9dfhehhjd6hpzwf8se5w1zobnc" with either $ safe cat command, or a Safe Browser. But let's now create a NRS name for it and obtain its human-friendly NRS-URL:
$ safe nrs create mywebsite --link "safe://hnyynyie8kccparz3pcxj9uisdc4gyzcpem9dfhehhjd6hpzwf8se5w1zobnc?v=0"
New NRS Map for "safe://mywebsite" created at: "safe://hnyydyz7utb6npt9kg3aksgorfwmkphet8u8z3or4nsu8n3bj8yiep4a91bqh"
+ mywebsite safe://hnyynyie8kccparz3pcxj9uisdc4gyzcpem9dfhehhjd6hpzwf8se5w1zobnc?v=0Note that we provided a versioned URL to the --link argument in the command above, i.e. a URL which targets a specific version of the content with ?v=<version number>. Any type of content which can have different versions (like the case of a FilesContainer in our example) can be mapped/linked from an NRS name/subname only if a specific version is provided in the link URL. If you are using a bash based system and want to provide a version (or any other command containing a question mark), the URL must be wrapped in double quotes or bash will interpret the link as a file path and throw an error, e.g. use "safe://hnyynyie8kccparz3pcxj9uisdc4gyzcpem9dfhehhjd6hpzwf8se5w1zobnc?v=0", not safe://hnyynyie8kccparz3pcxj9uisdc4gyzcpem9dfhehhjd6hpzwf8se5w1zobncv=0.
We can now share the NRS-URL safe://mywebsite to anyone who wants to visit our website. Using this NRS-URL we can now fetch the same content we would do when using the FilesContainer XOR-URL we linked to it, thus we can fetch it using the following command:
$ safe cat safe://mywebsite
Files of FilesContainer (version 0) at "safe://mywebsite":
+-------------------------+------+----------------------+----------------------+-------------------------------------------------------------------+
| Name | Size | Created | Modified | Link |
+-------------------------+------+----------------------+----------------------+-------------------------------------------------------------------+
| /index.html | 146 | 2019-07-24T14:31:42Z | 2019-07-24T14:31:42Z | safe://hbyyyydhp7y3mb6zcj4herpqm53ywnbycstamb54yhniud1cij7frjfe8c |
+-------------------------+------+----------------------+----------------------+-------------------------------------------------------------------+
| /image.jpg | 391 | 2019-07-24T14:31:42Z | 2019-07-24T14:31:42Z | safe://hbyyyynkt8ak5mxmbqkdt81hqceota8fu83e49gi3weszddujfc8fxcugp |
+-------------------------+------+----------------------+----------------------+-------------------------------------------------------------------+
| /contact/form.html | 23 | 2019-07-24T14:31:42Z | 2019-07-24T14:31:42Z | safe://hbyyyyd1sw4dd57k1xeeijukansatia6mthaz1h6htnb8pjoh9naskoaks |
+-------------------------+------+----------------------+----------------------+-------------------------------------------------------------------+In this example the cat simply prints out the content of the top level folder (FilesContainer) as we've learned from previous sections of this guide, but any other tool or application would be treating this in different ways, e.g. the Safe Browser would be automatically fetching the index.html file from it and rendering the website to the user.
We can obviously fetch the content of any of the files published at this NRS-URL using the corresponding path:
$ safe cat safe://mywebsite/contact/form.html
<!DOCTYPE html>
<html>
<body>
<h2>Contact Form</h2>
<form>
...
</form>
</body>
</html>Much like the old internet, the NRS system provides increased flexibility for those wanting to have a variety of resources available under one public name, via using Sub Names. This is done by creating a Public name and using a . (dot) character to separate it into various, individually controllable parts.
For example, you may wish to have safe://mywebsite to be about you in general, whereas safe://blog.mywebsite point to a different site which is your blog.
To create a public name with subnames, you need only to pass the full string with . separators, just like any traditional URL, to the CLI:
$ safe nrs create blog.mywebsite --link "safe://hnyynyie8kccparz3pcxj9uisdc4gyzcpem9dfhehhjd6hpzwf8se5w1zobnc?v=0"
New NRS Map for "safe://blog.mywebsite" created at: "safe://hnyydyz7utb6npt9kg3aksgorfwmkphet8u8z3or4nsu8n3bj8yiep4a91bqh"
+ blog.mywebsite safe://hnyynyie8kccparz3pcxj9uisdc4gyzcpem9dfhehhjd6hpzwf8se5w1zobnc?v=0As the NRS CLI advances, you'll be able to individually add to both blog.mywebsite, or indeed just mywebsite, as well as change what the default resource to retrieve is for both.
Once a public name has been created with nrs create command, more sub names can be added to it using the nrs add command. This command expects the same arguments as nrs create command but it only requires and assumes that the public name already exists.
Let's add profile sub name to the mywebsite NRS name we created before:
$ safe nrs add profile.mywebsite --link "safe://hnyynyipybem7ihnzqya3w31seezj4i6u8ckg9d7s39exz37z3nxue3cnkbnc?v=0"
NRS Map updated (version 1): "safe://hnyydyz7utb6npt9kg3aksgorfwmkphet8u8z3or4nsu8n3bj8yiep4a91bqh"
+ profile.mywebsite safe://hnyynyz8m4pkok41qrn9gkrwz35fu8zxfkwrc9xrt595wjtodacx9n8u3wbncThe safe nrs add command can also be used to update subnames after they have been added to a public name.
For example, if we have made changes to files mapped to the profile.mywebsite NRS subname we created before, we can use nrs add to update its link:
$ safe nrs add profile.mywebsite --link safe://hnyynyw9ru4afkbfee5m4ca4jbho4f5bj6ynep5k1pioyge6dihfqyjfrnbnc?v=0
NRS Map updated (version 2): "safe://profile.hnyydyz7utb6npt9kg3aksgorfwmkphet8u8z3or4nsu8n3bj8yiep4a91bqh"
+ profile.mywebsite safe://hnyynyw9ru4afkbfee5m4ca4jbho4f5bj6ynep5k1pioyge6dihfqyjfrnbnc?v=0Removing sub names from an NRS Map Container is very simple and straightforward, since the only information required to do so is just the NRS-URL. The nrs remove command will remove only the sub name specified in the provided NRS-URL without touching any of the other existing sub names, e.g. if the safe://sub-b.sub-a.mypubname NRS-URL is provided then only sub-b sub name will be removed from mypubname NRS Map Container (by creating a new version of it, remember this is all part of the perpetual web).
Let's remove the profile sub name from the mywebsite NRS name we added before:
$ safe nrs remove profile.mywebsite
NRS Map updated (version 3): "safe://hnyydyz7utb6npt9kg3aksgorfwmkphet8u8z3or4nsu8n3bj8yiep4a91bqh"
- profile.mywebsite safe://hnyynyw9ru4afkbfee5m4ca4jbho4f5bj6ynep5k1pioyge6dihfqyjfrnbnc?v=0In previous sections of this guide we explained how we can create two types of safe:// URLs, XOR-URLs and NRS-URLs. It has been explained that safe:// URLs can contain a path as well, if they target a FilesContainer, and they can also be post-fixed with v=<version> query param in order to target a specific version of the content rather than the latest/current version when this query param is omitted.
All these types of safe:// URLs can be used in any of the supported CLI commands interchangeably as the argument of any command which expects safe:// URL.
E.g. we can retrieve the content of a website with the cat command using either its XOR-URL or its NRS-URL, and either fetching the latest version of it or supplying the query param to get a specific version of it. Thus, if we wanted to fetch version #1 of the site we published at safe://mywebsite (which NRS Map Container XOR-URL is safe://hnyydyz7utb6npt9kg3aksgorfwmkphet8u8z3or4nsu8n3bj8yiep4a91bqh), the following two commands would be equivalent:
$ safe cat "safe://hnyydyz7utb6npt9kg3aksgorfwmkphet8u8z3or4nsu8n3bj8yiep4a91bqh?v=1"$ safe cat "safe://mywebsite?v=1"
In both cases the NRS Map Container will be found (from above URLs) by decoding the XOR-URL or by resolving NRS public name. Once that's done, and since the content is an NRS Map, following the rules defined by NRS and the map found in it the target link will be resolved from it. In some circumstances, it may be useful to get information about the resolution of a URL, which can be obtained using the dog command.
The sn_cli supports upload and retrieval of symlinks using the above commands. It can also resolve relative symlinks in a FileContainer provided that the target exists in the FileContainer.
The Safe Network relates information and content using links, as an example, just considering some of the type of content we've seen in this guide, FilesContainers, Wallets and NRS Map Containers, they are all containers with named links (Safe-URLs) to other content on the network, and depending on the abstraction they provide, each of these links are resolved following a specific set of rules for each type of container, e.g. NRS subnames are resolved with a predefined set of rules, while a file's location is resolved from a FilesContainer with another set of predefined rules.
Using the cat command is a very straightforward way of retrieving any type of data and see its content, but sometimes we may want to understand how the location of the content being retrieved is resolved using these set of predefined rules, and how links are resolved to eventually find the location of the content we are retrieving. This is when we need the dog command to sniff around and show the trace when resolving all these links from a URL.
The most basic case for the dog command is to get information about the native data type holding a content found with a XOR-URL:
$ safe dog safe://hnyynywttiyr6tf3qk811b3rto9azx8579h95ewbs3ikwpctxdhtqesmwnbnc
Native data type: PublicSequence
Version: 0
Type tag: 1100
XOR name: 0x231a809e8972e51e520e49187f1779f7dff3fb45036cd5546b22f1f22e459741
XOR-URL: safe://hnyynywttiyr6tf3qk811b3rto9azx8579h95ewbs3ikwpctxdhtqesmwnbncIn this case we see the location where this data is stored on the Network (this is called the XOR name), a type tag number associated with the content (1100 was set for this particular type of container), and the native Safe Network data type where this data is being held on (PublicSequence), and since this type of data is versionable we also see which is the version of the content the URL resolves to.
Of course the safe dog command can be used also with other type of content like files (Blob), e.g. if we use it with a FilesContainer's XOR-URL and the path of one of the files it contains:
$ safe dog safe://hnyynywttiyr6tf3qk811b3rto9azx8579h95ewbs3ikwpctxdhtqesmwnbnc/subfolder/index.html
Native data type: PublicBlob
XOR name: 0xda4ce4aa59889874921817e79c2b98dc3dbede7fd9a9808a60aa2d35efaa05f4
XOR-URL: safe://hbhybyds1ch1ifunraq1jbof98uoi3tzb7z5x89spjonfgbktpgzz4wbxw
Media type: text/htmlBut how about using the dog command with an NRS URL, as we now know it's resolved using the NRS rules and following the links found in the NRS Map Container:
$ safe dog safe://mywebsite/contact/form.html
Native data type: PublicBlob
XOR name: 0xda4ce4aa59889874921817e79c2b98dc3dbede7fd9a9808a60aa2d35efaa05f4
XOR-URL: safe://hbhybyds1ch1ifunraq1jbof98uoi3tzb7z5x89spjonfgbktpgzz4wbxw
Media type: text/html
Resolved using NRS Map:
PublicName: "mywebsite"
Container XOR-URL: safe://hnyydyz7utb6npt9kg3aksgorfwmkphet8u8z3or4nsu8n3bj8yiep4a91bqh
Native data type: PublicSequence
Type tag: 1500
XOR name: 0xfb3887c26c7ea3670ab1a042d16a6f1113ccf7cc09a15a6716429382a86eb1f9
Version: 3
+------------------+----------------------+----------------------+--------------------------------------------------------------------------+
| NRS name/subname | Created | Modified | Link |
+------------------+----------------------+----------------------+--------------------------------------------------------------------------+
| mywebsite | 2019-07-24T14:32:13Z | 2019-07-24T14:32:13Z | safe://hnyynyie8kccparz3pcxj9uisdc4gyzcpem9dfhehhjd6hpzwf8se5w1zobnc?v=0 |
+------------------+----------------------+----------------------+--------------------------------------------------------------------------+
| blog.mywebsite | 2019-07-24T16:52:30Z | 2019-07-24T16:52:30Z | safe://hnyynyie8kccparz3pcxj9uisdc4gyzcpem9dfhehhjd6hpzwf8se5w1zobnc?v=0 |
+------------------+----------------------+----------------------+--------------------------------------------------------------------------+In this case we don't only get information about the content that the URL resolves to, but also about the NRS Map Container this NRS-URL was resolved with. E.g. we see the XOR-URL of the NRS Map Container, its version, and among other data we also see the list of all NRS names defined by it with their corresponding XOR-URL links.
As mentioned before, FilesContainers and NRS Map Containers are abstractions created on top of the network's native Public Sequence data type. A Public Sequence is a very simple data type that allows the user to only append elements to it once it has been created on the network.
Mutations made to FilesContainers and NRS Map Containers are made by storing the new version as a snapshot of the content and appended as a new item into its underlying Public Sequence. This is how these types of content are able to keep the complete history on the network.
The CLI also allows us to store our own Public Sequence instances, with any other type of content we would like to store, instead of the data representing a FilesContainer or NRS Map Container. We can store a Public Sequence on the network with "my initial note" string as its first item:
$ safe seq store "my initial note"
Public Sequence stored at: "safe://hnyyyyp3yb3dczuaaiwx1mb5491xir4kz1hex3d1pc34oxwicy7scm3x4ybfo"We can then retrieve the content of this Sequence data, using either the cat/dog command as we do it with any other type of content:
$ safe cat safe://hnyyyyp3yb3dczuaaiwx1mb5491xir4kz1hex3d1pc34oxwicy7scm3x4ybfo
Public Sequence (version 0) at "safe://hnyyyyp3yb3dczuaaiwx1mb5491xir4kz1hex3d1pc34oxwicy7scm3x4ybfo":
my initial noteIt's also possible to pipe the output of another command into the seq store command to store a new Sequence with the content obtained from STDIN by providing - as the data argument:
$ echo "hello from stdin" | safe seq store -
Public Sequence stored at: "safe://hnyyyypfneksex7qxr5zuqqizdkbqbmn1tir1pmfwz1wsghb69rna76syabfo"
$ safe cat safe://hnyyyypfneksex7qxr5zuqqizdkbqbmn1tir1pmfwz1wsghb69rna76syabfo
Public Sequence (version 0) at "safe://hnyyyypfneksex7qxr5zuqqizdkbqbmn1tir1pmfwz1wsghb69rna76syabfo
hello from stdinThe above CLI command will store the Sequence as Public by default, i.e. it's perpetually stored on the network and publicly available for other users to read it. We can otherwise store the new Sequence as private content, in which case, only the creator of it will have access to read and mutate. This can be simply achieved by providing the --private flag:
$ safe seq store "my initial private note" --private
Private Sequence stored at: "safe://hnyyyytcgbrcfq5aw8myg6ihw6d8ss6bsgr9szm8y6qwjxsbiqufr8n3tebfo"We can retrieve it, just as with Public Sequence using its XOR-URL, as long as the CLI has been authorised with the Authenticator by the same user who stored the Sequence, any other user will get an error when trying to retrieve it with the following command:
$ safe cat safe://hnyyyytcgbrcfq5aw8myg6ihw6d8ss6bsgr9szm8y6qwjxsbiqufr8n3tebfo
Private Sequence (version 0) at "safe://hnyyyytcgbrcfq5aw8myg6ihw6d8ss6bsgr9szm8y6qwjxsbiqufr8n3tebfo
my initial private noteOnce we have a Sequence stored on the network, either Public or Private, new items can be appended to it:
$ safe seq append "first update to my note" safe://hnyyyyp3yb3dczuaaiwx1mb5491xir4kz1hex3d1pc34oxwicy7scm3x4ybfo
Data appended to the Sequence: "safe://hnyyyyp3yb3dczuaaiwx1mb5491xir4kz1hex3d1pc34oxwicy7scm3x4ybfo"We can confirm the new item has been appended to the Sequence:
$ safe cat safe://hnyyyyp3yb3dczuaaiwx1mb5491xir4kz1hex3d1pc34oxwicy7scm3x4ybfo
Public Sequence (version 1) at "safe://hnyyyyp3yb3dczuaaiwx1mb5491xir4kz1hex3d1pc34oxwicy7scm3x4ybfo":
first update to my noteAnd we can also confirm the previous item has been kept in the Sequence if we provide the same XOR-URL but specifying a version (with ?v=<version>):
$ safe cat safe://hnyyyyp3yb3dczuaaiwx1mb5491xir4kz1hex3d1pc34oxwicy7scm3x4ybfo?v=0
Public Sequence (version 0) at "safe://hnyyyyp3yb3dczuaaiwx1mb5491xir4kz1hex3d1pc34oxwicy7scm3x4ybfo?v=0":
my initial noteAutomatic command completions via are available for popular shells such as bash and PowerShell (Windows). Completions are also provided for the shells fish, zsh, and elvish.
Until an installer becomes available, these completions must be manually enabled as per below.
To enable bash completions in the current bash session, use the following command:
SC=/tmp/safe.rc && safe setup completions bash > $SC && source $SCTo enable bash completions always for the current user:
SC=~/.bash_sn_cli CL="source $SC" RC=~/.bashrc; safe setup completions bash > $SC && grep -qxF "$CL" $RC || echo $CL >> $RCTo enable completions in the current PowerShell session, use the following commands:
safe setup completions bash > sn_cli.ps1
sn_cli.ps1To enable PowerShell completions permanently, generate the sn_cli.ps1 file as per above and then see this stackoverflow answer.
The CLI can update itself to the latest available version. If you run safe update, the application will check if a newer release is available on GitHub. After prompting to confirm if you want to take the latest version, it will be downloaded and the binary will be updated.
You can discuss development-related topics on the Safe Dev Forum.
If you are just starting to develop an application for the Safe Network, it's very advisable to visit the Safe Network Dev Hub where you will find a lot of relevant information.
If you find any issues, or have ideas for improvements and/or new features for this application and the project, please raise them by creating a new issue in this repository.
This Safe Network library is dual-licensed under the Modified BSD (LICENSE-BSD https://opensource.org/licenses/BSD-3-Clause) or the MIT license (LICENSE-MIT https://opensource.org/licenses/MIT) at your option.
Want to contribute? Great 🎉
There are many ways to give back to the project, whether it be writing new code, fixing bugs, or just reporting errors. All forms of contributions are encouraged!
For instructions on how to contribute, see our Guide to contributing.