OSMO Data provides CLIs and APIs for handling data operations of Robotics data. Data operations include ingesting, downloading, transforming, querying and mining support.
Before using any of the OSMO Data CLIs or APIs, one must use the OSMO config CLI to define the location and authentication details of the Data Backend. An example is provided here:
user@computer:~/osmo$ osmo config data set <name> \
--access-key-id <id> --secret-access-key <key> --auth-url <URL>
For SwitftStack provide your ST_USER as access-key-id, ST_KEY as secret-access-key and ST_AUTH as auth-url. Failure to configure these properly will result in the following error.
user@computer:~/osmo$ osmo data --help
usage: main.py data [-h] {create,list,delete,stat,upload,download} ...
positional arguments:
{create,list,delete,stat,upload,download}
create Create the data container.
list List the buckets or objects.
delete Delete the data bucket
stat Display information about the object or container.
upload Upload objects or buckets
download Download objects or buckets
optional arguments:
-h, --help show this help message and exit
my-workstations:~$ osmo data create --remote_uri swift://swiftstack-maglev.ngc.nvidia.com/AUTH_team-osmo-svc/osmo --data_container osmo
home/osmo-svc/tests/9231fa55-0213-4522-91ba-8dd738241a6a/b23a50b6-84fa-11ea-a057-934836bce51d_monitor.jsonl
...
...
my-workstations:~$ osmo data upload --remote_uri swift://swiftstack-maglev.ngc.nvidia.com/AUTH_team-osmo-svc/osmo --local_path /home/osmo-svc/tests
home/osmo-svc/tests/9231fa55-0213-4522-91ba-8dd738241a6a/b23a50b6-84fa-11ea-a057-934836bce51d_monitor.jsonl
...
...
my-workstations:~$ osmo data list --remote_uri swift://swiftstack-maglev.ngc.nvidia.com/AUTH_team-osmo-svc/osmo
home/osmo-svc/tests/9231fa55-0213-4522-91ba-8dd738241a6a/03cc1d42-84f1-11ea-a057-934836bce51d_app.json
home/osmo-svc/tests/9231fa55-0213-4522-91ba-8dd738241a6a/03cc1d42-84f1-11ea-a057-934836bce51d_monitor.jsonl
home/osmo-svc/tests/9231fa55-0213-4522-91ba-8dd738241a6a/03cc1d42-84f1-11ea-a057-934836bce51d_perf.json