Download and install the latest release
or install with go:
go install github.com/everdrone/grab
Let’s start fresh. Run the following command to generate a new configuration file in the current directory
grab config generate
grab.hcl should be located in your home directory, or in any parent directory from where you will call the command.
The language of the file is Hashicorp Configuration Language
Read more about the configuration options here
Once you’re happy with your configuration, you can check if everything is ok by running
grab config check
or, if your file is not located in a parent directory from your current working directory, you can always specify its path with the
grab config check -c /var/grab.hcl
Now you can start using grab.
To scrape and download assets use the
grab command and pass at least one url or a file containing a list of urls.
Note The list of urls can contain comments, like the
iniformat, all lines starting with
;will be ignored
# single URL grab get https://url.to/scrape/files?from # list of URLs grab get urls.ini # at least one of each grab get https://my.url/and urls.ini list.ini
Distributed under the MIT License.