This is a Docker container that uses the cisagov fork of 18F's domain-scan to gather domains as a precursor to scanning by pshtt, trustymail, and sslyze.

This Docker container is intended to be run via orchestrator.

N.B.: The secrets in the src/secrets directory are only used when testing via the docker-compose.yml composition. Normally this Docker container is run via the Docker composition in cisagov/orchestrator, which expects the secrets in a different location.

To run the cisagov/gatherer image via Docker:

docker run cisagov/gatherer:1.5.18

1. Create a docker-compose.yml file similar to the one below to use Docker Compose.

   ---
   version: "3.7"
   
   services:
     gatherer:
       image: cisagov/gatherer:1.5.18
       volumes:
         - type: bind
           source: <your_output_dir>
           target: /home/cisa/shared

2. Start the container and detach:

   docker compose up --detach

This container also supports passing sensitive values via Docker secrets. Passing sensitive values like your credentials can be more secure using secrets than using environment variables. See the secrets section below for a table of all supported secret files.

1. To use secrets, create a database_creds.yml file in this format:

   ---
   version: '1'
   
   database:
     name: cyhy
     uri: mongodb://readonly:[email protected]:27017/cyhy
   

2. Then add the secret to your docker-compose.yml file:

   ---
   version: "3.7"
   
   secrets:
     database_creds:
       file: database_creds.yml
   
   services:
     gatherer:
       image: cisagov/gatherer:1.5.18
       volumes:
         - type: bind
           source: <your_output_dir>
           target: /home/cisa/shared
       secrets:
         - source: database_creds
           target: database_creds.yml

1. Pull the new image from Docker Hub:

   docker compose pull

2. Recreate the running container by following the previous instructions:

   docker compose up --detach

1. Stop the running container:

   docker stop <container_id>

2. Pull the new image:

   docker pull cisagov/gatherer:1.5.18

3. Recreate and run the container by following the previous instructions.

The images of this container are tagged with semantic versions of the underlying gatherer project that they containerize. It is recommended that most users use a version tag (e.g. :1.5.18).

See the tags tab on Docker Hub for a list of all the supported tags.

There are no ports exposed by this container.

There are no required environment variables.

There are no optional environment variables.

Build the image locally using this git repository as the build context:

docker build \
  --build-arg VERSION=1.5.18 \
  --tag cisagov/gatherer:1.5.18 \
  https://github.com/cisagov/gatherer.git#develop

To create images that are compatible with other platforms, you can use the buildx feature of Docker:

1. Copy the project to your machine using the Code button above or the command line:

   git clone https://github.com/cisagov/gatherer.git
   cd gatherer

2. Create the Dockerfile-x file with buildx platform support:

   ./buildx-dockerfile.sh

3. Build the image using buildx:

   docker buildx build \
     --file Dockerfile-x \
     --platform linux/amd64 \
     --build-arg VERSION=1.5.18 \
     --output type=docker \
     --tag cisagov/gatherer:1.5.18 .

We welcome contributions! Please see CONTRIBUTING.md for details.

This project is in the worldwide public domain.

This project is in the public domain within the United States, and copyright and related rights in the work worldwide are waived through the CC0 1.0 Universal public domain dedication.

All contributions to this project will be released under the CC0 dedication. By submitting a pull request, you are agreeing to comply with this waiver of copyright interest.