Dapi Service
Provides the public REST API for WDS — brokering requests between clients and core services, enforcing configuration constraints, and orchestrating jobs.
Used by:
This service is not open-source but its image is publicly accessible on DockerHub
Configuration
The following environment variables are used to configure this service:
| Name | Description |
|---|---|
| DB_CONNECTION_STRING | Required MongoDB connection string |
| DATAKEEPER_ORIGIN | Required The origin of the datakeeper service |
| SCRAPER_ORIGIN | Required The origin of the scraper service |
| IDEALER_ORIGIN | Required The origin of the idealer service |
| JOB_TYPES | Required Available job types for job configs |
| LICENSE_KEY | Required. A license key. See Plans |
| GLOBAL_EXCEPTION_RESPONSE_DELAY_MS | Optional. If a server error occurred, how much time should be waited before responding with an HTTP error? This makes sense because some clients can’t wait before repeating requests on their side, so this is done on the server side. Default value is 1 second |
| MIN_LOG_LEVEL | Optional. Minimal log level. Default value is Information |
JobTypes
Supported job execution environments.
Default and allowed values can be restricted in Dapi or Solidstack services.
Ensure the Crawler/Solidstack service is configured to handle the selected job type.
| Name | Description |
|---|---|
| Internet | Crawl data from internet sources via request gateways (Proxy addresses, Host IP addresses, etc.) |
| Intranet | Crawl data from intranet sources with no limits |