The Web Crawl Configuration screen controls how your website is crawled and indexed for use by the AI.
The screen is organised into four tabs. This section of the help documentation mirrors those tabs:
After you save changes, the configuration is written to your ingest config. Depending on what you changed, you may be prompted to trigger an index or HTML-processing job so that updates take effect.