Tools
/
Crawler
/
Crawler: IgnoreQueryParams
Jan. 17, 2022
Crawler: IgnoreQueryParams
Type:
string[]
Parameter syntax
ignoreQueryParams: [ 'param', 'param2_*', ... ]
About this parameter
Filters out specified query parameters from crawled URLs. This can help you avoid indexing duplicate URLs. You can use wildcards to pattern match.
Examples
In this example, the ref and all utm_ parameters are ignored in crawled URLs. Your crawler saves http://localhost?page=1&ref=algolia&utm_source=doc as http://localhost?page=1.
Copy
1
2
3
{
ignoreQueryParams: ['ref', 'utm_*'],
}
Did you find this page helpful?
