Tools
/
Crawler
/
Crawler: IgnoreQueryParams
Jan. 17, 2022
Crawler: IgnoreQueryParams
Type:
string[]
Parameter syntax
ignoreQueryParams: [ 'param', 'param2_*', ... ]
About this parameter# A
Filters out specified query parameters from crawled URLs. This can help you avoid indexing duplicate URLs. You can use wildcards to pattern match.
Examples# A
In this example, the ref
and all utm_
parameters are ignored in crawled URLs. Your crawler saves http://localhost?page=1&ref=algolia&utm_source=doc
as http://localhost?page=1
.
Copy
1
2
3
{
ignoreQueryParams: ['ref', 'utm_*'],
}
Did you find this page helpful?