Uniformi resource locator canonicalization
US9081861B2 Patents
A computer-implemented method includes receiving a plu rality of uniform resource locators (URLs), where the URLs identify content files, and where the URLs include at least one parameter. Fingerprints of the content files are identified. A first entropy of values of the fingerprints conditional on Val ues of a first parameteris determined, and a second entropy of values of the first parameter conditional on values of the fingerprints is determined. It is determined that the first parameter is irrelevant to the identification of a unique con tent file by the URLs based, at least in part, on th
24 claims. 79,490 characters of text.