ADBLK-27: Incorporate AdGuard CNAME Tracker Domains

Issue Information

Issue Type: Improvement
 
Priority: Major
Status: Closed

Reported By:
Ben Tasker
Assigned To:
Ben Tasker
Project: Adblock Lists (ADBLK)
Resolution: Done (2021-03-05 13:19:03)

Created: 2021-03-05 09:51:02
Time Spent Working


Description
There's been an increase in the number of domains using CNAMEs to try and mask tracking - essentially allowing trackers to masquerade as 1st party rather than 3rd party sites.

Adguard have released a list of underlying CNAMEs - https://github.com/AdguardTeam/cname-trackers/tree/master/trackers - however they're not in a particularly convenient format so will need some processing for inclusion.

They're of (relatively) limited use in browser-based adblocker extensions (only those that use dns.resolve or similar will see the CNAME target to block it), but are of use in Pihole and various other DNS based solutions.


Issue Links

Adguard CNAME Trackers Repo
Toggle State Changes

Activity


2021-03-05 09:54:23
Domains/zones are listed in per-advertiser files within the directory trackers, so the simplest solution is probably to have the list build server have a clone of the repo, then we can do something like 
cd $repo
git pull
find ./trackers -name '*.txt' -exec $some_magic


in order to extract the domains.

It'd also mean that if the ad companies managed to pull some DMCA nonsense and temporarily got the repo removed we'd still have a copy of the lists to use.

2021-03-05 11:15:21

Repo: adblocklists
Commit: 3bd8180bfbb9187f24c95dcb3fcd555a41e08707
Author: B Tasker <github@<Domain Hidden>>

Date: Fri Mar 05 11:06:34 2021 +0000
Commit Message: Pull down the Adguard CNAME tracker domains and process them into the blocked domain list for ADBLK-27



Modified (-)(+)
-------
bin/update_addomains.sh




Webhook User-Agent 

GitHub-Hookshot/b4aca59


View Commit


2021-03-05 11:15:22

Repo: adblocklists
Commit: 356029a41776b77381733d0bb255743eb9ef9d56
Author: B Tasker <github@<Domain Hidden>>

Date: Fri Mar 05 11:11:53 2021 +0000
Commit Message: We've added some code duplication in ADBLK-27 so move it to a function and make it DRY



Modified (-)(+)
-------
bin/update_addomains.sh




Webhook User-Agent 

GitHub-Hookshot/b4aca59


View Commit


2021-03-05 13:19:03
btasker changed status from 'Open' to 'Resolved'

2021-03-05 13:19:03
btasker added 'Done' to resolution

2021-03-05 13:19:06
btasker changed status from 'Resolved' to 'Closed'