ViewVC Help
View File | Revision Log | View Changeset | Root Listing
root/Oni2/Validate External Links/Development/ValExtLinks to-do.rtf
Revision: 1147
Committed: Tue Feb 2 20:10:39 2021 UTC (4 years, 8 months ago) by iritscen
Content type: application/rtf
File size: 1244 byte(s)
Log Message:
ValExtLinks: Changed --suggest-snapshots to --suggest-snapshots-ng and added --suggest-snapshots-ok for getting snapshot URLs for all good links. This can be used to confirm that sites are backed up in case they die in the future, but note that this argument will take hours to run due to the API rate limit. Added awareness of API rate limit so Archive.org will not start blocking script.

File Contents

# Content
1 {\rtf1\ansi\ansicpg1252\cocoartf2513
2 \cocoatextscaling0\cocoaplatform0{\fonttbl\f0\fswiss\fcharset0 Helvetica;}
3 {\colortbl;\red255\green255\blue255;}
4 {\*\expandedcolortbl;;}
5 \margl1440\margr1440\vieww12600\viewh10200\viewkind0
6 \deftab720
7 \pard\pardeftab720\qc\partightenfactor0
8
9 \f0\fs28 \cf0 \ul \ulc0 ValExtLinks to-do list\ulnone \
10 \
11 \pard\pardeftab720\partightenfactor0
12 \cf0 - It appears that YouTube videos which are taken down still return 200! How to detect?\
13 \
14 - Audit exceptions list so it doesn't acquire cruft \'97 mention URLs in list that aren't in extlinks.csv, and URLs that were found but returned different codes (or were OK instead of NG). This can be done with a parallel array of 0/1s that track whether each exception in the exceptions list was used.\
15 \
16 - Expand and test the interwiki links.\
17 \
18 - Test section links found in interwiki or intrawiki links. Intrawiki links are not in extlinks so this probably requires a bot.\
19 \
20 - Add advisory message about localizing any externally-linked images. But images are not part of the extlinks table so this probably requires a bot.\
21 \
22 - Can we automatically compare screenshots of old to new pages with some leeway for minor changes, in order to catch new silent redirects?}