Commit Graph

461 Commits

Author SHA1 Message Date
Yen Chi Hsuan 50ad078b7b
[gdcvault] Fix extraction for videos with gdc-player.html
Closes #12733
2017-05-05 15:13:40 +08:00
Yen Chi Hsuan 0c26548601
[cda] Implement birthday verification (closes #12789) 2017-05-04 16:26:17 +08:00
Yen Chi Hsuan 5401bea27f
[leeco] Fix extraction (closes #12974)
Seems on mobile devices a similar API is used, but I always get an AD
with mimicking that API.
2017-05-04 03:18:56 +08:00
Sergey M․ e0c1e9a98c
release 2017.05.01 2017-05-01 01:39:52 +07:00
Sergey M․ 086041e2f8
[ChangeLog] Actualize 2017-05-01 01:34:51 +07:00
Yen Chi Hsuan 24eb7c2578
[xtube] Fix extraction with non-standard JSON 'sources'
Closes #12734

Thanks @paulguy for the fix!
2017-04-29 15:55:08 +08:00
Sergey M․ bc8a2ea071
release 2017.04.28 2017-04-28 18:30:03 +07:00
Sergey M․ 7527923371
[ChangeLog] Actualize 2017-04-28 18:27:29 +07:00
Yen Chi Hsuan e31fed95b4
[youtube] Recognize new locale-based player URLs (fixes #12885) 2017-04-28 15:48:30 +08:00
Sergey M․ a82f41841d
release 2017.04.26 2017-04-26 00:06:12 +07:00
Sergey M․ 30a4ab191a
[ChangeLog] Actualize 2017-04-26 00:03:13 +07:00
Yen Chi Hsuan 01cb57016f
[iqiyi] Fix extraction of Yule videos 2017-04-25 22:23:57 +08:00
Yen Chi Hsuan fbf56be213
[iqiyi] Fix playlist detection (#12504) 2017-04-22 22:11:37 +08:00
Yen Chi Hsuan 54f54fcca7
[socks] Report errors elegantly when credentails are required but missing
In some non-standard implementations, the server may respond AUTH_USER_PASS
even if's not listed in available authentication methods. (it should
respond AUTH_NO_ACCEPTABLE per standards)
2017-04-22 21:48:41 +08:00
Yen Chi Hsuan facfd79f9a
[azubu] Remove extractor as the site is gone (closes #12813) 2017-04-22 21:20:25 +08:00
Yen Chi Hsuan 3110bb937d
[porn91] Fix extraction (closes #12814) 2017-04-22 21:16:36 +08:00
Yen Chi Hsuan 06d0ad9a4e
[brightcove] Support URLs with bcpid instead of playerID
Fixes #12482
2017-04-18 23:04:22 +08:00
Sergey M․ 16a09aefe3
release 2017.04.17 2017-04-17 00:46:32 +07:00
Sergey M․ fa7a6e6de6
[ChangeLog] Actualize 2017-04-17 00:43:56 +07:00
Sergey M․ 022250a594
release 2017.04.16 2017-04-16 01:49:02 +07:00
Sergey M․ 76b5f99617
[ChangeLog] Actualize 2017-04-16 01:47:58 +07:00
Sergey M․ d24bd4ffdb
release 2017.04.15 2017-04-15 01:39:33 +07:00
Sergey M․ b9859e2735
[ChangeLog] Actualize 2017-04-15 01:37:26 +07:00
Sergey M․ 38d2f8325f
release 2017.04.14 2017-04-14 00:31:49 +07:00
Sergey M․ 6f4dd6667b
[ChangeLog] Actualize 2017-04-14 00:29:36 +07:00
Sergey M․ 1730878167
release 2017.04.11 2017-04-11 02:17:53 +07:00
Sergey M․ 689cd458a6
[ChangeLog] Actualize 2017-04-11 02:16:20 +07:00
Sergey M․ 4372436504
release 2017.04.09 2017-04-09 00:01:28 +07:00
Sergey M․ eb8cc8ea3b
[ChangeLog] Actualize 2017-04-08 23:59:17 +07:00
Yen Chi Hsuan 4c03973296
[airmozilla] Fix extraction (closes #12670) 2017-04-08 15:39:58 +08:00
Sergey M․ b022f4f600
release 2017.04.03 2017-04-03 03:53:55 +07:00
Sergey M․ e2435ba5f3
[ChangeLog] Actualize 2017-04-03 03:52:44 +07:00
Sergey M․ b56e41a701
release 2017.04.02 2017-04-02 02:39:15 +07:00
Sergey M․ a76c25146a
[ChangeLog] Actualize 2017-04-02 02:37:18 +07:00
Sergey M․ 9e691da067
release 2017.03.26 2017-03-26 08:11:40 +07:00
Sergey M․ 82eefd0be0
[ChangeLog] Actualize 2017-03-26 23:39:12 +07:00
Yen Chi Hsuan f7923a4c39
[ChangeLog] Update after #12307 2017-03-26 22:07:12 +08:00
Yen Chi Hsuan 51ef4919df
[afreecatv] Fix extraction (closes #12179) 2017-03-26 01:32:07 +08:00
Sergey M․ a3ccd6bd11
release 2017.03.24 2017-03-24 00:24:23 +07:00
Sergey M․ 7963b6cba8
[ChangeLog] Actualize 2017-03-24 00:19:58 +07:00
Sergey M․ 093dad9e25
release 2017.03.22 2017-03-22 02:36:50 +07:00
Sergey M․ e8686e51d7
[ChangeLog] Actualize 2017-03-22 02:35:09 +07:00
Sergey M․ 0e9a73e612
release 2017.03.20 2017-03-20 00:07:57 +07:00
Sergey M․ 0ecdd3adbd
[ChangeLog] Actualize 2017-03-20 00:03:58 +07:00
Yen Chi Hsuan 68220649fa
[ChangeLog] Update after #12099 2017-03-19 20:42:17 +08:00
Yen Chi Hsuan ea883a687c
[openload] Fix extraction (closes #10408)
Thanks to @makgun02

Ref: http://pastebin.com/raw/JX9gHFUz
2017-03-17 15:22:34 +08:00
Sergey M․ 7d539ee10a
release 2017.03.16 2017-03-16 22:42:12 +07:00
Sergey M․ 6ad476079d
[ChangeLog] Actualize 2017-03-16 22:39:48 +07:00
Sergey M․ 5db83d79bf
release 2017.03.15 2017-03-15 02:01:24 +07:00
Sergey M․ 2a751e137f
[ChangeLog] Actualize 2017-03-15 02:00:10 +07:00
Yen Chi Hsuan 4605c94d1a
[__init__] Fix missing subtitles if --add-metadata is used (#12423)
The previous fix for #5594 is incorrect
2017-03-11 19:37:45 +08:00
Sergey M․ a8e687a4da
release 2017.03.10 2017-03-10 23:26:28 +07:00
Sergey M․ f9e5c92c94
[ChangeLog] Actualize 2017-03-10 23:23:24 +07:00
Yen Chi Hsuan 0f6b87d067
[miomio] Fix extraction
Closes #12291
Closes #12388
Closes #12402
2017-03-08 19:46:58 +08:00
Sergey M․ dccd0ab35d
release 2017.03.07 2017-03-07 03:59:22 +07:00
Sergey M․ 80146dcc6c
[ChangeLog] Actualize 2017-03-07 03:57:54 +07:00
Yen Chi Hsuan 54a3a8827b
[__init__] Metadata should be added after conversion
Fixes #5594
2017-03-06 18:09:12 +08:00
Yen Chi Hsuan 92cb5763f4
[ChangeLog] Update after #12357 2017-03-06 18:04:19 +08:00
Sergey M․ 1664702626
release 2017.03.06 2017-03-06 04:04:39 +07:00
Sergey M․ 3f116b189b
[ChangeLog] Actualize 2017-03-06 04:01:21 +07:00
Sergey M․ afa4597618
release 2017.03.05 2017-03-05 02:23:08 +07:00
Sergey M․ 75027364ba
[ChangeLog] Actualize 2017-03-05 02:22:02 +07:00
Yen Chi Hsuan 6f4e4132d8
[douyutv] Switch to the PC API to escape the 5-min limitation
Thanks @spacemeowx2 for the algo.

Ref: https://gist.github.com/spacemeowx2/629b1d131bd7e240a7d28742048e80fc

Closes #12316
2017-03-04 23:23:18 +08:00
Sergey M․ 250eea6821
release 2017.03.02 2017-03-02 22:33:22 +07:00
Sergey M․ 28d15b73f8
[ChangeLog] Actualize 2017-03-02 22:29:56 +07:00
Yen Chi Hsuan 11bb6ad1a5
[facebook] Fix extraction (closes #12323)
Almost all videos now use the pagelet type 'permalink_video_pagelet'
2017-03-02 20:51:24 +08:00
Sergey M․ 1dc24093f8
release 2017.02.28 2017-02-28 23:59:22 +07:00
Sergey M․ 11bae9cdde
[ChangeLog] Actualize 2017-02-28 23:49:24 +07:00
Yen Chi Hsuan 9bd05b5a18 [daisuki] Add new extractor (closes #4738) 2017-02-28 22:19:26 +08:00
Yen Chi Hsuan f4c68ba372
[douyu] Fix extraction and update _TESTS
They've switched from flv to hls

Closes #12301
2017-02-28 21:41:03 +08:00
Sergey M․ ef48a1175d
release 2017.02.27 2017-02-27 23:26:07 +07:00
Sergey M․ c6184bcf7b
[ChangeLog] Actualize 2017-02-27 23:24:03 +07:00
Yen Chi Hsuan 892b47ab6c
[scivee] Remove extractor (#9315)
The Wikipedia page is changed from active to down:
https://en.wikipedia.org/w/index.php?title=SciVee&diff=prev&oldid=723161154

Some other interesting bits:

$ nslookup www.scivee.tv
Server:         8.8.8.8
Address:        8.8.8.8#53

Non-authoritative answer:
www.scivee.tv   canonical name = scivee.rcsb.org.
Name:   scivee.rcsb.org
Address: 132.249.231.211

$ nslookup rcsb.org
Server:         8.8.8.8
Address:        8.8.8.8#53

Non-authoritative answer:
Name:   rcsb.org
Address: 132.249.231.77

Both IPs are from UCSD. I guess it's maintained by a lab and they don't
maintain it anymore.
2017-02-27 21:34:33 +08:00
Yen Chi Hsuan a5cf17989b
[MDR] Relax _VALID_URL and playerURL matching and update _TESTS
Ref: #12169
2017-02-26 17:24:54 +08:00
Yen Chi Hsuan 9d0c08a02c
[vevo] Fix videos with the new streams/streamsV3 format (closes #11719) 2017-02-26 00:15:49 +08:00
Yen Chi Hsuan db182c63fb
[njpwworld] Add new extractor (closes #11561) 2017-02-25 18:44:39 +08:00
Sergey M․ 204efc8509
release 2017.02.24.1 2017-02-24 21:59:39 +07:00
Sergey M․ 5d3a51e1b9
[ChangeLog] Actualize 2017-02-24 21:57:39 +07:00
Sergey M․ 6b097cff27
release 2017.02.24 2017-02-24 06:09:15 +07:00
Sergey M․ f2f7961820
[ChangeLog] Actualize 2017-02-24 06:07:41 +07:00
Sergey M․ 345b24538b
release 2017.02.22 2017-02-22 23:50:42 +07:00
Sergey M․ 63a29b6118
[ChangeLog] Actualize 2017-02-22 23:45:01 +07:00
Yen Chi Hsuan b5869560a4
[crunchyroll] Fix descriptions with double quotes (closes #12124) 2017-02-23 00:08:45 +08:00
Sergey M․ 8c6c88c7da
release 2017.02.21 2017-02-21 23:48:24 +07:00
Sergey M․ 159aaaa9d0
[ChangeLog] Actualize 2017-02-21 23:46:58 +07:00
Sergey M․ 28e35f5070
release 2017.02.17 2017-02-17 23:59:56 +07:00
Sergey M․ cf3704c132
[ChangeLog] Actualize 2017-02-17 23:48:30 +07:00
Yen Chi Hsuan fef51645d6
[theplatform] Recognize URLs with whitespaces (closes #12044) 2017-02-17 23:13:51 +08:00
Yen Chi Hsuan a4a554a793
[generic] Try parsing JWPlayer embedded videos (closes #12030) 2017-02-16 23:44:03 +08:00
Sergey M․ 2480b056c1
release 2017.02.16 2017-02-16 00:10:04 +07:00
Sergey M․ 3aa25395aa
[ChangeLog] Actualize 2017-02-16 00:08:56 +07:00
Sergey M․ 58a65ba852
release 2017.02.14 2017-02-14 01:09:18 +07:00
Sergey M․ cedf08ff54
[ChangeLog] Actualize 2017-02-14 01:07:35 +07:00
Yen Chi Hsuan f8514630db
[einthusan] Fix extraction (closes #11416)
The old test URLs are no longer valid, so I replace them with the one
from #11416
2017-02-12 20:53:55 +08:00
Yen Chi Hsuan 8d38dafbbf
ChangeLog: update after #12085 2017-02-12 00:45:37 +08:00
Sergey M․ 9b92a5917b
release 2017.02.11 2017-02-11 03:24:00 +07:00
Sergey M․ 3e2274c8b7
[ChangeLog] Actualize 2017-02-11 17:08:22 +07:00
Sergey M․ 55d4de2283
release 2017.02.10 2017-02-10 01:27:33 +07:00
Sergey M․ 61ee556aea
[ChangeLog] Actualize 2017-02-10 01:26:00 +07:00
Sergey M․ 013877298d
release 2017.02.07 2017-02-07 02:04:50 +07:00
Sergey M․ c87f95f991
[ChangeLog] Actualize 2017-02-07 01:58:57 +07:00
Yen Chi Hsuan 9c14fe9681
[gaskrank] Minor change and update ChangeLog after #11685 2017-02-06 00:25:28 +08:00
Yen Chi Hsuan 019f4c0371
[bandcamp] Fix extraction for incomplete albums
Closes #11727
2017-02-05 22:47:04 +08:00
Yen Chi Hsuan caf0f5f8b7
[iwara] Fix extraction (closes #11781) 2017-02-05 21:48:13 +08:00
Yen Chi Hsuan e4e50f60b1
[googledrive] Fix extraction on Python 3.6
Since Python 3.6, invalid escape sequences are deprecated. It's likely
that there are invalid escape sequences somewhere on the webpage, so
instead of unescaping the whole webpage, just unescape the URL.

See https://bugs.python.org/issue27364. That change was designed for
string literals, while it affects the 'unicode_escape' encoding as well.
The code path is:

str.decode('unicode_escape')
    codecs.unicode_escape_decode()
        PyUnicode_DecodeUnicodeEscape()
2017-02-05 21:41:08 +08:00
Sergey M․ a713a86755
release 2017.02.04.1 2017-02-04 23:26:39 +07:00
Sergey M․ 7bccd5fc8a
[ChangeLog] Actualize 2017-02-04 23:23:38 +07:00
Sergey M․ 3144eccf55
[ChangeLog] Actualize 2017-02-04 23:22:28 +07:00
Sergey M․ 31487eb974
release 2017.02.04 2017-02-04 22:57:48 +07:00
Yen Chi Hsuan daac118bf4
[ChangeLog] Update after #11901 2017-02-03 18:56:40 +08:00
Yen Chi Hsuan d7f9242e30
[ChangeLog] Update after #11565 2017-02-03 12:13:24 +08:00
Yen Chi Hsuan a22b2fd19b
[youtube] Fix ytsearch* when cookies are provided
Closes #11924

The API with `page` is no longer used in browsers, and YouTube always
returns {'reload': 'now'} when cookies are provided.

See http://youtube.github.io/spfjs/documentation/start/ for how SPF
works. Basically appending static link with a `spf` parameter yields the
corresponding dynamic link.
2017-02-03 01:28:24 +08:00
Yen Chi Hsuan bd8f48c78b
[bilibili] Support new Bangumi URLs (closes #11845)
To reduce complexity, I don't support old Bangumi URLs directly via
_VALID_URL. Instead, I choose to let it go to generic redirection. An
example can be found in #10190:

http://bangumi.bilibili.com/anime/v/40062
2017-02-02 21:51:31 +08:00
Jaime Marquínez Ferrándiz 020c5df52d [elpais] Fix extraction for some URLs (closes #11765) 2017-02-01 23:48:34 +01:00
Sergey M․ 5069594993
release 2017.02.01 2017-02-01 03:20:09 +07:00
Sergey M․ b996b88092
[ChangeLog] Actualize 2017-02-01 23:29:59 +07:00
Yen Chi Hsuan 000f207944
[prosiebensat1] Update ChangeLog 2017-02-01 23:16:35 +08:00
Sergey M․ d7e215b42d
release 2017.01.31 2017-01-31 22:24:45 +07:00
Sergey M․ 3a528ffd89
[ChangeLog] Actualize 2017-01-31 22:22:42 +07:00
Sergey M․ 4d2fdb07c4
release 2017.01.29 2017-01-29 13:21:42 +07:00
Sergey M․ fe323a4800
[ChangeLog] Actualize 2017-01-29 21:21:26 +07:00
Sergey M․ d41ed6d243
release 2017.01.28 2017-01-28 00:33:55 +07:00
Sergey M․ 815d2a36d8
[ChangeLog] Actualize 2017-01-28 00:03:21 +07:00
Sergey M․ 2417d41535
release 2017.01.25 2017-01-25 23:36:03 +07:00
Sergey M․ 2c302cf66b
[ChangeLog] Actualize 2017-01-25 23:33:46 +07:00
Sergey M․ c3a65c3de0
release 2017.01.24 2017-01-24 02:58:37 +07:00
Sergey M․ ee4c091ce5
[ChangeLog] Actualize 2017-01-24 02:56:19 +07:00
Yen Chi Hsuan bc35ed3fb6
[nextmedia] Add support for NextTV (壹電視) 2017-01-23 23:38:31 +08:00
Sergey M․ 9d5b29c881
release 2017.01.22 2017-01-22 18:59:04 +07:00
Sergey M․ 6c031a35f3
[ChangeLog] Actualize 2017-01-22 18:57:15 +07:00
Yen Chi Hsuan 7c20b7484c
[nextmedia] Support redirected URLs 2017-01-22 02:06:34 +08:00
Yen Chi Hsuan 4447fb2332
[cspan] Support Ustream embedded videos
Closes #11547
2017-01-20 22:27:13 +08:00
Sergey M․ 1560baacc6
release 2017.01.18 2017-01-18 23:10:00 +07:00
Sergey M․ 460f61fac4
[ChangeLog] Actualize 2017-01-18 23:06:46 +07:00
Sergey M․ c1c2fe2045
release 2017.01.16 2017-01-16 23:44:04 +07:00
Sergey M․ ddd53c392e
[ChangeLog] Actualize 2017-01-16 23:42:04 +07:00
Yen Chi Hsuan 16e2c8f771
[brightcove] Recognize another player ID
Closes #11688
2017-01-16 00:06:52 +08:00
Yen Chi Hsuan dcae7b3fdc
[niconico] Allow login via cookies
Some codes are borrowed from #7968, which is by @jlhg

Closes #7968
2017-01-15 22:51:54 +08:00
Sergey M․ 5d4c7daa49
release 2017.01.14 2017-01-14 07:31:07 +07:00
Sergey M․ 0b94510cd0
[ChangeLog] Actualize 2017-01-14 07:30:32 +07:00
Sergey M․ 31ea2ad89d
release 2017.01.10 2017-01-10 21:29:20 +07:00
Sergey M․ 2184d44361
[ChangeLog] Actualize 2017-01-10 21:27:17 +07:00
Philipp Hagemeister bfedb2cc5a small fix to Changelog format 2017-01-09 11:26:01 +01:00
Philipp Hagemeister 8084951b7f [egghead:course] Add support for egghead.io course playlists
Individual egghead videos are already handled by the generic/Wistia extractors.
2017-01-09 11:24:40 +01:00
Sergey M․ e7ea724cb9
release 2017.01.08 2017-01-08 20:58:43 +07:00
Sergey M․ e60166020b
[ChangeLog] Actualize 2017-01-08 20:56:38 +07:00
Yen Chi Hsuan 1219201143
[ChangeLog] Update after #11581
[ci skip]
2017-01-06 01:07:30 +08:00
Yen Chi Hsuan 24d8a75982
[discoverygo] Fix JSON data parsing
HTMLParser, which is used by extract_attributes, already unescapes
attribute values with HTMLParser.unescape. They shouldn't be unescaped
again, to there may be parsing errors.

Ref: #11219, #11522
2017-01-05 18:50:34 +08:00
Sergey M․ 7232bb299b
release 2017.01.05 2017-01-05 04:10:15 +07:00
Sergey M․ 2b12e34076
[ChangeLog] Actualize 2017-01-05 04:07:32 +07:00