Commit Graph

11079 Commits

Author SHA1 Message Date
Yen Chi Hsuan f7291a0b7c
[daum.net] Fix extraction for specific examples
Closes #9972
2016-07-07 01:26:14 +08:00
Yen Chi Hsuan c65aa4e9e1
[brightcove:legacy] Support 'playlistTabs' and skip a dead test
Closes #9965
2016-07-07 01:13:37 +08:00
Yen Chi Hsuan ad213a1d74
[francetv] Recognize more Dailymotion embedded videos
Closes #9955
2016-07-06 23:37:54 +08:00
Yen Chi Hsuan 43f1e4e41e
[onet] Add MD5 checksum 2016-07-06 20:32:03 +08:00
Yen Chi Hsuan 54b0e909d5
[amp] Fix a typo 2016-07-06 20:10:47 +08:00
Yen Chi Hsuan f8752b86ac
[Onet,ClipRs] Add new extractor for onet.tv and use it for clip.rs
Closes #9950
2016-07-06 20:09:05 +08:00
Yen Chi Hsuan 84c237fb8a
[utils] Add get_element_by_class
For #9950
2016-07-06 20:02:52 +08:00
Remita Amine ab49d7a9fa use mimetype2ext to determine manifest ext in multiple extractors 2016-07-06 09:11:46 +01:00
Remita Amine b4173f1551 [utils] add mimetypes to determine manifest ext(m3u8, f4m, mpd) 2016-07-06 09:06:28 +01:00
Remita Amine 2817b99cf2 [metacafe] fix info extraction(closes #8539)(closes #3253) 2016-07-06 02:19:55 +01:00
Remita Amine 001fffd004 [spiegel:article] update test(closes #10018) 2016-07-06 00:16:41 +01:00
Sergey M․ 0e94b4713d
release 2016.07.06 2016-07-06 00:54:23 +07:00
Sergey M․ a6d3b89feb
[prosiebensat1] Make downloading urls JSON non fatal 2016-07-06 00:52:48 +07:00
Remita Amine 6c26815d63 [onionstudios] fix info extraction 2016-07-05 18:05:07 +01:00
Sergey M․ 73c4ac2c95
[youtube:channel] Improve channel id extraction and detect unavailable channels (Closes #10009) 2016-07-05 23:30:44 +07:00
Remita Amine 84f214d840 [prosiebensat1] extract all formats 2016-07-05 17:11:45 +01:00
Remita Amine e3f88be7a9 [rtvnh] extract all formats 2016-07-05 14:45:39 +01:00
Remita Amine 31af3e35e0 [sandia] remove unused imports 2016-07-05 13:39:24 +01:00
Remita Amine 94a5cff91d [sendia] fix info extraction 2016-07-05 13:37:46 +01:00
Remita Amine 77082c7b9e [slideshare] fix description extraction 2016-07-05 12:01:04 +01:00
Remita Amine 252a1f75d2 [spiegel] improve info extraction 2016-07-05 11:46:25 +01:00
Remita Amine 5abf513cf8 [stitcher] fix episode config extraction 2016-07-05 10:44:16 +01:00
Yen Chi Hsuan c6054e3201
[xuite] Support videos with already encoded media id 2016-07-05 14:26:42 +08:00
Yen Chi Hsuan 4080530624
[youtube:shared] Recognize the new 'shared' URLs
Closes #10007
2016-07-05 13:15:05 +08:00
Sergey M․ c25f1a9b63
release 2016.07.05 2016-07-05 06:32:46 +07:00
Remita Amine d9163ae3b6 [kaltura] fix extraction error for videos from multiple kaltura servers 2016-07-04 21:34:27 +01:00
Remita Amine dafafe7cf1 [la7] extract more info from a kaltura custom server 2016-07-04 17:59:58 +01:00
Remita Amine 81953d1ae5 [kaltura] add support videos stored on custom kaltura servers(closes #5557) 2016-07-04 17:59:58 +01:00
Yen Chi Hsuan 3a212ed62e
[iqiyi] Skip an unstable MD5 checksum 2016-07-04 11:25:46 +08:00
Sergey M․ 195f084542
[pornhub] Detect private videos (Closes #9987) 2016-07-04 03:27:00 +07:00
Sergey M․ 6a4e659c93
[yahoo] Recognize brightcove embed (Closes #9995) 2016-07-03 23:00:36 +07:00
Remita Amine dd801bbe18 [brightcove] improve error detection 2016-07-03 16:37:22 +01:00
Yen Chi Hsuan 38cce791c7
Rename --cn-verfication-proxy to --geo-verification-proxy
And deprecate the former one

Since commit f138873900, this option is
not limited to China websites, so rename it.
2016-07-03 23:29:56 +08:00
Sergey M․ bff98341d5
release 2016.07.03.1 2016-07-03 21:28:55 +07:00
Yen Chi Hsuan 2644e911be
[iqiyi] Fix extraction
See https://github.com/soimort/you-get/issues/1211#issuecomment-229011559
2016-07-03 22:19:56 +08:00
Remita Amine a5f67895d3 [nationalgeographic] restore http formats
there was a misunderstanding about the reason of 403 response
the problem happen only when the user use aria2c as a downloader
a1f6f5c768 (commitcomment-18107559)
2016-07-03 14:10:25 +01:00
Yen Chi Hsuan 15e4b6b758
[rai] Support an alternative form of embedded relinker URL
Closes #8551
2016-07-03 19:52:11 +08:00
Yen Chi Hsuan 2b28b892d8
[rai] Support videos with embedded content item ID (#8551) 2016-07-03 19:52:11 +08:00
Yen Chi Hsuan 477b7a8474
[downloader/f4m] Fix for Rai live streams 2016-07-03 19:26:39 +08:00
Yen Chi Hsuan 034a884957
[rai] Support direct relinker URLs (closes #8552) 2016-07-03 19:26:39 +08:00
Remita Amine 64436cb1a4 [nationalgeographic] skip download for national geographic channel tests(closes #9991) 2016-07-03 10:43:36 +01:00
Yen Chi Hsuan f138873900 [rai] Fix extraction and update _TESTS
Closes #8617
Closes #9157
Closes #9232
2016-07-03 15:49:35 +08:00
Yen Chi Hsuan e793338c88
[buzzfeed] Detect Facebook embed and update _TESTS
Closes #5701
2016-07-03 14:12:02 +08:00
Yen Chi Hsuan 369bb06206
[facebook] Improve embed detection (#5701) 2016-07-03 14:11:29 +08:00
Sergey M․ 2cb31d288e
[history:topic] Relax _VALID_URL 2016-07-03 13:01:04 +07:00
Jaime Marquínez Ferrándiz 4cb13d0d6a [hrti] Don't redefine variable in list comprehension 2016-07-02 23:02:14 +02:00
Remita Amine a1f6f5c768 [nationalgeographic] add support Adobe Pass auth 2016-07-02 21:24:22 +01:00
Remita Amine 05c7feec77 [aenetworks] add support Adobe Pass auth 2016-07-02 21:24:22 +01:00
Remita Amine bf83024826 [theplatform] add basic support for Adobe Pass 2016-07-02 21:24:22 +01:00
Sergey M․ a0cfd82dda
release 2016.07.03 2016-07-03 03:19:22 +07:00
Sergey M․ 1b734adb2d
[xtube] Fix extraction (Closes #9953, closes #9961) 2016-07-03 03:17:35 +07:00
Sergey M․ 9b724d7277
[extractors] Add hrti:playlist import 2016-07-03 02:25:39 +07:00
Sergey M․ e3755a624b
[hrti] Improve and add support for playlists (Closes #9482) 2016-07-03 02:22:14 +07:00
Sergey M․ 95cf60e826
[utils] Add PUTRequest 2016-07-03 02:21:32 +07:00
Aleksandar Topuzovic 6b03e1e25d
[HRTi] Implement extractor for Croatian Radiotelevision 2016-07-03 02:20:41 +07:00
Yen Chi Hsuan 712b0b5b70
[la7.it] Fix the extractor 2016-07-02 23:49:03 +08:00
Yen Chi Hsuan 6a424391d9
[facebook] Make embed detection stricter to prevent false-positives 2016-07-02 23:15:55 +08:00
Yen Chi Hsuan dbf0157a26 [generic] Add MD5 checksums 2016-07-02 21:58:07 +08:00
Yen Chi Hsuan 7deef1ba67 [generic] Support Wordpress "YouTube Video Importer" plugin
Closes #9938
2016-07-02 21:58:07 +08:00
Yen Chi Hsuan fd6ca38262 [facebook] Improve Facebook embedded detection
Related to #9938.

Another example comes from 9834872bf6.
2016-07-02 21:58:07 +08:00
Sergey M․ bdafd88da0
[vk] Extend _VALID_URLs to support new domain (Closes #9981) 2016-07-02 16:43:19 +07:00
Sergey M․ 7a1e71575e
release 2016.07.02 2016-07-02 02:47:42 +07:00
Sergey M․ ac2d8f54d1
[vine] Remove superfluous whitespace 2016-07-02 02:45:00 +07:00
Sergey M․ 14ff6baa0e
[fusion] Improve 2016-07-02 02:44:37 +07:00
TRox1972 bb08101ec4
[Fusion] Add new extractor 2016-07-02 02:37:28 +07:00
Sergey M․ bc4b2d75ba
[pornhub] Add support for thumbzilla (Closes #8696) 2016-07-02 02:11:07 +07:00
Sergey M․ 35fc3021ba
[periscope] Add another fallback source 2016-07-02 01:35:57 +07:00
cant-think-of-a-name 347227237b
[periscope] fix playlist extraction (#9967)
The JSON response changed and the extractor needed to be updated in order to gather the video IDs.
2016-07-02 01:29:11 +07:00
Sergey M․ 564dc3c6e8
[vine] Fix extraction (Closes #9970) 2016-07-02 01:24:57 +07:00
Sergey M․ 9f4576a7eb
[twitch] Update usher URL (Closes #9975) 2016-07-01 23:16:43 +07:00
Sergey M․ f11315e8d4
release 2016.07.01 2016-07-01 03:59:57 +07:00
Sergey M․ 0c2ac64bb8
[sixplay] Rename preference key to quality in format dict 2016-07-01 03:57:59 +07:00
Jaime Marquínez Ferrándiz 9e29ef13a3
[options] Accept quoted string across multiple lines (#9940)
Like:

    -f "
    bestvideo+bestaudio/
    best
    "
2016-07-01 03:30:31 +07:00
Sergey M․ eaaaaec042
[pornhub] Add more tests with removed videos 2016-07-01 03:18:27 +07:00
Sergey M․ 3cb3b60064
[pornhub] Relax removed message regex (Closes #9964) 2016-07-01 03:14:23 +07:00
kidol 044e3d91b5
[Pornhub] Fix error detection 2016-07-01 02:59:50 +07:00
Remita Amine c9e538a3b1 [ctvnews] use orderedSet, increase the number of items for playlists and use smaller bin list for test 2016-06-30 19:52:32 +01:00
Remita Amine 76dad392f5 [meta] Clarify the source of uppod st decryption algorithm 2016-06-30 18:27:57 +01:00
Remita Amine 9617b557aa [ctv] Add new extractor(closes #4077) 2016-06-30 18:22:35 +01:00
Remita Amine bf4fa24414 [ctvnews] Add new extractor(closes #2156) 2016-06-30 18:22:35 +01:00
Remita Amine 20361b4f25 [rds] extract 9c9media formats 2016-06-30 18:22:35 +01:00
Remita Amine 05a0068a76 [9c9media] Add new extractor 2016-06-30 18:22:35 +01:00
Sergey M․ 66a42309fa
release 2016.06.30 2016-06-30 23:56:55 +07:00
Sergey M․ fd94e2671a
[meta] Add support for pladform embeds 2016-06-30 23:20:44 +07:00
Sergey M․ 8ff6697861
[pladform] Improve embed detection 2016-06-30 23:19:29 +07:00
Sergey M․ eafa643715
[meta] Make duration and description optional
For iframe URLs
2016-06-30 23:06:13 +07:00
Sergey M․ 049da7cb6c
[meta] Extend _VALID_URL 2016-06-30 23:04:18 +07:00
Remita Amine 7dbeee7e22 [generic] make twitter:player extraction non fatal 2016-06-30 14:11:55 +01:00
Remita Amine 93ad6c6bfa [sixplay] Add new extractor(closes #2183) 2016-06-30 13:50:49 +01:00
Remita Amine 329179073b [generic] add generic support for twitter:player embeds 2016-06-30 12:01:30 +01:00
Remita Amine 4d86d2008e [urplay] fix typo and check with flake8 2016-06-30 11:30:42 +01:00
Remita Amine ab47b6e881 [theatlantic] Add new extractor(closes #6611) 2016-06-30 04:08:56 +01:00
Remita Amine df43389ade [skysports] Add new extractor(closes #7066) 2016-06-30 02:54:21 +01:00
Remita Amine 397b305cfe [meta] Add new extractor(closes #8789) 2016-06-30 00:21:03 +01:00
Remita Amine e496fa50cd [urplay] Add new extractor(closes #9332) 2016-06-29 20:19:31 +01:00
Sergey M․ 06a96da15b
[eagleplatform] Improve embed detection and extract in separate routine (Closes #9926) 2016-06-29 23:01:34 +07:00
Remita Amine 70157c2c43 [aenetworks] add support for movie pages 2016-06-29 16:55:17 +01:00
Remita Amine c58ed8563d [aenetworks] extract history topic playlist title 2016-06-29 16:18:16 +01:00
Remita Amine 4c7821227c [aenetworks:historytopic] fix topic video url 2016-06-29 16:03:32 +01:00
Remita Amine 42362fdb5e [aenetworks] add support for show and season for A&E Network sites and History topics(closes #9816) 2016-06-29 15:49:17 +01:00
Sergey M․ 97124e572d
[arte:playlist] Fix test 2016-06-28 22:39:53 +07:00
Remita Amine 32616c14cc [vrt] extract all formats 2016-06-28 14:02:03 +01:00
Sergey M․ 8174d0fe95
release 2016.06.27 2016-06-27 23:09:39 +07:00
Sergey M․ 8704778d95
[pbs] Check manually constructed http links (Closes #9921) 2016-06-27 23:06:42 +07:00
Sergey M․ c287f2bc60
[extractor/generic] Use _extract_url for kaltura embeds (Closes #9922) 2016-06-27 22:45:26 +07:00
Sergey M․ 9ea5c04c0d
[kaltura] Add _extract_url with fixed regex 2016-06-27 22:44:17 +07:00
Sergey M․ f41ffc00d1
[skynewsarabia:article] Clarify IE_NAME 2016-06-27 05:08:09 +07:00
Sergey M․ 81fda15369
[sr:mediathek] Clarify IE_NAME 2016-06-27 05:07:12 +07:00
Sergey M․ 427cd050a3
[extractor/generic] Improve kaltura embed detection (Closes #9911) 2016-06-27 04:11:53 +07:00
Sergey M․ b0c200f1ec
[msn] Add test URL with non-alphanumeric characters 2016-06-26 22:03:36 +07:00
Sergey M․ 92747e664a
release 2016.06.26 2016-06-26 21:15:24 +07:00
Sergey M․ f1f336322d
[msn] Fix extraction (Closes #8960, closes #9542) 2016-06-26 21:10:05 +07:00
Sergey M․ bf8dd79045
[extractor/common] Fix sorting with custom field preference 2016-06-26 21:09:07 +07:00
TRox1972 c6781156aa
[MSN] add new extractor 2016-06-26 21:07:59 +07:00
remitamine 59bbe4911a [extractor/common] add helper method to extract html5 media entries 2016-06-26 14:04:08 +01:00
remitamine 4f3c5e0627 [utils] add helper function for parsing codecs 2016-06-26 14:03:58 +01:00
Sergey M․ f484c5fa25
[vidbit] Improve (Closes #9759) 2016-06-26 16:59:28 +07:00
Sergey M․ 88d9f6c0c4
[utils] Add support for name list in _html_search_meta 2016-06-26 16:57:14 +07:00
TRox1972 3c9c088f9c
[Vidbit] Add new extractor 2016-06-26 16:52:52 +07:00
Yen Chi Hsuan fc3996bfe1
[iqiyi] Remove codes for debugging 2016-06-26 15:45:41 +08:00
Yen Chi Hsuan 5b6ad8630c
[iqiyi] Partially fix IqiyiIE
Use the HTML5 API. Only low-resolution formats available

Related: #9839

Thanks @zhangn1985 for the overall algorithm (soimort/you-get#1224)
2016-06-26 15:18:32 +08:00
Yen Chi Hsuan 30105f4ac0
[le] Move urshift() to utils.py 2016-06-26 15:17:26 +08:00
Yen Chi Hsuan 1143535d76
[utils] Add urshift()
Used in IqiyiIE and LeIE
2016-06-26 15:16:49 +08:00
Yen Chi Hsuan 7d52c052ef
[generic] Fix test_Generic_76
Broken: https://travis-ci.org/rg3/youtube-dl/jobs/140251658
2016-06-26 11:56:27 +08:00
stepshal a2406fce3c
Fix misspelling 2016-06-26 01:28:55 +07:00
Sergey M․ 3b34ab538c
[svtplay] Extend _VALID_URL (#9900) 2016-06-26 00:29:53 +07:00
Sergey M․ ac782306f1
[iqiyi] Mark broken 2016-06-26 00:25:41 +07:00
Sergey M․ ce96ed05f4
[polskieradio] Add test with video 2016-06-25 23:31:21 +07:00
Sergey M․ 0463b77a1f
[polskieradio] Improve extraction (Closes #9813) 2016-06-25 23:19:18 +07:00
Jakub Adam Wieczorek 2d185706ea
[polskieradio] Add support for Polskie Radio.
Polskie Radio is the main Polish state-funded radio broadcasting service.
2016-06-25 23:19:18 +07:00
Sergey M․ b72b44318c
[utils] Add strip_or_none 2016-06-25 23:19:18 +07:00
Sergey M․ 46f59e89ea
[utils] Add unified_timestamp 2016-06-25 23:19:18 +07:00
Sergey M․ b4241e308e
release 2016.06.25 2016-06-25 03:03:20 +07:00
Sergey M․ be49068d65
[youtube] Fix and skip some tests 2016-06-24 22:47:19 +07:00
Sergey M․ 525cedb971
[youtube] Relax URL expansion in description 2016-06-24 22:37:13 +07:00
Sergey M․ de3c7fe0d4
[youtube] Fix 141 format tests 2016-06-24 22:27:55 +07:00
Yen Chi Hsuan 896cc72750
[mixcloud] View count and like count may be absent
Closes #9874
2016-06-24 17:26:12 +08:00
Yen Chi Hsuan c1ff6e1ad0
[vimeo:review] Fix extraction for password-protected videos
Closes #9853
2016-06-24 16:48:37 +08:00
Remita Amine fee70322d7 [appletrailers] correct thumbnail fallback 2016-06-23 19:03:34 +01:00
Remita Amine 8065d6c55f [dcn] extend _VALID_URL for awaan.ae and extract all available formats 2016-06-23 17:22:15 +01:00
Remita Amine 494172d2e5 [appletrailers] extract info from an alternative source if available(closes #8422)(closes #8422) 2016-06-23 15:49:42 +01:00
Remita Amine 6e3c2047f8 [tvp] extract all formats and detect erros 2016-06-23 04:36:16 +01:00
Sergey M․ 011bd3221b
release 2016.06.23.1 2016-06-23 09:42:56 +07:00
Sergey M․ b46eabecd3
[jsinterp] Relax JS function regex (Closes #9863) 2016-06-23 09:41:34 +07:00
Remita Amine 0437307a41 [nbc:nbcnews] improve extraction and add msnbc to the extractor 2016-06-23 01:36:19 +01:00
Remita Amine 22b7ac13ef [tf1] fix wat id extraction(closes #9862) 2016-06-23 00:14:34 +01:00
Sergey M․ 96f88e91b7
release 2016.06.23 2016-06-23 04:29:34 +07:00
Sergey M․ 3331a4644d
[vk] Remove unused import 2016-06-23 04:27:10 +07:00
Sergey M․ adf1921dc1
[xnxx] Improve _VALID_URL (Closes #9858) 2016-06-23 04:26:49 +07:00
Sergey M․ 97674f0419
[xnxx] Replace test 2016-06-23 04:24:00 +07:00