Yen Chi Hsuan
abc1723edd
[unistra] Sort formats
...
Originally URLs are passed to set() and not sorted, so the result is not
deterministic, causing occasional FAILs on Travis CI.
2016-04-25 22:24:40 +08:00
Yen Chi Hsuan
d6712378e7
Merge branch 'akamai_pv' of https://github.com/remitamine/youtube-dl into remitamine-akamai_pv
2016-04-25 21:02:02 +08:00
remitamine
fb72ec58ae
[extractor/common] do not process f4m manifest that contain akamai playerVerificationChallenge
2016-04-25 13:37:03 +01:00
Sergey M․
c83a352227
[openload] Make thumbnail optional
2016-04-25 00:26:06 +06:00
Sergey M․
e9063b5de9
[openload] Add test
2016-04-25 00:22:55 +06:00
Sergey M․
594b0c4c69
[openload] Fix ext extraction
2016-04-25 00:03:29 +06:00
Sergey M․
eb9ee19422
[utils] Allow None mimetypes in mimetype2ext
2016-04-25 00:03:12 +06:00
Sergey M․
a1394b820d
[openload] Fix title extraction ( Closes #9298 )
2016-04-25 00:01:37 +06:00
Yen Chi Hsuan
aa9dc24f5a
[douyutv] Improve extraction and update tests
...
The JSON API sometimes return HTML pages with errors
2016-04-24 23:52:17 +08:00
Yen Chi Hsuan
51762e1a31
[xminus] Fix extraction ( closes #9228 )
2016-04-24 23:21:45 +08:00
Philipp Hagemeister
8b38f2ac40
release 2016.04.24
2016-04-24 17:06:46 +02:00
Yen Chi Hsuan
a82398bd72
[kwuo:song] Fix extraction and update the test
2016-04-24 22:20:45 +08:00
remitamine
c14dc00df3
[viewster] improve http formats extraction
2016-04-24 14:34:28 +01:00
Yen Chi Hsuan
03dd60ca41
[kuwo:category] Fix the test
...
Sometimes there are 24 songs and sometimes 30 lol
2016-04-24 21:16:06 +08:00
Yen Chi Hsuan
0738187f9b
[ThePlatform] Fix tests failed since 79ba9140dc
2016-04-24 20:46:06 +08:00
Yen Chi Hsuan
a956cb6306
[onionstudios] Fix description extraction
...
\1 does not work in []. Fixes test_Generic_75
(http://www.clickhole.com/video/dont-understand-bitcoin-man-will-mumble-explanatio-2537 )
2016-04-24 20:41:17 +08:00
Yen Chi Hsuan
a8062eabcd
[mwave] Skip checking unstable MD5
...
On my PC the checksum is 02eda6d09fb63131a17a8d44e6237463, while a
recent Travis CI build
(https://travis-ci.org/rg3/youtube-dl/jobs/125341081 ) shows it's
c930e27b7720aaa3c9d0018dfc8ff6cc
2016-04-24 20:05:24 +08:00
Yen Chi Hsuan
2a7dee8cc5
[yahoo] Improve error detection and update tests
2016-04-24 18:12:16 +08:00
Yen Chi Hsuan
d9ed362116
[yahoo] Extract all <iframe>s
...
Fixes test_yahoo_6
(https://ca.finance.yahoo.com/news/hackers-sony-more-trouble-well-154609075.html )
2016-04-24 17:46:25 +08:00
Yen Chi Hsuan
4f54958097
[yahoo] Update some tests
...
One has new fields as ThePlatformIE changed, and others have changed
files.
2016-04-24 17:29:01 +08:00
Yen Chi Hsuan
2a7c38831c
[yahoo] Extend _VALID_URL and fix extraction
...
Closes #9271
2016-04-24 17:01:18 +08:00
Yen Chi Hsuan
949b6497cc
[generic] Unescape the video URL
...
Fixes #9279
2016-04-24 16:25:37 +08:00
remitamine
fda9a1ca9e
[viewster] simplify qualities_basename regex
2016-04-24 03:06:46 +01:00
remitamine
864d5e7231
[viewster] extract all http formats
2016-04-24 02:32:56 +01:00
Sergey M․
5448b781f6
[dplay] Sign unsigned final download hls URLs
2016-04-23 17:28:45 +06:00
Sergey M․
e239413fbc
[dplay] Extract subtitles ( Closes #9284 )
2016-04-23 16:50:31 +06:00
Sergey M․
fd0ff8bad8
[dplay] Improve extraction and document workarounds and tests
2016-04-23 16:36:17 +06:00
Sergey M․
397ec446f3
[dplay] Try secure api for no tld ( Closes #9282 )
2016-04-23 15:59:30 +06:00
remitamine
29a7e8f6f8
[nhl] Add new extractor( closes #8419 )( closes #8798 )
2016-04-22 20:18:27 +01:00
Yen Chi Hsuan
eb01e97e10
[youku] Skip streams with channel_type=tail
...
Fixes #9275
These video segments look like ads and they don't appear in the web
player.
2016-04-23 02:54:09 +08:00
remitamine
cb7d4d0efd
[nbc] add support for today.com( closes #2909 )
2016-04-22 18:08:20 +01:00
Yen Chi Hsuan
c80037918b
[iqiyi] Improve error detection ( #9276 )
2016-04-23 00:06:49 +08:00
remitamine
237a41108a
[eagleplatform] extract all http formats
2016-04-22 14:32:38 +01:00
remitamine
e962ae15d3
[newstube] extract http formats( closes #9253 )
2016-04-22 11:26:43 +01:00
remitamine
7c36ea7d54
[rtbf] improve extraction( fixes #9267 )
2016-04-21 22:52:49 +01:00
remitamine
9260cf1d97
[tubitv] fix extraction( closes #8741 )
2016-04-21 20:30:19 +01:00
Sergey M․
bdbb8530c7
[vimeo] Pass Referer for check-password request
2016-04-22 00:02:39 +06:00
Sergey M․
09a9fadb84
[dump] Remove extractor
2016-04-21 23:31:34 +06:00
Sergey M․
bf09af3acb
Add --hls-prefer-ffmpeg
2016-04-21 23:02:17 +06:00
Sergey M․
88296ac326
[planetaplay] Remove remainings of extractor
2016-04-21 22:57:38 +06:00
Sergey M․
870d525848
[options] Remove experimental mark for --hls-prefer-native
2016-04-21 22:44:01 +06:00
Sergey M․
6577112890
[planetaplay] Remove extractor ( Closes #9256 )
2016-04-21 22:33:54 +06:00
Sergey M․
1988647dda
[tvigle] Skip hls completely ( #9259 )
2016-04-21 22:15:20 +06:00
Yen Chi Hsuan
a292cba256
[mgtv] Fix _VALID_URL and add localized name
2016-04-22 00:07:43 +08:00
Yen Chi Hsuan
982e518a96
[dispeak] Rename DigitalSpeaking to DigitallySpeaking
2016-04-22 00:07:43 +08:00
Yen Chi Hsuan
748e730099
[dispeak] Several fixes
2016-04-22 00:07:43 +08:00
Sergey M
b6c0d4f431
Merge pull request #9110 from remitamine/parse_duration
...
[utils] imporove parse_duration to handle more formats
2016-04-21 22:53:16 +07:00
remitamine
acaff49575
[utils] imporove parse_duration to handle more formats
2016-04-21 16:34:54 +01:00
Yen Chi Hsuan
1da19488f9
[mgtv] Add new extractor ( closes #9212 )
2016-04-21 23:29:51 +08:00
Yen Chi Hsuan
442c4d361f
[dispeak/gdcvault] Add the test case from #5784
2016-04-21 19:47:10 +08:00
Yen Chi Hsuan
ec59d657e7
[dispeak] Add new extractor
...
Both GDCVault and GPUTechConf uses the service of DigitalSpeaking.
2016-04-21 19:36:33 +08:00
Yen Chi Hsuan
99ef96f84c
[gdcvault] Fix for videos with hard-coded hostnames
...
Fixes #9248
2016-04-21 18:07:03 +08:00
Yen Chi Hsuan
4dccea8ad0
[streetvoice] Fix extraction
...
The old API results in URLs with HTTP 403 from time to time.
Hopefully fixes #9219 .
2016-04-21 13:07:53 +08:00
Yen Chi Hsuan
2c0d9c6217
[extractor/common] Allow empty post data
2016-04-21 13:06:06 +08:00
Sergey M․
12a5134596
[tvigle] Fix extraction ( Closes #9259 )
2016-04-20 23:52:41 +06:00
Sergey M․
16e633a5d7
[quickvid] Remove extractor ( Closes #9258 )
2016-04-20 23:29:02 +06:00
Sergey M․
494ab6db73
[youtube] Capture and output login error message
2016-04-20 22:14:32 +06:00
Sergey M․
107701fcfc
[people] Remove bogus comment
2016-04-20 03:40:02 +06:00
Sergey M․
f77970765a
[people] Add extractor
2016-04-20 03:37:23 +06:00
Philipp Hagemeister
81215d5652
release 2016.04.19
2016-04-19 03:03:52 +02:00
Sergey M․
241a318f27
[vimeo] Improve _VALID_URL ( Closes #9229 )
2016-04-18 21:40:28 +06:00
Sergey M․
4fdf082375
[theonion] Remove extractor ( Closes #9220 )
...
It now uses generic onionstudios embed
2016-04-17 23:12:23 +06:00
Jaime Marquínez Ferrándiz
1b6182d8f7
[youtube:playlist] Fetch all the videos in a mix ( fixes #3837 )
...
Since there doesn't seem to be any indication, it stops when there aren't new videos in the webpage.
2016-04-17 17:07:57 +02:00
remitamine
7bab22a402
[vice] remove unused import and variable
2016-04-17 14:06:19 +01:00
Yen Chi Hsuan
0f97fb4d00
[musicplayon] Relax _VALID_URL and improve metadata extraction
...
In r'pl=\d+&play=\d+' pages, several metadata items are missing
Closes #9222 .
2016-04-17 17:24:33 +08:00
Yen Chi Hsuan
b1cf58f48f
[musicplayon] Fix extraction ( closes #9222 )
2016-04-17 15:08:51 +08:00
remitamine
3014b0ae83
Merge pull request #9195 from remitamine/ffmpeg-pipe
...
[downloader/external] enable piping for FFmpegFD(closes #2124 )
2016-04-16 22:00:49 +01:00
remitamine
b9f2fdd37f
[ffmpeg] Clarify rationale for pipe(-) exclusion in _ffmpeg_filename_argument
2016-04-16 21:50:13 +01:00
remitamine
bbb3f730bb
[onionstudios] extract m3u8 formats
2016-04-16 20:53:13 +01:00
remitamine
d868f43c58
[ffmpeg] check for - file name in _ffmpeg_filename_argument
2016-04-16 19:45:56 +01:00
Yen Chi Hsuan
21525bb8ca
[kuwo:category] Update the test
...
Now the webpage says there are 24 songs.
2016-04-17 02:38:05 +08:00
Sergey M․
d8f103159f
[nerdist] Remove extractor
...
It now uses brightcove
2016-04-17 00:16:31 +06:00
remitamine
663ee5f0a9
[vice] extract youtube embed
2016-04-16 17:49:39 +01:00
Sergey M․
b6b950bf58
[cbs] Remove unused import
2016-04-16 22:47:10 +06:00
Sergey M․
11e60fcad8
[extractor/generic] Improve instagram embeds ( Closes #9213 )
2016-04-16 22:39:20 +06:00
Sergey M․
c23533a100
[instagram] Add support for iframe embeds
2016-04-16 22:31:05 +06:00
Sergey M․
0dafea02e6
[instagram] Add support for embed URLs
2016-04-16 22:23:08 +06:00
Sergey M․
5d6360c3b7
[mooshare] Remove extractor
2016-04-16 21:31:50 +06:00
Yen Chi Hsuan
5e5c30c3fd
[mdr] Fix extraction and update tests
...
It's strange that the date is changed. Anyway, new data matches what the
webpage says.
2016-04-16 21:57:28 +08:00
Yen Chi Hsuan
9154c87fc4
[huffpost] Fix a typo
2016-04-16 21:41:22 +08:00
Yen Chi Hsuan
ef0e4e7bc0
[generic] Fix test_Generic_2
...
Now a HEAD request returns 400 Bad Request
2016-04-16 19:44:45 +08:00
Yen Chi Hsuan
67d46a3f90
[ustream] Fix /embed/ URLs and add a test
2016-04-16 19:39:25 +08:00
Yen Chi Hsuan
bec47a0748
[tudou] Improve error detection ( closes #9175 )
2016-04-16 19:11:25 +08:00
Yen Chi Hsuan
36b7d9dbfa
[twitter] Don't check /cards/ URLs
...
Fixes #9181
In this tweet, there are two cards:
1. https://twitter.com/i/cards/tfw/v1/719944006306701313
This shows #TeamCap vs. #TeamIronMan
2. https://twitter.com/i/videos/tweet/719944021058060289
This is the real video and can be handled by TwitterCardIE
In all current test_Twitter* tests, /videos/tweet/ approach works fine.
2016-04-16 18:57:50 +08:00
Yen Chi Hsuan
8c65e4a527
[bbc] Fix a test
2016-04-16 18:00:19 +08:00
Yen Chi Hsuan
6ad2ef8b7c
[audiomack] Update the test
...
The original test raises 404
2016-04-16 17:54:39 +08:00
Yen Chi Hsuan
00b426d66d
[varzesh3] Add md5 to the test
2016-04-16 17:41:56 +08:00
Yen Chi Hsuan
0de968b584
[newgrounds] Support videos ( closes #9138 )
2016-04-16 17:41:56 +08:00
remitamine
0841d5013c
[cbs] do not catch Exceptions raised by by _extract_theplatform_smil
2016-04-16 10:25:59 +01:00
remitamine
a71fca8577
[theplatform] remove _sort_formats from _extract_theplatform_smil
2016-04-16 10:23:56 +01:00
Yen Chi Hsuan
ee94e7e66d
[varzesh3] Fix metadata extraction ( closes #9197 )
2016-04-16 17:13:22 +08:00
Yen Chi Hsuan
759e37c9e6
[gazeta] Relax _VALID_URL and update tests
...
Closes #9196
2016-04-16 16:48:47 +08:00
Yen Chi Hsuan
ae65567102
[eagleplatform] Fix error handling
2016-04-16 16:47:16 +08:00
Yen Chi Hsuan
c394b4f4cb
[puls4] Fix error detection ( #9194 )
2016-04-16 16:22:44 +08:00
Yen Chi Hsuan
260c7036ba
[sportbox] Fix SportBoxEmbedIE
...
Also fixes test_Generic_29 (http://www.vestifinance.ru/articles/25753 )
2016-04-16 16:13:14 +08:00
remitamine
f74197a074
[cbs] extract rtmp formats
2016-04-15 22:38:37 +01:00
remitamine
f3a58d46bf
[youtube:user] check if the url didn't match only the other youtube extractors
2016-04-15 19:06:13 +01:00
Sergey M․
b6612c9b11
[karaoketv] Fix extraction
2016-04-15 21:26:54 +06:00
Yen Chi Hsuan
7e176effb2
[iqiyi] Also suuport pps.tv URLs
...
PPS is acquired by Baidu and merged with iQiyi in 2013 [1]. Now they
have the same page layouts.
[1] http://www.chinanews.com/it/2013/05-07/4792526.shtml
2016-04-15 22:39:18 +08:00
Yen Chi Hsuan
4a252cc2d2
[karaoketv] Update and mark as not _WORKING
2016-04-15 21:49:17 +08:00
Yen Chi Hsuan
f0ec61b525
[huffpost] Fix extraction
2016-04-15 20:55:56 +08:00
Yen Chi Hsuan
66d40ae3a5
Merge pull request #9041 from kasper93/master
...
[generic] Add support for LiveLeak embeds
2016-04-15 17:23:55 +08:00
Yen Chi Hsuan
e6da9240d4
[mixcloud:stream] Add new extractor
...
Closes #7633
2016-04-15 17:14:17 +08:00
Yen Chi Hsuan
dd91dfcd67
[mixcloud] Fix extraction by decrypting play info
...
Fixes #7521
2016-04-15 15:48:22 +08:00
Yen Chi Hsuan
c773082692
Merge branch 'Phaeilo-mixcloud'
2016-04-15 14:33:04 +08:00
Yen Chi Hsuan
9c250931f5
[mixcloud] Improve and simplify mixcloud:user and mixcloud:playlist
2016-04-15 14:32:02 +08:00
Yen Chi Hsuan
56f1750049
[tdslifeway] Use the new Brightcove API
...
Thanks for @remitamine's suggestion.
2016-04-15 04:28:54 +08:00
Yen Chi Hsuan
f2159c9815
[wayofthemaster] Remove extractor
...
Now it's using YouTube embeds.
2016-04-15 04:02:23 +08:00
Yen Chi Hsuan
b0cf2e7c1b
[ubu] Remove extractor
...
1. Videos on ubu.com are now hosted on Vimeo
2. The duration is far from correct, and may not exist on other videos
(For example http://ubu.com/film/hammons_king.html )
2016-04-15 03:48:23 +08:00
Yen Chi Hsuan
74b47d00c3
[xboxclips] Use http:// URL
...
xboxclips has misconfigured certificates
2016-04-15 03:30:38 +08:00
Yen Chi Hsuan
8cb57bab8e
[ministrygrid] Fix extraction and modernize
2016-04-15 02:48:12 +08:00
Yen Chi Hsuan
e1bf277e19
[tdslifeway] Add TDSLifewayIE
...
Used by MinistryGridIE
2016-04-15 02:48:12 +08:00
remitamine
ce599d5a7e
[downloader/external] enable piping for FFmpegFD( closes #2124 )
2016-04-14 18:49:02 +01:00
Sergey M․
9e28538726
[arte:creative] Improve _VALID_URL
2016-04-14 21:54:41 +06:00
Sergey M․
404284132c
[arte:info] Add extractor ( Closes #9182 )
2016-04-14 21:52:05 +06:00
remitamine
5565be9dd9
[aol] relex _VALID_URL regex
2016-04-14 08:47:55 +01:00
Yen Chi Hsuan
b3a9474ad1
Merge branch 'mixcloud' of https://github.com/Phaeilo/youtube-dl into Phaeilo-mixcloud
2016-04-14 15:31:58 +08:00
Yen Chi Hsuan
86475d59b1
[metacritic] Add a new valid test case
2016-04-14 15:12:59 +08:00
Yen Chi Hsuan
73d93f948e
[lecture2go] Fix extraction
...
RTSP stream fails to download. Seems it's a mpv bug as direct playback
works well:
$ mpv --ytdl-format rtsp https://lecture2go.uni-hamburg.de/veranstaltungen/-/v/17473
2016-04-14 15:08:01 +08:00
Yen Chi Hsuan
f5d8743e0a
[downloader/rtsp] Print the command
2016-04-14 15:07:31 +08:00
Yen Chi Hsuan
d1c4e4ba15
[laola1tv] Improve error detection and skip an invalid test
2016-04-14 14:11:28 +08:00
Yen Chi Hsuan
f141fefab7
[karrierevideos] Fix extraction
...
The server serves malformed header "Content Type: text/xml" for the XML
request (it should be Content-Type but not Content Type). Python 3.x,
which uses email.feedparser rejects such headers. As a result,
Content-Encoding header is not parsed, so the returned content is kept
not decompressed, and thus XML parsing error.
2016-04-14 14:06:05 +08:00
aystroganov@gmail.com
8334637f4a
Make tbr field 'int' rather than 'tuple'
...
Closes #9180 .
2016-04-13 14:29:34 +02:00
Philipp Hagemeister
b0ba11cc64
release 2016.04.13
2016-04-13 08:02:03 +02:00
Kacper Michajłow
b8f67449ec
[generic] Add support for LiveLeak embeds
2016-04-13 01:54:19 +02:00
Yen Chi Hsuan
75af5d59ae
[netease] Skip all tests: completely georestricted
2016-04-13 04:52:07 +08:00
Philip Huppert
6d67169509
[mixcloud] improved extraction of user description
2016-04-12 21:18:13 +02:00
Philip Huppert
dcaf00fb3e
[mixcloud] support older urllib versions
2016-04-12 21:18:13 +02:00
Philip Huppert
f896e1ccef
[mixcloud] fixed some tests
2016-04-12 21:18:13 +02:00
Philip Huppert
c96eca426b
[mixcloud] Added support for user uploads, playlists, favorites and listens.
...
Fixes #3750 and #5272
2016-04-12 21:18:13 +02:00
Sergey M․
466a614537
[youtube:playlist] Recognize popular uploads playlist as mix ( Closes #9170 )
2016-04-12 21:38:31 +06:00
Sergey M․
ffa2cecf72
[ard] Change subtitles extension to ttml ( Closes #9169 )
...
ttml is now served instead of srt
2016-04-12 21:20:31 +06:00
Yen Chi Hsuan
a837416025
[jadorecettepub] Remove extractor: website gone
2016-04-12 18:30:53 +08:00
Yen Chi Hsuan
c9d448876f
[izlesene] Fix extraction
...
description may be absent
2016-04-12 18:29:28 +08:00
Yen Chi Hsuan
8865b8abfd
[howstuffworks] Skip a broken test case
2016-04-12 17:30:14 +08:00
Yen Chi Hsuan
c77a0c01cb
[groupon] Fix extraction
2016-04-12 17:26:09 +08:00
Yen Chi Hsuan
12355ac473
[goshgay] Fix extraction
...
isFamilyFriendly no longer exists in the webpage and I can't find
another indicator.
2016-04-12 17:23:00 +08:00
Sergey M․
49f523ca50
[mixcloud] Capture error message ( #9156 )
2016-04-11 20:45:58 +06:00
remitamine
4a903b93a9
Revert "[openclassroom] Add new extractor( closes #9147 )"
...
This reverts commit 13267a2be3
2016-04-11 14:44:35 +01:00
remitamine
13267a2be3
[openclassroom] Add new extractor( closes #9147 )
2016-04-11 14:24:08 +01:00
Yen Chi Hsuan
134c207e3f
[arte.tv:embed] Extended support ( #2620 )
2016-04-11 19:32:27 +08:00
Yen Chi Hsuan
0f56bd2178
Merge branch 'Phaeilo-presstv'
2016-04-11 16:17:05 +08:00
Yen Chi Hsuan
dfbc7f7f3f
[presstv] Improve and simplify
2016-04-11 16:14:07 +08:00
Yen Chi Hsuan
7d58ea7c5b
Merge branch 'presstv' of https://github.com/Phaeilo/youtube-dl into Phaeilo-presstv
2016-04-11 15:48:10 +08:00
Sergey M․
452908b257
[telebruxelles] Fix extraction ( Closes #9142 )
2016-04-11 00:06:05 +06:00
Sergey M․
5899e988d5
[glide] Improve extraction and extract upload info
2016-04-10 23:56:23 +06:00
Sergey M․
4a121d29bb
[glide] Fix extraction ( Closes #9141 )
2016-04-10 23:45:17 +06:00
Sergey M․
7ebc36900d
[jwplatform:base] Improve subtitles extraction
2016-04-10 22:55:07 +06:00
Sergey M․
d7eb052fa2
[screencastomatic] Add duration to test
2016-04-10 22:48:04 +06:00
Sergey M․
a6d6722c8f
[jwplatform:base] Extract duration
2016-04-10 22:47:38 +06:00
Sergey M․
66fa495868
[screencastomatic] Fix extraction ( Closes #9136 )
2016-04-10 22:37:14 +06:00
Sergey M․
443285aabe
[ebaumsworlds] Update _VALID_URL ( Closes #9135 )
2016-04-10 22:15:11 +06:00
Philip Huppert
de728757ad
[presstv] Refactored extractor.
2016-04-10 16:36:44 +02:00
Sergey M․
f44c276842
[extractor/extractors] Remove non-existant imports
2016-04-10 19:21:58 +06:00
Sergey M․
a1fa60a934
[cliprs] Add extractor ( Closes #9099 )
2016-04-10 18:43:40 +06:00
Sergey M․
49caf3307f
[extractor/common] Remove irrelevant comment
2016-04-10 17:10:27 +06:00
Sergey M․
61dd350a04
[1tv] Fix extraction ( Closes #9103 )
2016-04-10 03:02:35 +06:00
Philip Huppert
95153a960d
[presstv] updated extractor and tests to work with current PressTV website
2016-04-09 16:14:05 +02:00
Yen Chi Hsuan
c991106706
[videodetective] Adapt to InternetVideoArchiveIE
2016-04-09 21:47:35 +08:00
Yen Chi Hsuan
dae2a058de
[rottentomatoes] Adapt to InternetVideoArchiveIE
2016-04-09 21:47:12 +08:00
Yen Chi Hsuan
c05025fdd7
[internetvideoarchive] Fix extraction and support json URLs
2016-04-09 21:46:51 +08:00
Philip Huppert
bfe96d7bea
[presstv] Added extractor PressTV.
...
Fixes #7060
2016-04-09 14:55:54 +02:00
Yen Chi Hsuan
ab481b48e5
[funnyordie] Relax M3U8 URL matching
...
Also, m3u8_url extraction should be fatal as all formats depends
directly or indirectly on it.
This change fixes test_Generic_26 and TestFunnyOrDieSubtitles
2016-04-09 20:17:35 +08:00
Sergey M․
92c7f3157a
[aol] Add coding cookie
2016-04-09 17:32:23 +06:00
Yen Chi Hsuan
cacd996662
[utils] Don't touch URLs if not necessary
...
Fix test_Generic_15 (Google redirect)
2016-04-09 19:27:54 +08:00
remitamine
bffb245a48
[aol] add support for videos with vidible IDs( closes #9124 )
2016-04-09 10:51:23 +01:00
Jaime Marquínez Ferrándiz
e0986e31cf
lazy extractors: Output if it's enabled in the verbose log
2016-04-08 21:50:54 +02:00
Jaime Marquínez Ferrándiz
779822d945
Add experimental support for lazy loading the info extractors
...
'make lazy-extractors' creates the youtube_dl/extractor/lazy_extractors.py (imported by youtube_dl/extractor/__init__.py), which contains simplified classes that only have the 'suitable' class method and that load the appropiate class with the '__new__' method when a instance is created.
2016-04-08 21:50:07 +02:00
Jaime Marquínez Ferrándiz
1b3d5e05a8
Move the extreactors import to youtube_dl/extractor/extractors.py
2016-04-08 21:47:51 +02:00
Jaime Marquínez Ferrándiz
e52d7f85f2
Delay initialization of InfoExtractors until they are needed
2016-04-08 21:43:24 +02:00
Sergey M․
568d2f78d6
[tnaflix] Fix metadata extraction
2016-04-09 00:27:24 +06:00
Sergey M․
2f2fcf1a33
[tnaflix] Fix extraction ( Closes #9074 )
2016-04-08 23:34:59 +06:00
Sergey M․
bacec0397f
[extractor/common] Relax _hidden_inputs
2016-04-08 23:33:45 +06:00
Sergey M․
3c6c7e7d7e
[gdcvault] Fix extraction ( Closes #9107 , closes #9114 )
2016-04-08 23:16:02 +06:00
Sergey M․
fb38aa8b53
[extractor/common] Support arbitrary format strings for template based identifiers in mpd manifests ( Closes #9119 , closes #9120 )
2016-04-08 22:48:08 +06:00
Sergey M․
18da24634c
[democracynow] Improve extraction
2016-04-08 22:27:27 +06:00
Sergey M․
a134426d61
[democracynow] Fix tests
2016-04-08 22:21:14 +06:00
Sergey M․
a64c0c9b06
[democracynow] Make description optional ( Closes #9115 )
2016-04-08 22:15:36 +06:00
Sergey M․
56019444cb
[novamov] Improve _VALID_URL template ( Closes #9116 )
2016-04-08 21:26:42 +06:00
remitamine
a1ff3cd5f9
[acast] fix channel extraction( closes #9117 )
2016-04-08 15:15:34 +01:00
remitamine
9a32e80477
[acast] fix extraction( #9117 )
2016-04-08 14:51:00 +01:00
Sergey M․
536a55dabd
[YoutubeDL] Sanitize single thumbnail URL
2016-04-08 00:17:47 +06:00
Sergey M․
ed6fb8b804
[vrt] Add support for direct hls playlists and YouTube ( Closes #9108 )
2016-04-07 23:22:43 +06:00
Sergey M․
3afef2e3fc
[beeg] Improve extraction
2016-04-07 22:40:35 +06:00
Sergey M․
e90d175436
[yandexmusic] Extract music album metafields ( Closes #7354 )
2016-04-07 02:56:13 +06:00
Sergey M․
7a93ab5f3f
[extractor/common] Introduce music album metafields
2016-04-07 02:53:53 +06:00
Philipp Hagemeister
c41cf65d4a
release 2016.04.06
2016-04-06 15:13:08 +02:00
Yen Chi Hsuan
92d5477d84
[compat] Handle tuples properly in urlencode()
...
Fixes #9055
2016-04-06 18:29:54 +08:00
Yen Chi Hsuan
8790249c68
[iqiyi] Improve error detection for VIP-only videos
...
Closes #9071
2016-04-06 16:12:16 +08:00
Philipp Hagemeister
416930d450
release 2016.04.05
2016-04-05 18:36:24 +02:00
Sergey M․
65150b41bb
[deezer] Fix extraction ( Closes #9086 )
2016-04-05 22:27:33 +06:00
Sergey M․
e42f413716
[rte] Improve thumbnail extraction ( Closes #9085 )
2016-04-05 22:23:20 +06:00
Sergey M․
40a056d85d
[extractor/__init__] Remove novamov extractor and sort novamov based extractors alphabetically
2016-04-05 21:54:09 +06:00
Sergey M․
e7d77efb9d
[auroravid] Add extractor ( Closes #9070 )
2016-04-05 21:52:07 +06:00
Sergey M․
995cf05c96
[novamov] Make title fatal
2016-04-05 21:40:43 +06:00
Jaime Marquínez Ferrándiz
5bf28d7864
[utils] dfxp2srt: add additional namespace
...
Used by the ZDF subtitles (#9081 ).
2016-04-04 20:46:35 +02:00
Jaime Marquínez Ferrándiz
8c7d6e8e22
[zdf] Extract subtitles ( closes #9081 )
2016-04-04 20:44:06 +02:00
Sergey M․
6d4fc66bfc
[youtube] Add support for zwearz ( Closes #9062 )
2016-04-04 02:26:20 +06:00
remitamine
23576edbfc
[brightcove:legacy] skip None value for uploader_id
2016-04-02 21:31:21 +01:00
remitamine
4d4cd35f48
[brightcove:legacy] extract uploader_id as a string
2016-04-02 20:55:44 +01:00
remitamine
3aac9b2fb1
[nowness] update tests
2016-04-02 18:57:15 +01:00
remitamine
e47d19e991
[brightcove:new] extract subtitles and strip video title
2016-04-02 18:57:15 +01:00
remitamine
41f5492fbc
[brightcove:legacy] improve format extraction and extract uploader_id, duration and timestamp
2016-04-02 18:57:15 +01:00
Jaime Marquínez Ferrándiz
2defa7d75a
[instagram:user] Fix extraction ( fixes #9059 )
...
The URL for the next page was incorrect and we always got the same page, therefore it got trapped in an infinite loop.
2016-04-02 18:03:56 +02:00
Sergey M․
bbc26c8a01
[bbc] Set vcodec to none for audio formats
2016-04-02 19:00:38 +06:00
Sergey M․
b507cc925b
[extractor/common] Carry long line
2016-04-02 18:49:58 +06:00
Sergey M․
db8ee7ec05
[extractor/common] Fix numeric identifiers conversion in DASH URL templates
2016-04-02 18:48:05 +06:00
remitamine
08136dc138
[brightcove] fix format sorting
2016-04-02 10:57:57 +01:00
remitamine
fe7ef95e91
[cbsinteractive] Add support for ZDNet videos
2016-04-01 23:53:32 +01:00
remitamine
5f705baf5e
[cnet] extract more formats
2016-04-01 20:42:15 +01:00
remitamine
0750b2491f
[ffmpeg] try to convert tt subtitles usng dfxp2srt
2016-04-01 19:47:49 +01:00
remitamine
df634be2ed
[common] prefer using mime type over ext for smil subtitle extraction
...
the subtitle ext for http://www.cnet.com/videos/download-amazon-prime-movies-and-tv/
is adb_xml while using the mime type it get tt(application/smptett+xml)
2016-04-01 19:47:49 +01:00
Jaime Marquínez Ferrándiz
6d628fafca
[camwithher] Remove extra blank line
2016-04-01 20:45:21 +02:00
Jaime Marquínez Ferrándiz
0f28777f58
[cbsnews] Remove unused import
2016-04-01 20:43:14 +02:00
Jaime Marquínez Ferrándiz
329c1eae54
[aenetworks] Make pep8 happy
2016-04-01 20:42:19 +02:00
Sergey M․
9aaaf8e8e8
[camwithher] Improve extraction ( Closes #8989 )
2016-04-01 23:47:27 +06:00
theGeekPirate
04819db58e
[camwithher] Add extractor
...
Corrected unnecessary test
Sane variable naming
RTMP all .flv & url_id for _download_webpage()
Corrected all outstanding issues, next up is a squash!
2016-04-01 23:44:25 +06:00
remitamine
79ba9140dc
[theplatform] extract timestamp and uploader
2016-04-01 18:07:17 +01:00
Sergey M․
75d572e9fb
[screencast] Improve title regexes ( Closes #9025 )
2016-04-01 23:01:55 +06:00
Martin Trigaux
791d6aaecc
screencast.com: fallback on page title
...
When determining the title of the page, use the <title> tag of the page
2016-04-01 23:00:52 +06:00
Sergey M․
81de73e5b4
[screencast] Add test
2016-04-01 23:00:45 +06:00
Martin Trigaux
83cedc1cf2
screencast.com: support missing www
...
The "www." part of the URL is not mandatory
2016-04-01 22:58:16 +06:00
Sergey M․
244cd04237
[pluralsight] Remove unnecessary login/password encode
2016-04-01 22:46:46 +06:00
Sergey M․
fbdaced256
[lynda] Remove unnecessary login/password encode
2016-04-01 22:45:20 +06:00
Sergey M․
a3373823e1
[udemy] Remove unnecessary login/password encode
...
This is now covered by compat_urllib_parse_urlencode
2016-04-01 22:42:09 +06:00
Sergey M․
03caa463e7
[udemy:course] Skip non-video lectures
2016-04-01 22:38:56 +06:00
remitamine
3f64379eda
[movieclips] fix extraction
2016-04-01 16:22:06 +01:00
remitamine
3e0c3d14d9
[cbs] add base extractor
2016-04-01 10:12:29 +01:00
remitamine
d8873d4def
[aenetworks] improve format extraction
2016-04-01 09:58:02 +01:00
remitamine
db1c969da5
[theplatform] sign https urls
2016-04-01 09:58:02 +01:00
Philipp Hagemeister
1e02bc7ba2
release 2016.04.01
2016-04-01 09:07:40 +02:00
remitamine
63c55e9f22
[cbs] improve extraction( closes #6321 )
2016-04-01 07:33:37 +01:00
remitamine
f9b1529af8
[generic] remove sbnation test(handled by VoxMediaIE)
2016-03-31 23:50:45 +01:00
remitamine
961fc024d2
[voxmedia] improve sbnation support
2016-03-31 23:33:36 +01:00
Sergey M․
b53a06e3b9
[udemy:course] Use new URL format
2016-04-01 02:24:22 +06:00
remitamine
4ecc1fc638
[howstuffworks] improve extraction
2016-03-31 21:11:58 +01:00
Yen Chi Hsuan
5b012dfce8
[tudou] Improve error handling ( closes #8988 )
2016-04-01 01:42:16 +08:00
remitamine
8369942773
[voxmedia] Add new extractor( closes #3182 )
2016-03-31 18:36:41 +01:00
Sergey M․
86f3b66cec
[udemy] Remove unused import
2016-03-31 23:00:11 +06:00
Sergey M․
6bb4600717
[udemy:course] Simplify course curriculum downloading
2016-03-31 22:59:19 +06:00
Sergey M․
41d06b0424
[extractor/common] Improve _request_webpage
...
* Do not ignore data, headers and query for Requests
* Default values for headers and query switched to dicts since these are used by urllib itself
2016-03-31 22:58:38 +06:00
Sergey M․
15d260ebaa
[utils] Use update_Request in http_request
2016-03-31 22:55:49 +06:00
Sergey M․
ed0291d153
[utils] Add update_Request
2016-03-31 22:55:01 +06:00
Sergey M․
81da8cbc45
[udemy] Switch to api 2.0 ( Closes #9035 )
2016-03-31 22:05:25 +06:00
Sergey M․
5299bc3f91
[beeg] Switch to api v6 ( Closes #9036 )
2016-03-31 20:42:41 +06:00
remitamine
c9c39c22c5
[nationalgeographic] add support for channel.nationalgeographic.com urls
2016-03-31 13:47:38 +01:00
remitamine
d84b48e3f1
[nationalgeographic] improve extraction
2016-03-31 13:44:55 +01:00
remitamine
dd17041c82
[tenplay] remove extractor( fixes #6927 )
2016-03-31 12:02:04 +01:00
remitamine
fea7295b14
[brightcove] relax embed_in_page regex
2016-03-31 10:48:22 +01:00
remitamine
9cf01f7f30
[nbc] add new extractor for csnne.com( #5432 )
2016-03-31 00:26:42 +01:00
remitamine
ce548296fe
[cnbc] fix test
2016-03-31 00:25:11 +01:00
remitamine
c02ec7d430
[cnbc] Add new extractor( closes #8012 )
2016-03-30 23:18:31 +01:00
remitamine
6b820a2376
[myspace] improve extraction
2016-03-30 21:18:07 +01:00
Yen Chi Hsuan
e621a344e6
[kwuo] Port to new API and enable --cn-verification-proxy
2016-03-31 02:27:52 +08:00
Yen Chi Hsuan
3ae6f8fec1
[kwuo] Remove _sort_formats() from KuwoBaseIE._get_formats()
...
Following the idea proposed in 19dbaeece3
2016-03-31 02:11:21 +08:00
Yen Chi Hsuan
597d52fadb
[kuwo:song] Correct song ID extraction ( fixes #9033 )
...
Bug introduced in daef04a4e7
2016-03-31 02:00:50 +08:00
Sergey M․
afca767d19
[tumblr] Improve _VALID_URL ( Closes #9027 )
2016-03-30 22:26:43 +06:00
remitamine
6e359a1534
[comcarcoff] don not depend on crackle extractor( closes #8995 )
...
previously extraction has been delegated to crackle to extract more info
and subtitles #6106 but some of the episodes can't be extracted using
crackle #8995 .
2016-03-30 12:27:00 +01:00
Sergey M․
33f3040a3e
[YoutubeDL] Fix sanitizing subtitles' url
2016-03-28 03:13:39 +06:00
Sergey M․
03442072c0
[pornhub] Fix typo ( Closes #9008 )
2016-03-28 01:21:44 +06:00
Sergey M․
c8b13fec02
[foxnews] Restore upload time fields in test
2016-03-28 01:14:12 +06:00
Sergey M․
87d105ac6c
[amp] Fix upload timestamp extraction ( Closes #9007 )
2016-03-28 01:13:47 +06:00
Sergey M․
3454139576
[pornhub:uservideos] Add support for multipage videos ( Closes #9006 )
2016-03-28 00:50:46 +06:00
Sergey M․
3a23bae9cc
[pornhub:playlistbase] Do not include videos not from playlist
2016-03-28 00:32:57 +06:00
Sergey M․
8f9a477e7f
[pornhub:playlistbase] Use orderedSet
2016-03-28 00:21:08 +06:00
Sergey M․
a1cf3e38a3
[bbc] Extend vpid regex ( Closes #9003 )
2016-03-27 23:22:51 +06:00
Philipp Hagemeister
a122e7080b
release 2016.03.27
2016-03-27 16:56:33 +02:00
Sergey M․
b22ca76204
[extractor/common] Filter out unsupported encrypted media for f4m formats ( Closes #8573 )
2016-03-27 07:42:38 +06:00
Sergey M․
f7df343b4a
[downloader/f4m] Extract routine for removing unsupported encrypted media
2016-03-27 07:41:19 +06:00
Sergey M․
19dbaeece3
Remove _sort_formats from _extract_*_formats methods
...
Now _sort_formats should be called explicitly.
_sort_formats has been added to all the necessary places in code.
Closes #8051
2016-03-27 07:03:08 +06:00
Yen Chi Hsuan
395fd4b08a
[twitter] Handle another form of embedded Vine
...
Fixes #8996
2016-03-27 04:36:02 +08:00
Sergey M․
8018028d0f
[pluralsight] Extract chapter metadata ( Closes #8993 )
2016-03-27 02:10:52 +06:00
Sergey M․
00322ad4fd
[lynda] Extract chapter metadata ( #8993 )
2016-03-27 02:00:36 +06:00
Sergey M․
4cf3489c6e
[vevo] Update videoservice API URL ( Closes #8900 )
2016-03-27 01:11:11 +06:00
Sergey M․
b24ab3e341
[udemy] Improve paid course detection
2016-03-27 00:09:12 +06:00
Sergey M․
af4116f4f0
[udemy] Improve format_id
2016-03-27 00:02:52 +06:00
Sergey M․
f973e5d54e
[udemy] Drop outputs' formats
...
Always results in 403
2016-03-26 23:55:07 +06:00
Sergey M․
62f55aa68a
[udemy] Add outputs metadata to view_html formats
2016-03-26 23:54:12 +06:00
Sergey M․
02d7634d24
[udemy] Fix outputs' formats format_id
2016-03-26 23:43:25 +06:00
Sergey M․
48dce58ca9
[udemy] Use custom sorting
2016-03-26 23:42:46 +06:00
Sergey M․
efcba804f6
[udemy] Extract formats from view_html ( Closes #8979 )
2016-03-26 23:42:34 +06:00
Sergey M․
6dee688e6d
[youtube:playlistsbase] Restrict playlist regex ( Closes #8986 )
2016-03-26 20:42:18 +06:00
Sergey M․
eedb7ba536
[YoutubeDL] Sort imports
2016-03-26 19:40:33 +06:00
Sergey M․
dcf77cf1a7
[YoutubeDL] Sanitize final URLs ( Closes #8991 )
2016-03-26 19:37:41 +06:00
Sergey M․
17bcc626bf
[utils] Extract sanitize_url routine
2016-03-26 19:33:57 +06:00
Sergey M․
b5a5bbf376
[mailru] Extend _VALID_URL ( Closes #8990 )
2016-03-26 19:15:32 +06:00
Yen Chi Hsuan
e68d3a010f
[twitter] Fix extraction ( closes #8966 )
...
HLS and DASH formats are no longer appeared in test cases. I keep them
for fear of triggering new errors.
2016-03-26 18:34:51 +08:00
Yen Chi Hsuan
d10fe8358c
[generic] Add a test case for brightcove embed
...
Closes #8862
2016-03-26 18:30:43 +08:00
Yen Chi Hsuan
d6c340cae5
[brightcove] Extract more formats ( #8862 )
2016-03-26 18:21:07 +08:00
Yen Chi Hsuan
5964b598ff
[brightcove] Support alternative BrightcoveExperience layout
...
The full URL lays in the `data` attribute of <object> (#8862 )
2016-03-26 17:47:32 +08:00
Philipp Hagemeister
62cdb96f51
release 2016.03.26
2016-03-26 08:58:03 +01:00
Sergey M․
6e6bc8dae5
Use urlencode_postdata across the codebase
2016-03-26 02:19:24 +06:00
Sergey M․
15707c7e02
[compat] Add compat_urllib_parse_urlencode and eliminate encode_dict
...
encode_dict functionality has been improved and moved directly into compat_urllib_parse_urlencode
All occurrences of compat_urllib_parse.urlencode throughout the codebase have been replaced by compat_urllib_parse_urlencode
Closes #8974
2016-03-26 01:46:57 +06:00
Sergey M․
2156f16ca7
[thescene] Fix extraction and improve style ( Closes #8978 )
2016-03-25 20:14:34 +06:00
Sergey M․
4db441de72
[once] Relax _VALID_URL ( Closes #8976 )
2016-03-25 19:51:28 +06:00
Philipp Hagemeister
0be8314dc8
release 2016.03.25
2016-03-25 09:27:18 +01:00
Yen Chi Hsuan
d7f62b049a
[iqiyi] Update enc_key
2016-03-25 15:45:40 +08:00
Yen Chi Hsuan
3bb3356812
[douyutv] Extend _VALID_URL
2016-03-25 15:43:29 +08:00
Sergey M․
98e68806fb
[mnet] Improve ( Closes #8958 )
2016-03-25 03:26:29 +06:00
Kagami Hiiragi
e031768666
[mnet] Add new extractor
2016-03-25 02:32:06 +06:00
