Philipp Hagemeister
d41e6efc85
New debug option --write-pages
2013-10-28 10:44:02 +01:00
Filippo Valsorda
8ffa13e03e
[Instagram] get the non-https link, as they are serving Akamai cert from a instagram.com domain
2013-10-28 02:34:29 -04:00
Filippo Valsorda
750e9833b8
Add the missing age_limit tags; added a devscript to do a superficial check for porn sites without the age_limit tag in the test
2013-10-28 01:50:17 -04:00
Filippo Valsorda
82f0ac657c
Merge pull request #1657 by @rzhxeo
...
[YouPornIE] Extract all encrypted links and remove doubles at the end
2013-10-28 01:45:52 -04:00
Filippo Valsorda
eb6a2277a2
Merge pull request #1659 by @rzhxeo
...
Add support for http://www.tube8.com
2013-10-28 01:38:28 -04:00
Filippo Valsorda
f8778fb0fa
Merge pull request #1663 by @rzhxeo
...
Add support for http://www.spankwire.com
2013-10-28 01:35:11 -04:00
Filippo Valsorda
e2f9de207c
Merge pull request #1664 by @rzhxeo
...
Add support for http://www.keezmovies.com
2013-10-28 01:25:46 -04:00
Filippo Valsorda
a93cc0d943
Merge pull request #1661 by @rzhxeo
...
Add support for http://www.pornhub.com
2013-10-28 00:50:39 -04:00
Filippo Valsorda
7d8c2e07f2
[Exfm] replace the failing Soundcloud test vector (broken also in browser)
2013-10-28 00:33:43 -04:00
Filippo Valsorda
efb4c36b18
Merge pull request #1660 from pyed/master
...
[addanime] try to download HQ before normal
2013-10-27 21:14:19 -07:00
Jaime Marquínez Ferrándiz
29526d0d2b
Merge pull request #1656 from rzhxeo/xhamster
...
[XHamsterIE] Extract SD and HD video
2013-10-27 10:12:59 -07:00
Abdulelah Alfntokh
198e370f23
[addanime] better regex.
2013-10-27 19:48:02 +03:00
Jaime Marquínez Ferrándiz
c19f7764a5
[generic] Detect bandcamp pages that use custom domains ( closes #1662 )
...
They embed the original url in the 'og:url' property.
2013-10-27 14:40:25 +01:00
Jaime Marquínez Ferrándiz
bc63d9d329
[rtlnow] Change the test for rtlnitronow
2013-10-27 14:26:19 +01:00
Jaime Marquínez Ferrándiz
aa929c37d5
[generic] Fix test video's checksum
2013-10-27 14:21:37 +01:00
Jaime Marquínez Ferrándiz
af4d506eb3
[faz] Use a regex for getting the description
...
The page cannot be parsed in python2.6 with the html parser.
2013-10-27 14:18:55 +01:00
rzhxeo
5da0549581
[KeezMoviesIE] Correct return value for embedded videos
2013-10-27 12:48:09 +01:00
Jaime Marquínez Ferrándiz
749a4fd2fd
[facebook] Don't recommend to report the issue if the video is private.
2013-10-27 12:13:55 +01:00
Jaime Marquínez Ferrándiz
6f71ef580c
[facebook] Report a more meaningful message if the video cannot be accessed ( closes #1658 )
2013-10-27 12:09:46 +01:00
Jaime Marquínez Ferrándiz
67874aeffa
[facebook] Fix the login process ( fixes #1244 )
2013-10-27 12:07:58 +01:00
Abdulelah Alfntokh
3e6a330d38
[addanime] fix md5sum
2013-10-27 13:51:26 +03:00
Abdulelah Alfntokh
aee5e18c8f
[addanime] catch 'RegexNotFoundError'
2013-10-27 13:36:43 +03:00
rzhxeo
5b11143d05
Add support for http://www.keezmovies.com
2013-10-27 10:10:28 +01:00
rzhxeo
7b2212e954
Add support for http://www.spankwire.com
2013-10-27 01:59:26 +02:00
rzhxeo
71865091ab
[Tube8IE] Fix regex for uploader extraction
2013-10-27 01:08:03 +02:00
rzhxeo
125cfd78e8
Add support for http://www.pornhub.com
2013-10-27 01:04:22 +02:00
rzhxeo
8cb57d9b91
[Tube8IE] Escape dot in regex
2013-10-27 00:21:27 +02:00
pyed
14e10b2b6e
[addanime] try to download HQ before normal
2013-10-27 01:19:38 +03:00
rzhxeo
6e76104d66
[YouPornIE] Make webpage download more robust
2013-10-26 23:33:32 +02:00
rzhxeo
1d45a23b74
Add support for http://www.tube8.com
2013-10-26 23:27:30 +02:00
rzhxeo
7df286540f
[YouPornIE] Extract all encrypted links and remove doubles at the end
2013-10-26 21:57:10 +02:00
rzhxeo
5d0c97541a
[XHamsterIE] Extract SD and HD video
2013-10-26 20:38:54 +02:00
Philipp Hagemeister
49a25557b0
[8tracks] Use track count instead of looking at at_last_track property
...
This fixes the error:
$ youtube-dl http://8tracks.com/vladmc/counting-stars
[8tracks] counting-stars: Downloading webpage
[8tracks] counting-stars: Downloading song information 1/4
[8tracks] counting-stars: Downloading song information 2/4
[8tracks] counting-stars: Downloading song information 3/4
[8tracks] counting-stars: Downloading song information 4/4
[8tracks] counting-stars: Downloading song information 5/4
Traceback (most recent call last):
File "/usr/lib/python2.7/runpy.py", line 162, in _run_module_as_main
"__main__", fname, loader, pkg_name)
File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
exec code in run_globals
File "/home/phihag/projects/youtube-dl/youtube_dl/__main__.py", line 18, in <module>
youtube_dl.main()
File "/home/phihag/projects/youtube-dl/youtube_dl/__init__.py", line 761, in main
_real_main(argv)
File "/home/phihag/projects/youtube-dl/youtube_dl/__init__.py", line 714, in _real_main
retcode = ydl.download(all_urls)
File "/home/phihag/projects/youtube-dl/youtube_dl/YoutubeDL.py", line 701, in download
videos = self.extract_info(url)
File "/home/phihag/projects/youtube-dl/youtube_dl/YoutubeDL.py", line 342, in extract_info
ie_result = ie.extract(url)
File "/home/phihag/projects/youtube-dl/youtube_dl/extractor/common.py", line 121, in extract
return self._real_extract(url)
File "/home/phihag/projects/youtube-dl/youtube_dl/extractor/eighttracks.py", line 111, in _real_extract
'id': track_data['id'],
KeyError: 'id'
2013-10-25 23:46:19 +02:00
Jaime Marquínez Ferrándiz
600cc1a4f0
[youtube] Set the format_id field to the itag of the format ( closes #1624 )
2013-10-25 17:17:46 +02:00
Jaime Marquínez Ferrándiz
ea32fbacc8
Fix the extensions of two tests with youtube videos
...
The best quality is now a mp4 video.
2013-10-25 16:55:37 +02:00
Jaime Marquínez Ferrándiz
00fe14fc75
[youtube] Also use the 'adaptative_fmts' field from the /get_video_info page ( fixes #1649 )
...
The 'adaptative_fmts' field from the video page is not added to the 'url_encoded_fmt_stream_map'
2013-10-25 16:52:58 +02:00
Jaime Marquínez Ferrándiz
fcc28edb2f
[cinemassacre] Simplify
...
* Remove some rtmp parameters that are not needed.
* Remove the md5 checksums, the video is not downloaded.
* Remove the code used before the current format system.
2013-10-23 20:21:41 +02:00
Jaime Marquínez Ferrándiz
fac6be2dd5
Merge pull request #1632 from rzhxeo/cinemassacre
...
[Cinemassacre] Download video that is shown in flash player
2013-10-23 20:15:39 +02:00
Jaime Marquínez Ferrándiz
cdec0190c4
[dailymotion] Extract all the available formats ( closes #1028 )
2013-10-23 17:33:38 +02:00
Jaime Marquínez Ferrándiz
2450bcb28b
[nowvideo] Fix key extraction
...
Extract it from the embed page
2013-10-23 17:00:33 +02:00
Jaime Marquínez Ferrándiz
93b22c7828
[vimeo] fix the extraction for videos protected with password
...
Added a test video.
2013-10-23 16:31:53 +02:00
Jaime Marquínez Ferrándiz
55b3e45bba
[vimeo] Fix pro videos and player.vimeo.com urls
...
The old process can still be used for those videos.
Added RegexNotFoundError, which is raised by _search_regex if it can't extract the info.
2013-10-23 14:38:03 +02:00
Philipp Hagemeister
365bcf6d97
Merge remote-tracking branch 'origin/master'
2013-10-23 11:40:46 +02:00
Philipp Hagemeister
71907db3ba
[vimeo] Fix normal videos ( Fixes #1642 )
...
Vimeo Pro Videos are still broken
2013-10-23 11:38:53 +02:00
Philipp Hagemeister
6803655ced
Merge pull request #1622 from rbrito/fix-extension
...
extractor: youtube: Set extension of AAC audio formats to m4a.
2013-10-22 15:16:26 -07:00
Jaime Marquínez Ferrándiz
b028e96144
[arte.tv:creative] Update the title of the test
2013-10-22 21:06:06 +02:00
Jaime Marquínez Ferrándiz
ce68b5907c
[nhl:videocenter] Fix playlist title extraction
2013-10-22 21:01:16 +02:00
Joshua Elsasser
a6387bfd3c
[vimeo] Implement the new format selection system (closes PR #996 )
...
Rebased and deleted some parts to use the new system instead of copying the one from YoutubeIE
2013-10-21 23:16:11 +02:00
Jaime Marquínez Ferrándiz
f6a54188c2
[youtube] Use 'node is None' when checking if the video has automatic captions
...
It had stopped working and it reports a FutureWarning
2013-10-21 16:28:55 +02:00
Jaime Marquínez Ferrándiz
cbbd9a9c69
Fix the duration field for the VideoDetective and InternetVideoArchive tests
...
Also remove the use of the old format system and the comment
2013-10-21 15:07:33 +02:00
Jaime Marquínez Ferrándiz
685a9cd2f1
[googleplus] Fix upload_date extraction
2013-10-21 15:00:21 +02:00
Jaime Marquínez Ferrándiz
182a107877
[arte] Set the format_note and the format_id fields ( closes #1628 )
2013-10-21 14:42:30 +02:00
Jaime Marquínez Ferrándiz
8c51aa6506
The 'format' field now defaults to '{format_id} - {width}x{height}{format_note}'
...
Following the YoutubeIE format. The 'format_note' gives additional info about the format, for example '3D' or 'DASH video'.
2013-10-21 14:42:06 +02:00
Philipp Hagemeister
f8b45beacc
Merge remote-tracking branch 'rbrito/set-age'
...
Conflicts:
youtube_dl/extractor/xhamster.py
2013-10-19 21:16:14 +02:00
Philipp Hagemeister
9d92015d43
[xhamster] Add support for age_limit (Instead of #1627 )
2013-10-19 21:09:48 +02:00
Rogério Brito
50a6150ed9
extractor: Set age limit on some adult-related extractors.
...
More age limit of videos for adult-related sites.
Note that, for redtube, I explicitly left the variable containing the age
limit, since the comment justifying the age limit is a good thing to have.
That being said, I included the age limit field on the test, to better
reflect what the information extractor does (even if it may not break the
automated tests).
Signed-off-by: Rogério Brito <rbrito@ime.usp.br>
2013-10-19 14:19:25 -03:00
rzhxeo
b0505eb611
[CinemassacreIE] Fix information extraction
2013-10-19 16:46:17 +02:00
Rogério Brito
8ed6b34477
extractor: Set age limit on some adult-related extractors.
...
This is similar in spirit to what was done in commit 8e590a117f
.
Signed-off-by: Rogério Brito <rbrito@ime.usp.br>
2013-10-18 19:32:37 -03:00
Rogério Brito
f6f1fc9286
extractor: youtube: Fix extension of dash formats.
...
While we are at it, separate the audio formats from the video formats.
Signed-off-by: Rogério Brito <rbrito@ime.usp.br>
2013-10-18 18:53:00 -03:00
Philipp Hagemeister
8e590a117f
[xnxx] Add age_limit
2013-10-18 23:35:17 +02:00
Rogério Brito
16f36a6fc9
extractor: youtube: Set extension of AAC audio formats to m4a.
...
This, in particular, eases downloading both audio and videos in DASH formats
before muxing them, which alleviates the problem that I exposed on issue
Furthermore, one may argue that this is, indeed, the case for correctness's
sake.
Signed-off-by: Rogério Brito <rbrito@ime.usp.br>
2013-10-18 17:50:55 -03:00
Philipp Hagemeister
53c1d3ef49
Check for embedded YouTube player ( Fixes #1616 )
2013-10-18 11:44:57 +02:00
Philipp Hagemeister
7c58ef3275
[tudou] Fix title regex ( Fixes #1614 )
2013-10-18 11:16:20 +02:00
Philipp Hagemeister
416a5efce7
fix typos
2013-10-18 00:49:45 +02:00
Jaime Marquínez Ferrándiz
d21ab29200
Add an extractor for techtalks.tv ( closes #1606 )
2013-10-17 08:20:58 +02:00
Philipp Hagemeister
a733eb6c53
[youtube] Do not crash if caption info is missing altogether ( Fixes #1610 )
2013-10-17 02:19:19 +02:00
Philipp Hagemeister
591454798d
[brightcove] Raise error if playlist is empty ( #1608 )
2013-10-17 01:02:17 +02:00
Philipp Hagemeister
38604f1a4f
Merge remote-tracking branch 'origin/master'
2013-10-17 00:55:06 +02:00
Philipp Hagemeister
2d0efe70a6
[brightcove] Fix more broken XML ( #1608 )
2013-10-17 00:46:11 +02:00
Jaime Marquínez Ferrándiz
bfd14b1b2f
Add an extractor for rutube.ru ( closes #1136 )
...
It downloads with a m3u8 manifest, requires ffmpeg.
2013-10-16 16:57:40 +02:00
Philipp Hagemeister
10eaae48ff
Merge branch 'master' of github.com:rg3/youtube-dl
2013-10-15 12:05:24 +02:00
Philipp Hagemeister
9d4660cab1
[generic] Support embedded vimeo videos ( #1602 )
2013-10-15 12:05:13 +02:00
Jaime Marquínez Ferrándiz
9d74e308f7
[sztvhu] Fix the title extraction
2013-10-15 08:22:59 +02:00
Jaime Marquínez Ferrándiz
8381a92120
[websurg] Skipt the test
...
It needs login information.
2013-10-15 08:12:30 +02:00
Philipp Hagemeister
4f41664de8
Merge remote-tracking branch 'Rudloff/websurg'
2013-10-15 02:11:33 +02:00
Philipp Hagemeister
7cf67fbe29
[sztvhu] Simplify
2013-10-15 01:33:20 +02:00
Philipp Hagemeister
3ddf1a6d01
Merge remote-tracking branch 'Elbandi/master'
2013-10-15 01:26:34 +02:00
Philipp Hagemeister
850555c484
Merge remote-tracking branch 'origin/master'
2013-10-15 01:25:47 +02:00
Philipp Hagemeister
9ed3bdc64d
[tudou] Add support for youku links ( Closes #1571 )
2013-10-15 01:20:04 +02:00
Jaime Marquínez Ferrándiz
c45aa56080
[gamespot] Fix video extraction ( fixes #1587 )
2013-10-14 16:46:07 +02:00
Philipp Hagemeister
7394b8db3b
Merge remote-tracking branch 'origin/master'
2013-10-14 16:07:53 +02:00
Andras Elso
f9b3d7af47
Add an extractor for Szombathelyi TV
2013-10-14 13:07:47 +02:00
Filippo Valsorda
ea62a2da46
add VideoPremium.tv RTMP support
2013-10-14 01:32:47 -04:00
Jai Grimshaw
1fb07d10a3
[youtube] Adds #1312 Download annotations
...
Adds #1321 Download annotations from youtube
Annotations are downloaded and written to a .annotations.xml file using the https://www.youtube.com/annotations_invideo?features=1&legacy=1&video_id=$VIDEOID API.
Added unit test for annotations.
2013-10-14 16:22:27 +11:00
Philipp Hagemeister
9378ae6e1d
[youku] Allow shortcut youku:ID and make non-matching groups non-matching ( #1571 )
2013-10-13 15:55:05 +02:00
Jaime Marquínez Ferrándiz
69a0c470b5
[arte] Add an extractor for future.arte.tv ( closes #1593 )
2013-10-13 14:21:13 +02:00
Jaime Marquínez Ferrándiz
c40f5cf45c
[arte] add an extractor for creative.arte.tv ( #1593 )
...
The +7 videos now use an independent extractor that is also used for the creative videos
2013-10-13 13:54:31 +02:00
Jaime Marquínez Ferrándiz
4b7b839f24
Add an extractor for rottentomatoes.com and improve InternetVideoArchiveIE to get the best quality
2013-10-12 22:22:31 +02:00
Jaime Marquínez Ferrándiz
3d60d33773
Add an extractor for videodetective.com ( closes #262 )
...
It uses the internetvideoarchive.com platform.
2013-10-12 21:36:17 +02:00
Jaime Marquínez Ferrándiz
d7e66d39a0
Add an extractor for internetvideoarchive.com videos
...
It's used by videodetective.com
2013-10-12 21:34:04 +02:00
Filippo Valsorda
f5e54a1fda
add support for NowVideo.ch
2013-10-12 13:11:03 -04:00
Joey Adams
3283533149
Fix Brightcove detection when another Flash object is on the page
...
The regex used non-greedy match, but alas it failed on input like this:
<object class="...> ... class="BrightcoveExperience"
It captured two objects and the intervening HTML. This commit fixes this by
not allowing a ">" to appear before BrightcoveExperience.
Video in question: http://www.harpercollinschildrens.com/feature/petethecat/
2013-10-11 21:52:33 -04:00
Jaime Marquínez Ferrándiz
8032e31f2d
Merge pull request #1558 from rzhxeo/cinemassacre
...
Add support for http://cinemassacre.com
2013-10-11 20:38:26 +02:00
Jaime Marquínez Ferrándiz
d2f9cdb205
Merge branch 'cinemassacre' of github.com:rzhxeo/youtube-dl into rzhxeo-cinemassacre
2013-10-11 19:53:27 +02:00
Jaime Marquínez Ferrándiz
3823342d9d
[arte] Prepare for generic format support ( #980 )
2013-10-11 16:33:31 +02:00
Jaime Marquínez Ferrándiz
91dbaef406
[nhl] Add an extractor for videocenter's categories ( #1586 )
...
It downloads the last 12 videos.
2013-10-11 14:33:26 +02:00
Jaime Marquínez Ferrándiz
cb354c8f62
[yahoo] Download the info from another page
...
The 'meta' field is not always in the video webpage
2013-10-10 21:01:45 +02:00
Jaime Marquínez Ferrándiz
1cbb27b151
[gamespot] Mark as broken ( #1587 )
2013-10-10 19:55:52 +02:00
Jaime Marquínez Ferrándiz
0ab4ff6378
[mtv] Strip the description
...
There were some tabs and newlines added around the string.
2013-10-10 19:53:44 +02:00
Jaime Marquínez Ferrándiz
63da13e829
Add an extractor for faz.net ( closes #1582 )
2013-10-10 19:37:17 +02:00