Sergio Kef
cf85d36c5f
Remove unused function
2020-04-23 20:38:56 +02:00
Sergio Kef
4a95f62d1d
Remove unused function
2020-04-23 20:38:24 +02:00
Sergio Kef
dd065a7305
Add Archive class for efficient archiving
...
Currently we reread the file for every new link we download.
In cases where user runs youtube_dl to keep their library
up-to-date, this is very inefficient, as most of the links
are already downloaded.
Archive class works half way between a database and an append
log. It's an append log that also keeps a hash set in memory
for fast checking existing links.
A compatibility function was added for reading file's last
modification date
Tests have been added
2020-04-18 00:03:19 +02:00
Sergey M․
bfe2b8cf2a
[update] Fix updating via symlinks ( closes #23991 )
2020-02-08 19:46:58 +07:00
Sergey M․
82fea5b42e
[compat] Introduce compat_realpath (refs #23991 )
2020-02-08 19:36:55 +07:00
Sergey M․
3089bc748c
Fix W504 and disable W503 ( closes #20863 )
2019-05-11 03:57:40 +07:00
Sergey M․
067aa17edf
Start moving to ytdl-org
2019-03-11 04:00:54 +07:00
Sergey M․
399f76870d
[compat] Introduce compat_etree_Element
2019-03-06 01:18:52 +07:00
Sergey M․
075a13d3e9
[compat] Introduce compat_integer_types
2018-06-18 04:52:58 +07:00
Sergey M․
9a340af37e
[compat] Mute some F821 under python 3
2018-02-02 03:18:22 +07:00
Sergey M․
65220c3bd6
Add support for IronPython
2018-01-28 05:48:18 +07:00
Sergey M․
f206126df0
[compat] Add compat_b64decode
2018-01-23 21:53:01 +07:00
Philipp Hagemeister
d7cd9a9e84
[utils] Fix youtube-dl under PyPy3 on Windows
2018-01-01 22:48:27 +07:00
Tatsuyuki Ishi
2384f5a64e
[mixcloud] Fix extraction ( closes #14088 )
2017-09-23 05:36:57 +07:00
Sergey M․
b08e235f09
[compat] Fix compat_shlex_quote on Windows ( closes #5889 , closes #10254 )
2017-06-17 23:14:24 +07:00
Sergey M․
b081f53b08
[compat] Add compat_HTMLParseError to __all__
2017-06-12 02:36:43 +07:00
Sergey M․
72b409559c
[compat] Introduce compat_HTMLParseError
2017-06-12 01:50:32 +07:00
Remita Amine
40fcba5edb
improve coding style
2017-04-12 20:38:43 +01:00
Sergey M․
831217291a
[compat] Use try except for compat_numeric_types
2017-02-25 19:44:50 +07:00
Sergey M․
28572a1a0b
[compat] Add compat_numeric_types
2017-02-23 22:57:53 +08:00
Remita Amine
da162c1135
[compat] add compat_etree_register_namespace to __all__ list
2017-02-01 20:15:59 +01:00
Remita Amine
c2d9c25f81
[compat] add compat_etree_register_namespace
2017-01-29 16:03:39 +01:00
Yen Chi Hsuan
ec85ded83c
Fix "invalid escape sequences" error on Python 3.6
2017-01-06 00:58:56 +08:00
Yen Chi Hsuan
582be35847
Update coding style after pycodestyle 2.1.0
...
In pycodestyle 2.1.0, E305 was introduced, which requires two blank
lines after top level declarations, too.
See https://github.com/PyCQA/pycodestyle/issues/400
See also #10689 ; thanks @stepshal for first mentioning this issue and
initial patches
2016-11-17 19:45:42 +08:00
Yen Chi Hsuan
ec3518725b
[compat] Fix test_cmdline_umlauts on Python 2.6
...
The original statement raises uncaught UnicodeWarning on Python 2.6
2016-07-07 22:30:58 +08:00
Yen Chi Hsuan
dfe5fa49ae
[compat] Fix compat_shlex_split for non-ASCII input
...
Closes #9871
2016-07-07 17:37:29 +08:00
Yen Chi Hsuan
836ab0c554
[compat] Import html5 entities correctly
2016-06-10 18:12:57 +08:00
Yen Chi Hsuan
9631a94fb5
[compat] Add compat_html_entities_html5
...
Used in tset_Vporn_1. Also Related to #9270
2016-06-10 15:05:24 +08:00
Jaime Marquínez Ferrándiz
e67f688025
[compat] Add 'compat_input' to __all__
2016-06-05 23:16:08 +02:00
Sergey M․
1ae6c83bce
[compat] Add compat_input
2016-06-05 00:43:55 +07:00
Yen Chi Hsuan
eb7941e3e6
[compat] Fix for XML with <!DOCTYPE> in Python 2.7 and 3.2
...
Such XML documents cause DeprecationWarning if python is run
with `-W error`
2016-05-23 01:40:11 +08:00
Yen Chi Hsuan
702ccf2dc0
[compat] Rename shlex_quote and remove unused subprocess_check_output
2016-05-10 16:00:21 +08:00
Yen Chi Hsuan
edaa23f822
[compat] Rename struct_(un)pack to compat_struct_(un)pack
2016-05-10 14:51:38 +08:00
Yen Chi Hsuan
dab0daeeb0
[utils,compat] Move struct_pack and struct_unpack to compat.py
2016-05-10 14:51:38 +08:00
Sergey M․
fe40f9eef2
[compat] Add compat_setenv
2016-05-09 21:55:03 +06:00
Yen Chi Hsuan
92d5477d84
[compat] Handle tuples properly in urlencode()
...
Fixes #9055
2016-04-06 18:29:54 +08:00
Sergey M․
15707c7e02
[compat] Add compat_urllib_parse_urlencode and eliminate encode_dict
...
encode_dict functionality has been improved and moved directly into compat_urllib_parse_urlencode
All occurrences of compat_urllib_parse.urlencode throughout the codebase have been replaced by compat_urllib_parse_urlencode
Closes #8974
2016-03-26 01:46:57 +06:00
Sergey M․
57f7e3c62d
[compat] Add compat_xpath
2016-03-18 02:51:38 +06:00
remitamine
83548824c2
Merge pull request #8092 from bpfoley/twitter-thumbnail
...
[utils] Add extract_attributes for extracting html tag attributes
2016-03-16 13:16:27 +01:00
Yen Chi Hsuan
e9c0cdd389
[jython] Introduce compat_os_name
...
os.name is always 'java' on Jython
2016-03-03 19:24:24 +08:00
Brian Foley
8bb56eeeea
[utils] Add extract_attributes for extracting html tag attributes
...
This is much more robust than just using regexps, and handles all
the common scenarios, such as empty/no values, repeated attributes,
entity decoding, mixed case names, and the different possible value
quoting schemes.
2016-03-03 10:11:37 +00:00
Sergey M․
611c1dd96e
[refactor] Single quotes consistency
2016-02-14 15:37:17 +06:00
Yen Chi Hsuan
614db89ae3
[compat] Clarify the versions requiring compat_kwargs
...
It's supported since 2.7.0 alpha 1 and 2.6.5 rc 1. See
https://hg.python.org/cpython/file/v2.7a1/Misc/NEWS#l337
https://hg.python.org/cpython/file/v2.6.5rc1/Misc/NEWS#l28
2016-01-16 22:17:31 +08:00
Sergey M․
67dda51722
Rename compat_urllib_request_Request to sanitized_Request and move to utils
2015-11-23 21:55:15 +06:00
Sergey M․
13a10d5aa3
[compat] Add compat_urllib_request_Request
...
This is actually not a compatibility routine but rather a workaround for URLs without protocol specified.
The protocol-less URL is treated as HTTP one since it's most probable scenario and it will most likely to
redirect to HTTPS if HTTPS was actually expected. This routine could also be useful for any Request
preprocessing that may be added in future.
2015-11-23 21:55:12 +06:00
Jaime Marquínez Ferrándiz
ae37338e68
[compat] compat_etree_fromstring: clarify comment
2015-10-29 13:58:40 +01:00
Jaime Marquínez Ferrándiz
f78546272c
[compat] compat_etree_fromstring: also decode the text attribute
...
Deletes parse_xml from utils, because it also does it.
2015-10-26 16:41:24 +01:00
Jaime Marquínez Ferrándiz
387db16a78
[compat] compat_etree_fromstring: only decode bytes objects
2015-10-25 20:30:54 +01:00
Jaime Marquínez Ferrándiz
36e6f62cd0
Use a wrapper around xml.etree.ElementTree.fromstring in python 2.x ( #7178 )
...
Attributes aren't unicode objects, so they couldn't be directly used in info_dict fields (for example '--write-description' doesn't work with bytes).
2015-10-25 20:13:16 +01:00
Yen Chi Hsuan
0a67a3632b
[compat] Add compat_urllib_request_DataHandler
2015-10-18 13:44:21 +08:00
