aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* bpo-36541: Add lib2to3 grammar PEP-570 pos-only arg parsing (GH-23759)Gregory P. Smith2020-12-142-6/+77
| | | | | | | | | Add positional only args support to lib2to3 pgen2. This adds 3.8's PEP-570 support to lib2to3's pgen2. lib2to3, while being deprecated is still used by things to parse all versions of Python code today. We need it to support parsing modern 3.8 and 3.9 constructs. Also add tests for complex *expr and **expr's.
* bpo-40360: Deprecate lib2to3 module in light of PEP 617 (GH-19663)Carl Meyer2020-04-241-1/+8
| | | | | Deprecate lib2to3 module in light of PEP 617. We anticipate removal in the 3.12 timeframe.
* lib2to3: Support named assignment expressions (GH-12702)Tim Hatch2020-04-025-6/+25
| | | | | | | | | | | | There are two copies of the grammar -- the one used by Python itself as Grammar/Grammar, and the one used by lib2to3 which has necessarily diverged at Lib/lib2to3/Grammar.txt because it needs to support older syntax an we want it to be reasonable stable to avoid requiring fixer rewrites. This brings suport for syntax like `if x:= foo():` to match what the live Python grammar does. This should've been added at the time of the walrus operator itself, but lib2to3 being independent is often overlooked. So we do consider this a bugfix rather than enhancement.
* bpo-38080: Added "getproxies" to urllib fixes in the 2to3 tool (GH-16167)José Roberto Meza Cabrera2020-03-112-1/+5
|
* bpo-38641: Add lib2to3 support for starred expressions in return/yield ↵Vlad Emelianov2020-03-012-3/+15
| | | | | | statements (GH-16994)
* bpo-39313: Add an option to RefactoringTool for using exec as a function ↵Batuhan Taşkaya2020-01-123-7/+20
| | | | | | | | (GH-17967) https://bugs.python.org/issue39313 Automerge-Triggered-By: @pablogsal
* bpo-38871: Fix lib2to3 for filter-based statements that contain lambda ↵Dong-hee Na2020-01-072-3/+12
| | | | | | (GH-17780) Correctly parenthesize filter-based statements that contain lambda expressions in lib2to3.
* Remove binding of captured exceptions when not used to reduce the chances of ↵Pablo Galindo2019-11-191-2/+2
| | | | | | | creating cycles (GH-17246) Capturing exceptions into names can lead to reference cycles though the __traceback__ attribute of the exceptions in some obscure cases that have been reported previously and fixed individually. As these variables are not used anyway, we can remove the binding to reduce the chances of creating reference cycles. See for example GH-13135
* bpo-33348: parse expressions after * and ** in lib2to3 (GH-6586)Zsolt Dollenstein2019-10-235-11/+12
| | | | | | | | | | These are valid even in python 2.7 https://bugs.python.org/issue33348 Automerge-Triggered-By: @gpshead
* Fix typos in comments, docs and test names (#15018)Min ho Kim2019-07-302-2/+2
| | | | | | | | | | | | | | | | | | | | | | | | * Fix typos in comments, docs and test names * Update test_pyparse.py account for change in string length * Apply suggestion: splitable -> splittable Co-Authored-By: Terry Jan Reedy <tjreedy@udel.edu> * Apply suggestion: splitable -> splittable Co-Authored-By: Terry Jan Reedy <tjreedy@udel.edu> * Apply suggestion: Dealloccte -> Deallocate Co-Authored-By: Terry Jan Reedy <tjreedy@udel.edu> * Update posixmodule checksum. * Reverse idlelib changes.
* closes bpo-37675: Use pkgutil.iter_modules to find fixers in a package ↵Benjamin Peterson2019-07-241-4/+4
| | | | rather than listdir. (14942)
* Fix typos in docs and docstrings (GH-13745)Xtreak2019-06-031-1/+1
|
* bpo-5028: Fix up rest of documentation for tokenize documenting line (GH-13686)Anthony Sottile2019-05-301-1/+1
| | | https://bugs.python.org/issue5028
* bpo-5028: fix doc bug for tokenize (GH-11683)Andrew Carr2019-05-301-1/+1
| | | https://bugs.python.org/issue5028
* bpo-23896: Add a grammar where exec isn't a stmt (#13272)Batuhan Taşkaya2019-05-201-0/+3
| | | https://bugs.python.org/issue23896
* bpo-36766: Typos in docs and code comments (GH-13116)penguindustin2019-05-061-1/+1
|
* bpo-35312: Make lib2to3.pgen2.parse.ParseError round-trip pickle-able. ↵Anthony Sottile2018-11-272-0/+15
| | | | (GH-10710)
* bpo-35202: Remove unused imports in Lib directory. (GH-10446)Srinivas Thatiparthy (శ్రీనివాస్ తాటిపర్తి)2018-11-102-2/+0
|
* bpo-16965: 2to3 now rewrites execfile() to open with 'rb'. (GH-8569)Zackery Spytz2018-10-132-9/+10
|
* closes bpo-34515: Support non-ASCII identifiers in lib2to3. (GH-8950)Monson Shao2018-09-152-6/+15
|
* Revert "closes bpo-27494: Fix 2to3 handling of trailing comma after a ↵Serhiy Storchaka2018-07-316-36/+10
| | | | | | | | generator expression (GH-3771)" (#8241) This reverts commit af810b35b494ef1d255d4bf340b92a9dad446995. This is not valid syntax (see bpo-32012).
* bpo-21446: Update reload fixer to use importlib (GH-8391)Berker Peksag2018-07-232-9/+9
|
* bpo-34108: Fix double carriage return in 2to3 on Windows (#8271)Jason R. Coombs2018-07-132-1/+2
| | | | | * Add test capturing failure. * Honor newlines as present in the original file.
* bpo-31583: Fix 2to3 for using with --add-suffix option (GH-3758)Denis Osipov2018-04-181-1/+1
|
* bpo-11594: Ensure line-endings are respected when using 2to3 (GH-6483)Aaron Ang2018-04-173-18/+34
|
* [lib2to3] Make grammar pickling faster (#6491)Łukasz Langa2018-04-161-25/+2
| | | | | | | | | * Now uses pickle protocol 4 * Doesn't wrap the grammar's `__dict__` in ordered dictionaries anymore as dictionaries in Python 3.6+ are ordered by default This still produces deterministic pickles (that hash the same with MD5). Tested with different PYTHONHASHSEED values.
* Add support for all string literals to lib2to3 (#6457)Zsolt Dollenstein2018-04-162-52/+28
|
* Revert "bpo-30406: Make async and await proper keywords (#1669)" (GH-6143)Jelle Zijlstra2018-03-184-20/+94
| | | | | This reverts commit ac317700ce7439e38a8b420218d9a5035bba92ed. (Reverts only the lib2to3 part.)
* lib2to3: Add more tests (#6101)Łukasz Langa2018-03-131-0/+108
|
* bpo-33064: lib2to3: support trailing comma after *args and **kwargs (#6096)Łukasz Langa2018-03-132-26/+37
| | | | | | | New tests also added. I also made the comments in line with the builtin Grammar/Grammar. PEP 306 was withdrawn, Kees Blom's railroad program has been lost to the sands of time for at least 16 years now (I found a python-dev post from people looking for it).
* compare with difflib not diff(1) (GH-5450)Benjamin Peterson2018-01-301-13/+9
|
* closes bpo-30117: fix lib2to3 ParserIdempotency test (GH-1242)Eric Appelt2018-01-292-10/+15
| | | | | | | | | | | Fix two (in my opinion) spurious failure conditions in the lib2to3.tests.test_parser.TestParserIdempotency test_parser test. Use the same encoding found in the initial file to write a temp file for a diff. This retains the BOM if the encoding was initially utf-8-sig. If the file cannot be parsed using the normal grammar, try again with no print statement which should succeed for valid files using future print_function For case (1), the driver was correctly handling a BOM in a utf-8 file, but then the test was not writing a comparison file using 'utf-8-sig' to diff against, so the BOM got removed. I don't think that is the fault of the parser, and lib2to3 will retain the BOM. For case (2), lib2to3 pre-detects the use of from __future__ import print_function or allows the user to force this interpretation with a -p flag, and then selects a different grammar with the print statement removed. That makes the test cases unfair to this test as the driver itself doesn't know which grammar to use. As a minimal fix, the test will try using a grammar with the print statement, and if that fails fall back on a grammar without it. A more thorough handling of the idempotency test would to be to parse all files using both grammars and ignore if one of the two failed but otherwise check both. I didn't think this was necessary but can change.
* remove unused import (#5040)Benjamin Peterson2017-12-281-1/+0
|
* make PatternCompiler use the packaged grammar if possible (more bpo-24960) ↵Benjamin Peterson2017-12-281-7/+7
| | | | (#5034)
* correct wording (#4983)Benjamin Peterson2017-12-221-1/+1
|
* bpo-24960: use pkgutil.get_data in lib2to3 to read pickled grammar files (#4977)Benjamin Peterson2017-12-224-2/+42
| | | | | | This is more complicated than it should be because we need to preserve the useful mtime-based regeneration feature that lib2to3.pgen2.driver.load_grammar has. We only look for the pickled grammar file with pkgutil.get_data and only if the source file does not exist.
* bpo-32046: Update 2to3 when converts operator.isCallable(obj). (#4417)Dong-hee Na2017-11-282-6/+5
|
* bpo-30143: 2to3 now generates a code that uses abstract collection classes ↵Serhiy Storchaka2017-11-162-10/+10
| | | | | | (#1262) from collections.abc rather than collections.
* bpo-30406: Make async and await proper keywords (#1669)Jelle Zijlstra2017-10-054-94/+24
| | | Per PEP 492, 'async' and 'await' should become proper keywords in 3.7.
* closes bpo-27494: Fix 2to3 handling of trailing comma after a generator ↵Jakub Stasiak2017-10-056-10/+36
| | | | expression (#3771)
* bpo-29783: Replace codecs.open() with io.open() (#599)Victor Stinner2017-06-162-30/+11
|
* bpo-23894: make lib2to3 recognize f-strings (#1733)Łukasz Langa2017-05-222-1/+7
| | | | | | | Note: this doesn't unpack f-strings into the underlying JoinedStr AST. Ideally we'd fully implement JoinedStr here but given its additional complexity, I think this is worth bandaiding as is. This unblocks tools like https://github.com/google/yapf to format 3.6 syntax using f-strings.
* Make rb'' strings work in lib2to3 (#1724)Łukasz Langa2017-05-222-7/+37
| | | This partially solves bpo-23894.
* bpo-30144: Import collections ABC from collections.abc rather than ↵Serhiy Storchaka2017-04-241-2/+2
| | | | collections. (#1263)
* bpo-29869: Allow underscores in numeric literals in lib2to3. (GH-1119)Nevada Sanchez2017-04-132-8/+30
| | | | | * Allow underscores in numeric literals in lib2to3. * Stricter literal parsing for Python 3.6 in lib2to3.pgen2.tokenize. * Add test case for underscores in literals in Python 3.
* bpo-28837: Fix lib2to3 handling of map/zip/filter calls when followed with a ↵Stuart Berg2017-04-054-26/+109
| | | | 'trailer', e.g. zip()[x] (#24)
* bpo-29762: More use "raise from None". (#569)Serhiy Storchaka2017-04-053-4/+4
| | | This hides unwanted implementation details from tracebacks.
* bpo-29957: change LBYL key lookup to dict.setdefault (#938)Michael Selik2017-04-011-5/+0
| | | | | | | | | | | | | * change LBYL key lookup to dict.setdefault The ``results`` was constructed as a defaultdict and we could simply delete the check ``if key not in results``. However, I think it's safer to use dict.setdefault as I'm not sure whether the caller expects a regular dict or defaultdict. * add name to the acknowledgements file * use defaultdict to make the key-lookup cleaner
* bpo-29919: Remove unused imports found by pyflakes (#137)Victor Stinner2017-03-271-1/+1
| | | Make also minor PEP8 coding style fixes on modified imports.
* bpo-29776: Use decorator syntax for properties. (#585)Serhiy Storchaka2017-03-191-8/+8
|