<!DOCTYPE html PUBLIC
"-//W3C//DTD HTML 4.0 Transitional//EN">
<link rel=
"STYLESHEET" href=
"lib.css" type='text/css'
/>
<link rel=
"SHORTCUT ICON" href=
"../icons/pyfav.png" type=
"image/png" />
<link rel='start' href='../index.html' title='Python Documentation Index'
/>
<link rel=
"first" href=
"lib.html" title='Python Library Reference'
/>
<link rel='contents' href='contents.html'
title=
"Contents" />
<link rel='index' href='genindex.html' title='Index'
/>
<link rel='last' href='about.html' title='About this document...'
/>
<link rel='help' href='about.html' title='About this document...'
/>
<link rel=
"next" href=
"shlex-parsing-rules.html" />
<link rel=
"prev" href=
"module-shlex.html" />
<link rel=
"parent" href=
"module-shlex.html" />
<link rel=
"next" href=
"shlex-parsing-rules.html" />
<meta name='aesop' content='information'
/>
<title>5.21.1 shlex Objects
</title>
<div id='top-navigation-panel' xml:id='top-navigation-panel'
>
<table align=
"center" width=
"100%" cellpadding=
"0" cellspacing=
"2">
<td class='online-navigation'
><a rel=
"prev" title=
"5.21 shlex "
href=
"module-shlex.html"><img src='../icons/previous.png'
border='
0' height='
32' alt='Previous Page' width='
32'
/></A></td><td class='online-navigation'
><a rel=
"parent" title=
"5.21 shlex "
href=
"module-shlex.html"><img src='../icons/up.png'
border='
0' height='
32' alt='Up One Level' width='
32'
/></A></td><td class='online-navigation'
><a rel=
"next" title=
"5.21.2 Parsing Rules"
href=
"shlex-parsing-rules.html"><img src='../icons/next.png'
border='
0' height='
32' alt='Next Page' width='
32'
/></A></td><td align=
"center" width=
"100%">Python Library Reference
</td>
<td class='online-navigation'
><a rel=
"contents" title=
"Table of Contents"
href=
"contents.html"><img src='../icons/contents.png'
border='
0' height='
32' alt='Contents' width='
32'
/></A></td><td class='online-navigation'
><a href=
"modindex.html" title=
"Module Index"><img src='../icons/modules.png'
border='
0' height='
32' alt='Module Index' width='
32'
/></a></td><td class='online-navigation'
><a rel=
"index" title=
"Index"
href=
"genindex.html"><img src='../icons/index.png'
border='
0' height='
32' alt='Index' width='
32'
/></A></td><div class='online-navigation'
>
<b class=
"navlabel">Previous:
</b>
<a class=
"sectref" rel=
"prev" href=
"module-shlex.html">5.21 shlex
</A>
<b class=
"navlabel">Up:
</b>
<a class=
"sectref" rel=
"parent" href=
"module-shlex.html">5.21 shlex
</A>
<b class=
"navlabel">Next:
</b>
<a class=
"sectref" rel=
"next" href=
"shlex-parsing-rules.html">5.21.2 Parsing Rules
</A>
<!--End of Navigation Panel-->
<H2><A NAME=
"SECTION0072110000000000000000"></A><A NAME=
"shlex-objects"></A>
A
<tt class=
"class">shlex
</tt> instance has the following methods:
<dl><dt><table cellpadding=
"0" cellspacing=
"0"><tr valign=
"baseline">
<td><nobr><b><tt id='l2h-
1482' xml:id='l2h-
1482'
class=
"method">get_token
</tt></b>(
</nobr></td>
<td><var></var>)
</td></tr></table></dt>
Return a token. If tokens have been stacked using
<tt class=
"method">push_token()
</tt>, pop a token off the stack. Otherwise, read one
from the input stream. If reading encounters an immediate
end-of-file,
<tt class=
"member">self.eof
</tt> is returned (the empty string (
<code>''
</code>)
in non-POSIX mode, and
<code>None
</code> in POSIX mode).
<dl><dt><table cellpadding=
"0" cellspacing=
"0"><tr valign=
"baseline">
<td><nobr><b><tt id='l2h-
1483' xml:id='l2h-
1483'
class=
"method">push_token
</tt></b>(
</nobr></td>
<td><var>str
</var>)
</td></tr></table></dt>
Push the argument onto the token stack.
<dl><dt><table cellpadding=
"0" cellspacing=
"0"><tr valign=
"baseline">
<td><nobr><b><tt id='l2h-
1484' xml:id='l2h-
1484'
class=
"method">read_token
</tt></b>(
</nobr></td>
<td><var></var>)
</td></tr></table></dt>
Read a raw token. Ignore the pushback stack, and do not interpret source
requests. (This is not ordinarily a useful entry point, and is
documented here only for the sake of completeness.)
<dl><dt><table cellpadding=
"0" cellspacing=
"0"><tr valign=
"baseline">
<td><nobr><b><tt id='l2h-
1485' xml:id='l2h-
1485'
class=
"method">sourcehook
</tt></b>(
</nobr></td>
<td><var>filename
</var>)
</td></tr></table></dt>
When
<tt class=
"class">shlex
</tt> detects a source request (see
<tt class=
"member">source
</tt> below) this method is given the following token as
argument, and expected to return a tuple consisting of a filename and
an open file-like object.
Normally, this method first strips any quotes off the argument. If
the result is an absolute pathname, or there was no previous source
request in effect, or the previous source was a stream
(such as
<code>sys.stdin
</code>), the result is left alone. Otherwise, if the
result is a relative pathname, the directory part of the name of the
file immediately before it on the source inclusion stack is prepended
(this behavior is like the way the C preprocessor handles
<code>#include
"file.h"</code>).
The result of the manipulations is treated as a filename, and returned
as the first component of the tuple, with
<tt class=
"function">open()
</tt> called on it to yield the second component. (Note:
this is the reverse of the order of arguments in instance initialization!)
This hook is exposed so that you can use it to implement directory
search paths, addition of file extensions, and other namespace hacks.
There is no corresponding `close' hook, but a shlex instance will call
the
<tt class=
"method">close()
</tt> method of the sourced input stream when it
For more explicit control of source stacking, use the
<tt class=
"method">push_source()
</tt> and
<tt class=
"method">pop_source()
</tt> methods.
<dl><dt><table cellpadding=
"0" cellspacing=
"0"><tr valign=
"baseline">
<td><nobr><b><tt id='l2h-
1486' xml:id='l2h-
1486'
class=
"method">push_source
</tt></b>(
</nobr></td>
<td><var>stream
</var><big>[
</big><var>, filename
</var><big>]
</big><var></var>)
</td></tr></table></dt>
Push an input source stream onto the input stack. If the filename
argument is specified it will later be available for use in error
messages. This is the same method used internally by the
<tt class=
"method">sourcehook
</tt> method.
<span class=
"versionnote">New in version
2.1.
</span>
<dl><dt><table cellpadding=
"0" cellspacing=
"0"><tr valign=
"baseline">
<td><nobr><b><tt id='l2h-
1487' xml:id='l2h-
1487'
class=
"method">pop_source
</tt></b>(
</nobr></td>
<td><var></var>)
</td></tr></table></dt>
Pop the last-pushed input source from the input stack.
This is the same method used internally when the lexer reaches
EOF on a stacked input stream.
<span class=
"versionnote">New in version
2.1.
</span>
<dl><dt><table cellpadding=
"0" cellspacing=
"0"><tr valign=
"baseline">
<td><nobr><b><tt id='l2h-
1488' xml:id='l2h-
1488'
class=
"method">error_leader
</tt></b>(
</nobr></td>
<td><var></var><big>[
</big><var>file
</var><big>[
</big><var>, line
</var><big>]
</big><var></var><big>]
</big><var></var>)
</td></tr></table></dt>
This method generates an error message leader in the format of a
<span class=
"Unix">Unix
</span> C compiler error label; the format is
<code>'
"%s", line %d: '
</code>,
where the
"<tt class="samp
">%s</tt>" is replaced with the name of the current source
file and the
"<tt class="samp
">%d</tt>" with the current input line number (the
optional arguments can be used to override these).
This convenience is provided to encourage
<tt class=
"module">shlex
</tt> users to
generate error messages in the standard, parseable format understood
by Emacs and other
<span class=
"Unix">Unix
</span> tools.
Instances of
<tt class=
"class">shlex
</tt> subclasses have some public instance
variables which either control lexical analysis or can be used for
<dl><dt><b><tt id='l2h-
1489' xml:id='l2h-
1489'
class=
"member">commenters
</tt></b></dt>
The string of characters that are recognized as comment beginners.
All characters from the comment beginner to end of line are ignored.
Includes just
"<tt class="character
">#</tt>" by default.
<dl><dt><b><tt id='l2h-
1490' xml:id='l2h-
1490'
class=
"member">wordchars
</tt></b></dt>
The string of characters that will accumulate into multi-character
tokens. By default, includes all ASCII alphanumerics and
<dl><dt><b><tt id='l2h-
1491' xml:id='l2h-
1491'
class=
"member">whitespace
</tt></b></dt>
Characters that will be considered whitespace and skipped. Whitespace
bounds tokens. By default, includes space, tab, linefeed and
<dl><dt><b><tt id='l2h-
1492' xml:id='l2h-
1492'
class=
"member">escape
</tt></b></dt>
Characters that will be considered as escape. This will be only used
in POSIX mode, and includes just
"<tt class="character
">\</tt>" by default.
<span class=
"versionnote">New in version
2.3.
</span>
<dl><dt><b><tt id='l2h-
1493' xml:id='l2h-
1493'
class=
"member">quotes
</tt></b></dt>
Characters that will be considered string quotes. The token
accumulates until the same quote is encountered again (thus, different
quote types protect each other as in the shell.) By default, includes
ASCII single and double quotes.
<dl><dt><b><tt id='l2h-
1494' xml:id='l2h-
1494'
class=
"member">escapedquotes
</tt></b></dt>
Characters in
<tt class=
"member">quotes
</tt> that will interpret escape characters
defined in
<tt class=
"member">escape
</tt>. This is only used in POSIX mode, and
includes just
"<tt class="character
">"</tt>" by default.<span class="versionnote
">New in version 2.3.</span>
<dl><dt><b><tt id='l2h-1495' xml:id='l2h-1495' class="member
">whitespace_split</tt></b></dt>
If <code>True</code>, tokens will only be split in whitespaces. This is useful, for
example, for parsing command lines with <tt class="class
">shlex</tt>, getting tokens
in a similar way to shell arguments.
<span class="versionnote
">New in version 2.3.</span>
<dl><dt><b><tt id='l2h-1496' xml:id='l2h-1496' class="member
">infile</tt></b></dt>
The name of the current input file, as initially set at class
instantiation time or stacked by later source requests. It may
be useful to examine this when constructing error messages.
<dl><dt><b><tt id='l2h-1497' xml:id='l2h-1497' class="member
">instream</tt></b></dt>
The input stream from which this <tt class="class
">shlex</tt> instance is reading
<dl><dt><b><tt id='l2h-1498' xml:id='l2h-1498' class="member
">source</tt></b></dt>
This member is <code>None</code> by default. If you assign a string to it,
that string will be recognized as a lexical-level inclusion request
similar to the "<tt class=
"samp">source
</tt>" keyword in various shells. That is, the
immediately following token will opened as a filename and input taken
from that stream until EOF, at which point the <tt class="method
">close()</tt>
method of that stream will be called and the input source will again
become the original input stream. Source requests may be stacked any
<dl><dt><b><tt id='l2h-1499' xml:id='l2h-1499' class="member
">debug</tt></b></dt>
If this member is numeric and <code>1</code> or more, a <tt class="class
">shlex</tt>
instance will print verbose progress output on its behavior. If you
need to use this, you can read the module source code to learn the
<dl><dt><b><tt id='l2h-1500' xml:id='l2h-1500' class="member
">lineno</tt></b></dt>
Source line number (count of newlines seen so far plus one).
<dl><dt><b><tt id='l2h-1501' xml:id='l2h-1501' class="member
">token</tt></b></dt>
The token buffer. It may be useful to examine this when catching
<dl><dt><b><tt id='l2h-1502' xml:id='l2h-1502' class="member
">eof</tt></b></dt>
Token used to determine end of file. This will be set to the empty
string (<code>''</code>), in non-POSIX mode, and to <code>None</code> in
<span class="versionnote
">New in version 2.3.</span>
<div class='online-navigation'>
<table align="center
" width="100%
" cellpadding="0" cellspacing="2">
<td class='online-navigation'><a rel="prev
" title="5.21 shlex
"
href="module-shlex.html
"><img src='../icons/previous.png'
border='0' height='32' alt='Previous Page' width='32' /></A></td>
<td class='online-navigation'><a rel="parent
" title="5.21 shlex
"
href="module-shlex.html
"><img src='../icons/up.png'
border='0' height='32' alt='Up One Level' width='32' /></A></td>
<td class='online-navigation'><a rel="next
" title="5.21.2 Parsing Rules
"
href="shlex-parsing-rules.html
"><img src='../icons/next.png'
border='0' height='32' alt='Next Page' width='32' /></A></td>
<td align="center
" width="100%
">Python Library Reference</td>
<td class='online-navigation'><a rel="contents
" title="Table of Contents
"
href="contents.html
"><img src='../icons/contents.png'
border='0' height='32' alt='Contents' width='32' /></A></td>
<td class='online-navigation'><a href="modindex.html
" title="Module Index
"><img src='../icons/modules.png'
border='0' height='32' alt='Module Index' width='32' /></a></td>
<td class='online-navigation'><a rel="index
" title="Index
"
href="genindex.html
"><img src='../icons/index.png'
border='0' height='32' alt='Index' width='32' /></A></td>
<div class='online-navigation'>
<b class="navlabel
">Previous:</b>
<a class="sectref
" rel="prev
" href="module-shlex.html
">5.21 shlex </A>
<b class="navlabel
">Up:</b>
<a class="sectref
" rel="parent
" href="module-shlex.html
">5.21 shlex </A>
<b class="navlabel
">Next:</b>
<a class="sectref
" rel="next
" href="shlex-parsing-rules.html
">5.21.2 Parsing Rules</A>
<span class="release-info
">Release 2.4.2, documentation updated on 28 September 2005.</span>
<!--End of Navigation Panel-->
See <i><a href="about.html
">About this document...</a></i> for information on suggesting changes.
projects / OpenSPARC-T2-SAM / blob