Tools (xonsh.tools)

Misc. xonsh tools.

The following implementations were forked from the IPython project:

Implementations:

  • decode()
  • encode()
  • cast_unicode()
  • safe_hasattr()
  • indent()
exception xonsh.tools.XonshCalledProcessError(returncode, command, output=None, stderr=None, completed_command=None)[source]

Raised when there’s an error with a called process

Inherits from XonshError and subprocess.CalledProcessError, catching either will also catch this error.

Raised after iterating over stdout of a captured command, if the returncode of the command is nonzero.

Example:
try:
for line in !(ls):
print(line)
except subprocess.CalledProcessError as error:
print(“Error in process: {}.format(error.completed_command.pid))

This also handles differences between Python3.4 and 3.5 where CalledProcessError is concerned.

with_traceback()

Exception.with_traceback(tb) – set self.__traceback__ to tb and return self.

args
stdout

Alias for output attribute, to match stderr

exception xonsh.tools.XonshError[source]
with_traceback()

Exception.with_traceback(tb) – set self.__traceback__ to tb and return self.

args
class xonsh.tools.DefaultNotGivenType[source]

Singleton for representing when no default value is given.

class xonsh.tools.EnvPath(args=None)[source]

A class that implements an environment path, which is a list of strings. Provides a custom method that expands all paths if the relevant env variable has been set.

append(value)

S.append(value) – append value to the end of the sequence

clear() → None -- remove all items from S
count(value) → integer -- return number of occurrences of value
extend(values)

S.extend(iterable) – extend sequence by appending elements from the iterable

index(value[, start[, stop]]) → integer -- return first index of value.

Raises ValueError if the value is not present.

insert(index, value)[source]
pop([index]) → item -- remove and return item at index (default last).

Raise IndexError if list is empty or index is out of range.

remove(value)

S.remove(value) – remove first occurrence of value. Raise ValueError if the value is not present.

reverse()

S.reverse() – reverse IN PLACE

paths

Returns the list of directories that this EnvPath contains.

class xonsh.tools.redirect_stderr(new_target)[source]

Context manager for temporarily redirecting stderr to another file.

class xonsh.tools.redirect_stdout(new_target)[source]

Context manager for temporarily redirecting stdout to another file:

# How to send help() to stderr
with redirect_stdout(sys.stderr):
    help(dir)

# How to write help() to a file
with open('help.txt', 'w') as f:
    with redirect_stdout(f):
        help(pow)

Mostly for backwards compatibility.

xonsh.tools.always_false(x)[source]

Returns False

xonsh.tools.always_true(x)[source]

Returns True

xonsh.tools.argvquote(arg, force=False)[source]

Returns an argument quoted in such a way that that CommandLineToArgvW on Windows will return the argument string unchanged. This is the same thing Popen does when supplied with an list of arguments. Arguments in a command line should be separated by spaces; this function does not add these spaces. This implementation follows the suggestions outlined here: https://blogs.msdn.microsoft.com/twistylittlepassagesallalike/2011/04/23/everyone-quotes-command-line-arguments-the-wrong-way/

xonsh.tools.backup_file(fname)[source]

Moves an existing file to a new name that has the current time right before the extension.

xonsh.tools.bool_or_int_to_str(x)[source]

Converts a boolean or integer to a string.

xonsh.tools.bool_seq_to_csv(x)[source]

Converts a sequence of bools to a comma-separated string.

xonsh.tools.bool_to_str(x)[source]

Converts a bool to an empty string if False and the string ‘1’ if True.

xonsh.tools.carriage_return()[source]

Writes a carriage return to stdout, and nothing else.

xonsh.tools.cast_unicode(s, encoding=None)[source]
xonsh.tools.check_bad_str_token(tok)[source]

Checks if a token is a bad string.

xonsh.tools.check_for_partial_string(x)[source]

Returns the starting index (inclusive), ending index (exclusive), and starting quote string of the most recent Python string found in the input.

check_for_partial_string(x) -> (startix, endix, quote)

Parameters:

x : str

The string to be checked (representing a line of terminal input)

Returns:

startix : int (or None)

The index where the most recent Python string found started (inclusive), or None if no strings exist in the input

endix : int (or None)

The index where the most recent Python string found ended (exclusive), or None if no strings exist in the input OR if the input ended in the middle of a Python string

quote : str (or None)

A string containing the quote used to start the string (e.g., b”, ”, ‘’‘), or None if no string was found.

xonsh.tools.check_quotes(s)[source]

Checks a string to make sure that if it starts with quotes, it also ends with quotes.

xonsh.tools.color_style()[source]

Returns the current color map.

xonsh.tools.color_style_names()[source]

Returns an iterable of all available style names.

xonsh.tools.columnize(elems, width=80, newline='\n')[source]

Takes an iterable of strings and returns a list of lines with the elements placed in columns. Each line will be at most width columns. The newline character will be appended to the end of each line.

xonsh.tools.command_not_found(cmd)[source]

Uses the debian/ubuntu command-not-found utility to suggest packages for a command that cannot currently be found.

xonsh.tools.csv_to_bool_seq(x)[source]

Takes a comma-separated string and converts it into a list of bools.

xonsh.tools.csv_to_set(x)[source]

Convert a comma-separated list of strings to a set of strings.

xonsh.tools.decode(s, encoding=None)[source]
xonsh.tools.decode_bytes(b)[source]

Tries to decode the bytes using XONSH_ENCODING if available, otherwise using sys.getdefaultencoding().

xonsh.tools.display_error_message()[source]

Prints the error message of the current exception on stderr.

xonsh.tools.dynamic_cwd_tuple_to_str(x)[source]

Convert a canonical cwd_width tuple to a string.

xonsh.tools.encode(u, encoding=None)[source]
xonsh.tools.ensure_slice(x)[source]

Try to convert an object into a slice, complain on failure

xonsh.tools.ensure_string(x)[source]

Returns a string if x is not a string, and x if it already is.

xonsh.tools.ensure_timestamp(t, datetime_format=None)[source]
xonsh.tools.env_path_to_str(x)[source]

Converts an environment path to a string by joining on the OS separator.

xonsh.tools.escape_windows_cmd_string(s)[source]

Returns a string that is usable by the Windows cmd.exe. The escaping is based on details here and emperical testing: http://www.robvanderwoude.com/escapechars.php

xonsh.tools.executables_in(path)[source]

Returns a generator of files in path that the user could execute.

xonsh.tools.expand_case_matching(s)[source]

Expands a string to a case insensitive globable string.

xonsh.tools.expand_gray_colors_for_cmd_exe(style_map)[source]

Expand the style’s gray scale color range. All gray scale colors has a tendency to map to the same default GRAY in cmd.exe.

xonsh.tools.expand_path(s, expand_user=True)[source]

Takes a string path and expands ~ to home if expand_user is set and environment vars if EXPAND_ENV_VARS is set.

xonsh.tools.expanduser_abs_path(inp)[source]

Provides user expanded absolute path

xonsh.tools.expandvars(path)[source]

Expand shell variables of the forms $var, ${var} and %var%. Unknown variables are left unchanged.

xonsh.tools.fallback(cond, backup)[source]

Decorator for returning the object if cond is true and a backup if cond is false.

xonsh.tools.find_next_break(line, mincol=0, lexer=None)[source]

Returns the column number of the next logical break in subproc mode. This function may be useful in finding the maxcol argument of subproc_toks().

xonsh.tools.findfirst(s, substrs)[source]

Finds whichever of the given substrings occurs first in the given string and returns that substring, or returns None if no such strings occur.

xonsh.tools.format_color(string, **kwargs)[source]

Formats strings that may contain colors. This simply dispatches to the shell instances method of the same name. The results of this function should be directly usable by print_color().

xonsh.tools.format_datetime(dt)[source]

Format datetime object to string base on $XONSH_DATETIME_FORMAT Env.

xonsh.tools.format_std_prepost(template, env=None)[source]

Formats a template prefix/postfix string for a standard buffer. Returns a string suitable for prepending or appending.

xonsh.tools.get_logical_line(lines, idx)[source]

Returns a single logical line (i.e. one without line continuations) from a list of lines. This line should begin at index idx. This also returns the number of physical lines the logical line spans. The lines should not contain newlines

xonsh.tools.get_portions(it, slices)[source]

Yield from portions of an iterable.

Parameters:

it: iterable

slices: a slice or a list of slice objects

xonsh.tools.get_sep()[source]

Returns the appropriate filepath separator char depending on OS and xonsh options set

xonsh.tools.globpath(s, ignore_case=False, return_empty=False, sort_result=None)[source]

Simple wrapper around glob that also expands home and env vars.

xonsh.tools.history_tuple_to_str(x)[source]

Converts a valid history tuple to a canonical string.

xonsh.tools.iglobpath(s, ignore_case=False, sort_result=None)[source]

Simple wrapper around iglob that also expands home and env vars.

xonsh.tools.indent(instr, nspaces=4, ntabs=0, flatten=False)[source]

Indent a string a given number of spaces or tabstops.

indent(str,nspaces=4,ntabs=0) -> indent str by ntabs+nspaces.

Parameters:

instr : basestring

The string to be indented.

nspaces : int (default: 4)

The number of spaces to be indented.

ntabs : int (default: 0)

The number of tabs to be indented.

flatten : bool (default: False)

Whether to scrub existing indentation. If True, all lines will be aligned to the same indentation. If False, existing indentation will be strictly increased.

Returns:

outstr : string indented by ntabs and nspaces.

xonsh.tools.intensify_colors_for_cmd_exe(style_map, replace_colors=None, ansi=False)[source]

Returns a modified style to where colors that maps to dark colors are replaced with brighter versions. Also expands the range used by the gray colors

xonsh.tools.intensify_colors_on_win_setter(enable)[source]

Resets the style when setting the INTENSIFY_COLORS_ON_WIN environment variable.

xonsh.tools.is_balanced(expr, ltok, rtok)[source]

Determines whether an expression has unbalanced opening and closing tokens.

xonsh.tools.is_bool(x)[source]

Tests if something is a boolean.

xonsh.tools.is_bool_or_int(x)[source]

Returns whether a value is a boolean or integer.

xonsh.tools.is_bool_seq(x)[source]

Tests if an object is a sequence of bools.

xonsh.tools.is_callable(x)[source]

Tests if something is callable

xonsh.tools.is_class(x)[source]

Tests if something is a class

xonsh.tools.is_completions_display_value(x)[source]
xonsh.tools.is_dynamic_cwd_width(x)[source]

Determine if the input is a valid input for the DYNAMIC_CWD_WIDTH environement variable.

xonsh.tools.is_env_path(x)[source]

This tests if something is an environment path, ie a list of strings.

xonsh.tools.is_float(x)[source]

Tests if something is a float

xonsh.tools.is_history_backend(x)[source]

Tests if something is a valid history backend.

xonsh.tools.is_history_tuple(x)[source]

Tests if something is a proper history value, units tuple.

xonsh.tools.is_int(x)[source]

Tests if something is an integer

xonsh.tools.is_int_as_str(x)[source]

Test if string x is an integer. If not a string return False.

xonsh.tools.is_logfile_opt(x)[source]

Checks if x is a valid $XONSH_TRACEBACK_LOGFILE option. Returns False if x is not a writable/creatable file or an empty string or None.

xonsh.tools.is_nonstring_seq_of_strings(x)[source]

Tests if something is a sequence of strings, where the top-level sequence is not a string itself.

xonsh.tools.is_slice(x)[source]

Tests if something is a slice

xonsh.tools.is_slice_as_str(x)[source]

Test if string x is a slice. If not a string return False.

xonsh.tools.is_string(x)[source]

Tests if something is a string

xonsh.tools.is_string_or_callable(x)[source]

Tests if something is a string or callable

xonsh.tools.is_string_seq(x)[source]

Tests if something is a sequence of strings

xonsh.tools.is_string_set(x)[source]

Tests if something is a set of strings

xonsh.tools.is_writable_file(filepath)[source]

Checks if a filepath is valid for writing.

xonsh.tools.levenshtein(a, b, max_dist=inf)[source]

Calculates the Levenshtein distance between a and b.

xonsh.tools.logfile_opt_to_str(x)[source]

Detypes a $XONSH_TRACEBACK_LOGFILE option.

xonsh.tools.normabspath(p)[source]

Retuns as normalized absolute path, namely, normcase(abspath(p))

xonsh.tools.on_main_thread()[source]

Checks if we are on the main thread or not.

xonsh.tools.pathsep_to_seq(x)[source]

Converts a os.pathsep separated string to a sequence of strings.

xonsh.tools.pathsep_to_set(x)[source]

Converts a os.pathsep separated string to a set of strings.

xonsh.tools.pathsep_to_upper_seq(x)[source]

Converts a os.pathsep separated string to a sequence of uppercase strings.

xonsh.tools.print_color(string, **kwargs)[source]

Prints a string that may contain colors. This dispatched to the shell method of the same name. Colors will be formatted if they have not already been.

xonsh.tools.print_exception(msg=None)[source]

Print exceptions with/without traceback.

xonsh.tools.replace_logical_line(lines, logical, idx, n)[source]

Replaces lines at idx that may end in line continuation with a logical line that spans n lines.

xonsh.tools.safe_hasattr(obj, attr)[source]

In recent versions of Python, hasattr() only catches AttributeError. This catches all errors.

xonsh.tools.seq_to_pathsep(x)[source]

Converts a sequence to an os.pathsep separated string.

xonsh.tools.seq_to_upper_pathsep(x)[source]

Converts a sequence to an uppercase os.pathsep separated string.

xonsh.tools.set_to_csv(x)[source]

Convert a set of strings to a comma-separated list of strings.

xonsh.tools.set_to_pathsep(x, sort=False)[source]

Converts a set to an os.pathsep separated string. The sort kwarg specifies whether to sort the set prior to str conversion.

xonsh.tools.setup_win_unicode_console(enable)[source]

“Enables or disables unicode display on windows.

xonsh.tools.str_to_env_path(x)[source]

Converts a string to an environment path, ie a list of strings, splitting on the OS separator.

xonsh.tools.subexpr_before_unbalanced(expr, ltok, rtok)[source]

Obtains the expression prior to last unblanced left token.

xonsh.tools.subexpr_from_unbalanced(expr, ltok, rtok)[source]

Attempts to pull out a valid subexpression for unbalanced grouping, based on opening tokens, eg. ‘(‘, and closing tokens, eg. ‘)’. This does not do full tokenization, but should be good enough for tab completion.

xonsh.tools.subproc_toks(line, mincol=-1, maxcol=None, lexer=None, returnline=False, greedy=False)[source]

Excapsulates tokens in a source code line in a uncaptured subprocess ![] starting at a minimum column. If there are no tokens (ie in a comment line) this returns None. If greedy is True, it will encapsulate normal parentheses. Greedy is False by default.

xonsh.tools.suggest_commands(cmd, env, aliases)[source]

Suggests alternative commands given an environment and aliases.

xonsh.tools.suggestion_sort_helper(x, y)[source]

Returns a score (lower is better) for x based on how similar it is to y. Used to rank suggestions.

xonsh.tools.swap(namespace, name, value, default=<object object>)[source]

Swaps a current variable name in a namespace for another value, and then replaces it when the context is exited.

xonsh.tools.swap_values(d, updates, default=<object object>)[source]

Updates a dictionary (or other mapping) with values from another mapping, and then restores the original mapping when the context is exited.

xonsh.tools.to_bool(x)[source]

“Converts to a boolean in a semantically meaningful way.

xonsh.tools.to_bool_or_break(x)[source]
xonsh.tools.to_bool_or_int(x)[source]

Converts a value to a boolean or an integer.

xonsh.tools.to_completions_display_value(x)[source]
xonsh.tools.to_dynamic_cwd_tuple(x)[source]

Convert to a canonical cwd_width tuple.

xonsh.tools.to_history_tuple(x)[source]

Converts to a canonincal history tuple.

xonsh.tools.to_itself(x)[source]

No conversion, returns itself.

xonsh.tools.to_logfile_opt(x)[source]

Converts a $XONSH_TRACEBACK_LOGFILE option to either a str containing the filepath if it is a writable file or None if the filepath is not valid, informing the user on stderr about the invalid choice.

xonsh.tools.uncapturable(f)[source]

Decorator that specifies that a callable alias should not be run with any capturing. This is often needed if the alias call interactive subprocess, like pagers and text editors.

xonsh.tools.unthreadable(f)[source]

Decorator that specifies that a callable alias should be run only on the main thread process. This is often needed for debuggers and profilers.

xonsh.tools.HISTORY_UNITS = {'': ('commands', <class 'int'>), 'megabytes': ('b', <function <lambda>>), 'months': ('s', <function <lambda>>), 'day': ('s', <function <lambda>>), 'hour': ('s', <function <lambda>>), 'command': ('commands', <class 'int'>), 'days': ('s', <function <lambda>>), 'month': ('s', <function <lambda>>), 'bytes': ('b', <class 'int'>), 'y': ('s', <function <lambda>>), 'megabyte': ('b', <function <lambda>>), 'year': ('s', <function <lambda>>), 'b': ('b', <class 'int'>), 'terabyte': ('b', <function <lambda>>), 'd': ('s', <function <lambda>>), 's': ('s', <class 'float'>), 'seconds': ('s', <class 'float'>), 'second': ('s', <class 'float'>), 'megs': ('b', <function <lambda>>), 'meg': ('b', <function <lambda>>), 'gigabytes': ('b', <function <lambda>>), 'yrs': ('s', <function <lambda>>), 'hr': ('s', <function <lambda>>), 'hours': ('s', <function <lambda>>), 'kb': ('b', <function <lambda>>), 'cmds': ('commands', <class 'int'>), 'sec': ('s', <class 'float'>), 'gigabyte': ('b', <function <lambda>>), 'kilobyte': ('b', <function <lambda>>), 'tb': ('b', <function <lambda>>), 'terabytes': ('b', <function <lambda>>), 'byte': ('b', <class 'int'>), 'kilobytes': ('b', <function <lambda>>), 'years': ('s', <function <lambda>>), 'min': ('s', <function <lambda>>), 'mins': ('s', <function <lambda>>), 'cmd': ('commands', <class 'int'>), 'files': ('files', <class 'int'>), 'yr': ('s', <function <lambda>>), 'gig': ('b', <function <lambda>>), 'c': ('commands', <class 'int'>), 'm': ('s', <function <lambda>>), 'mb': ('b', <function <lambda>>), 'f': ('files', <class 'int'>), 'gb': ('b', <function <lambda>>), 'mon': ('s', <function <lambda>>), 'h': ('s', <function <lambda>>), 'commands': ('commands', <class 'int'>), 'gigs': ('b', <function <lambda>>)}

Maps lowercase unit names to canonical name and conversion utilities.

xonsh.tools.RE_BEGIN_STRING = re.compile('([bBprRuU]*("""|\'\'\'|"|\'))')

Regular expression matching the start of a string, including quotes and leading characters (r, b, or u)

xonsh.tools.RE_STRING_CONT = <xonsh.lazyasd.LazyDict object>

Dictionary mapping starting quote sequences to regular expressions that match the contents of a string beginning with those quotes (not including the terminating quotes)

xonsh.tools.RE_STRING_START = re.compile('[bBprRuU]*')

Regular expression matching the characters before the quotes when starting a string (r, b, or u, case insensitive)

xonsh.tools.is_superuser[source]