From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.129.124]) by sourceware.org (Postfix) with ESMTPS id 873F73858CD1 for ; Sat, 20 Apr 2024 09:10:26 +0000 (GMT) DMARC-Filter: OpenDMARC Filter v1.4.2 sourceware.org 873F73858CD1 Authentication-Results: sourceware.org; dmarc=pass (p=none dis=none) header.from=redhat.com Authentication-Results: sourceware.org; spf=pass smtp.mailfrom=redhat.com ARC-Filter: OpenARC Filter v1.0.0 sourceware.org 873F73858CD1 Authentication-Results: server2.sourceware.org; arc=none smtp.remote-ip=170.10.129.124 ARC-Seal: i=1; a=rsa-sha256; d=sourceware.org; s=key; t=1713604229; cv=none; b=fmoL5V1fHKcvZJfjeF1aNMMQZGslu6IOkN73Ne84ZiPYb0xACGNSPdz5dr5uwafwrVahzXYge+2Oy5dnlkSCXwpspYsZ+krr7HQZSRUl4QEX6adtdcksCkGkAhFsMg8LiL5rB9bK9jQJ6aDvOu3K7Fh0iLBrvrOz17C+fgrfeAs= ARC-Message-Signature: i=1; a=rsa-sha256; d=sourceware.org; s=key; t=1713604229; c=relaxed/simple; bh=0gjLt49qPV4EH+fCEfNlWPo9EYAVydSsHVVtBEIlNKM=; h=DKIM-Signature:From:To:Subject:Date:Message-Id:MIME-Version; b=LWZEsePsArg+DUPCKkZdiW/kCzbL4z7IOzXoNbrYwOaVAmdOqHEE0Swtw5xhnj0g9swKVpmemB8sifNboEqaANXMPSlEVuHmJnw00sDfgNSY88tnC0BCeJB9Ks18yheyybgBbBXyXcLK9M6kEFlcCMz8sYBOy0QHhkV8xaIQN9A= ARC-Authentication-Results: i=1; server2.sourceware.org DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1713604226; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ORia5LCnScqE7bRg8Y2VzZrQiQTYKV9dTomKIbVoAy8=; b=eqd/TFWdQxRa/6GGFbJZ9edSDxJwgdmnO7rhoOQ1CGsv7Jhb53dwLgi/4sAIXKRhw4yIhT s3K+gnyYAA/UgChcLFPR6vKIUvTxnh/ZCvqiRUZ63MSSoMOuTf0ykaNunKKRdQsegGPOUI Bo6EHEgOkkytYN0VbiVusRsnFbgydcc= Received: from mail-wm1-f70.google.com (mail-wm1-f70.google.com [209.85.128.70]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id us-mta-213-M_d3wT9sNnuIkkHMCDxNyg-1; Sat, 20 Apr 2024 05:10:24 -0400 X-MC-Unique: M_d3wT9sNnuIkkHMCDxNyg-1 Received: by mail-wm1-f70.google.com with SMTP id 5b1f17b1804b1-4147f17da12so15676805e9.0 for ; Sat, 20 Apr 2024 02:10:24 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1713604222; x=1714209022; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=ORia5LCnScqE7bRg8Y2VzZrQiQTYKV9dTomKIbVoAy8=; b=TfwXKJU/7U6E6Sqfou23KwvKAXHT+gscbvF+F2adHl3aMjL/RL9E8+AnZRDoB4J8sB XI0vIjzLRYUYdgOHfat5n0ZV8dnWV6si5/gc7XfhnMkrhM3WxdKyJNwZv0bZIPmZfTlP 2x6zAtpIpRkwPWsQBezgv4OyPJConY24j6Gdr0nOD2vli83h7QBHluGqSE8eRYhXl8yk p7+xb/KalLNVbwYac5iBbL30Tp5FyP0k4m+4i/8GyInDo8KP8DQUdjDIfF8+J5FdU5m9 dP3gCxHAazKbzzqZddqwyFJKEK6zuFo3gnI2lVK0yGrGTk+TaOl2FAOWZNQ202RVhfEq KOBw== X-Gm-Message-State: AOJu0YxzkVIk6eXLzzKFgSlps+gfRezvYon0wIiZaU+QDDx+DuRcwUbk L5WxseTN+uphKSZcOCE+QMTQOSzk6KQdLOgae9wjL1YtntRTsdNro9sNvzlD4gzGd8Vhah781sO CHGX7v7pMlA+vXHQBBBjRBOsmFctsehlk/ZDyTA4MlQnfhxQ777MQ0q/pOoymiPgA5EPbfO5V+8 GnRf4UNSObsgDSpU9Syp7Mgq7BgEK+lJvrpPxLfgbH7sY= X-Received: by 2002:a05:600c:c85:b0:419:d0d3:6865 with SMTP id fj5-20020a05600c0c8500b00419d0d36865mr1444287wmb.35.1713604222323; Sat, 20 Apr 2024 02:10:22 -0700 (PDT) X-Google-Smtp-Source: AGHT+IFGq0ja6ECQz3ymQvuea6d+odQvHyyL933YQd7cA6TAEeVjT+Y3ASfsmdWKAiiX9A6UydtVAQ== X-Received: by 2002:a05:600c:c85:b0:419:d0d3:6865 with SMTP id fj5-20020a05600c0c8500b00419d0d36865mr1444271wmb.35.1713604221817; Sat, 20 Apr 2024 02:10:21 -0700 (PDT) Received: from localhost (92.40.185.25.threembb.co.uk. [92.40.185.25]) by smtp.gmail.com with ESMTPSA id r13-20020a05600c458d00b00417f65f148esm13335880wmo.31.2024.04.20.02.10.20 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sat, 20 Apr 2024 02:10:20 -0700 (PDT) From: Andrew Burgess To: gdb-patches@sourceware.org Cc: Andrew Burgess , Lancelot SIX , Eli Zaretskii Subject: [PATCHv2 3/8] gdb: improve escaping when completing filenames Date: Sat, 20 Apr 2024 10:10:03 +0100 Message-Id: <10dfa8c8c8fb03b0f5de97cf9e01d5cb4d502351.1713603416.git.aburgess@redhat.com> X-Mailer: git-send-email 2.25.4 In-Reply-To: References: MIME-Version: 1.0 X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset="US-ASCII"; x-default=true X-Spam-Status: No, score=-9.6 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH,DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,GIT_PATCH_0,RCVD_IN_ABUSEAT,RCVD_IN_DNSWL_NONE,RCVD_IN_MSPIKE_H4,RCVD_IN_MSPIKE_WL,RCVD_IN_SBL_CSS,SPF_HELO_NONE,SPF_NONE,TXREP autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on server2.sourceware.org List-Id: This improves quoting and escaping when completing filenames for commands that allow filenames to be quoted and escaped. I've struggled a bit trying to split this series into chunks. There's a lot of dependencies between different parts of the completion system, and trying to get this working correctly is pretty messy. This first step is really about implementing 3 readline hooks: rl_char_is_quoted_p - Is a particular character quoted within readline's input buffer? rl_filename_dequoting_function - Remove quoting characters from a filename. rl_filename_quoting_function - Add quoting characters to a filename. See 'info readline' for full details, but with these hooks connected up, readline (on behalf of GDB) should do a better job inserting backslash escapes when completing filenames. There's still a bunch of stuff that doesn't work after this commit, mostly around the 'complete' command which of course doesn't go through readline, so doesn't benefit from all of these new functions yet, I'll add some of this in a later commit. Tab completion is now slightly improved though, it is possible to tab-complete a filename that includes a double or single quote, either in an unquoted string or within a string surrounded by single or double quotes, backslash escaping is used when necessary. There are some additional tests to cover the new functionality. --- gdb/completer.c | 169 +++++++++++++++++- .../gdb.base/filename-completion.exp | 36 +++- 2 files changed, 201 insertions(+), 4 deletions(-) diff --git a/gdb/completer.c b/gdb/completer.c index c300e42f588..396b1e0136b 100644 --- a/gdb/completer.c +++ b/gdb/completer.c @@ -203,6 +203,159 @@ noop_completer (struct cmd_list_element *ignore, { } +/* Return 1 if the character at EINDEX in STRING is quoted (there is an + unclosed quoted string), or if the character at EINDEX is quoted by a + backslash. */ + +static int +gdb_completer_file_name_char_is_quoted (char *string, int eindex) +{ + for (int i = 0; i <= eindex && string[i] != '\0'; ) + { + char c = string[i]; + + if (c == '\\') + { + /* The backslash itself is not quoted. */ + if (i >= eindex) + return 0; + ++i; + /* But the next character is. */ + if (i >= eindex) + return 1; + if (string[i] == '\0') + return 0; + ++i; + continue; + } + else if (strchr (rl_completer_quote_characters, c) != nullptr) + { + /* This assumes that extract_string_maybe_quoted can handle a + string quoted with character C. Currently this is true as the + only characters we put in rl_completer_quote_characters are + single and/or double quotes, both of which + extract_string_maybe_quoted can handle. */ + gdb_assert (c == '"' || c == '\''); + const char *tmp = &string[i]; + (void) extract_string_maybe_quoted (&tmp); + i = tmp - string; + + /* Consider any character within the string we just skipped over + as quoted, though this might not be completely correct; the + opening and closing quotes are not themselves quoted. But so + far this doesn't seem to have caused any issues. */ + if (i >= eindex) + return 1; + } + else + ++i; + } + + return 0; +} + +/* Removing character escaping from FILENAME. QUOTE_CHAR is the quote + character around FILENAME or the null-character if there is no quoting + around FILENAME. */ + +static char * +gdb_completer_file_name_dequote (char *filename, int quote_char) +{ + std::string tmp; + + if (quote_char == '\'') + { + /* There is no backslash escaping within a single quoted string. In + this case we can just return the input string. */ + tmp = filename; + } + else if (quote_char == '"') + { + /* Remove escaping from a double quoted string. */ + for (const char *input = filename; + *input != '\0'; + ++input) + { + if (input[0] == '\\' + && input[1] != '\0' + && strchr ("\"\\", input[1]) != nullptr) + ++input; + tmp += *input; + } + } + else + { + gdb_assert (quote_char == '\0'); + + /* Remove escaping from an unquoted string. */ + for (const char *input = filename; + *input != '\0'; + ++input) + { + /* We allow anything to be escaped in an unquoted string. */ + if (*input == '\\') + { + ++input; + if (*input == '\0') + break; + } + + tmp += *input; + } + } + + return strdup (tmp.c_str ()); +} + +/* Apply character escaping to the file name in TEXT. QUOTE_PTR points to + the quote character surrounding TEXT, or points to the null-character if + there are no quotes around TEXT. MATCH_TYPE will be one of the readline + constants SINGLE_MATCH or MULTI_MATCH depending on if there is one or + many completions. */ + +static char * +gdb_completer_file_name_quote (char *text, int match_type ATTRIBUTE_UNUSED, + char *quote_ptr) +{ + std::string str; + + if (*quote_ptr == '\'') + { + /* There is no backslash escaping permitted within a single quoted + string, so in this case we can just return the input sting. */ + str = text; + } + else if (*quote_ptr == '"') + { + /* Add escaping for a double quoted filename. */ + for (const char *input = text; + *input != '\0'; + ++input) + { + if (strchr ("\"\\", *input) != nullptr) + str += '\\'; + str += *input; + } + } + else + { + gdb_assert (*quote_ptr == '\0'); + + /* Add escaping for an unquoted filename. */ + for (const char *input = text; + *input != '\0'; + ++input) + { + if (strchr (" \t\n\\\"'", *input) + != nullptr) + str += '\\'; + str += *input; + } + } + + return strdup (str.c_str ()); +} + /* Generate filename completions of WORD, storing the completions into TRACKER. This is used for generating completions for commands that only accept unquoted filenames as well as for commands that accept @@ -256,6 +409,7 @@ filename_maybe_quoted_completer (struct cmd_list_element *ignore, completion_tracker &tracker, const char *text, const char *word) { + rl_char_is_quoted_p = gdb_completer_file_name_char_is_quoted; rl_completer_quote_characters = gdb_completer_file_name_quote_characters; filename_completer_generate_completions (tracker, word); } @@ -271,6 +425,7 @@ filename_maybe_quoted_completer_handle_brkchars (gdb_completer_file_name_break_characters); rl_completer_quote_characters = gdb_completer_file_name_quote_characters; + rl_char_is_quoted_p = gdb_completer_file_name_char_is_quoted; } /* See completer.h. */ @@ -1271,6 +1426,7 @@ complete_line_internal_1 (completion_tracker &tracker, completing file names then we can switch to the file name quote character set (i.e., both single- and double-quotes). */ rl_completer_quote_characters = gdb_completer_expression_quote_characters; + rl_char_is_quoted_p = nullptr; /* Decide whether to complete on a list of gdb commands or on symbols. */ @@ -2163,9 +2319,11 @@ completion_tracker::build_completion_result (const char *text, /* Build replacement word, based on the LCD. */ recompute_lowest_common_denominator (); - match_list[0] - = expand_preserving_ws (text, end - start, - m_lowest_common_denominator); + if (rl_filename_completion_desired) + match_list[0] = xstrdup (m_lowest_common_denominator); + else + match_list[0] + = expand_preserving_ws (text, end - start, m_lowest_common_denominator); if (m_lowest_common_denominator_unique) { @@ -3028,6 +3186,11 @@ _initialize_completer () rl_attempted_completion_function = gdb_rl_attempted_completion_function; set_rl_completer_word_break_characters (default_word_break_characters ()); + /* Setup readline globals relating to filename completion. */ + rl_filename_quote_characters = " \t\n\\\"'"; + rl_filename_dequoting_function = gdb_completer_file_name_dequote; + rl_filename_quoting_function = gdb_completer_file_name_quote; + add_setshow_zuinteger_unlimited_cmd ("max-completions", no_class, &max_completions, _("\ Set maximum number of completion candidates."), _("\ diff --git a/gdb/testsuite/gdb.base/filename-completion.exp b/gdb/testsuite/gdb.base/filename-completion.exp index 1ccaaff9afc..275140ffd9d 100644 --- a/gdb/testsuite/gdb.base/filename-completion.exp +++ b/gdb/testsuite/gdb.base/filename-completion.exp @@ -52,6 +52,9 @@ proc setup_directory_tree {} { remote_exec host "touch \"${root}/bb2/dir 2/file 1\"" remote_exec host "touch \"${root}/bb2/dir 2/file 2\"" + remote_exec host "touch \"${root}/bb1/aa\\\"bb\"" + remote_exec host "touch \"${root}/bb1/aa'bb\"" + return $root } @@ -102,12 +105,43 @@ proc run_quoting_and_escaping_tests { root } { if { $qc ne "" } { set sp " " - test_gdb_complete_multiple "$cmd ${qc}${root}/aaa/" \ + test_gdb_complete_multiple "file ${qc}${root}/aaa/" \ "a" "a${sp}" { "aa bb" "aa cc" } "" "${qc}" false \ "expand filenames containing spaces" + + test_gdb_complete_multiple "file ${qc}${root}/bb1/" \ + "a" "a" { + "aa\"bb" + "aa'bb" + } "" "${qc}" false \ + "expand filenames containing quotes" + } else { + set sp "\\ " + + test_gdb_complete_tab_multiple "file ${qc}${root}/aaa/a" \ + "a${sp}" { + "aa bb" + "aa cc" + } false \ + "expand filenames containing spaces" + + test_gdb_complete_tab_multiple "file ${qc}${root}/bb1/a" \ + "a" { + "aa\"bb" + "aa'bb" + } false \ + "expand filenames containing quotes" + + test_gdb_complete_tab_unique "file ${qc}${root}/bb1/aa\\\"" \ + "file ${qc}${root}/bb1/aa\\\\\"bb${qc}" " " \ + "expand unique filename containing double quotes" + + test_gdb_complete_tab_unique "file ${qc}${root}/bb1/aa\\'" \ + "file ${qc}${root}/bb1/aa\\\\'bb${qc}" " " \ + "expand unique filename containing single quote" } } -- 2.25.4