www.digitalmars.com

D Programming Language 2.0

Last update Fri Oct 5 00:07:39 2007

std.regexp

Regular expressions are a powerful method of string pattern matching. The regular expression language used is the same as that commonly used, however, some of the very advanced forms may behave slightly differently.

std.regexp is designed to work only with valid UTF strings as input. To validate untrusted input, use std.utf.validate().

In the following guide, pattern[] refers to a regular expression. The attributes[] refers to a string controlling the interpretation of the regular expression. It consists of a sequence of one or more of the following characters:

Attribute Characters
Attribute Action
g global; repeat over the whole input string
i case insensitive
m treat as multiple lines separated by newlines


The format[] string has the formatting characters:

Formatting Characters
Format Replaced With
$$ $
$& The matched substring.
$` The portion of string that precedes the matched substring.
$' The portion of string that follows the matched substring.
$n The nth capture, where n is a single digit 1-9 and n is not followed by a decimal digit.
$nn The nnth capture, where nn is a two-digit decimal number 01-99. If nnth capture is undefined or more than the number of parenthesized subexpressions, use the empty string instead.


Any other $ are left as is.

References:
Wikipedia

const const(char)[] email;
Regular expression to extract an email address

const const(char)[] url;
Regular expression to extract a url

class RegExpException: object.Exception;
One of these gets thrown on compilation errors

const(char)[] sub(const(char)[] s, const(char)[] pattern, const(char)[] format, const(char)[] attributes = null);
Search string for matches with regular expression pattern with attributes. Replace each match with string generated from format.

Params:
const(char)[] s String to search.
const(char)[] pattern Regular expression pattern.
const(char)[] format Replacement string format.
const(char)[] attributes Regular expression attributes.

Returns:
the resulting string

Example:
Replace the letters 'a' with the letters 'ZZ'.
 s = "Strap a rocket engine on a chicken."
 sub(s, "a", "ZZ")        // result: StrZZp a rocket engine on a chicken.
 sub(s, "a", "ZZ", "g")   // result: StrZZp ZZ rocket engine on ZZ chicken.
The replacement format can reference the matches using the $&, $$, $', $`, .. 9 notation:
 sub(s, "[ar]", "[$&]", "g") // result: St[r][a]p [a] [r]ocket engine on [a] chi


const(char)[] sub(const(char)[] s, const(char)[] pattern, const(char)[] delegate(RegExp) dg, const(char)[] attributes = null);
Search string for matches with regular expression pattern with attributes. Pass each match to delegate dg. Replace each match with the return value from dg.

Params:
const(char)[] s String to search.
const(char)[] pattern Regular expression pattern.
const(char)[] delegate(RegExp) dg Delegate
const(char)[] attributes Regular expression attributes.

Returns:
the resulting string.

Example:
Capitalize the letters 'a' and 'r':
 s = "Strap a rocket engine on a chicken.";
 sub(s, "[ar]",
    delegate char[] (RegExp m)
    {
         return toupper(m.match(0));
    },
    "g");    // result: StRAp A Rocket engine on A chicken.


int find(const(char)[] s, const(char)[] pattern, const(char)[] attributes = null);
Search s[] for first match with pattern[] with attributes[].

Params:
const(char)[] s String to search.
const(char)[] pattern Regular expression pattern.
const(char)[] attributes Regular expression attributes.

Returns:
index into s[] of match if found, -1 if no match.

Example:
 auto s = "abcabcabab";
 std.regexp.find(s, "b");    // match, returns 1
 std.regexp.find(s, "f");    // no match, returns -1


int rfind(const(char)[] s, const(char)[] pattern, const(char)[] attributes = null);
Search s[] for last match with pattern[] with attributes[].

Params:
const(char)[] s String to search.
const(char)[] pattern Regular expression pattern.
const(char)[] attributes Regular expression attributes.

Returns:
index into s[] of match if found, -1 if no match.

Example:
 auto s = "abcabcabab";
 std.regexp.find(s, "b");    // match, returns 9
 std.regexp.find(s, "f");    // no match, returns -1


const(char)[][] split(const(char)[] s, const(char)[] pattern, const(char)[] attributes = null);
Split s[] into an array of strings, using the regular expression pattern[] with attributes[] as the separator.

Params:
const(char)[] s String to search.
const(char)[] pattern Regular expression pattern.
const(char)[] attributes Regular expression attributes.

Returns:
array of slices into s[]

Example:
 foreach (s; split("abcabcabab", "C.", "i"))
 {
     writefln("s = '%s'", s);
 }
 // Prints:
 // s = 'ab'
 // s = 'b'
 // s = 'bab'


RegExp search(const(char)[] s, const(char)[] pattern, const(char)[] attributes = null);
Search s[] for first match with pattern[] with attributes[].

Params:
const(char)[] s String to search.
const(char)[] pattern Regular expression pattern.
const(char)[] attributes Regular expression attributes.

Returns:
corresponding RegExp if found, null if not.

Example:
 import std.stdio;
 import std.regexp;

 void main()
 {
     if (auto m = std.regexp.search("abcdef", "c"))
     {
         writefln("%s[%s]%s", m.pre, m.match(0), m.post);
     }
 }
 // Prints:
 // ab[c]def


class RegExp;
RegExp is a class to handle regular expressions.

It is the core foundation for adding powerful string pattern matching capabilities to programs like grep, text editors, awk, sed, etc.

this(const(char)[] pattern, const(char)[] attributes = null);
Construct a RegExp object. Compile pattern with attributes into an internal form for fast execution.

Params:
const(char)[] pattern regular expression
const(char)[] attributes attributes

Throws:
RegExpException if there are any compilation errors.

Example:
Declare two variables and assign to them a RegExp object:
 auto r = new RegExp("pattern");
 auto s = new RegExp(r"p[1-5]\s*");


static RegExp opCall(const(char)[] pattern, const(char)[] attributes = null);
Generate instance of RegExp.

Params:
const(char)[] pattern regular expression
const(char)[] attributes attributes

Throws:
RegExpException if there are any compilation errors.

Example:
Declare two variables and assign to them a RegExp object:
 auto r = RegExp("pattern");
 auto s = RegExp(r"p[1-5]\s*");


RegExp search(const(char)[] string);
int opApply(int delegate(ref RegExp) dg);
Set up for start of foreach loop.

Returns:
search() returns instance of RegExp set up to search string[].

Example:
 import std.stdio;
 import std.regexp;

 void main()
 {
     foreach(m; RegExp("ab").search("abcabcabab"))
     {
         writefln("%s[%s]%s", m.pre, m.match(0), m.post);
     }
 }
 // Prints:
 // [ab]cabcabab
 // abc[ab]cabab
 // abcabc[ab]ab
 // abcabcab[ab]


const(char)[] match(uint n);
Retrieve match n.

n==0 means the matched substring, n>0 means the n'th parenthesized subexpression. if n is larger than the number of parenthesized subexpressions, null is returned.

const(char)[] pre();
Return the slice of the input that precedes the matched substring.

const(char)[] post();
Return the slice of the input that follows the matched substring.

const(char)[][] split(const(char)[] s);
Split s[] into an array of strings, using the regular expression as the separator.

Returns:
array of slices into s[]

int find(const(char)[] string);
Search string[] for match with regular expression.

Returns:
index of match if successful, -1 if not found

const(char)[][] match(const(char)[] s);
Search s[] for match.

Returns:
If global attribute, return same value as exec(s). If not global attribute, return array of all matches.

const(char)[] replace(const(char)[] s, const(char)[] format);
Find regular expression matches in s[]. Replace those matches with a new string composed of format[] merged with the result of the matches. If global, replace all matches. Otherwise, replace first match.

Returns:
the new string

const(char)[][] exec(const(char)[] string);
Search string[] for match.

Returns:
array of slices into string[] representing matches

const(char)[][] exec();
Pick up where last exec(string) or exec() left off, searching string[] for next match.

Returns:
array of slices into string[] representing matches

int test(const(char)[] s);
Search s[] for match.

Returns:
0 for no match, !=0 for match

Example:
import std.stdio;
import std.regexp;
import std.string;

int grep(int delegate(char[]) pred, char[][] list)
{
  int count;
  foreach (s; list)
  {  if (pred(s))
       ++count;
  }
  return count;
}

void main()
{
  auto x = grep(&RegExp("[Ff]oo").test,
                std.string.split("mary had a foo lamb"));
  writefln(x);
}
which prints: 1

int test();
Pick up where last test(string) or test() left off, and search again.

Returns:
0 for no match, !=0 for match

int test(const(char)[] s, int startindex);
Test s[] starting at startindex against regular expression.

Returns:
0 for no match, !=0 for match

const(char)[] replace(const(char)[] format);
After a match is found with test(), this function will take the match results and, using the format string, generate and return a new string.

const(char)[] replaceOld(const(char)[] format);
Like replace(char[] format), but uses old style formatting:
Format Description
& replace with the match
\n replace with the nth parenthesized match, n is 1..9
\c replace with char c.