[GHC] #11018: ApiAnnotations: Add SourceText for unicode tokens

[GHC]

#11018: ApiAnnotations: Add SourceText for unicode tokens
-------------------------------------+-------------------------------------
        Reporter:  alanz             |                Owner:  alanz
            Type:  bug               |               Status:  patch
        Priority:  normal            |            Milestone:  8.0.1
       Component:  Compiler          |              Version:  7.10.2
      Resolution:                    |             Keywords:
                                     |  ApiAnnotations
Operating System:  Unknown/Multiple  |         Architecture:
                                     |  Unknown/Multiple
 Type of failure:  None/Unknown      |            Test Case:
      Blocked By:                    |             Blocking:
 Related Tickets:                    |  Differential Rev(s):  Phab:D1473
       Wiki Page:                    |
-------------------------------------+-------------------------------------

Comment (by Alan Zimmerman <alan.zimm@…>):

 In [changeset:"fe95463bdf42651d53d1edc7723491664257cc5a/ghc" fe95463/ghc]:
 {{{
 #!CommitTicketReference repository="ghc"
 revision="fe95463bdf42651d53d1edc7723491664257cc5a"
 ApiAnnotations: Add SourceText for unicode tokens

 Summary:
 At the moment there is no way to tell if a given token used its unicode
 variant or its normal one, except to look at the length of the token.

 This fails for the unicode '*'.

 Expose the original source text for unicode variants so that API
 Annotations can capture them specifically.

 Test Plan: ./validate

 Reviewers: mpickering, austin, bgamari

 Reviewed By: bgamari

 Subscribers: thomie

 Differential Revision: https://phabricator.haskell.org/D1473

 GHC Trac Issues: #11018
 }}}

--
Ticket URL: <http://ghc.haskell.org/trac/ghc/ticket/11018#comment:5>
GHC <http://www.haskell.org/ghc/>
The Glasgow Haskell Compiler