CbC/CbC_llvm: utils/extract_symbols.py annotate

author	Shinji KONO <kono@ie.u-ryukyu.ac.jp>
date	Mon, 25 May 2020 11:07:02 +0900
parents
children

rev	line source
171 66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	1 #!/usr/bin/env python
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	2
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	3 """A tool for extracting a list of symbols to export
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	4
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	5 When exporting symbols from a dll or exe we either need to mark the symbols in
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	6 the source code as __declspec(dllexport) or supply a list of symbols to the
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	7 linker. This program automates the latter by inspecting the symbol tables of a
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	8 list of link inputs and deciding which of those symbols need to be exported.
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	9
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	10 We can't just export all the defined symbols, as there's a limit of 65535
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	11 exported symbols and in clang we go way over that, particularly in a debug
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	12 build. Therefore a large part of the work is pruning symbols either which can't
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	13 be imported, or which we think are things that have definitions in public header
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	14 files (i.e. template instantiations) and we would get defined in the thing
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	15 importing these symbols anyway.
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	16 """
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	17
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	18 from __future__ import print_function
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	19 import sys
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	20 import re
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	21 import os
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	22 import subprocess
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	23 import multiprocessing
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	24 import argparse
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	25
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	26 # Define functions which extract a list of symbols from a library using several
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	27 # different tools. We use subprocess.Popen and yield a symbol at a time instead
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	28 # of using subprocess.check_output and returning a list as, especially on
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	29 # Windows, waiting for the entire output to be ready can take a significant
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	30 # amount of time.
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	31
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	32 def dumpbin_get_symbols(lib):
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	33 process = subprocess.Popen(['dumpbin','/symbols',lib], bufsize=1,
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	34 stdout=subprocess.PIPE, stdin=subprocess.PIPE,
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	35 universal_newlines=True)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	36 process.stdin.close()
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	37 for line in process.stdout:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	38 # Look for external symbols that are defined in some section
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	39 match = re.match("^.+SECT.+External\s+\\|\s+(\S+).*$", line)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	40 if match:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	41 yield match.group(1)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	42 process.wait()
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	43
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	44 def nm_get_symbols(lib):
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	45 process = subprocess.Popen(['nm',lib], bufsize=1,
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	46 stdout=subprocess.PIPE, stdin=subprocess.PIPE,
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	47 universal_newlines=True)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	48 process.stdin.close()
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	49 for line in process.stdout:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	50 # Look for external symbols that are defined in some section
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	51 match = re.match("^\S+\s+[BDGRSTVW]\s+(\S+)$", line)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	52 if match:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	53 yield match.group(1)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	54 process.wait()
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	55
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	56 def readobj_get_symbols(lib):
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	57 process = subprocess.Popen(['llvm-readobj','-symbols',lib], bufsize=1,
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	58 stdout=subprocess.PIPE, stdin=subprocess.PIPE,
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	59 universal_newlines=True)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	60 process.stdin.close()
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	61 for line in process.stdout:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	62 # When looking through the output of llvm-readobj we expect to see Name,
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	63 # Section, then StorageClass, so record Name and Section when we see
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	64 # them and decide if this is a defined external symbol when we see
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	65 # StorageClass.
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	66 match = re.search('Name: (\S+)', line)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	67 if match:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	68 name = match.group(1)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	69 match = re.search('Section: (\S+)', line)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	70 if match:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	71 section = match.group(1)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	72 match = re.search('StorageClass: (\S+)', line)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	73 if match:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	74 storageclass = match.group(1)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	75 if section != 'IMAGE_SYM_ABSOLUTE' and \
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	76 section != 'IMAGE_SYM_UNDEFINED' and \
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	77 storageclass == 'External':
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	78 yield name
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	79 process.wait()
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	80
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	81 # Define functions which determine if the target is 32-bit Windows (as that's
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	82 # where calling convention name decoration happens).
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	83
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	84 def dumpbin_is_32bit_windows(lib):
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	85 # dumpbin /headers can output a huge amount of data (>100MB in a debug
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	86 # build) so we read only up to the 'machine' line then close the output.
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	87 process = subprocess.Popen(['dumpbin','/headers',lib], bufsize=1,
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	88 stdout=subprocess.PIPE, stdin=subprocess.PIPE,
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	89 universal_newlines=True)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	90 process.stdin.close()
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	91 retval = False
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	92 for line in process.stdout:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	93 match = re.match('.+machine \((\S+)\)', line)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	94 if match:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	95 retval = (match.group(1) == 'x86')
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	96 break
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	97 process.stdout.close()
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	98 process.wait()
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	99 return retval
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	100
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	101 def objdump_is_32bit_windows(lib):
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	102 output = subprocess.check_output(['objdump','-f',lib],
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	103 universal_newlines=True)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	104 for line in output:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	105 match = re.match('.+file format (\S+)', line)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	106 if match:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	107 return (match.group(1) == 'pe-i386')
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	108 return False
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	109
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	110 def readobj_is_32bit_windows(lib):
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	111 output = subprocess.check_output(['llvm-readobj','-file-headers',lib],
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	112 universal_newlines=True)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	113 for line in output:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	114 match = re.match('Format: (\S+)', line)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	115 if match:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	116 return (match.group(1) == 'COFF-i386')
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	117 return False
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	118
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	119 # MSVC mangles names to ?<identifier_mangling>@<type_mangling>. By examining the
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	120 # identifier/type mangling we can decide which symbols could possibly be
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	121 # required and which we can discard.
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	122 def should_keep_microsoft_symbol(symbol, calling_convention_decoration):
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	123 # Keep unmangled (i.e. extern "C") names
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	124 if not '?' in symbol:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	125 if calling_convention_decoration:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	126 # Remove calling convention decoration from names
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	127 match = re.match('[_@]([^@]+)', symbol)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	128 if match:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	129 return match.group(1)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	130 return symbol
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	131 # Function template instantiations start with ?$; keep the instantiations of
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	132 # clang::Type::getAs, as some of them are explipict specializations that are
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	133 # defined in clang's lib/AST/Type.cpp; discard the rest as it's assumed that
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	134 # the definition is public
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	135 elif re.match('\?\?\$getAs@.+@Type@clang@@', symbol):
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	136 return symbol
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	137 elif symbol.startswith('??$'):
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	138 return None
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	139 # Deleting destructors start with ?_G or ?_E and can be discarded because
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	140 # link.exe gives you a warning telling you they can't be exported if you
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	141 # don't
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	142 elif symbol.startswith('??_G') or symbol.startswith('??_E'):
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	143 return None
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	144 # Constructors (?0) and destructors (?1) of templates (?$) are assumed to be
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	145 # defined in headers and not required to be kept
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	146 elif symbol.startswith('??0?$') or symbol.startswith('??1?$'):
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	147 return None
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	148 # An anonymous namespace is mangled as ?A(maybe hex number)@. Any symbol
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	149 # that mentions an anonymous namespace can be discarded, as the anonymous
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	150 # namespace doesn't exist outside of that translation unit.
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	151 elif re.search('\?A(0x\w+)?@', symbol):
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	152 return None
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	153 # Keep mangled llvm:: and clang:: function symbols. How we detect these is a
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	154 # bit of a mess and imprecise, but that avoids having to completely demangle
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	155 # the symbol name. The outermost namespace is at the end of the identifier
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	156 # mangling, and the identifier mangling is followed by the type mangling, so
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	157 # we look for (llvm\|clang)@@ followed by something that looks like a
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	158 # function type mangling. To spot a function type we use (this is derived
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	159 # from clang/lib/AST/MicrosoftMangle.cpp):
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	160 # <function-type> ::= <function-class> <this-cvr-qualifiers>
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	161 # <calling-convention> <return-type>
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	162 # <argument-list> <throw-spec>
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	163 # <function-class> ::= [A-Z]
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	164 # <this-cvr-qualifiers> ::= [A-Z0-9_]*
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	165 # <calling-convention> ::= [A-JQ]
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	166 # <return-type> ::= .+
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	167 # <argument-list> ::= X (void)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	168 # ::= .+@ (list of types)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	169 # ::= .*Z (list of types, varargs)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	170 # <throw-spec> ::= exceptions are not allowed
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	171 elif re.search('(llvm\|clang)@@[A-Z][A-Z0-9_][A-JQ].+(X\|.+@\|.Z)$', symbol):
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	172 return symbol
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	173 return None
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	174
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	175 # Itanium manglings are of the form _Z<identifier_mangling><type_mangling>. We
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	176 # demangle the identifier mangling to identify symbols that can be safely
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	177 # discarded.
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	178 def should_keep_itanium_symbol(symbol, calling_convention_decoration):
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	179 # Start by removing any calling convention decoration (which we expect to
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	180 # see on all symbols, even mangled C++ symbols)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	181 if calling_convention_decoration and symbol.startswith('_'):
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	182 symbol = symbol[1:]
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	183 # Keep unmangled names
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	184 if not symbol.startswith('_') and not symbol.startswith('.'):
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	185 return symbol
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	186 # Discard manglings that aren't nested names
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	187 match = re.match('_Z(T[VTIS])?(N.+)', symbol)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	188 if not match:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	189 return None
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	190 # Demangle the name. If the name is too complex then we don't need to keep
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	191 # it, but it the demangling fails then keep the symbol just in case.
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	192 try:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	193 names, _ = parse_itanium_nested_name(match.group(2))
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	194 except TooComplexName:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	195 return None
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	196 if not names:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	197 return symbol
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	198 # Constructors and destructors of templates classes are assumed to be
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	199 # defined in headers and not required to be kept
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	200 if re.match('[CD][123]', names[-1][0]) and names[-2][1]:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	201 return None
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	202 # Keep the instantiations of clang::Type::getAs, as some of them are
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	203 # explipict specializations that are defined in clang's lib/AST/Type.cpp;
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	204 # discard any other function template instantiations as it's assumed that
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	205 # the definition is public
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	206 elif symbol.startswith('_ZNK5clang4Type5getAs'):
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	207 return symbol
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	208 elif names[-1][1]:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	209 return None
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	210 # Keep llvm:: and clang:: names
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	211 elif names[0][0] == '4llvm' or names[0][0] == '5clang':
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	212 return symbol
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	213 # Discard everything else
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	214 else:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	215 return None
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	216
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	217 # Certain kinds of complex manglings we assume cannot be part of a public
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	218 # interface, and we handle them by raising an exception.
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	219 class TooComplexName(Exception):
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	220 pass
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	221
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	222 # Parse an itanium mangled name from the start of a string and return a
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	223 # (name, rest of string) pair.
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	224 def parse_itanium_name(arg):
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	225 # Check for a normal name
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	226 match = re.match('(\d+)(.+)', arg)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	227 if match:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	228 n = int(match.group(1))
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	229 name = match.group(1)+match.group(2)[:n]
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	230 rest = match.group(2)[n:]
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	231 return name, rest
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	232 # Check for constructor/destructor names
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	233 match = re.match('([CD][123])(.+)', arg)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	234 if match:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	235 return match.group(1), match.group(2)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	236 # Assume that a sequence of characters that doesn't end a nesting is an
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	237 # operator (this is very imprecise, but appears to be good enough)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	238 match = re.match('([^E]+)(.+)', arg)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	239 if match:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	240 return match.group(1), match.group(2)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	241 # Anything else: we can't handle it
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	242 return None, arg
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	243
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	244 # Parse an itanium mangled template argument list from the start of a string
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	245 # and throw it away, returning the rest of the string.
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	246 def skip_itanium_template(arg):
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	247 # A template argument list starts with I
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	248 assert arg.startswith('I'), arg
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	249 tmp = arg[1:]
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	250 while tmp:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	251 # Check for names
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	252 match = re.match('(\d+)(.+)', tmp)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	253 if match:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	254 n = int(match.group(1))
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	255 tmp = match.group(2)[n:]
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	256 continue
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	257 # Check for substitutions
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	258 match = re.match('S[A-Z0-9]*_(.+)', tmp)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	259 if match:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	260 tmp = match.group(1)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	261 # Start of a template
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	262 elif tmp.startswith('I'):
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	263 tmp = skip_itanium_template(tmp)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	264 # Start of a nested name
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	265 elif tmp.startswith('N'):
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	266 _, tmp = parse_itanium_nested_name(tmp)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	267 # Start of an expression: assume that it's too complicated
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	268 elif tmp.startswith('L') or tmp.startswith('X'):
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	269 raise TooComplexName
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	270 # End of the template
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	271 elif tmp.startswith('E'):
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	272 return tmp[1:]
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	273 # Something else: probably a type, skip it
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	274 else:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	275 tmp = tmp[1:]
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	276 return None
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	277
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	278 # Parse an itanium mangled nested name and transform it into a list of pairs of
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	279 # (name, is_template), returning (list, rest of string).
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	280 def parse_itanium_nested_name(arg):
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	281 # A nested name starts with N
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	282 assert arg.startswith('N'), arg
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	283 ret = []
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	284
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	285 # Skip past the N, and possibly a substitution
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	286 match = re.match('NS[A-Z0-9]*_(.+)', arg)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	287 if match:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	288 tmp = match.group(1)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	289 else:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	290 tmp = arg[1:]
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	291
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	292 # Skip past CV-qualifiers and ref qualifiers
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	293 match = re.match('[rVKRO]*(.+)', tmp);
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	294 if match:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	295 tmp = match.group(1)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	296
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	297 # Repeatedly parse names from the string until we reach the end of the
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	298 # nested name
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	299 while tmp:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	300 # An E ends the nested name
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	301 if tmp.startswith('E'):
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	302 return ret, tmp[1:]
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	303 # Parse a name
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	304 name_part, tmp = parse_itanium_name(tmp)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	305 if not name_part:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	306 # If we failed then we don't know how to demangle this
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	307 return None, None
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	308 is_template = False
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	309 # If this name is a template record that, then skip the template
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	310 # arguments
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	311 if tmp.startswith('I'):
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	312 tmp = skip_itanium_template(tmp)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	313 is_template = True
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	314 # Add the name to the list
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	315 ret.append((name_part, is_template))
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	316
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	317 # If we get here then something went wrong
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	318 return None, None
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	319
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	320 def extract_symbols(arg):
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	321 get_symbols, should_keep_symbol, calling_convention_decoration, lib = arg
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	322 symbols = dict()
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	323 for symbol in get_symbols(lib):
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	324 symbol = should_keep_symbol(symbol, calling_convention_decoration)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	325 if symbol:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	326 symbols[symbol] = 1 + symbols.setdefault(symbol,0)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	327 return symbols
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	328
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	329 if __name__ == '__main__':
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	330 tool_exes = ['dumpbin','nm','objdump','llvm-readobj']
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	331 parser = argparse.ArgumentParser(
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	332 description='Extract symbols to export from libraries')
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	333 parser.add_argument('--mangling', choices=['itanium','microsoft'],
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	334 required=True, help='expected symbol mangling scheme')
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	335 parser.add_argument('--tools', choices=tool_exes, nargs='*',
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	336 help='tools to use to extract symbols and determine the'
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	337 ' target')
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	338 parser.add_argument('libs', metavar='lib', type=str, nargs='+',
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	339 help='libraries to extract symbols from')
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	340 parser.add_argument('-o', metavar='file', type=str, help='output to file')
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	341 args = parser.parse_args()
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	342
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	343 # Determine the function to use to get the list of symbols from the inputs,
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	344 # and the function to use to determine if the target is 32-bit windows.
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	345 tools = { 'dumpbin' : (dumpbin_get_symbols, dumpbin_is_32bit_windows),
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	346 'nm' : (nm_get_symbols, None),
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	347 'objdump' : (None, objdump_is_32bit_windows),
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	348 'llvm-readobj' : (readobj_get_symbols, readobj_is_32bit_windows) }
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	349 get_symbols = None
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	350 is_32bit_windows = None
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	351 # If we have a tools argument then use that for the list of tools to check
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	352 if args.tools:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	353 tool_exes = args.tools
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	354 # Find a tool to use by trying each in turn until we find one that exists
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	355 # (subprocess.call will throw OSError when the program does not exist)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	356 get_symbols = None
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	357 for exe in tool_exes:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	358 try:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	359 # Close std streams as we don't want any output and we don't
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	360 # want the process to wait for something on stdin.
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	361 p = subprocess.Popen([exe], stdout=subprocess.PIPE,
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	362 stderr=subprocess.PIPE,
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	363 stdin=subprocess.PIPE,
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	364 universal_newlines=True)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	365 p.stdout.close()
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	366 p.stderr.close()
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	367 p.stdin.close()
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	368 p.wait()
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	369 # Keep going until we have a tool to use for both get_symbols and
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	370 # is_32bit_windows
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	371 if not get_symbols:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	372 get_symbols = tools[exe][0]
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	373 if not is_32bit_windows:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	374 is_32bit_windows = tools[exe][1]
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	375 if get_symbols and is_32bit_windows:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	376 break
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	377 except OSError:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	378 continue
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	379 if not get_symbols:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	380 print("Couldn't find a program to read symbols with", file=sys.stderr)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	381 exit(1)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	382 if not is_32bit_windows:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	383 print("Couldn't find a program to determining the target", file=sys.stderr)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	384 exit(1)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	385
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	386 # How we determine which symbols to keep and which to discard depends on
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	387 # the mangling scheme
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	388 if args.mangling == 'microsoft':
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	389 should_keep_symbol = should_keep_microsoft_symbol
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	390 else:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	391 should_keep_symbol = should_keep_itanium_symbol
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	392
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	393 # Get the list of libraries to extract symbols from
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	394 libs = list()
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	395 for lib in args.libs:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	396 # When invoked by cmake the arguments are the cmake target names of the
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	397 # libraries, so we need to add .lib/.a to the end and maybe lib to the
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	398 # start to get the filename. Also allow objects.
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	399 suffixes = ['.lib','.a','.obj','.o']
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	400 if not any([lib.endswith(s) for s in suffixes]):
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	401 for s in suffixes:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	402 if os.path.exists(lib+s):
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	403 lib = lib+s
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	404 break
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	405 if os.path.exists('lib'+lib+s):
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	406 lib = 'lib'+lib+s
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	407 break
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	408 if not any([lib.endswith(s) for s in suffixes]):
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	409 print("Don't know what to do with argument "+lib, file=sys.stderr)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	410 exit(1)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	411 libs.append(lib)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	412
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	413 # Check if calling convention decoration is used by inspecting the first
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	414 # library in the list
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	415 calling_convention_decoration = is_32bit_windows(libs[0])
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	416
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	417 # Extract symbols from libraries in parallel. This is a huge time saver when
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	418 # doing a debug build, as there are hundreds of thousands of symbols in each
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	419 # library.
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	420 pool = multiprocessing.Pool()
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	421 try:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	422 # Only one argument can be passed to the mapping function, and we can't
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	423 # use a lambda or local function definition as that doesn't work on
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	424 # windows, so create a list of tuples which duplicates the arguments
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	425 # that are the same in all calls.
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	426 vals = [(get_symbols, should_keep_symbol, calling_convention_decoration, x) for x in libs]
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	427 # Do an async map then wait for the result to make sure that
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	428 # KeyboardInterrupt gets caught correctly (see
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	429 # http://bugs.python.org/issue8296)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	430 result = pool.map_async(extract_symbols, vals)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	431 pool.close()
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	432 libs_symbols = result.get(3600)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	433 except KeyboardInterrupt:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	434 # On Ctrl-C terminate everything and exit
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	435 pool.terminate()
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	436 pool.join()
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	437 exit(1)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	438
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	439 # Merge everything into a single dict
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	440 symbols = dict()
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	441 for this_lib_symbols in libs_symbols:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	442 for k,v in list(this_lib_symbols.items()):
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	443 symbols[k] = v + symbols.setdefault(k,0)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	444
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	445 # Count instances of member functions of template classes, and map the
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	446 # symbol name to the function+class. We do this under the assumption that if
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	447 # a member function of a template class is instantiated many times it's
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	448 # probably declared in a public header file.
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	449 template_function_count = dict()
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	450 template_function_mapping = dict()
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	451 template_function_count[""] = 0
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	452 for k in symbols:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	453 name = None
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	454 if args.mangling == 'microsoft':
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	455 # Member functions of templates start with
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	456 # ?<fn_name>@?$<class_name>@, so we map to <fn_name>@?$<class_name>.
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	457 # As manglings go from the innermost scope to the outermost scope
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	458 # this means:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	459 # * When we have a function member of a subclass of a template
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	460 # class then <fn_name> will actually contain the mangling of
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	461 # both the subclass and the function member. This is fine.
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	462 # * When we have a function member of a template subclass of a
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	463 # (possibly template) class then it's the innermost template
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	464 # subclass that becomes <class_name>. This should be OK so long
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	465 # as we don't have multiple classes with a template subclass of
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	466 # the same name.
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	467 match = re.search("^\?(\??\w+\@\?\$\w+)\@", k)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	468 if match:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	469 name = match.group(1)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	470 else:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	471 # Find member functions of templates by demangling the name and
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	472 # checking if the second-to-last name in the list is a template.
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	473 match = re.match('_Z(T[VTIS])?(N.+)', k)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	474 if match:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	475 try:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	476 names, _ = parse_itanium_nested_name(match.group(2))
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	477 if names and names[-2][1]:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	478 name = ''.join([x for x,_ in names])
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	479 except TooComplexName:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	480 # Manglings that are too complex should already have been
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	481 # filtered out, but if we happen to somehow see one here
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	482 # just leave it as-is.
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	483 pass
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	484 if name:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	485 old_count = template_function_count.setdefault(name,0)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	486 template_function_count[name] = old_count + 1
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	487 template_function_mapping[k] = name
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	488 else:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	489 template_function_mapping[k] = ""
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	490
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	491 # Print symbols which both:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	492 # * Appear in exactly one input, as symbols defined in multiple
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	493 # objects/libraries are assumed to have public definitions.
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	494 # * Aren't instances of member functions of templates which have been
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	495 # instantiated 100 times or more, which are assumed to have public
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	496 # definitions. (100 is an arbitrary guess here.)
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	497 if args.o:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	498 outfile = open(args.o,'w')
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	499 else:
66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824 Shinji KONO <kono@ie.u-ryukyu.ac.jp> parents: diff changeset	500 outfile = sys.stdout

171

66f3bfe93da9 git version 2c4ca6832fa6b306ee6a7010bfb80a3f2596f824