mbox series

[U-Boot,00/26] test: Include Python tools in test coverage

Message ID 20171113045231.15911-1-sjg@chromium.org
Headers show
Series test: Include Python tools in test coverage | expand

Message

Simon Glass Nov. 13, 2017, 4:52 a.m. UTC 
At present there are a number of tools in U-Boot which have tests which
are not widely used:

  patman   - prepare, check and send patches
  buildman - multi-threaded multi-commit builder
  dtoc     - convert device tree file to C
  binman   - produce firmware images

In fact many tests are broken and this has not been noticed.

This series fixes up the tests and updates 'make tests' to run them. This
should help ensure that the tests stay current.

Note: This series is available at u-boot-dm/binman-working. It requires
Masahiro's pylibfdt series.


Simon Glass (26):
  binman: Add better Makefile debugging
  binman: Add docs explaining how to enable binman for a board
  binman: Add a Makefile for test-program compilation
  binman: Rename tests to ftest
  binman: Disable the no-unit_address_vs_reg warnings
  test/run: Report and return failure
  test: Run binman tests
  patman: Fix up tests to pass with newest checkpatch
  test: Run patman tests
  buildman: Allow skipping of tests which use the network
  buildman: Fix up tests
  test: Run buildman tests
  dtoc: Fix up tests
  test: Run dtoc tests
  binman: Append to PYTHONPATH when running test coverage
  binman: Set up 'entry' to permit full test coverage
  binman: Add tests for importlib availability
  binman: Add a main program to the tests
  binman: Increase test coverage back to 100%
  binman: Check for files missing from test coverage
  binman: Add test for u-boot-spl-bss-pad
  binman: Add a test for x86-start16-spl
  binman: Add add test for SPL with a microcode pointer
  binman: Add add test for using an Intel MRC binary
  binman: Return non-zero exit code on test failure
  RFC: binman: Run code coverage tests

 scripts/Makefile.lib                            |  18 +++-
 test/run                                        |  31 ++++++-
 tools/binman/README                             |  24 +++++-
 tools/binman/binman.py                          |  42 +++++++--
 tools/binman/entry_test.py                      |  36 +++++++-
 tools/binman/etype/u_boot_spl_with_ucode_ptr.py |   2 +-
 tools/binman/etype/u_boot_ucode.py              |  11 +--
 tools/binman/{func_test.py => ftest.py}         | 108 ++++++++++++++++++------
 tools/binman/image.py                           |   7 +-
 tools/binman/test/47_spl_bss_pad.dts            |  17 ++++
 tools/binman/test/48_x86-start16-spl.dts        |  13 +++
 tools/binman/test/49_x86_ucode_spl.dts          |  29 +++++++
 tools/binman/test/50_intel_mrc.dts              |  13 +++
 tools/binman/test/Makefile                      |  39 +++++++++
 tools/binman/test/bss_data                      | Bin 0 -> 5020 bytes
 tools/binman/test/bss_data.c                    |  18 ++++
 tools/binman/test/bss_data.lds                  |  16 ++++
 tools/binman/test/u_boot_no_ucode_ptr.c         |   4 -
 tools/binman/test/u_boot_ucode_ptr.c            |   4 -
 tools/buildman/buildman.py                      |   6 +-
 tools/buildman/cmdline.py                       |   2 +
 tools/buildman/test.py                          |  38 ++++++---
 tools/dtoc/fdt_util.py                          |   3 +-
 tools/dtoc/test_dtoc.py                         |  82 ++++++++----------
 tools/patman/test.py                            |  41 +++++----
 25 files changed, 466 insertions(+), 138 deletions(-)
 rename tools/binman/{func_test.py => ftest.py} (91%)
 create mode 100644 tools/binman/test/47_spl_bss_pad.dts
 create mode 100644 tools/binman/test/48_x86-start16-spl.dts
 create mode 100644 tools/binman/test/49_x86_ucode_spl.dts
 create mode 100644 tools/binman/test/50_intel_mrc.dts
 create mode 100644 tools/binman/test/Makefile
 create mode 100755 tools/binman/test/bss_data
 create mode 100644 tools/binman/test/bss_data.c
 create mode 100644 tools/binman/test/bss_data.lds