mbox series

[0/6] fix varous tests

Message ID 20200501210211.647-1-thomas@adapt-ip.com
Headers show
Series fix varous tests | expand

Message

Thomas Pedersen May 1, 2020, 9:02 p.m. UTC 
These were tested against linux wireless-testing wt-2020-04-29.

Before this patchset running through parallel-vm.py gets something like:

Failed test cases:
proxyarp_open_ebtables dpp_qr_code_auth_neg_chan dpp_ap_config_p521_p256
fst_dynamic_iface_attach
Failed even on retry:
fst_dynamic_iface_attach proxyarp_open_ebtables
TOTAL=3526 PASS=3265 FAIL=6 SKIP=251

After (if you're lucky :))

Failed test cases:
p2p_ext_vendor_elem_invitation fst_dynamic_iface_attach
Failed even on retry:
fst_dynamic_iface_attach
TOTAL=3524 PASS=3311 FAIL=3 SKIP=207

There are still some tests which seem to fail randomly, but will pass on
retry (ap_ft_reassoc_replay, gas_anqp_venue_url, ap_csa_1_switch,
proxyarp_errors, ...), but at least now only fst_dynamic_iface_attach
seems to fail on retry.

Thomas Pedersen (6):
  tests: fix wpas_mesh_password_mismatch_retry
  tests: sigma_dut: set regulatory inside try/except
  tests: reset country code after exception in wpas_config_file
  tests: mesh: use common utility function to clear regdomain
  tests: proxyarp: skip test if ebtables rule install fails
  tests: flush scan results before checking alloc failure

 tests/hwsim/test_ap_hs20.py     |  8 ++++--
 tests/hwsim/test_scan.py        |  1 +
 tests/hwsim/test_sigma_dut.py   |  2 +-
 tests/hwsim/test_wpas_config.py |  7 +++--
 tests/hwsim/test_wpas_mesh.py   | 51 ++++++---------------------------
 tests/hwsim/utils.py            |  9 ++++++
 tests/hwsim/wpasupplicant.py    |  5 ++--
 7 files changed, 33 insertions(+), 50 deletions(-)