/opt/stack/tempest ~
Initializing stestr
all-plugin create: /opt/stack/tempest/.tox/all-plugin
all-plugin installdeps: -chttps://releases.openstack.org/constraints/upper/master, -r/opt/stack/tempest/requirements.txt
all-plugin develop-inst: /opt/stack/tempest
all-plugin installed: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead,  from cryptography.utils import int_from_bytes,/usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead,  from cryptography.utils import int_from_bytes,alembic==1.6.5,amqp==5.0.6,aniso8601==9.0.1,appdirs==1.4.4,attrs==21.2.0,Automat==0.8.0,automaton==2.3.0,Babel==2.9.1,bcrypt==3.2.0,beautifulsoup4==4.9.3,blinker==1.4,boto3==1.17.88,botocore==1.20.88,cachetools==4.2.2,castellan==3.8.0,certifi==2021.5.30,cffi==1.14.5,chardet==4.0.0,-e git+https://opendev.org/openstack/cinder@d5f0e51879c03654db4bf89564695e01af593350#egg=cinder,click==8.0.1,cliff==3.8.0,cmd2==2.0.1,colorama==0.4.4,command-not-found==0.3,configobj==5.0.6,configshell-fb==1.1.25,constantly==15.1.0,cryptography==3.4.7,cursive==0.2.2,dbus-python==1.2.16,debtcollector==2.2.0,decorator==4.4.2,defusedxml==0.7.1,distlib==0.3.2,distro==1.4.0,distro-info===0.23ubuntu1,dnspython==1.16.0,dogpile.cache==1.1.3,elementpath==2.2.2,entrypoints==0.3,etcd3==0.12.0,etcd3gw==0.2.5,eventlet==0.30.2,extras==1.0.0,fasteners==0.14.1,filelock==3.0.12,fixtures==3.0.0,Flask==2.0.1,Flask-RESTful==0.3.9,future==0.18.2,futurist==2.3.0,-e git+https://opendev.org/openstack/glance@4f20e5007f3cef4b2406051744356ee56c1d3c25#egg=glance,glance-store==2.5.0,google-api-core==1.29.0,google-api-python-client==2.7.0,google-auth==1.30.1,google-auth-httplib2==0.1.0,googleapis-common-protos==1.53.0,greenlet==1.1.0,grpcio==1.38.0,httplib2==0.19.1,hyperlink==19.0.0,idna==2.10,importlib-metadata==1.5.0,importlib-resources==5.1.4,incremental==16.10.1,iso8601==0.1.14,itsdangerous==2.0.1,Jinja2==3.0.1,jmespath==0.10.0,jsonpatch==1.32,jsonpointer==2.1,jsonschema==3.2.0,keyring==18.0.1,-e git+https://opendev.org/openstack/keystone@0783e46e33236dc29833c2896920ade3d3f45126#egg=keystone,keystoneauth1==4.3.1,keystonemiddleware==9.3.0,kombu==5.1.0,language-selector==0.1,lazr.uri==1.0.3,linecache2==1.0.0,logutils==0.3.5,lxml==4.6.3,Mako==1.1.4,MarkupSafe==2.0.1,microversion-parse==1.0.1,monotonic==1.6,more-itertools==4.2.0,msgpack==1.0.2,munch==2.5.0,mysqlclient==1.4.4,netaddr==0.8.0,netifaces==0.11.0,-e git+https://opendev.org/openstack/networking-hyperv@a913cc69ace39c8e738ae823ae3bad1bcaa2da73#egg=networking_hyperv,networkx==2.5.1,-e git+http://10.106.1.39/p/openstack/neutron@9a4f536ec7284bf0ba30a533505421f64bc19671#egg=neutron,neutron-lib==2.11.0,-e git+https://opendev.org/openstack/nova@1a1a6a042c5b2295c7ab38b0387f3c234a704462#egg=nova,numpy==1.20.3,oauth2client==4.1.3,oauthlib==3.1.1,-e git+https://opendev.org/openstack/placement.git@7e0f288dd4dab3e06f892f34839ba90600e5d360#egg=openstack_placement,openstacksdk==0.57.0,os-brick==4.4.0,os-client-config==2.1.0,os-ken==2.0.0,os-resource-classes==1.0.0,os-service-types==1.7.0,os-testr==2.0.0,os-traits==2.5.0,os-vif==2.5.0,os-win==5.4.0,os-xenapi==0.3.4,osc-lib==2.4.0,osc-placement==3.0.0,oslo.cache==2.8.0,oslo.concurrency==4.4.0,oslo.config==8.7.0,oslo.context==3.3.0,oslo.db==9.0.0,oslo.i18n==5.0.1,oslo.log==4.5.0,oslo.messaging==12.8.0,oslo.middleware==4.2.0,oslo.policy==3.8.0,oslo.privsep==2.5.0,oslo.reports==2.2.0,oslo.rootwrap==6.2.0,oslo.serialization==4.1.0,oslo.service==2.5.0,oslo.upgradecheck==1.4.0,oslo.utils==4.9.0,oslo.versionedobjects==2.4.0,oslo.vmware==3.9.0,osprofiler==3.4.0,ovs==2.13.3,ovsdbapp==1.10.0,packaging==20.9,paramiko==2.7.2,passlib==1.7.4,Paste==3.5.0,PasteDeploy==2.1.1,pbr==5.6.0,pcp==5.0,pecan==1.3.3,pexpect==4.6.0,pluggy==0.13.1,prettytable==0.7.2,protobuf==3.17.2,psutil==5.8.0,py==1.10.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycadf==3.1.1,pycparser==2.20,pydot==1.4.2,pyeclib==1.6.0,Pygments==2.3.1,PyGObject==3.36.0,PyHamcrest==1.9.0,pyinotify==0.9.6,PyJWT==2.1.0,pymacaroons==0.13.0,PyMySQL==1.0.2,PyNaCl==1.4.0,pyOpenSSL==20.0.1,pyparsing==2.4.7,pyperclip==1.8.2,pypowervm==1.1.26,pyroute2==0.6.4,pyroute2.core==0.6.4,pyroute2.ethtool==0.6.4,pyroute2.ipdb==0.6.4,pyroute2.ipset==0.6.4,pyroute2.ndb==0.6.4,pyroute2.nftables==0.6.4,pyroute2.nslink==0.6.4,pyrsistent==0.15.5,pysaml2==7.0.1,pyserial==3.4,python-apt==2.0.0+ubuntu0.20.4.4,python-barbicanclient==5.1.0,python-cinderclient==7.4.0,python-dateutil==2.8.1,python-debian===0.1.36ubuntu1,python-designateclient==4.3.0,python-editor==1.0.4,python-glanceclient==3.3.0,python-keystoneclient==4.2.0,python-memcached==1.59,python-mimeparse==1.6.0,python-neutronclient==7.4.0,python-novaclient==17.5.0,python-openstackclient==5.5.0,python-subunit==1.4.0,python-swiftclient==3.12.0,pytz==2021.1,pyudev==0.22.0,PyYAML==5.4.1,repoze.lru==0.7,requests==2.25.1,requests-unixsocket==0.2.0,requestsexceptions==1.4.0,retrying==1.3.3,rfc3986==1.5.0,Routes==2.5.1,rsa==4.7.2,rtslib-fb==2.1.74,s3transfer==0.4.2,scrypt==0.8.18,SecretStorage==2.3.1,setproctitle==1.2.2,simplegeneric==0.8.1,simplejson==3.17.2,six==1.16.0,sortedcontainers==2.1.0,sos==4.1,soupsieve==2.2.1,SQLAlchemy==1.3.23,sqlalchemy-migrate==0.13.0,sqlparse==0.4.1,ssh-import-id==5.10,statsd==3.3.0,stestr==3.2.0,stevedore==3.3.0,suds-jurko==0.6,-e git+https://opendev.org/openstack/swift@5bc28a7febe8c45df6f489d3de12870fb1b81f58#egg=swift,systemd-python==234,tabulate==0.8.9,targetcli-fb==2.1.51,taskflow==4.6.0,-e git+https://opendev.org/openstack/tempest@663787ee794df54e7ded41e5f3e8ae246e9b4288#egg=tempest,Tempita==0.5.2,tenacity==6.3.1,testresources==2.0.1,testscenarios==0.5.0,testtools==2.4.0,toml==0.10.2,tooz==2.9.0,tox==3.23.1,traceback2==1.4.0,ufw==0.36,unattended-upgrades==0.1,unittest2==1.1.0,uritemplate==3.0.1,urllib3==1.26.5,urwid==2.0.1,vine==5.0.0,virtualenv==20.4.7,voluptuous==0.12.1,wadllib==1.3.3,waitress==2.0.0,warlock==1.3.3,wcwidth==0.2.5,WebOb==1.8.7,websockify==0.9.0,WebTest==2.0.35,Werkzeug==2.0.1,wrapt==1.12.1,WSME==0.10.1,xattr==0.9.7,xmlschema==1.6.2,yappi==1.3.2,zipp==3.4.1,zope.interface==4.7.1,zstd==1.5.0.2,zVMCloudConnector==1.4.1
___________________________________ summary ____________________________________
  all-plugin: skipped tests
  congratulations :)
{7} tempest.api.network.admin.test_metering_extensions.MeteringIpV6TestJSON.test_create_delete_metering_label_rule_with_filters [1.045495s] ... ok
{7} tempest.api.network.admin.test_metering_extensions.MeteringIpV6TestJSON.test_create_delete_metering_label_with_filters [1.581168s] ... ok
{7} tempest.api.network.admin.test_metering_extensions.MeteringIpV6TestJSON.test_list_metering_label_rules [0.124386s] ... ok
{7} tempest.api.network.admin.test_metering_extensions.MeteringIpV6TestJSON.test_list_metering_labels [0.059179s] ... ok
{7} tempest.api.network.admin.test_metering_extensions.MeteringIpV6TestJSON.test_show_metering_label [0.312769s] ... ok
{7} tempest.api.network.admin.test_metering_extensions.MeteringIpV6TestJSON.test_show_metering_label_rule [0.170660s] ... ok
{3} tempest.api.network.admin.test_routers_negative.RoutersAdminNegativeTest.test_router_set_gateway_used_ip_returns_409 [12.177614s] ... ok
{1} tempest.api.network.admin.test_dhcp_agent_scheduler.DHCPAgentSchedulersTestJSON.test_add_remove_network_from_dhcp_agent [9.930700s] ... ok
{1} tempest.api.network.admin.test_dhcp_agent_scheduler.DHCPAgentSchedulersTestJSON.test_list_dhcp_agent_hosting_network [0.374298s] ... ok
{1} tempest.api.network.admin.test_dhcp_agent_scheduler.DHCPAgentSchedulersTestJSON.test_list_networks_hosted_by_one_dhcp [1.131720s] ... ok
{3} tempest.api.network.test_agent_management_negative.AgentManagementNegativeTest.test_list_agents_non_admin [0.333081s] ... ok
{5} tempest.api.network.test_dhcp_ipv6.NetworksTestDHCPv6.test_dhcp_stateful [30.838377s] ... ok
{7} tempest.api.network.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON.test_create_list_port_with_address_pair [9.355232s] ... ok
{1} tempest.api.network.admin.test_external_networks_negative.ExternalNetworksAdminNegativeTestJSON.test_create_port_with_precreated_floatingip_as_fixed_ip [13.466338s] ... ok
{3} tempest.api.network.test_extra_dhcp_options.ExtraDHCPOptionsIpV6TestJSON.test_create_list_port_with_extra_dhcp_options [10.889587s] ... ok
{7} tempest.api.network.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON.test_update_port_with_address_pair [16.645461s] ... FAILED

Captured traceback:
~~~~~~~~~~~~~~~~~~~
    Traceback (most recent call last):

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 105, in test_update_port_with_address_pair
    self._update_port_with_address(self.ip_address)

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 100, in _update_port_with_address
    self.assertCountEqual(allowed_address_pair, allowed_address_pairs)

      File "/usr/lib/python3.8/unittest/case.py", line 1272, in assertCountEqual
    self.fail(msg)

      File "/opt/stack/tempest/.tox/venv/lib/python3.8/site-packages/unittest2/case.py", line 690, in fail
    raise self.failureException(msg)

    AssertionError: Element counts were not equal:
First has 1, Second has 0:  {'mac_address': 'fa:16:3e:7e:fd:7d', 'ip_address': '2001:db8::30d', 'active': True}
First has 0, Second has 1:  {'ip_address': '2001:db8::30d', 'mac_address': 'fa:16:3e:7e:fd:7d'}


Captured pythonlogging:
~~~~~~~~~~~~~~~~~~~~~~~
    2021-06-08 12:19:42,241 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:test_update_port_with_address_pair): 201 POST http://10.222.0.44:9696/v2.0/ports 3.676s
2021-06-08 12:19:42,241 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"network_id": "d02a2a90-aff3-4c96-b2fc-3f9c7f86998f", "name": "tempest-AllowedAddressPairIpV6TestJSON-462735305"}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '744', 'x-openstack-request-id': 'req-56d6ae49-a274-447c-b393-de02b158094e', 'date': 'Tue, 08 Jun 2021 12:19:42 GMT', 'connection': 'close', 'status': '201', 'content-location': 'http://10.222.0.44:9696/v2.0/ports'}
        Body: b'{"port":{"id":"06d3e650-188f-49bd-b0ba-46c0d7f88020","name":"tempest-AllowedAddressPairIpV6TestJSON-462735305","network_id":"d02a2a90-aff3-4c96-b2fc-3f9c7f86998f","tenant_id":"c20763a485ee4aefb5e052fd9c040973","mac_address":"fa:16:3e:32:20:55","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"05119fe9-49be-4b13-a2a8-878c568c0e93","ip_address":"2001:db8::14f"}],"project_id":"c20763a485ee4aefb5e052fd9c040973","port_security_enabled":true,"security_groups":["1848c0e7-6303-4e84-9633-c5c5c497de44"],"binding:vnic_type":"normal","allowed_address_pairs":[],"extra_dhcp_opts":[],"description":"","tags":[],"created_at":"2021-06-08T12:19:39Z","updated_at":"2021-06-08T12:19:40Z","revision_number":1}}'
2021-06-08 12:19:47,970 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:test_update_port_with_address_pair): 200 PUT http://10.222.0.44:9696/v2.0/ports/06d3e650-188f-49bd-b0ba-46c0d7f88020 5.728s
2021-06-08 12:19:47,970 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"allowed_address_pairs": [{"ip_address": "2001:db8::30d", "mac_address": "fa:16:3e:7e:fd:7d"}]}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '822', 'x-openstack-request-id': 'req-6f166bd8-aeba-4edc-ae13-727d143a953a', 'date': 'Tue, 08 Jun 2021 12:19:47 GMT', 'connection': 'close', 'status': '200', 'content-location': 'http://10.222.0.44:9696/v2.0/ports/06d3e650-188f-49bd-b0ba-46c0d7f88020'}
        Body: b'{"port":{"id":"06d3e650-188f-49bd-b0ba-46c0d7f88020","name":"tempest-AllowedAddressPairIpV6TestJSON-462735305","network_id":"d02a2a90-aff3-4c96-b2fc-3f9c7f86998f","tenant_id":"c20763a485ee4aefb5e052fd9c040973","mac_address":"fa:16:3e:32:20:55","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"05119fe9-49be-4b13-a2a8-878c568c0e93","ip_address":"2001:db8::14f"}],"allowed_address_pairs":[{"mac_address":"fa:16:3e:7e:fd:7d","ip_address":"2001:db8::30d","active":true}],"extra_dhcp_opts":[],"security_groups":["1848c0e7-6303-4e84-9633-c5c5c497de44"],"description":"","binding:vnic_type":"normal","port_security_enabled":true,"tags":[],"created_at":"2021-06-08T12:19:39Z","updated_at":"2021-06-08T12:19:45Z","revision_number":2,"project_id":"c20763a485ee4aefb5e052fd9c040973"}}'
2021-06-08 12:19:55,052 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:_run_cleanups): 204 DELETE http://10.222.0.44:9696/v2.0/ports/06d3e650-188f-49bd-b0ba-46c0d7f88020 7.075s
2021-06-08 12:19:55,053 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-length': '0', 'x-openstack-request-id': 'req-b8d1b043-178e-4aa6-beb4-394be0111640', 'date': 'Tue, 08 Jun 2021 12:19:55 GMT', 'connection': 'close', 'status': '204', 'content-location': 'http://10.222.0.44:9696/v2.0/ports/06d3e650-188f-49bd-b0ba-46c0d7f88020'}
        Body: b''
2021-06-08 12:19:55,209 107895 INFO     [tempest.lib.co
    mmon.rest_client] Request (AllowedAddressPairIpV6TestJSON:_run_cleanups): 404 GET http://10.222.0.44:9696/v2.0/ports/06d3e650-188f-49bd-b0ba-46c0d7f88020 0.155s
2021-06-08 12:19:55,209 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-type': 'application/json', 'content-length': '132', 'x-openstack-request-id': 'req-573c99a6-d4f7-48b3-bb26-220efa7340dc', 'date': 'Tue, 08 Jun 2021 12:19:55 GMT', 'connection': 'close', 'status': '404', 'content-location': 'http://10.222.0.44:9696/v2.0/ports/06d3e650-188f-49bd-b0ba-46c0d7f88020'}
        Body: b'{"NeutronError": {"type": "PortNotFound", "message": "Port 06d3e650-188f-49bd-b0ba-46c0d7f88020 could not be found.", "detail": ""}}'

{3} tempest.api.network.test_extra_dhcp_options.ExtraDHCPOptionsIpV6TestJSON.test_update_show_port_with_extra_dhcp_options [2.473615s] ... ok
{4} tempest.api.network.admin.test_floating_ips_admin_actions.FloatingIPAdminTestJSON.test_create_list_show_floating_ip_with_tenant_id_by_admin [21.707867s] ... ok
{7} tempest.api.network.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON.test_update_port_with_cidr_address_pair [8.111753s] ... FAILED

Captured traceback:
~~~~~~~~~~~~~~~~~~~
    Traceback (most recent call last):

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 110, in test_update_port_with_cidr_address_pair
    self._update_port_with_address(str(self.cidr))

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 100, in _update_port_with_address
    self.assertCountEqual(allowed_address_pair, allowed_address_pairs)

      File "/usr/lib/python3.8/unittest/case.py", line 1272, in assertCountEqual
    self.fail(msg)

      File "/opt/stack/tempest/.tox/venv/lib/python3.8/site-packages/unittest2/case.py", line 690, in fail
    raise self.failureException(msg)

    AssertionError: Element counts were not equal:
First has 1, Second has 0:  {'mac_address': 'fa:16:3e:7e:fd:7d', 'ip_address': '2001:db8::/48', 'active': True}
First has 0, Second has 1:  {'ip_address': '2001:db8::/48', 'mac_address': 'fa:16:3e:7e:fd:7d'}


Captured pythonlogging:
~~~~~~~~~~~~~~~~~~~~~~~
    2021-06-08 12:19:57,827 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:test_update_port_with_cidr_address_pair): 201 POST http://10.222.0.44:9696/v2.0/ports 2.616s
2021-06-08 12:19:57,828 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"network_id": "d02a2a90-aff3-4c96-b2fc-3f9c7f86998f", "name": "tempest-AllowedAddressPairIpV6TestJSON-905056580"}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '743', 'x-openstack-request-id': 'req-7e4eccac-0e70-4ecc-9c7e-baa960e04aa2', 'date': 'Tue, 08 Jun 2021 12:19:57 GMT', 'connection': 'close', 'status': '201', 'content-location': 'http://10.222.0.44:9696/v2.0/ports'}
        Body: b'{"port":{"id":"70f2d22e-b2d9-4539-9984-541467b2c8b2","name":"tempest-AllowedAddressPairIpV6TestJSON-905056580","network_id":"d02a2a90-aff3-4c96-b2fc-3f9c7f86998f","tenant_id":"c20763a485ee4aefb5e052fd9c040973","mac_address":"fa:16:3e:a7:be:0d","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"05119fe9-49be-4b13-a2a8-878c568c0e93","ip_address":"2001:db8::cf"}],"project_id":"c20763a485ee4aefb5e052fd9c040973","port_security_enabled":true,"security_groups":["1848c0e7-6303-4e84-9633-c5c5c497de44"],"binding:vnic_type":"normal","allowed_address_pairs":[],"extra_dhcp_opts":[],"description":"","tags":[],"created_at":"2021-06-08T12:19:56Z","updated_at":"2021-06-08T12:19:56Z","revision_number":1}}'
2021-06-08 12:19:59,910 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:test_update_port_with_cidr_address_pair): 200 PUT http://10.222.0.44:9696/v2.0/ports/70f2d22e-b2d9-4539-9984-541467b2c8b2 2.081s
2021-06-08 12:19:59,910 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"allowed_address_pairs": [{"ip_address": "2001:db8::/48", "mac_address": "fa:16:3e:7e:fd:7d"}]}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '821', 'x-openstack-request-id': 'req-e11494f9-fd03-46da-b0e4-bbe083863c5d', 'date': 'Tue, 08 Jun 2021 12:19:59 GMT', 'connection': 'close', 'status': '200', 'content-location': 'http://10.222.0.44:9696/v2.0/ports/70f2d22e-b2d9-4539-9984-541467b2c8b2'}
        Body: b'{"port":{"id":"70f2d22e-b2d9-4539-9984-541467b2c8b2","name":"tempest-AllowedAddressPairIpV6TestJSON-905056580","network_id":"d02a2a90-aff3-4c96-b2fc-3f9c7f86998f","tenant_id":"c20763a485ee4aefb5e052fd9c040973","mac_address":"fa:16:3e:a7:be:0d","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"05119fe9-49be-4b13-a2a8-878c568c0e93","ip_address":"2001:db8::cf"}],"allowed_address_pairs":[{"mac_address":"fa:16:3e:7e:fd:7d","ip_address":"2001:db8::/48","active":true}],"extra_dhcp_opts":[],"security_groups":["1848c0e7-6303-4e84-9633-c5c5c497de44"],"description":"","binding:vnic_type":"normal","port_security_enabled":true,"tags":[],"created_at":"2021-06-08T12:19:56Z","updated_at":"2021-06-08T12:19:59Z","revision_number":2,"project_id":"c20763a485ee4aefb5e052fd9c040973"}}'
2021-06-08 12:20:03,065 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:_run_cleanups): 204 DELETE http://10.222.0.44:9696/v2.0/ports/70f2d22e-b2d9-4539-9984-541467b2c8b2 3.153s
2021-06-08 12:20:03,065 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-length': '0', 'x-openstack-request-id': 'req-43d20923-f617-47b2-9e2a-701c1c689a41', 'date': 'Tue, 08 Jun 2021 12:20:03 GMT', 'connection': 'close', 'status': '204', 'content-location': 'http://10.222.0.44:9696/v2.0/ports/70f2d22e-b2d9-4539-9984-541467b2c8b2'}
        Body: b''
2021-06-08 12:20:03,321 107895 INFO     [tempes
    t.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:_run_cleanups): 404 GET http://10.222.0.44:9696/v2.0/ports/70f2d22e-b2d9-4539-9984-541467b2c8b2 0.255s
2021-06-08 12:20:03,322 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-type': 'application/json', 'content-length': '132', 'x-openstack-request-id': 'req-cd6abb53-ebea-46d4-84a3-31d3349d1d9a', 'date': 'Tue, 08 Jun 2021 12:20:03 GMT', 'connection': 'close', 'status': '404', 'content-location': 'http://10.222.0.44:9696/v2.0/ports/70f2d22e-b2d9-4539-9984-541467b2c8b2'}
        Body: b'{"NeutronError": {"type": "PortNotFound", "message": "Port 70f2d22e-b2d9-4539-9984-541467b2c8b2 could not be found.", "detail": ""}}'

{1} tempest.api.network.admin.test_negative_quotas.QuotasNegativeTest.test_network_quota_exceeding [9.918447s] ... ok
{7} tempest.api.network.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON.test_update_port_with_multiple_ip_mac_address_pair [12.879519s] ... FAILED

Captured traceback:
~~~~~~~~~~~~~~~~~~~
    Traceback (most recent call last):

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 129, in test_update_port_with_multiple_ip_mac_address_pair
    self._update_port_with_address(

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 100, in _update_port_with_address
    self.assertCountEqual(allowed_address_pair, allowed_address_pairs)

      File "/usr/lib/python3.8/unittest/case.py", line 1272, in assertCountEqual
    self.fail(msg)

      File "/opt/stack/tempest/.tox/venv/lib/python3.8/site-packages/unittest2/case.py", line 690, in fail
    raise self.failureException(msg)

    AssertionError: Element counts were not equal:
First has 1, Second has 0:  {'mac_address': 'fa:16:3e:7e:fd:7d', 'ip_address': '2001:db8::30d', 'active': True}
First has 1, Second has 0:  {'mac_address': 'fa:16:3e:f8:d2:54', 'ip_address': '2001:db8::99', 'active': True}
First has 0, Second has 1:  {'ip_address': '2001:db8::30d', 'mac_address': 'fa:16:3e:7e:fd:7d'}
First has 0, Second has 1:  {'ip_address': '2001:db8::99', 'mac_address': 'fa:16:3e:f8:d2:54'}


Captured pythonlogging:
~~~~~~~~~~~~~~~~~~~~~~~
    2021-06-08 12:20:06,448 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:test_update_port_with_multiple_ip_mac_address_pair): 201 POST http://10.222.0.44:9696/v2.0/ports 3.122s
2021-06-08 12:20:06,448 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"network_id": "d02a2a90-aff3-4c96-b2fc-3f9c7f86998f", "name": "tempest-AllowedAddressPairIpV6TestJSON-1494202098"}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '744', 'x-openstack-request-id': 'req-51cda261-1ed4-4094-94ea-be5aaf267e4a', 'date': 'Tue, 08 Jun 2021 12:20:06 GMT', 'connection': 'close', 'status': '201', 'content-location': 'http://10.222.0.44:9696/v2.0/ports'}
        Body: b'{"port":{"id":"f09cccaf-7446-4f14-a1d9-525d3935b736","name":"tempest-AllowedAddressPairIpV6TestJSON-1494202098","network_id":"d02a2a90-aff3-4c96-b2fc-3f9c7f86998f","tenant_id":"c20763a485ee4aefb5e052fd9c040973","mac_address":"fa:16:3e:f8:d2:54","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"05119fe9-49be-4b13-a2a8-878c568c0e93","ip_address":"2001:db8::99"}],"project_id":"c20763a485ee4aefb5e052fd9c040973","port_security_enabled":true,"security_groups":["1848c0e7-6303-4e84-9633-c5c5c497de44"],"binding:vnic_type":"normal","allowed_address_pairs":[],"extra_dhcp_opts":[],"description":"","tags":[],"created_at":"2021-06-08T12:20:04Z","updated_at":"2021-06-08T12:20:05Z","revision_number":1}}'
2021-06-08 12:20:08,227 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:test_update_port_with_multiple_ip_mac_address_pair): 201 POST http://10.222.0.44:9696/v2.0/ports 1.778s
2021-06-08 12:20:08,228 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"network_id": "d02a2a90-aff3-4c96-b2fc-3f9c7f86998f", "name": "tempest-AllowedAddressPairIpV6TestJSON-1145511128"}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '745', 'x-openstack-request-id': 'req-8b3e8728-a841-4e33-b45b-ae8e18783b10', 'date': 'Tue, 08 Jun 2021 12:20:08 GMT', 'connection': 'close', 'status': '201', 'content-location': 'http://10.222.0.44:9696/v2.0/ports'}
        Body: b'{"port":{"id":"0d1be92d-01b7-466d-b5a0-bb2844fe3575","name":"tempest-AllowedAddressPairIpV6TestJSON-1145511128","network_id":"d02a2a90-aff3-4c96-b2fc-3f9c7f86998f","tenant_id":"c20763a485ee4aefb5e052fd9c040973","mac_address":"fa:16:3e:91:06:8c","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"05119fe9-49be-4b13-a2a8-878c568c0e93","ip_address":"2001:db8::371"}],"project_id":"c20763a485ee4aefb5e052fd9c040973","port_security_enabled":true,"security_groups":["1848c0e7-6303-4e84-9633-c5c5c497de44"],"binding:vnic_type":"normal","allowed_address_pairs":[],"extra_dhcp_opts":[],"description":"","tags":[],"created_at":"2021-06-08T12:20:06Z","updated_at":"2021-06-08T12:20:07Z","revision_number":1}}'
2021-06-08 12:20:11,260 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:test_update_port_with_multiple_ip_mac_address_pair): 200 PUT http://10.222.0.44:9696/v2.0/ports/0d1be92d-01b7-466d-b5a0-bb2844fe3575 3.030s
2021-06-08 12:20:11,260 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"allowed_address_pairs": [{"ip_address": "2001:db8::30d", "mac_address": "fa:16:3e:7e:fd:7d"}, {"ip_address": "2001:db8::99", "mac_address": "fa:16:3e:f8:d2:54"}]}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '901', 'x-openstack-request-id': 'req-af144fce-b2e8-4fa5-92b3-bae44fb49fda', 'date': 'Tue, 08 Jun 2021 12:20:11 GMT', 'connection': 'close', 'status': '200', 'content-location': 'htt
    p://10.222.0.44:9696/v2.0/ports/0d1be92d-01b7-466d-b5a0-bb2844fe3575'}
        Body: b'{"port":{"id":"0d1be92d-01b7-466d-b5a0-bb2844fe3575","name":"tempest-AllowedAddressPairIpV6TestJSON-1145511128","network_id":"d02a2a90-aff3-4c96-b2fc-3f9c7f86998f","tenant_id":"c20763a485ee4aefb5e052fd9c040973","mac_address":"fa:16:3e:91:06:8c","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"05119fe9-49be-4b13-a2a8-878c568c0e93","ip_address":"2001:db8::371"}],"allowed_address_pairs":[{"mac_address":"fa:16:3e:7e:fd:7d","ip_address":"2001:db8::30d","active":true},{"mac_address":"fa:16:3e:f8:d2:54","ip_address":"2001:db8::99","active":true}],"extra_dhcp_opts":[],"security_groups":["1848c0e7-6303-4e84-9633-c5c5c497de44"],"description":"","binding:vnic_type":"normal","port_security_enabled":true,"tags":[],"created_at":"2021-06-08T12:20:06Z","updated_at":"2021-06-08T12:20:10Z","revision_number":2,"project_id":"c20763a485ee4aefb5e052fd9c040973"}}'
2021-06-08 12:20:14,336 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:_run_cleanups): 204 DELETE http://10.222.0.44:9696/v2.0/ports/0d1be92d-01b7-466d-b5a0-bb2844fe3575 3.075s
2021-06-08 12:20:14,336 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-length': '0', 'x-openstack-request-id': 'req-c6c9f9c6-ce1c-4850-b66a-9913c3e1d139', 'date': 'Tue, 08 Jun 2021 12:20:14 GMT', 'connection': 'close', 'status': '204', 'content-location': 'http://10.222.0.44:9696/v2.0/ports/0d1be92d-01b7-466d-b5a0-bb2844fe3575'}
        Body: b''
2021-06-08 12:20:14,434 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:_run_cleanups): 404 GET http://10.222.0.44:9696/v2.0/ports/0d1be92d-01b7-466d-b5a0-bb2844fe3575 0.097s
2021-06-08 12:20:14,434 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-type': 'application/json', 'content-length': '132', 'x-openstack-request-id': 'req-0673749f-ba76-48e6-97b3-d2b335f34d60', 'date': 'Tue, 08 Jun 2021 12:20:14 GMT', 'connection': 'close', 'status': '404', 'content-location': 'http://10.222.0.44:9696/v2.0/ports/0d1be92d-01b7-466d-b5a0-bb2844fe3575'}
        Body: b'{"NeutronError": {"type": "PortNotFound", "message": "Port 0d1be92d-01b7-466d-b5a0-bb2844fe3575 could not be found.", "detail": ""}}'
2021-06-08 12:20:16,042 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:_run_cleanups): 204 DELETE http://10.222.0.44:9696/v2.0/ports/f09cccaf-7446-4f14-a1d9-525d3935b736 1.607s
2021-06-08 12:20:16,042 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-length': '0', 'x-openstack-request-id': 'req-ad3b6b6c-1ebb-4bbd-994b-0cedc3e42b8b', 'date': 'Tue, 08 Jun 2021 12:20:16 GMT', 'connection': 'close', 'status': '204', 'content-location': 'http://10.222.0.44:9696/v2.0/ports/f09cccaf-7446-4f14-a1d9-525d3935b736'}
        Body: b''
2021-06-08 12:20:16,203 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:_run_cleanups): 404 GET http://10.222.0.44:9696/v2.0/ports/f09cccaf-7446-4f14-a1d9-525d3935b736 0.160s
2021-06-08 12:20:16,203 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-type': 'application/json', 'content-length': '132', 'x-openstack-request-id': 'req-f4e72b25-b4e0-4bcb-aa06-031ac6becf9d', 'date': 'Tue, 08 Jun 2021 12:20:16 GMT', 'connection': 'close', 'status': '404', 'content-location': 'http://10.222.0.44:9696/v2.0/ports/f09cccaf-
    7446-4f14-a1d9-525d3935b736'}
        Body: b'{"NeutronError": {"type": "PortNotFound", "message": "Port f09cccaf-7446-4f14-a1d9-525d3935b736 could not be found.", "detail": ""}}'

{4} tempest.api.network.admin.test_floating_ips_admin_actions.FloatingIPAdminTestJSON.test_list_floating_ips_from_admin_and_nonadmin [15.261599s] ... ok
{5} tempest.api.network.test_dhcp_ipv6.NetworksTestDHCPv6.test_dhcp_stateful_fixedips [46.875325s] ... ok
{3} tempest.api.network.test_extra_dhcp_options.ExtraDHCPOptionsTestJSON.test_create_list_port_with_extra_dhcp_options [7.015028s] ... ok
{3} tempest.api.network.test_extra_dhcp_options.ExtraDHCPOptionsTestJSON.test_update_show_port_with_extra_dhcp_options [2.477184s] ... ok
{5} tempest.api.network.test_dhcp_ipv6.NetworksTestDHCPv6.test_dhcp_stateful_fixedips_duplicate [10.799296s] ... ok
{5} tempest.api.network.test_dhcp_ipv6.NetworksTestDHCPv6.test_dhcp_stateful_fixedips_outrange [4.406302s] ... ok
{1} tempest.api.network.admin.test_routers.RoutersAdminTest.test_create_router_set_gateway_with_fixed_ip [22.684380s] ... ok
{7} tempest.api.network.test_allowed_address_pair.AllowedAddressPairTestJSON.test_create_list_port_with_address_pair [6.831950s] ... ok
{1} tempest.api.network.admin.test_routers.RoutersAdminTest.test_create_router_setting_project_id [3.088171s] ... ok
{7} tempest.api.network.test_allowed_address_pair.AllowedAddressPairTestJSON.test_update_port_with_address_pair [6.655846s] ... FAILED

Captured traceback:
~~~~~~~~~~~~~~~~~~~
    Traceback (most recent call last):

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 105, in test_update_port_with_address_pair
    self._update_port_with_address(self.ip_address)

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 100, in _update_port_with_address
    self.assertCountEqual(allowed_address_pair, allowed_address_pairs)

      File "/usr/lib/python3.8/unittest/case.py", line 1272, in assertCountEqual
    self.fail(msg)

      File "/opt/stack/tempest/.tox/venv/lib/python3.8/site-packages/unittest2/case.py", line 690, in fail
    raise self.failureException(msg)

    AssertionError: Element counts were not equal:
First has 1, Second has 0:  {'mac_address': 'fa:16:3e:f7:ce:1c', 'ip_address': '172.20.0.6', 'active': True}
First has 0, Second has 1:  {'ip_address': '172.20.0.6', 'mac_address': 'fa:16:3e:f7:ce:1c'}


Captured pythonlogging:
~~~~~~~~~~~~~~~~~~~~~~~
    2021-06-08 12:20:43,958 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:test_update_port_with_address_pair): 201 POST http://10.222.0.44:9696/v2.0/ports 2.071s
2021-06-08 12:20:43,958 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"network_id": "b8603a02-94a4-4fdf-84cf-28e4cd736ef7", "name": "tempest-AllowedAddressPairTestJSON-1790819370"}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '739', 'x-openstack-request-id': 'req-9161202a-7cca-48e8-ba7d-c8858ccc87f3', 'date': 'Tue, 08 Jun 2021 12:20:43 GMT', 'connection': 'close', 'status': '201', 'content-location': 'http://10.222.0.44:9696/v2.0/ports'}
        Body: b'{"port":{"id":"0d56d8fd-33f8-4240-a6f5-668addcb9c9a","name":"tempest-AllowedAddressPairTestJSON-1790819370","network_id":"b8603a02-94a4-4fdf-84cf-28e4cd736ef7","tenant_id":"8a5bffe2e191455ab1ac2087d1820597","mac_address":"fa:16:3e:65:0e:d4","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"e776e277-f662-4f88-9257-95067b1a1173","ip_address":"172.20.0.12"}],"project_id":"8a5bffe2e191455ab1ac2087d1820597","port_security_enabled":true,"security_groups":["1856b85a-cd0f-4057-85a3-5b0743a051dc"],"binding:vnic_type":"normal","allowed_address_pairs":[],"extra_dhcp_opts":[],"description":"","tags":[],"created_at":"2021-06-08T12:20:42Z","updated_at":"2021-06-08T12:20:43Z","revision_number":1}}'
2021-06-08 12:20:46,004 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:test_update_port_with_address_pair): 200 PUT http://10.222.0.44:9696/v2.0/ports/0d56d8fd-33f8-4240-a6f5-668addcb9c9a 2.045s
2021-06-08 12:20:46,004 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"allowed_address_pairs": [{"ip_address": "172.20.0.6", "mac_address": "fa:16:3e:f7:ce:1c"}]}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '814', 'x-openstack-request-id': 'req-f6bfd8ce-77f0-4aa5-be5d-bbdefda88a1f', 'date': 'Tue, 08 Jun 2021 12:20:46 GMT', 'connection': 'close', 'status': '200', 'content-location': 'http://10.222.0.44:9696/v2.0/ports/0d56d8fd-33f8-4240-a6f5-668addcb9c9a'}
        Body: b'{"port":{"id":"0d56d8fd-33f8-4240-a6f5-668addcb9c9a","name":"tempest-AllowedAddressPairTestJSON-1790819370","network_id":"b8603a02-94a4-4fdf-84cf-28e4cd736ef7","tenant_id":"8a5bffe2e191455ab1ac2087d1820597","mac_address":"fa:16:3e:65:0e:d4","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"e776e277-f662-4f88-9257-95067b1a1173","ip_address":"172.20.0.12"}],"allowed_address_pairs":[{"mac_address":"fa:16:3e:f7:ce:1c","ip_address":"172.20.0.6","active":true}],"extra_dhcp_opts":[],"security_groups":["1856b85a-cd0f-4057-85a3-5b0743a051dc"],"description":"","binding:vnic_type":"normal","port_security_enabled":true,"tags":[],"created_at":"2021-06-08T12:20:42Z","updated_at":"2021-06-08T12:20:44Z","revision_number":2,"project_id":"8a5bffe2e191455ab1ac2087d1820597"}}'
2021-06-08 12:20:48,474 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:_run_cleanups): 204 DELETE http://10.222.0.44:9696/v2.0/ports/0d56d8fd-33f8-4240-a6f5-668addcb9c9a 2.468s
2021-06-08 12:20:48,474 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-length': '0', 'x-openstack-request-id': 'req-b20e39c9-f804-4c1d-9d7f-efef452f65b8', 'date': 'Tue, 08 Jun 2021 12:20:48 GMT', 'connection': 'close', 'status': '204', 'content-location': 'http://10.222.0.44:9696/v2.0/ports/0d56d8fd-33f8-4240-a6f5-668addcb9c9a'}
        Body: b''
2021-06-08 12:20:48,541 107895 INFO     [tempest.lib.common.rest_client] Request (Allo
    wedAddressPairTestJSON:_run_cleanups): 404 GET http://10.222.0.44:9696/v2.0/ports/0d56d8fd-33f8-4240-a6f5-668addcb9c9a 0.067s
2021-06-08 12:20:48,542 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-type': 'application/json', 'content-length': '132', 'x-openstack-request-id': 'req-47d6a773-4c0d-4e94-9608-ee539208574e', 'date': 'Tue, 08 Jun 2021 12:20:48 GMT', 'connection': 'close', 'status': '404', 'content-location': 'http://10.222.0.44:9696/v2.0/ports/0d56d8fd-33f8-4240-a6f5-668addcb9c9a'}
        Body: b'{"NeutronError": {"type": "PortNotFound", "message": "Port 0d56d8fd-33f8-4240-a6f5-668addcb9c9a could not be found.", "detail": ""}}'

{1} tempest.api.network.admin.test_routers.RoutersAdminTest.test_create_router_with_default_snat_value [8.684817s] ... ok
{3} tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_delete_slaac_subnet_with_ports [8.289372s] ... ok
{7} tempest.api.network.test_allowed_address_pair.AllowedAddressPairTestJSON.test_update_port_with_cidr_address_pair [7.791368s] ... FAILED

Captured traceback:
~~~~~~~~~~~~~~~~~~~
    Traceback (most recent call last):

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 110, in test_update_port_with_cidr_address_pair
    self._update_port_with_address(str(self.cidr))

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 100, in _update_port_with_address
    self.assertCountEqual(allowed_address_pair, allowed_address_pairs)

      File "/usr/lib/python3.8/unittest/case.py", line 1272, in assertCountEqual
    self.fail(msg)

      File "/opt/stack/tempest/.tox/venv/lib/python3.8/site-packages/unittest2/case.py", line 690, in fail
    raise self.failureException(msg)

    AssertionError: Element counts were not equal:
First has 1, Second has 0:  {'mac_address': 'fa:16:3e:f7:ce:1c', 'ip_address': '172.20.0.0/16', 'active': True}
First has 0, Second has 1:  {'ip_address': '172.20.0.0/16', 'mac_address': 'fa:16:3e:f7:ce:1c'}


Captured pythonlogging:
~~~~~~~~~~~~~~~~~~~~~~~
    2021-06-08 12:20:52,193 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:test_update_port_with_cidr_address_pair): 201 POST http://10.222.0.44:9696/v2.0/ports 3.645s
2021-06-08 12:20:52,193 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"network_id": "b8603a02-94a4-4fdf-84cf-28e4cd736ef7", "name": "tempest-AllowedAddressPairTestJSON-1620070953"}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '738', 'x-openstack-request-id': 'req-01544f75-68b6-46ab-9644-9912ed04a25a', 'date': 'Tue, 08 Jun 2021 12:20:52 GMT', 'connection': 'close', 'status': '201', 'content-location': 'http://10.222.0.44:9696/v2.0/ports'}
        Body: b'{"port":{"id":"6fdb0b97-838f-4f14-9c93-a6956a0571a0","name":"tempest-AllowedAddressPairTestJSON-1620070953","network_id":"b8603a02-94a4-4fdf-84cf-28e4cd736ef7","tenant_id":"8a5bffe2e191455ab1ac2087d1820597","mac_address":"fa:16:3e:c3:f2:2f","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"e776e277-f662-4f88-9257-95067b1a1173","ip_address":"172.20.0.4"}],"project_id":"8a5bffe2e191455ab1ac2087d1820597","port_security_enabled":true,"security_groups":["1856b85a-cd0f-4057-85a3-5b0743a051dc"],"binding:vnic_type":"normal","allowed_address_pairs":[],"extra_dhcp_opts":[],"description":"","tags":[],"created_at":"2021-06-08T12:20:49Z","updated_at":"2021-06-08T12:20:50Z","revision_number":1}}'
2021-06-08 12:20:53,928 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:test_update_port_with_cidr_address_pair): 200 PUT http://10.222.0.44:9696/v2.0/ports/6fdb0b97-838f-4f14-9c93-a6956a0571a0 1.734s
2021-06-08 12:20:53,929 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"allowed_address_pairs": [{"ip_address": "172.20.0.0/16", "mac_address": "fa:16:3e:f7:ce:1c"}]}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '816', 'x-openstack-request-id': 'req-7e92407d-af43-4682-9b40-e2d171913e78', 'date': 'Tue, 08 Jun 2021 12:20:53 GMT', 'connection': 'close', 'status': '200', 'content-location': 'http://10.222.0.44:9696/v2.0/ports/6fdb0b97-838f-4f14-9c93-a6956a0571a0'}
        Body: b'{"port":{"id":"6fdb0b97-838f-4f14-9c93-a6956a0571a0","name":"tempest-AllowedAddressPairTestJSON-1620070953","network_id":"b8603a02-94a4-4fdf-84cf-28e4cd736ef7","tenant_id":"8a5bffe2e191455ab1ac2087d1820597","mac_address":"fa:16:3e:c3:f2:2f","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"e776e277-f662-4f88-9257-95067b1a1173","ip_address":"172.20.0.4"}],"allowed_address_pairs":[{"mac_address":"fa:16:3e:f7:ce:1c","ip_address":"172.20.0.0/16","active":true}],"extra_dhcp_opts":[],"security_groups":["1856b85a-cd0f-4057-85a3-5b0743a051dc"],"description":"","binding:vnic_type":"normal","port_security_enabled":true,"tags":[],"created_at":"2021-06-08T12:20:49Z","updated_at":"2021-06-08T12:20:52Z","revision_number":2,"project_id":"8a5bffe2e191455ab1ac2087d1820597"}}'
2021-06-08 12:20:56,194 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:_run_cleanups): 204 DELETE http://10.222.0.44:9696/v2.0/ports/6fdb0b97-838f-4f14-9c93-a6956a0571a0 2.264s
2021-06-08 12:20:56,195 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-length': '0', 'x-openstack-request-id': 'req-b908d7e9-4ba4-43c7-b27f-1a813d620c88', 'date': 'Tue, 08 Jun 2021 12:20:56 GMT', 'connection': 'close', 'status': '204', 'content-location': 'http://10.222.0.44:9696/v2.0/ports/6fdb0b97-838f-4f14-9c93-a6956a0571a0'}
        Body: b''
2021-06-08 12:20:56,338 107895 INFO     [tempest.lib.common.rest_client]
     Request (AllowedAddressPairTestJSON:_run_cleanups): 404 GET http://10.222.0.44:9696/v2.0/ports/6fdb0b97-838f-4f14-9c93-a6956a0571a0 0.142s
2021-06-08 12:20:56,338 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-type': 'application/json', 'content-length': '132', 'x-openstack-request-id': 'req-f710133d-2847-4e2c-995d-5cc2aad867cd', 'date': 'Tue, 08 Jun 2021 12:20:56 GMT', 'connection': 'close', 'status': '404', 'content-location': 'http://10.222.0.44:9696/v2.0/ports/6fdb0b97-838f-4f14-9c93-a6956a0571a0'}
        Body: b'{"NeutronError": {"type": "PortNotFound", "message": "Port 6fdb0b97-838f-4f14-9c93-a6956a0571a0 could not be found.", "detail": ""}}'

{6} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus [0.714121s] ... ok
{6} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details [0.000856s] ... ok
{4} tempest.api.network.test_ports.PortsTestJSON.test_create_bulk_port [11.142534s] ... ok
{3} tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_delete_stateless_subnet_with_ports [8.162514s] ... ok
{3} tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_delete_subnet_with_v6_attributes_slaac [4.967863s] ... ok
{3} tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_delete_subnet_with_v6_attributes_stateful [1.874566s] ... ok
{2} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus [1.361032s] ... ok
{2} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details [0.000621s] ... ok
{7} tempest.api.network.test_allowed_address_pair.AllowedAddressPairTestJSON.test_update_port_with_multiple_ip_mac_address_pair [12.640371s] ... FAILED

Captured traceback:
~~~~~~~~~~~~~~~~~~~
    Traceback (most recent call last):

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 129, in test_update_port_with_multiple_ip_mac_address_pair
    self._update_port_with_address(

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 100, in _update_port_with_address
    self.assertCountEqual(allowed_address_pair, allowed_address_pairs)

      File "/usr/lib/python3.8/unittest/case.py", line 1272, in assertCountEqual
    self.fail(msg)

      File "/opt/stack/tempest/.tox/venv/lib/python3.8/site-packages/unittest2/case.py", line 690, in fail
    raise self.failureException(msg)

    AssertionError: Element counts were not equal:
First has 1, Second has 0:  {'mac_address': 'fa:16:3e:5d:2b:12', 'ip_address': '172.20.0.10', 'active': True}
First has 1, Second has 0:  {'mac_address': 'fa:16:3e:f7:ce:1c', 'ip_address': '172.20.0.6', 'active': True}
First has 0, Second has 1:  {'ip_address': '172.20.0.6', 'mac_address': 'fa:16:3e:f7:ce:1c'}
First has 0, Second has 1:  {'ip_address': '172.20.0.10', 'mac_address': 'fa:16:3e:5d:2b:12'}


Captured pythonlogging:
~~~~~~~~~~~~~~~~~~~~~~~
    2021-06-08 12:20:59,882 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:test_update_port_with_multiple_ip_mac_address_pair): 201 POST http://10.222.0.44:9696/v2.0/ports 3.542s
2021-06-08 12:20:59,883 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"network_id": "b8603a02-94a4-4fdf-84cf-28e4cd736ef7", "name": "tempest-AllowedAddressPairTestJSON-1253289481"}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '739', 'x-openstack-request-id': 'req-ceeb32d3-c689-4b03-ac22-da0f2ca92cb3', 'date': 'Tue, 08 Jun 2021 12:20:59 GMT', 'connection': 'close', 'status': '201', 'content-location': 'http://10.222.0.44:9696/v2.0/ports'}
        Body: b'{"port":{"id":"2ef03f27-fc41-4c42-a8c3-3f317a22948a","name":"tempest-AllowedAddressPairTestJSON-1253289481","network_id":"b8603a02-94a4-4fdf-84cf-28e4cd736ef7","tenant_id":"8a5bffe2e191455ab1ac2087d1820597","mac_address":"fa:16:3e:5d:2b:12","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"e776e277-f662-4f88-9257-95067b1a1173","ip_address":"172.20.0.10"}],"project_id":"8a5bffe2e191455ab1ac2087d1820597","port_security_enabled":true,"security_groups":["1856b85a-cd0f-4057-85a3-5b0743a051dc"],"binding:vnic_type":"normal","allowed_address_pairs":[],"extra_dhcp_opts":[],"description":"","tags":[],"created_at":"2021-06-08T12:20:56Z","updated_at":"2021-06-08T12:20:57Z","revision_number":1}}'
2021-06-08 12:21:02,284 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:test_update_port_with_multiple_ip_mac_address_pair): 201 POST http://10.222.0.44:9696/v2.0/ports 2.401s
2021-06-08 12:21:02,284 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"network_id": "b8603a02-94a4-4fdf-84cf-28e4cd736ef7", "name": "tempest-AllowedAddressPairTestJSON-1354873655"}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '739', 'x-openstack-request-id': 'req-5c18e0a7-cedc-4f21-bbf6-b43bd486b573', 'date': 'Tue, 08 Jun 2021 12:21:02 GMT', 'connection': 'close', 'status': '201', 'content-location': 'http://10.222.0.44:9696/v2.0/ports'}
        Body: b'{"port":{"id":"bd75cb9b-f19e-4390-9b0a-eaa0256f8f3d","name":"tempest-AllowedAddressPairTestJSON-1354873655","network_id":"b8603a02-94a4-4fdf-84cf-28e4cd736ef7","tenant_id":"8a5bffe2e191455ab1ac2087d1820597","mac_address":"fa:16:3e:9c:60:2e","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"e776e277-f662-4f88-9257-95067b1a1173","ip_address":"172.20.0.12"}],"project_id":"8a5bffe2e191455ab1ac2087d1820597","port_security_enabled":true,"security_groups":["1856b85a-cd0f-4057-85a3-5b0743a051dc"],"binding:vnic_type":"normal","allowed_address_pairs":[],"extra_dhcp_opts":[],"description":"","tags":[],"created_at":"2021-06-08T12:21:00Z","updated_at":"2021-06-08T12:21:01Z","revision_number":1}}'
2021-06-08 12:21:03,698 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:test_update_port_with_multiple_ip_mac_address_pair): 200 PUT http://10.222.0.44:9696/v2.0/ports/bd75cb9b-f19e-4390-9b0a-eaa0256f8f3d 1.412s
2021-06-08 12:21:03,698 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"allowed_address_pairs": [{"ip_address": "172.20.0.6", "mac_address": "fa:16:3e:f7:ce:1c"}, {"ip_address": "172.20.0.10", "mac_address": "fa:16:3e:5d:2b:12"}]}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '891', 'x-openstack-request-id': 'req-8443b56b-b956-4ae9-b10c-ecbcf4e5d291', 'date': 'Tue, 08 Jun 2021 12:21:03 GMT', 'connection': 'close', 'status': '200', 'content-location': 'http://10.222.0.44:9696/v2.0/ports/bd7
    5cb9b-f19e-4390-9b0a-eaa0256f8f3d'}
        Body: b'{"port":{"id":"bd75cb9b-f19e-4390-9b0a-eaa0256f8f3d","name":"tempest-AllowedAddressPairTestJSON-1354873655","network_id":"b8603a02-94a4-4fdf-84cf-28e4cd736ef7","tenant_id":"8a5bffe2e191455ab1ac2087d1820597","mac_address":"fa:16:3e:9c:60:2e","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"e776e277-f662-4f88-9257-95067b1a1173","ip_address":"172.20.0.12"}],"allowed_address_pairs":[{"mac_address":"fa:16:3e:5d:2b:12","ip_address":"172.20.0.10","active":true},{"mac_address":"fa:16:3e:f7:ce:1c","ip_address":"172.20.0.6","active":true}],"extra_dhcp_opts":[],"security_groups":["1856b85a-cd0f-4057-85a3-5b0743a051dc"],"description":"","binding:vnic_type":"normal","port_security_enabled":true,"tags":[],"created_at":"2021-06-08T12:21:00Z","updated_at":"2021-06-08T12:21:02Z","revision_number":2,"project_id":"8a5bffe2e191455ab1ac2087d1820597"}}'
2021-06-08 12:21:04,906 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:_run_cleanups): 204 DELETE http://10.222.0.44:9696/v2.0/ports/bd75cb9b-f19e-4390-9b0a-eaa0256f8f3d 1.207s
2021-06-08 12:21:04,906 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-length': '0', 'x-openstack-request-id': 'req-15996f1d-b7b6-48ee-8a3c-e92847439dfa', 'date': 'Tue, 08 Jun 2021 12:21:04 GMT', 'connection': 'close', 'status': '204', 'content-location': 'http://10.222.0.44:9696/v2.0/ports/bd75cb9b-f19e-4390-9b0a-eaa0256f8f3d'}
        Body: b''
2021-06-08 12:21:05,170 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:_run_cleanups): 404 GET http://10.222.0.44:9696/v2.0/ports/bd75cb9b-f19e-4390-9b0a-eaa0256f8f3d 0.263s
2021-06-08 12:21:05,171 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-type': 'application/json', 'content-length': '132', 'x-openstack-request-id': 'req-6ccfdf0c-4856-4798-b7b5-4870a0460495', 'date': 'Tue, 08 Jun 2021 12:21:05 GMT', 'connection': 'close', 'status': '404', 'content-location': 'http://10.222.0.44:9696/v2.0/ports/bd75cb9b-f19e-4390-9b0a-eaa0256f8f3d'}
        Body: b'{"NeutronError": {"type": "PortNotFound", "message": "Port bd75cb9b-f19e-4390-9b0a-eaa0256f8f3d could not be found.", "detail": ""}}'
2021-06-08 12:21:08,831 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:_run_cleanups): 204 DELETE http://10.222.0.44:9696/v2.0/ports/2ef03f27-fc41-4c42-a8c3-3f317a22948a 3.660s
2021-06-08 12:21:08,832 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-length': '0', 'x-openstack-request-id': 'req-dd02f0f9-4d70-48e5-aeb0-bf9df85926a6', 'date': 'Tue, 08 Jun 2021 12:21:08 GMT', 'connection': 'close', 'status': '204', 'content-location': 'http://10.222.0.44:9696/v2.0/ports/2ef03f27-fc41-4c42-a8c3-3f317a22948a'}
        Body: b''
2021-06-08 12:21:08,979 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:_run_cleanups): 404 GET http://10.222.0.44:9696/v2.0/ports/2ef03f27-fc41-4c42-a8c3-3f317a22948a 0.146s
2021-06-08 12:21:08,979 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-type': 'application/json', 'content-length': '132', 'x-openstack-request-id': 'req-a13690ba-000e-4359-a5ba-c245b9bab40b', 'date': 'Tue, 08 Jun 2021 12:21:08 GMT', 'connection': 'close', 'status': '404', 'content-location': 'http://10.222.0.44:9696/v2.0/ports/2ef03f27-fc41-4c42-a8c3-3f317a22948a'}
        Body: b'{"NeutronError"
    : {"type": "PortNotFound", "message": "Port 2ef03f27-fc41-4c42-a8c3-3f317a22948a could not be found.", "detail": ""}}'

{3} tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_delete_subnet_with_v6_attributes_stateless [10.803295s] ... ok
{4} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools [18.727243s] ... ok
{5} tempest.api.network.test_dhcp_ipv6.NetworksTestDHCPv6.test_dhcp_stateful_router [43.943916s] ... ok
{1} tempest.api.network.admin.test_routers.RoutersAdminTest.test_create_router_with_snat_explicit [29.795266s] ... ok
{7} tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions [2.876538s] ... ok
{0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server [25.869721s] ... ok
{7} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_additional_default_security_group_fails [0.372887s] ... ok
{0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_pause_unpause_server [9.697069s] ... ok
{7} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_duplicate_security_group_rule_fails [5.939651s] ... ok
{4} tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups [14.616688s] ... ok
{7} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_ethertype [2.149633s] ... ok
{7} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_protocol [1.090340s] ... ok
{7} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_remote_ip_prefix [2.583587s] ... ok
{1} tempest.api.network.admin.test_routers.RoutersAdminTest.test_update_router_reset_gateway_without_snat [18.014711s] ... ok
{4} tempest.api.network.test_ports.PortsTestJSON.test_create_show_delete_port_user_defined_mac [4.993982s] ... ok
{7} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_invalid_ports [3.243790s] ... ok
{7} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_remote_groupid [1.519604s] ... ok
{7} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_security_group [1.165329s] ... ok
{2} tempest.api.network.admin.test_metering_extensions.MeteringTestJSON.test_create_delete_metering_label_rule_with_filters [1.056154s] ... ok
{4} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port [6.471688s] ... ok
{2} tempest.api.network.admin.test_metering_extensions.MeteringTestJSON.test_create_delete_metering_label_with_filters [1.544456s] ... ok
{2} tempest.api.network.admin.test_metering_extensions.MeteringTestJSON.test_list_metering_label_rules [0.092109s] ... ok
{2} tempest.api.network.admin.test_metering_extensions.MeteringTestJSON.test_list_metering_labels [0.147369s] ... ok
{2} tempest.api.network.admin.test_metering_extensions.MeteringTestJSON.test_show_metering_label [0.115991s] ... ok
{2} tempest.api.network.admin.test_metering_extensions.MeteringTestJSON.test_show_metering_label_rule [0.037972s] ... ok
{6} tempest.api.network.admin.test_external_network_extension.ExternalNetworksTestJSON.test_create_external_network [2.929562s] ... ok
{1} tempest.api.network.admin.test_routers.RoutersAdminTest.test_update_router_set_gateway [11.521353s] ... ok
{7} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_remote_ip_and_group [7.446338s] ... ok
{7} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_update_name_default [2.484318s] ... ok
{7} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_delete_non_existent_security_group [0.037709s] ... ok
{7} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group [0.064505s] ... ok
{7} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group_rule [0.038756s] ... ok
{6} tempest.api.network.admin.test_external_network_extension.ExternalNetworksTestJSON.test_delete_external_networks_with_floating_ip [14.114851s] ... ok
{3} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_add_router_interfaces_on_overlapping_subnets_returns_400 [23.663932s] ... ok
{3} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_delete_non_existent_router_returns_404 [0.322005s] ... ok
{3} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_router_add_gateway_invalid_network_returns_404 [0.850254s] ... ok
{1} tempest.api.network.admin.test_routers.RoutersAdminTest.test_update_router_set_gateway_with_snat_explicit [15.144822s] ... ok
{6} tempest.api.network.admin.test_external_network_extension.ExternalNetworksTestJSON.test_list_external_networks [3.032714s] ... ok
{2} tempest.api.network.admin.test_ports.PortsAdminExtendedAttrsTestJSON.test_create_port_binding_ext_attr [7.827168s] ... ok
{6} tempest.api.network.admin.test_external_network_extension.ExternalNetworksTestJSON.test_show_external_networks_attribute [3.527093s] ... ok
{6} tempest.api.network.admin.test_external_network_extension.ExternalNetworksTestJSON.test_update_external_network [3.501173s] ... ok
{4} tempest.api.network.test_ports.PortsTestJSON.test_create_update_port_with_second_ip [29.808563s] ... ok
{2} tempest.api.network.admin.test_ports.PortsAdminExtendedAttrsTestJSON.test_list_ports_binding_ext_attr [8.321368s] ... ok
{4} tempest.api.network.test_ports.PortsTestJSON.test_list_ports [0.828719s] ... ok
{4} tempest.api.network.test_ports.PortsTestJSON.test_list_ports_fields [0.805390s] ... ok
{1} tempest.api.network.admin.test_routers.RoutersAdminTest.test_update_router_set_gateway_without_snat [13.181282s] ... ok
{2} tempest.api.network.admin.test_ports.PortsAdminExtendedAttrsTestJSON.test_show_port_binding_ext_attr [4.351248s] ... ok
{3} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_router_remove_interface_in_use_returns_409 [18.019602s] ... ok
{3} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_show_non_existent_router_returns_404 [0.169971s] ... ok
{3} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_update_non_existent_router_returns_404 [0.197899s] ... ok
{6} tempest.api.network.admin.test_routers_dvr.RoutersTestDVR.test_centralized_router_creation [1.990030s] ... ok
{5} tempest.api.network.test_dhcp_ipv6.NetworksTestDHCPv6.test_dhcpv6_64_subnets [68.658003s] ... ok
{2} tempest.api.network.admin.test_ports.PortsAdminExtendedAttrsTestJSON.test_update_port_binding_ext_attr [8.495890s] ... ok
{6} tempest.api.network.admin.test_routers_dvr.RoutersTestDVR.test_centralized_router_update_to_dvr [5.283217s] ... ok
{6} tempest.api.network.admin.test_routers_dvr.RoutersTestDVR.test_distributed_router_creation [2.526391s] ... ok
{1} tempest.api.network.admin.test_routers.RoutersAdminTest.test_update_router_unset_gateway [14.734262s] ... ok
{5} tempest.api.network.test_dhcp_ipv6.NetworksTestDHCPv6.test_dhcpv6_invalid_options [5.679038s] ... ok
{0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard [61.866202s] ... ok
{3} tempest.api.network.test_versions.NetworksApiDiscovery.test_api_version_resources [0.024106s] ... ok
{3} tempest.api.network.test_versions.NetworksApiDiscovery.test_show_api_v2_details [0.506600s] ... ok
{4} tempest.api.network.test_ports.PortsTestJSON.test_port_list_filter_by_ip [23.023314s] ... ok
{1} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_network [5.926782s] ... ok
{5} tempest.api.network.test_dhcp_ipv6.NetworksTestDHCPv6.test_dhcpv6_stateless_eui64 [18.853780s] ... ok
{1} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_port [8.096745s] ... ok
{6} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_bulk_port [14.229813s] ... ok
{0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server [24.009623s] ... ok
{2} tempest.api.network.admin.test_routers.RoutersIpV6AdminTest.test_create_router_set_gateway_with_fixed_ip [26.669258s] ... ok
{4} tempest.api.network.test_ports.PortsTestJSON.test_port_list_filter_by_ip_substr [23.061535s] ... ok
{2} tempest.api.network.admin.test_routers.RoutersIpV6AdminTest.test_create_router_setting_project_id [2.084502s] ... ok
{0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_suspend_resume_server [10.261653s] ... ok
{1} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_subnet [14.917627s] ... ok
{5} tempest.api.network.test_dhcp_ipv6.NetworksTestDHCPv6.test_dhcpv6_stateless_no_ra [17.108189s] ... ok
{2} tempest.api.network.admin.test_routers.RoutersIpV6AdminTest.test_create_router_with_default_snat_value [8.158167s] ... ok
{6} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools [16.483395s] ... ok
{5} tempest.api.network.test_dhcp_ipv6.NetworksTestDHCPv6.test_dhcpv6_stateless_no_ra_no_dhcp [14.451920s] ... ok
{6} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups [14.185509s] ... ok
{1} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_network [6.136806s] ... ok
{4} tempest.api.network.test_ports.PortsTestJSON.test_port_list_filter_by_router_id [30.187803s] ... ok
{4} tempest.api.network.test_ports.PortsTestJSON.test_show_port [0.147292s] ... ok
{4} tempest.api.network.test_ports.PortsTestJSON.test_show_port_fields [0.088260s] ... ok
{1} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_port [8.301295s] ... ok
{6} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_show_delete_port_user_defined_mac [9.646159s] ... ok
{2} tempest.api.network.admin.test_routers.RoutersIpV6AdminTest.test_create_router_with_snat_explicit [28.593020s] ... ok
{6} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port [4.158124s] ... ok
{1} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_subnet [7.400569s] ... ok
{4} tempest.api.network.test_ports.PortsTestJSON.test_update_port_with_security_group_and_extra_attributes [16.066632s] ... ok
{0} tempest.api.network.admin.test_ports.PortsAdminExtendedAttrsIpV6TestJSON.test_create_port_binding_ext_attr [7.415581s] ... ok
{0} tempest.api.network.admin.test_ports.PortsAdminExtendedAttrsIpV6TestJSON.test_list_ports_binding_ext_attr [5.540708s] ... ok
{2} tempest.api.network.admin.test_routers.RoutersIpV6AdminTest.test_update_router_reset_gateway_without_snat [18.557095s] ... ok
{0} tempest.api.network.admin.test_ports.PortsAdminExtendedAttrsIpV6TestJSON.test_show_port_binding_ext_attr [3.653498s] ... ok
{1} tempest.api.network.test_tags.TagsTest.test_create_list_show_update_delete_tags [7.454316s] ... ok
{2} tempest.api.network.admin.test_routers.RoutersIpV6AdminTest.test_update_router_set_gateway [10.359454s] ... ok
{0} tempest.api.network.admin.test_ports.PortsAdminExtendedAttrsIpV6TestJSON.test_update_port_binding_ext_attr [9.808138s] ... ok
{6} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_port_with_second_ip [29.572180s] ... ok
{6} tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports [0.327985s] ... ok
{6} tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports_fields [0.228484s] ... ok
{4} tempest.api.network.test_ports.PortsTestJSON.test_update_port_with_two_security_groups_and_extra_attributes [27.572737s] ... ok
{0} tempest.api.network.admin.test_quotas.QuotasTest.test_quotas [1.638191s] ... ok
{0} tempest.api.network.admin.test_quotas.QuotasTest.test_show_quota_details [0.767898s] ... ok
{2} tempest.api.network.admin.test_routers.RoutersIpV6AdminTest.test_update_router_set_gateway_with_snat_explicit [10.423905s] ... ok
{6} tempest.api.network.test_ports.PortsIpV6TestJSON.test_port_list_filter_by_ip [15.150660s] ... ok
{2} tempest.api.network.admin.test_routers.RoutersIpV6AdminTest.test_update_router_set_gateway_without_snat [8.747789s] ... ok
{5} tempest.api.network.test_dhcp_ipv6.NetworksTestDHCPv6.test_dhcpv6_two_subnets [66.179570s] ... ok
{0} tempest.api.network.admin.test_routers_negative.RoutersAdminNegativeIpV6Test.test_router_set_gateway_used_ip_returns_409 [10.901366s] ... ok
{2} tempest.api.network.admin.test_routers.RoutersIpV6AdminTest.test_update_router_unset_gateway [17.108249s] ... ok
{6} tempest.api.network.test_ports.PortsIpV6TestJSON.test_port_list_filter_by_ip_substr [23.585220s] ... ok
{5} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_all_attributes [8.052709s] ... ok
{5} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_allocation_pools [3.321890s] ... ok
{4} tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces [34.172785s] ... ok
{5} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_dhcp_enabled [9.306478s] ... ok
{6} tempest.api.network.test_ports.PortsIpV6TestJSON.test_port_list_filter_by_router_id [25.686139s] ... ok
{5} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw [9.133632s] ... ok
{6} tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port [0.103267s] ... ok
{6} tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port_fields [0.115656s] ... ok
{0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address [16.456321s] ... ok
{2} tempest.api.network.test_floating_ips_negative.FloatingIPNegativeTestJSON.test_associate_floatingip_port_ext_net_unreachable [8.627362s] ... ok
{2} tempest.api.network.test_floating_ips_negative.FloatingIPNegativeTestJSON.test_create_floatingip_in_private_network [1.153557s] ... ok
{4} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id [22.153061s] ... ok
{5} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw_and_allocation_pools [8.876179s] ... ok
{2} tempest.api.network.test_floating_ips_negative.FloatingIPNegativeTestJSON.test_create_floatingip_with_port_ext_net_unreachable [7.035396s] ... ok
{7} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_connectivity_between_vms_on_different_networks [209.721993s] ... ok
{7} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_hotplug_nic ... SKIPPED: NIC hotplug not available
{5} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_host_routes_and_dns_nameservers [8.201332s] ... ok
{6} tempest.api.network.test_ports.PortsIpV6TestJSON.test_update_port_with_security_group_and_extra_attributes [17.568123s] ... ok
{0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip [22.185159s] ... ok
{5} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_without_gateway [9.440425s] ... ok
{4} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id [21.691279s] ... ok
{5} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet [9.449394s] ... ok
{5} tempest.api.network.test_networks.NetworksTest.test_create_update_network_description [2.110508s] ... ok
{6} tempest.api.network.test_ports.PortsIpV6TestJSON.test_update_port_with_two_security_groups_and_extra_attributes [21.398277s] ... ok
{5} tempest.api.network.test_networks.NetworksTest.test_delete_network_with_subnet [4.306157s] ... ok
{5} tempest.api.network.test_networks.NetworksTest.test_external_network_visibility [0.532493s] ... ok
{5} tempest.api.network.test_networks.NetworksTest.test_list_networks [0.537639s] ... ok
{5} tempest.api.network.test_networks.NetworksTest.test_list_networks_fields [0.637714s] ... ok
{5} tempest.api.network.test_networks.NetworksTest.test_list_subnets [0.311283s] ... ok
{5} tempest.api.network.test_networks.NetworksTest.test_list_subnets_fields [0.298949s] ... ok
{5} tempest.api.network.test_networks.NetworksTest.test_show_network [0.430507s] ... ok
{5} tempest.api.network.test_networks.NetworksTest.test_show_network_fields [1.014606s] ... ok
{5} tempest.api.network.test_networks.NetworksTest.test_show_subnet [0.155298s] ... ok
{5} tempest.api.network.test_networks.NetworksTest.test_show_subnet_fields [0.260950s] ... ok
{0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_update_floatingip_with_port_multiple_ip_address [24.093238s] ... ok
{4} tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router [19.448800s] ... ok
{6} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group [4.494241s] ... ok
{5} tempest.api.network.test_networks.NetworksTest.test_update_subnet_gw_dns_host_routes_dhcp [8.641809s] ... ok
{6} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_security_group_rule_with_additional_args [3.890889s] ... ok
{0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_floating_ip_delete_port [10.715020s] ... ok
{5} tempest.api.network.test_networks_negative.NetworksNegativeTestJSON.test_create_port_on_non_existent_network [0.219903s] ... ok
{5} tempest.api.network.test_networks_negative.NetworksNegativeTestJSON.test_delete_non_existent_network [0.037207s] ... ok
{5} tempest.api.network.test_networks_negative.NetworksNegativeTestJSON.test_delete_non_existent_port [0.054138s] ... ok
{5} tempest.api.network.test_networks_negative.NetworksNegativeTestJSON.test_delete_non_existent_subnet [0.046761s] ... ok
{5} tempest.api.network.test_networks_negative.NetworksNegativeTestJSON.test_show_non_existent_network [0.039098s] ... ok
{5} tempest.api.network.test_networks_negative.NetworksNegativeTestJSON.test_show_non_existent_port [0.083008s] ... ok
{5} tempest.api.network.test_networks_negative.NetworksNegativeTestJSON.test_show_non_existent_subnet [0.056602s] ... ok
{5} tempest.api.network.test_networks_negative.NetworksNegativeTestJSON.test_update_non_existent_network [0.035811s] ... ok
{5} tempest.api.network.test_networks_negative.NetworksNegativeTestJSON.test_update_non_existent_port [0.129676s] ... ok
{5} tempest.api.network.test_networks_negative.NetworksNegativeTestJSON.test_update_non_existent_subnet [0.116419s] ... ok
{6} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_security_group_rule_with_icmp_type_code [8.677322s] ... ok
{6} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_security_group_rule_with_protocol_integer_value [5.088398s] ... ok
{4} tempest.api.network.test_routers.RoutersIpV6Test.test_router_interface_port_update_with_fixed_ip [21.919347s] ... ok
{5} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group [4.578366s] ... ok
{2} tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces [44.724420s] ... ok
{5} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_additional_args [3.609203s] ... ok
{6} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_security_group_rule_with_remote_group_id [5.118907s] ... ok
{6} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_security_group_rule_with_remote_ip_prefix [3.035237s] ... ok
{5} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_icmp_type_code [8.520678s] ... ok
{5} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_protocol_integer_value [3.475674s] ... ok
{6} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule [9.241464s] ... ok
{6} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups [0.151005s] ... ok
{6} tempest.api.network.test_security_groups_negative.NegativeSecGroupIPv6Test.test_create_additional_default_security_group_fails [0.318374s] ... ok
{5} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_group_id [5.369470s] ... ok
{6} tempest.api.network.test_security_groups_negative.NegativeSecGroupIPv6Test.test_create_duplicate_security_group_rule_fails [4.371620s] ... ok
{5} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_ip_prefix [3.579773s] ... ok
{6} tempest.api.network.test_security_groups_negative.NegativeSecGroupIPv6Test.test_create_security_group_rule_with_bad_ethertype [1.542832s] ... ok
{6} tempest.api.network.test_security_groups_negative.NegativeSecGroupIPv6Test.test_create_security_group_rule_with_bad_protocol [2.760918s] ... ok
{2} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id [26.667184s] ... ok
{5} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule [6.523318s] ... ok
{5} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups [0.171762s] ... ok
{6} tempest.api.network.test_security_groups_negative.NegativeSecGroupIPv6Test.test_create_security_group_rule_with_bad_remote_ip_prefix [3.335163s] ... ok
{6} tempest.api.network.test_security_groups_negative.NegativeSecGroupIPv6Test.test_create_security_group_rule_with_invalid_ports [2.821608s] ... ok
{6} tempest.api.network.test_security_groups_negative.NegativeSecGroupIPv6Test.test_create_security_group_rule_with_non_existent_remote_groupid [1.331674s] ... ok
{6} tempest.api.network.test_security_groups_negative.NegativeSecGroupIPv6Test.test_create_security_group_rule_with_non_existent_security_group [0.159306s] ... ok
{6} tempest.api.network.test_security_groups_negative.NegativeSecGroupIPv6Test.test_create_security_group_rule_with_remote_ip_and_group [1.672089s] ... ok
{6} tempest.api.network.test_security_groups_negative.NegativeSecGroupIPv6Test.test_create_security_group_rule_wrong_ip_prefix_version [2.761771s] ... ok
{0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_floating_ip_update_different_router [54.061869s] ... ok
{6} tempest.api.network.test_security_groups_negative.NegativeSecGroupIPv6Test.test_create_security_group_update_name_default [2.487620s] ... ok
{6} tempest.api.network.test_security_groups_negative.NegativeSecGroupIPv6Test.test_delete_non_existent_security_group [0.330752s] ... ok
{6} tempest.api.network.test_security_groups_negative.NegativeSecGroupIPv6Test.test_show_non_existent_security_group [0.049212s] ... ok
{6} tempest.api.network.test_security_groups_negative.NegativeSecGroupIPv6Test.test_show_non_existent_security_group_rule [0.093697s] ... ok
{5} tempest.api.network.test_tags.TagsExtTest.test_create_check_list_and_delete_tags [8.740959s] ... ok
{2} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id [21.444102s] ... ok
{7} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_mtu_sized_frames [110.041381s] ... ok
{5} tempest.api.network.test_tags.TagsExtTest.test_update_and_delete_all_tags [11.013880s] ... ok
{2} tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router [11.581606s] ... ok
{5} tempest.scenario.test_network_advanced_server_ops.TestNetworkAdvancedServerOps.test_server_connectivity_cold_migration ... SKIPPED: Less than 2 compute nodes, skipping multinode tests.
{5} tempest.scenario.test_network_advanced_server_ops.TestNetworkAdvancedServerOps.test_server_connectivity_cold_migration_revert ... SKIPPED: Less than 2 compute nodes, skipping multinode tests.
{5} tempest.scenario.test_network_advanced_server_ops.TestNetworkAdvancedServerOps.test_server_connectivity_live_migration ... SKIPPED: Less than 2 compute nodes, skipping multinode tests.
{4} tempest.api.network.test_routers.RoutersIpV6Test.test_update_delete_extra_route [70.417675s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6Test.test_create_delete_subnet_with_dhcp_enabled [5.991893s] ... ok
{4} tempest.api.network.test_routers.RoutersIpV6Test.test_update_router_admin_state [2.448583s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6Test.test_create_delete_subnet_with_gw [3.696567s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6Test.test_create_delete_subnet_with_gw_and_allocation_pools [3.531479s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6Test.test_create_delete_subnet_with_host_routes_and_dns_nameservers [6.359160s] ... ok
{2} tempest.api.network.test_routers.RoutersTest.test_router_interface_port_update_with_fixed_ip [22.967658s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6Test.test_create_delete_subnet_without_gateway [4.301789s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6Test.test_create_list_subnet_with_no_gw64_one_network [6.565041s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6Test.test_create_update_delete_network_subnet [4.346743s] ... ok
{4} tempest.api.network.test_routers_negative.RoutersNegativeIpV6Test.test_add_router_interfaces_on_overlapping_subnets_returns_400 [20.656562s] ... ok
{4} tempest.api.network.test_routers_negative.RoutersNegativeIpV6Test.test_delete_non_existent_router_returns_404 [0.091481s] ... ok
{4} tempest.api.network.test_routers_negative.RoutersNegativeIpV6Test.test_router_add_gateway_invalid_network_returns_404 [1.168192s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6Test.test_create_update_network_description [2.985617s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6Test.test_external_network_visibility [0.437856s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6Test.test_list_networks [0.594429s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6Test.test_list_networks_fields [0.293162s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6Test.test_list_subnets [0.121781s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6Test.test_list_subnets_fields [0.344197s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6Test.test_show_network [0.263423s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6Test.test_show_network_fields [0.821403s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6Test.test_show_subnet [0.634262s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6Test.test_show_subnet_fields [0.206535s] ... ok
{4} tempest.api.network.test_routers_negative.RoutersNegativeIpV6Test.test_router_add_gateway_net_not_external_returns_400 [4.269117s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6Test.test_update_subnet_gw_dns_host_routes_dhcp [10.844087s] ... ok
{4} tempest.api.network.test_routers_negative.RoutersNegativeIpV6Test.test_router_remove_interface_in_use_returns_409 [12.165028s] ... ok
{4} tempest.api.network.test_routers_negative.RoutersNegativeIpV6Test.test_show_non_existent_router_returns_404 [0.141728s] ... ok
{4} tempest.api.network.test_routers_negative.RoutersNegativeIpV6Test.test_update_non_existent_router_returns_404 [0.115366s] ... ok
{0} tempest.api.network.test_service_providers.ServiceProvidersTest.test_service_providers_list [0.184877s] ... ok
{4} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools [0.721298s] ... ok
{2} tempest.api.network.test_routers.RoutersTest.test_update_delete_extra_route [70.440045s] ... ok
{2} tempest.api.network.test_routers.RoutersTest.test_update_router_admin_state [2.094023s] ... ok
{2} tempest.api.network.test_routers_negative.DvrRoutersNegativeTest.test_router_create_tenant_distributed_returns_forbidden [0.108847s] ... ok
{4} tempest.scenario.test_server_advanced_ops.TestServerAdvancedOps.test_server_sequence_suspend_resume [31.917972s] ... ok
{7} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops [163.582899s] ... ok
{7} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_port_security_macspoofing_port ... SKIPPED: NIC hotplug not available
{5} tempest.scenario.test_network_advanced_server_ops.TestNetworkAdvancedServerOps.test_server_connectivity_rebuild [160.168646s] ... ok
{7} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_preserve_preexisting_port [53.735189s] ... ok
{7} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_router_rescheduling [71.610329s] ... ok
{7} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_subnet_details [193.818067s] ... ok
{4} tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern [435.146601s] ... ok
{7} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_update_instance_port_admin_state [99.247917s] ... ok
{7} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_update_router_admin_state [74.762353s] ... ok

==============================
Failed 6 tests - output below:
==============================

tempest.api.network.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON.test_update_port_with_address_pair[id-9599b337-272c-47fd-b3cf-509414414ac4]
--------------------------------------------------------------------------------------------------------------------------------------------------------

Captured traceback:
~~~~~~~~~~~~~~~~~~~
    Traceback (most recent call last):

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 105, in test_update_port_with_address_pair
    self._update_port_with_address(self.ip_address)

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 100, in _update_port_with_address
    self.assertCountEqual(allowed_address_pair, allowed_address_pairs)

      File "/usr/lib/python3.8/unittest/case.py", line 1272, in assertCountEqual
    self.fail(msg)

      File "/opt/stack/tempest/.tox/venv/lib/python3.8/site-packages/unittest2/case.py", line 690, in fail
    raise self.failureException(msg)

    AssertionError: Element counts were not equal:
First has 1, Second has 0:  {'mac_address': 'fa:16:3e:7e:fd:7d', 'ip_address': '2001:db8::30d', 'active': True}
First has 0, Second has 1:  {'ip_address': '2001:db8::30d', 'mac_address': 'fa:16:3e:7e:fd:7d'}


Captured pythonlogging:
~~~~~~~~~~~~~~~~~~~~~~~
    2021-06-08 12:19:42,241 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:test_update_port_with_address_pair): 201 POST http://10.222.0.44:9696/v2.0/ports 3.676s
2021-06-08 12:19:42,241 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"network_id": "d02a2a90-aff3-4c96-b2fc-3f9c7f86998f", "name": "tempest-AllowedAddressPairIpV6TestJSON-462735305"}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '744', 'x-openstack-request-id': 'req-56d6ae49-a274-447c-b393-de02b158094e', 'date': 'Tue, 08 Jun 2021 12:19:42 GMT', 'connection': 'close', 'status': '201', 'content-location': 'http://10.222.0.44:9696/v2.0/ports'}
        Body: b'{"port":{"id":"06d3e650-188f-49bd-b0ba-46c0d7f88020","name":"tempest-AllowedAddressPairIpV6TestJSON-462735305","network_id":"d02a2a90-aff3-4c96-b2fc-3f9c7f86998f","tenant_id":"c20763a485ee4aefb5e052fd9c040973","mac_address":"fa:16:3e:32:20:55","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"05119fe9-49be-4b13-a2a8-878c568c0e93","ip_address":"2001:db8::14f"}],"project_id":"c20763a485ee4aefb5e052fd9c040973","port_security_enabled":true,"security_groups":["1848c0e7-6303-4e84-9633-c5c5c497de44"],"binding:vnic_type":"normal","allowed_address_pairs":[],"extra_dhcp_opts":[],"description":"","tags":[],"created_at":"2021-06-08T12:19:39Z","updated_at":"2021-06-08T12:19:40Z","revision_number":1}}'
2021-06-08 12:19:47,970 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:test_update_port_with_address_pair): 200 PUT http://10.222.0.44:9696/v2.0/ports/06d3e650-188f-49bd-b0ba-46c0d7f88020 5.728s
2021-06-08 12:19:47,970 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"allowed_address_pairs": [{"ip_address": "2001:db8::30d", "mac_address": "fa:16:3e:7e:fd:7d"}]}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '822', 'x-openstack-request-id': 'req-6f166bd8-aeba-4edc-ae13-727d143a953a', 'date': 'Tue, 08 Jun 2021 12:19:47 GMT', 'connection': 'close', 'status': '200', 'content-location': 'http://10.222.0.44:9696/v2.0/ports/06d3e650-188f-49bd-b0ba-46c0d7f88020'}
        Body: b'{"port":{"id":"06d3e650-188f-49bd-b0ba-46c0d7f88020","name":"tempest-AllowedAddressPairIpV6TestJSON-462735305","network_id":"d02a2a90-aff3-4c96-b2fc-3f9c7f86998f","tenant_id":"c20763a485ee4aefb5e052fd9c040973","mac_address":"fa:16:3e:32:20:55","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"05119fe9-49be-4b13-a2a8-878c568c0e93","ip_address":"2001:db8::14f"}],"allowed_address_pairs":[{"mac_address":"fa:16:3e:7e:fd:7d","ip_address":"2001:db8::30d","active":true}],"extra_dhcp_opts":[],"security_groups":["1848c0e7-6303-4e84-9633-c5c5c497de44"],"description":"","binding:vnic_type":"normal","port_security_enabled":true,"tags":[],"created_at":"2021-06-08T12:19:39Z","updated_at":"2021-06-08T12:19:45Z","revision_number":2,"project_id":"c20763a485ee4aefb5e052fd9c040973"}}'
2021-06-08 12:19:55,052 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:_run_cleanups): 204 DELETE http://10.222.0.44:9696/v2.0/ports/06d3e650-188f-49bd-b0ba-46c0d7f88020 7.075s
2021-06-08 12:19:55,053 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-length': '0', 'x-openstack-request-id': 'req-b8d1b043-178e-4aa6-beb4-394be0111640', 'date': 'Tue, 08 Jun 2021 12:19:55 GMT', 'connection': 'close', 'status': '204', 'content-location': 'http://10.222.0.44:9696/v2.0/ports/06d3e650-188f-49bd-b0ba-46c0d7f88020'}
        Body: b''
2021-06-08 12:19:55,209 107895 INFO     [tempest.lib.co
    mmon.rest_client] Request (AllowedAddressPairIpV6TestJSON:_run_cleanups): 404 GET http://10.222.0.44:9696/v2.0/ports/06d3e650-188f-49bd-b0ba-46c0d7f88020 0.155s
2021-06-08 12:19:55,209 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-type': 'application/json', 'content-length': '132', 'x-openstack-request-id': 'req-573c99a6-d4f7-48b3-bb26-220efa7340dc', 'date': 'Tue, 08 Jun 2021 12:19:55 GMT', 'connection': 'close', 'status': '404', 'content-location': 'http://10.222.0.44:9696/v2.0/ports/06d3e650-188f-49bd-b0ba-46c0d7f88020'}
        Body: b'{"NeutronError": {"type": "PortNotFound", "message": "Port 06d3e650-188f-49bd-b0ba-46c0d7f88020 could not be found.", "detail": ""}}'


tempest.api.network.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON.test_update_port_with_cidr_address_pair[id-4d6d178f-34f6-4bff-a01c-0a2f8fe909e4]
-------------------------------------------------------------------------------------------------------------------------------------------------------------

Captured traceback:
~~~~~~~~~~~~~~~~~~~
    Traceback (most recent call last):

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 110, in test_update_port_with_cidr_address_pair
    self._update_port_with_address(str(self.cidr))

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 100, in _update_port_with_address
    self.assertCountEqual(allowed_address_pair, allowed_address_pairs)

      File "/usr/lib/python3.8/unittest/case.py", line 1272, in assertCountEqual
    self.fail(msg)

      File "/opt/stack/tempest/.tox/venv/lib/python3.8/site-packages/unittest2/case.py", line 690, in fail
    raise self.failureException(msg)

    AssertionError: Element counts were not equal:
First has 1, Second has 0:  {'mac_address': 'fa:16:3e:7e:fd:7d', 'ip_address': '2001:db8::/48', 'active': True}
First has 0, Second has 1:  {'ip_address': '2001:db8::/48', 'mac_address': 'fa:16:3e:7e:fd:7d'}


Captured pythonlogging:
~~~~~~~~~~~~~~~~~~~~~~~
    2021-06-08 12:19:57,827 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:test_update_port_with_cidr_address_pair): 201 POST http://10.222.0.44:9696/v2.0/ports 2.616s
2021-06-08 12:19:57,828 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"network_id": "d02a2a90-aff3-4c96-b2fc-3f9c7f86998f", "name": "tempest-AllowedAddressPairIpV6TestJSON-905056580"}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '743', 'x-openstack-request-id': 'req-7e4eccac-0e70-4ecc-9c7e-baa960e04aa2', 'date': 'Tue, 08 Jun 2021 12:19:57 GMT', 'connection': 'close', 'status': '201', 'content-location': 'http://10.222.0.44:9696/v2.0/ports'}
        Body: b'{"port":{"id":"70f2d22e-b2d9-4539-9984-541467b2c8b2","name":"tempest-AllowedAddressPairIpV6TestJSON-905056580","network_id":"d02a2a90-aff3-4c96-b2fc-3f9c7f86998f","tenant_id":"c20763a485ee4aefb5e052fd9c040973","mac_address":"fa:16:3e:a7:be:0d","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"05119fe9-49be-4b13-a2a8-878c568c0e93","ip_address":"2001:db8::cf"}],"project_id":"c20763a485ee4aefb5e052fd9c040973","port_security_enabled":true,"security_groups":["1848c0e7-6303-4e84-9633-c5c5c497de44"],"binding:vnic_type":"normal","allowed_address_pairs":[],"extra_dhcp_opts":[],"description":"","tags":[],"created_at":"2021-06-08T12:19:56Z","updated_at":"2021-06-08T12:19:56Z","revision_number":1}}'
2021-06-08 12:19:59,910 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:test_update_port_with_cidr_address_pair): 200 PUT http://10.222.0.44:9696/v2.0/ports/70f2d22e-b2d9-4539-9984-541467b2c8b2 2.081s
2021-06-08 12:19:59,910 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"allowed_address_pairs": [{"ip_address": "2001:db8::/48", "mac_address": "fa:16:3e:7e:fd:7d"}]}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '821', 'x-openstack-request-id': 'req-e11494f9-fd03-46da-b0e4-bbe083863c5d', 'date': 'Tue, 08 Jun 2021 12:19:59 GMT', 'connection': 'close', 'status': '200', 'content-location': 'http://10.222.0.44:9696/v2.0/ports/70f2d22e-b2d9-4539-9984-541467b2c8b2'}
        Body: b'{"port":{"id":"70f2d22e-b2d9-4539-9984-541467b2c8b2","name":"tempest-AllowedAddressPairIpV6TestJSON-905056580","network_id":"d02a2a90-aff3-4c96-b2fc-3f9c7f86998f","tenant_id":"c20763a485ee4aefb5e052fd9c040973","mac_address":"fa:16:3e:a7:be:0d","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"05119fe9-49be-4b13-a2a8-878c568c0e93","ip_address":"2001:db8::cf"}],"allowed_address_pairs":[{"mac_address":"fa:16:3e:7e:fd:7d","ip_address":"2001:db8::/48","active":true}],"extra_dhcp_opts":[],"security_groups":["1848c0e7-6303-4e84-9633-c5c5c497de44"],"description":"","binding:vnic_type":"normal","port_security_enabled":true,"tags":[],"created_at":"2021-06-08T12:19:56Z","updated_at":"2021-06-08T12:19:59Z","revision_number":2,"project_id":"c20763a485ee4aefb5e052fd9c040973"}}'
2021-06-08 12:20:03,065 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:_run_cleanups): 204 DELETE http://10.222.0.44:9696/v2.0/ports/70f2d22e-b2d9-4539-9984-541467b2c8b2 3.153s
2021-06-08 12:20:03,065 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-length': '0', 'x-openstack-request-id': 'req-43d20923-f617-47b2-9e2a-701c1c689a41', 'date': 'Tue, 08 Jun 2021 12:20:03 GMT', 'connection': 'close', 'status': '204', 'content-location': 'http://10.222.0.44:9696/v2.0/ports/70f2d22e-b2d9-4539-9984-541467b2c8b2'}
        Body: b''
2021-06-08 12:20:03,321 107895 INFO     [tempes
    t.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:_run_cleanups): 404 GET http://10.222.0.44:9696/v2.0/ports/70f2d22e-b2d9-4539-9984-541467b2c8b2 0.255s
2021-06-08 12:20:03,322 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-type': 'application/json', 'content-length': '132', 'x-openstack-request-id': 'req-cd6abb53-ebea-46d4-84a3-31d3349d1d9a', 'date': 'Tue, 08 Jun 2021 12:20:03 GMT', 'connection': 'close', 'status': '404', 'content-location': 'http://10.222.0.44:9696/v2.0/ports/70f2d22e-b2d9-4539-9984-541467b2c8b2'}
        Body: b'{"NeutronError": {"type": "PortNotFound", "message": "Port 70f2d22e-b2d9-4539-9984-541467b2c8b2 could not be found.", "detail": ""}}'


tempest.api.network.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON.test_update_port_with_multiple_ip_mac_address_pair[id-b3f20091-6cd5-472b-8487-3516137df933]
------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Captured traceback:
~~~~~~~~~~~~~~~~~~~
    Traceback (most recent call last):

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 129, in test_update_port_with_multiple_ip_mac_address_pair
    self._update_port_with_address(

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 100, in _update_port_with_address
    self.assertCountEqual(allowed_address_pair, allowed_address_pairs)

      File "/usr/lib/python3.8/unittest/case.py", line 1272, in assertCountEqual
    self.fail(msg)

      File "/opt/stack/tempest/.tox/venv/lib/python3.8/site-packages/unittest2/case.py", line 690, in fail
    raise self.failureException(msg)

    AssertionError: Element counts were not equal:
First has 1, Second has 0:  {'mac_address': 'fa:16:3e:7e:fd:7d', 'ip_address': '2001:db8::30d', 'active': True}
First has 1, Second has 0:  {'mac_address': 'fa:16:3e:f8:d2:54', 'ip_address': '2001:db8::99', 'active': True}
First has 0, Second has 1:  {'ip_address': '2001:db8::30d', 'mac_address': 'fa:16:3e:7e:fd:7d'}
First has 0, Second has 1:  {'ip_address': '2001:db8::99', 'mac_address': 'fa:16:3e:f8:d2:54'}


Captured pythonlogging:
~~~~~~~~~~~~~~~~~~~~~~~
    2021-06-08 12:20:06,448 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:test_update_port_with_multiple_ip_mac_address_pair): 201 POST http://10.222.0.44:9696/v2.0/ports 3.122s
2021-06-08 12:20:06,448 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"network_id": "d02a2a90-aff3-4c96-b2fc-3f9c7f86998f", "name": "tempest-AllowedAddressPairIpV6TestJSON-1494202098"}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '744', 'x-openstack-request-id': 'req-51cda261-1ed4-4094-94ea-be5aaf267e4a', 'date': 'Tue, 08 Jun 2021 12:20:06 GMT', 'connection': 'close', 'status': '201', 'content-location': 'http://10.222.0.44:9696/v2.0/ports'}
        Body: b'{"port":{"id":"f09cccaf-7446-4f14-a1d9-525d3935b736","name":"tempest-AllowedAddressPairIpV6TestJSON-1494202098","network_id":"d02a2a90-aff3-4c96-b2fc-3f9c7f86998f","tenant_id":"c20763a485ee4aefb5e052fd9c040973","mac_address":"fa:16:3e:f8:d2:54","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"05119fe9-49be-4b13-a2a8-878c568c0e93","ip_address":"2001:db8::99"}],"project_id":"c20763a485ee4aefb5e052fd9c040973","port_security_enabled":true,"security_groups":["1848c0e7-6303-4e84-9633-c5c5c497de44"],"binding:vnic_type":"normal","allowed_address_pairs":[],"extra_dhcp_opts":[],"description":"","tags":[],"created_at":"2021-06-08T12:20:04Z","updated_at":"2021-06-08T12:20:05Z","revision_number":1}}'
2021-06-08 12:20:08,227 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:test_update_port_with_multiple_ip_mac_address_pair): 201 POST http://10.222.0.44:9696/v2.0/ports 1.778s
2021-06-08 12:20:08,228 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"network_id": "d02a2a90-aff3-4c96-b2fc-3f9c7f86998f", "name": "tempest-AllowedAddressPairIpV6TestJSON-1145511128"}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '745', 'x-openstack-request-id': 'req-8b3e8728-a841-4e33-b45b-ae8e18783b10', 'date': 'Tue, 08 Jun 2021 12:20:08 GMT', 'connection': 'close', 'status': '201', 'content-location': 'http://10.222.0.44:9696/v2.0/ports'}
        Body: b'{"port":{"id":"0d1be92d-01b7-466d-b5a0-bb2844fe3575","name":"tempest-AllowedAddressPairIpV6TestJSON-1145511128","network_id":"d02a2a90-aff3-4c96-b2fc-3f9c7f86998f","tenant_id":"c20763a485ee4aefb5e052fd9c040973","mac_address":"fa:16:3e:91:06:8c","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"05119fe9-49be-4b13-a2a8-878c568c0e93","ip_address":"2001:db8::371"}],"project_id":"c20763a485ee4aefb5e052fd9c040973","port_security_enabled":true,"security_groups":["1848c0e7-6303-4e84-9633-c5c5c497de44"],"binding:vnic_type":"normal","allowed_address_pairs":[],"extra_dhcp_opts":[],"description":"","tags":[],"created_at":"2021-06-08T12:20:06Z","updated_at":"2021-06-08T12:20:07Z","revision_number":1}}'
2021-06-08 12:20:11,260 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:test_update_port_with_multiple_ip_mac_address_pair): 200 PUT http://10.222.0.44:9696/v2.0/ports/0d1be92d-01b7-466d-b5a0-bb2844fe3575 3.030s
2021-06-08 12:20:11,260 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"allowed_address_pairs": [{"ip_address": "2001:db8::30d", "mac_address": "fa:16:3e:7e:fd:7d"}, {"ip_address": "2001:db8::99", "mac_address": "fa:16:3e:f8:d2:54"}]}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '901', 'x-openstack-request-id': 'req-af144fce-b2e8-4fa5-92b3-bae44fb49fda', 'date': 'Tue, 08 Jun 2021 12:20:11 GMT', 'connection': 'close', 'status': '200', 'content-location': 'htt
    p://10.222.0.44:9696/v2.0/ports/0d1be92d-01b7-466d-b5a0-bb2844fe3575'}
        Body: b'{"port":{"id":"0d1be92d-01b7-466d-b5a0-bb2844fe3575","name":"tempest-AllowedAddressPairIpV6TestJSON-1145511128","network_id":"d02a2a90-aff3-4c96-b2fc-3f9c7f86998f","tenant_id":"c20763a485ee4aefb5e052fd9c040973","mac_address":"fa:16:3e:91:06:8c","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"05119fe9-49be-4b13-a2a8-878c568c0e93","ip_address":"2001:db8::371"}],"allowed_address_pairs":[{"mac_address":"fa:16:3e:7e:fd:7d","ip_address":"2001:db8::30d","active":true},{"mac_address":"fa:16:3e:f8:d2:54","ip_address":"2001:db8::99","active":true}],"extra_dhcp_opts":[],"security_groups":["1848c0e7-6303-4e84-9633-c5c5c497de44"],"description":"","binding:vnic_type":"normal","port_security_enabled":true,"tags":[],"created_at":"2021-06-08T12:20:06Z","updated_at":"2021-06-08T12:20:10Z","revision_number":2,"project_id":"c20763a485ee4aefb5e052fd9c040973"}}'
2021-06-08 12:20:14,336 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:_run_cleanups): 204 DELETE http://10.222.0.44:9696/v2.0/ports/0d1be92d-01b7-466d-b5a0-bb2844fe3575 3.075s
2021-06-08 12:20:14,336 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-length': '0', 'x-openstack-request-id': 'req-c6c9f9c6-ce1c-4850-b66a-9913c3e1d139', 'date': 'Tue, 08 Jun 2021 12:20:14 GMT', 'connection': 'close', 'status': '204', 'content-location': 'http://10.222.0.44:9696/v2.0/ports/0d1be92d-01b7-466d-b5a0-bb2844fe3575'}
        Body: b''
2021-06-08 12:20:14,434 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:_run_cleanups): 404 GET http://10.222.0.44:9696/v2.0/ports/0d1be92d-01b7-466d-b5a0-bb2844fe3575 0.097s
2021-06-08 12:20:14,434 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-type': 'application/json', 'content-length': '132', 'x-openstack-request-id': 'req-0673749f-ba76-48e6-97b3-d2b335f34d60', 'date': 'Tue, 08 Jun 2021 12:20:14 GMT', 'connection': 'close', 'status': '404', 'content-location': 'http://10.222.0.44:9696/v2.0/ports/0d1be92d-01b7-466d-b5a0-bb2844fe3575'}
        Body: b'{"NeutronError": {"type": "PortNotFound", "message": "Port 0d1be92d-01b7-466d-b5a0-bb2844fe3575 could not be found.", "detail": ""}}'
2021-06-08 12:20:16,042 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:_run_cleanups): 204 DELETE http://10.222.0.44:9696/v2.0/ports/f09cccaf-7446-4f14-a1d9-525d3935b736 1.607s
2021-06-08 12:20:16,042 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-length': '0', 'x-openstack-request-id': 'req-ad3b6b6c-1ebb-4bbd-994b-0cedc3e42b8b', 'date': 'Tue, 08 Jun 2021 12:20:16 GMT', 'connection': 'close', 'status': '204', 'content-location': 'http://10.222.0.44:9696/v2.0/ports/f09cccaf-7446-4f14-a1d9-525d3935b736'}
        Body: b''
2021-06-08 12:20:16,203 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:_run_cleanups): 404 GET http://10.222.0.44:9696/v2.0/ports/f09cccaf-7446-4f14-a1d9-525d3935b736 0.160s
2021-06-08 12:20:16,203 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-type': 'application/json', 'content-length': '132', 'x-openstack-request-id': 'req-f4e72b25-b4e0-4bcb-aa06-031ac6becf9d', 'date': 'Tue, 08 Jun 2021 12:20:16 GMT', 'connection': 'close', 'status': '404', 'content-location': 'http://10.222.0.44:9696/v2.0/ports/f09cccaf-
    7446-4f14-a1d9-525d3935b736'}
        Body: b'{"NeutronError": {"type": "PortNotFound", "message": "Port f09cccaf-7446-4f14-a1d9-525d3935b736 could not be found.", "detail": ""}}'


tempest.api.network.test_allowed_address_pair.AllowedAddressPairTestJSON.test_update_port_with_address_pair[id-9599b337-272c-47fd-b3cf-509414414ac4]
----------------------------------------------------------------------------------------------------------------------------------------------------

Captured traceback:
~~~~~~~~~~~~~~~~~~~
    Traceback (most recent call last):

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 105, in test_update_port_with_address_pair
    self._update_port_with_address(self.ip_address)

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 100, in _update_port_with_address
    self.assertCountEqual(allowed_address_pair, allowed_address_pairs)

      File "/usr/lib/python3.8/unittest/case.py", line 1272, in assertCountEqual
    self.fail(msg)

      File "/opt/stack/tempest/.tox/venv/lib/python3.8/site-packages/unittest2/case.py", line 690, in fail
    raise self.failureException(msg)

    AssertionError: Element counts were not equal:
First has 1, Second has 0:  {'mac_address': 'fa:16:3e:f7:ce:1c', 'ip_address': '172.20.0.6', 'active': True}
First has 0, Second has 1:  {'ip_address': '172.20.0.6', 'mac_address': 'fa:16:3e:f7:ce:1c'}


Captured pythonlogging:
~~~~~~~~~~~~~~~~~~~~~~~
    2021-06-08 12:20:43,958 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:test_update_port_with_address_pair): 201 POST http://10.222.0.44:9696/v2.0/ports 2.071s
2021-06-08 12:20:43,958 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"network_id": "b8603a02-94a4-4fdf-84cf-28e4cd736ef7", "name": "tempest-AllowedAddressPairTestJSON-1790819370"}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '739', 'x-openstack-request-id': 'req-9161202a-7cca-48e8-ba7d-c8858ccc87f3', 'date': 'Tue, 08 Jun 2021 12:20:43 GMT', 'connection': 'close', 'status': '201', 'content-location': 'http://10.222.0.44:9696/v2.0/ports'}
        Body: b'{"port":{"id":"0d56d8fd-33f8-4240-a6f5-668addcb9c9a","name":"tempest-AllowedAddressPairTestJSON-1790819370","network_id":"b8603a02-94a4-4fdf-84cf-28e4cd736ef7","tenant_id":"8a5bffe2e191455ab1ac2087d1820597","mac_address":"fa:16:3e:65:0e:d4","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"e776e277-f662-4f88-9257-95067b1a1173","ip_address":"172.20.0.12"}],"project_id":"8a5bffe2e191455ab1ac2087d1820597","port_security_enabled":true,"security_groups":["1856b85a-cd0f-4057-85a3-5b0743a051dc"],"binding:vnic_type":"normal","allowed_address_pairs":[],"extra_dhcp_opts":[],"description":"","tags":[],"created_at":"2021-06-08T12:20:42Z","updated_at":"2021-06-08T12:20:43Z","revision_number":1}}'
2021-06-08 12:20:46,004 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:test_update_port_with_address_pair): 200 PUT http://10.222.0.44:9696/v2.0/ports/0d56d8fd-33f8-4240-a6f5-668addcb9c9a 2.045s
2021-06-08 12:20:46,004 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"allowed_address_pairs": [{"ip_address": "172.20.0.6", "mac_address": "fa:16:3e:f7:ce:1c"}]}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '814', 'x-openstack-request-id': 'req-f6bfd8ce-77f0-4aa5-be5d-bbdefda88a1f', 'date': 'Tue, 08 Jun 2021 12:20:46 GMT', 'connection': 'close', 'status': '200', 'content-location': 'http://10.222.0.44:9696/v2.0/ports/0d56d8fd-33f8-4240-a6f5-668addcb9c9a'}
        Body: b'{"port":{"id":"0d56d8fd-33f8-4240-a6f5-668addcb9c9a","name":"tempest-AllowedAddressPairTestJSON-1790819370","network_id":"b8603a02-94a4-4fdf-84cf-28e4cd736ef7","tenant_id":"8a5bffe2e191455ab1ac2087d1820597","mac_address":"fa:16:3e:65:0e:d4","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"e776e277-f662-4f88-9257-95067b1a1173","ip_address":"172.20.0.12"}],"allowed_address_pairs":[{"mac_address":"fa:16:3e:f7:ce:1c","ip_address":"172.20.0.6","active":true}],"extra_dhcp_opts":[],"security_groups":["1856b85a-cd0f-4057-85a3-5b0743a051dc"],"description":"","binding:vnic_type":"normal","port_security_enabled":true,"tags":[],"created_at":"2021-06-08T12:20:42Z","updated_at":"2021-06-08T12:20:44Z","revision_number":2,"project_id":"8a5bffe2e191455ab1ac2087d1820597"}}'
2021-06-08 12:20:48,474 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:_run_cleanups): 204 DELETE http://10.222.0.44:9696/v2.0/ports/0d56d8fd-33f8-4240-a6f5-668addcb9c9a 2.468s
2021-06-08 12:20:48,474 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-length': '0', 'x-openstack-request-id': 'req-b20e39c9-f804-4c1d-9d7f-efef452f65b8', 'date': 'Tue, 08 Jun 2021 12:20:48 GMT', 'connection': 'close', 'status': '204', 'content-location': 'http://10.222.0.44:9696/v2.0/ports/0d56d8fd-33f8-4240-a6f5-668addcb9c9a'}
        Body: b''
2021-06-08 12:20:48,541 107895 INFO     [tempest.lib.common.rest_client] Request (Allo
    wedAddressPairTestJSON:_run_cleanups): 404 GET http://10.222.0.44:9696/v2.0/ports/0d56d8fd-33f8-4240-a6f5-668addcb9c9a 0.067s
2021-06-08 12:20:48,542 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-type': 'application/json', 'content-length': '132', 'x-openstack-request-id': 'req-47d6a773-4c0d-4e94-9608-ee539208574e', 'date': 'Tue, 08 Jun 2021 12:20:48 GMT', 'connection': 'close', 'status': '404', 'content-location': 'http://10.222.0.44:9696/v2.0/ports/0d56d8fd-33f8-4240-a6f5-668addcb9c9a'}
        Body: b'{"NeutronError": {"type": "PortNotFound", "message": "Port 0d56d8fd-33f8-4240-a6f5-668addcb9c9a could not be found.", "detail": ""}}'


tempest.api.network.test_allowed_address_pair.AllowedAddressPairTestJSON.test_update_port_with_cidr_address_pair[id-4d6d178f-34f6-4bff-a01c-0a2f8fe909e4]
---------------------------------------------------------------------------------------------------------------------------------------------------------

Captured traceback:
~~~~~~~~~~~~~~~~~~~
    Traceback (most recent call last):

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 110, in test_update_port_with_cidr_address_pair
    self._update_port_with_address(str(self.cidr))

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 100, in _update_port_with_address
    self.assertCountEqual(allowed_address_pair, allowed_address_pairs)

      File "/usr/lib/python3.8/unittest/case.py", line 1272, in assertCountEqual
    self.fail(msg)

      File "/opt/stack/tempest/.tox/venv/lib/python3.8/site-packages/unittest2/case.py", line 690, in fail
    raise self.failureException(msg)

    AssertionError: Element counts were not equal:
First has 1, Second has 0:  {'mac_address': 'fa:16:3e:f7:ce:1c', 'ip_address': '172.20.0.0/16', 'active': True}
First has 0, Second has 1:  {'ip_address': '172.20.0.0/16', 'mac_address': 'fa:16:3e:f7:ce:1c'}


Captured pythonlogging:
~~~~~~~~~~~~~~~~~~~~~~~
    2021-06-08 12:20:52,193 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:test_update_port_with_cidr_address_pair): 201 POST http://10.222.0.44:9696/v2.0/ports 3.645s
2021-06-08 12:20:52,193 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"network_id": "b8603a02-94a4-4fdf-84cf-28e4cd736ef7", "name": "tempest-AllowedAddressPairTestJSON-1620070953"}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '738', 'x-openstack-request-id': 'req-01544f75-68b6-46ab-9644-9912ed04a25a', 'date': 'Tue, 08 Jun 2021 12:20:52 GMT', 'connection': 'close', 'status': '201', 'content-location': 'http://10.222.0.44:9696/v2.0/ports'}
        Body: b'{"port":{"id":"6fdb0b97-838f-4f14-9c93-a6956a0571a0","name":"tempest-AllowedAddressPairTestJSON-1620070953","network_id":"b8603a02-94a4-4fdf-84cf-28e4cd736ef7","tenant_id":"8a5bffe2e191455ab1ac2087d1820597","mac_address":"fa:16:3e:c3:f2:2f","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"e776e277-f662-4f88-9257-95067b1a1173","ip_address":"172.20.0.4"}],"project_id":"8a5bffe2e191455ab1ac2087d1820597","port_security_enabled":true,"security_groups":["1856b85a-cd0f-4057-85a3-5b0743a051dc"],"binding:vnic_type":"normal","allowed_address_pairs":[],"extra_dhcp_opts":[],"description":"","tags":[],"created_at":"2021-06-08T12:20:49Z","updated_at":"2021-06-08T12:20:50Z","revision_number":1}}'
2021-06-08 12:20:53,928 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:test_update_port_with_cidr_address_pair): 200 PUT http://10.222.0.44:9696/v2.0/ports/6fdb0b97-838f-4f14-9c93-a6956a0571a0 1.734s
2021-06-08 12:20:53,929 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"allowed_address_pairs": [{"ip_address": "172.20.0.0/16", "mac_address": "fa:16:3e:f7:ce:1c"}]}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '816', 'x-openstack-request-id': 'req-7e92407d-af43-4682-9b40-e2d171913e78', 'date': 'Tue, 08 Jun 2021 12:20:53 GMT', 'connection': 'close', 'status': '200', 'content-location': 'http://10.222.0.44:9696/v2.0/ports/6fdb0b97-838f-4f14-9c93-a6956a0571a0'}
        Body: b'{"port":{"id":"6fdb0b97-838f-4f14-9c93-a6956a0571a0","name":"tempest-AllowedAddressPairTestJSON-1620070953","network_id":"b8603a02-94a4-4fdf-84cf-28e4cd736ef7","tenant_id":"8a5bffe2e191455ab1ac2087d1820597","mac_address":"fa:16:3e:c3:f2:2f","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"e776e277-f662-4f88-9257-95067b1a1173","ip_address":"172.20.0.4"}],"allowed_address_pairs":[{"mac_address":"fa:16:3e:f7:ce:1c","ip_address":"172.20.0.0/16","active":true}],"extra_dhcp_opts":[],"security_groups":["1856b85a-cd0f-4057-85a3-5b0743a051dc"],"description":"","binding:vnic_type":"normal","port_security_enabled":true,"tags":[],"created_at":"2021-06-08T12:20:49Z","updated_at":"2021-06-08T12:20:52Z","revision_number":2,"project_id":"8a5bffe2e191455ab1ac2087d1820597"}}'
2021-06-08 12:20:56,194 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:_run_cleanups): 204 DELETE http://10.222.0.44:9696/v2.0/ports/6fdb0b97-838f-4f14-9c93-a6956a0571a0 2.264s
2021-06-08 12:20:56,195 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-length': '0', 'x-openstack-request-id': 'req-b908d7e9-4ba4-43c7-b27f-1a813d620c88', 'date': 'Tue, 08 Jun 2021 12:20:56 GMT', 'connection': 'close', 'status': '204', 'content-location': 'http://10.222.0.44:9696/v2.0/ports/6fdb0b97-838f-4f14-9c93-a6956a0571a0'}
        Body: b''
2021-06-08 12:20:56,338 107895 INFO     [tempest.lib.common.rest_client]
     Request (AllowedAddressPairTestJSON:_run_cleanups): 404 GET http://10.222.0.44:9696/v2.0/ports/6fdb0b97-838f-4f14-9c93-a6956a0571a0 0.142s
2021-06-08 12:20:56,338 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-type': 'application/json', 'content-length': '132', 'x-openstack-request-id': 'req-f710133d-2847-4e2c-995d-5cc2aad867cd', 'date': 'Tue, 08 Jun 2021 12:20:56 GMT', 'connection': 'close', 'status': '404', 'content-location': 'http://10.222.0.44:9696/v2.0/ports/6fdb0b97-838f-4f14-9c93-a6956a0571a0'}
        Body: b'{"NeutronError": {"type": "PortNotFound", "message": "Port 6fdb0b97-838f-4f14-9c93-a6956a0571a0 could not be found.", "detail": ""}}'


tempest.api.network.test_allowed_address_pair.AllowedAddressPairTestJSON.test_update_port_with_multiple_ip_mac_address_pair[id-b3f20091-6cd5-472b-8487-3516137df933]
--------------------------------------------------------------------------------------------------------------------------------------------------------------------

Captured traceback:
~~~~~~~~~~~~~~~~~~~
    Traceback (most recent call last):

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 129, in test_update_port_with_multiple_ip_mac_address_pair
    self._update_port_with_address(

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 100, in _update_port_with_address
    self.assertCountEqual(allowed_address_pair, allowed_address_pairs)

      File "/usr/lib/python3.8/unittest/case.py", line 1272, in assertCountEqual
    self.fail(msg)

      File "/opt/stack/tempest/.tox/venv/lib/python3.8/site-packages/unittest2/case.py", line 690, in fail
    raise self.failureException(msg)

    AssertionError: Element counts were not equal:
First has 1, Second has 0:  {'mac_address': 'fa:16:3e:5d:2b:12', 'ip_address': '172.20.0.10', 'active': True}
First has 1, Second has 0:  {'mac_address': 'fa:16:3e:f7:ce:1c', 'ip_address': '172.20.0.6', 'active': True}
First has 0, Second has 1:  {'ip_address': '172.20.0.6', 'mac_address': 'fa:16:3e:f7:ce:1c'}
First has 0, Second has 1:  {'ip_address': '172.20.0.10', 'mac_address': 'fa:16:3e:5d:2b:12'}


Captured pythonlogging:
~~~~~~~~~~~~~~~~~~~~~~~
    2021-06-08 12:20:59,882 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:test_update_port_with_multiple_ip_mac_address_pair): 201 POST http://10.222.0.44:9696/v2.0/ports 3.542s
2021-06-08 12:20:59,883 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"network_id": "b8603a02-94a4-4fdf-84cf-28e4cd736ef7", "name": "tempest-AllowedAddressPairTestJSON-1253289481"}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '739', 'x-openstack-request-id': 'req-ceeb32d3-c689-4b03-ac22-da0f2ca92cb3', 'date': 'Tue, 08 Jun 2021 12:20:59 GMT', 'connection': 'close', 'status': '201', 'content-location': 'http://10.222.0.44:9696/v2.0/ports'}
        Body: b'{"port":{"id":"2ef03f27-fc41-4c42-a8c3-3f317a22948a","name":"tempest-AllowedAddressPairTestJSON-1253289481","network_id":"b8603a02-94a4-4fdf-84cf-28e4cd736ef7","tenant_id":"8a5bffe2e191455ab1ac2087d1820597","mac_address":"fa:16:3e:5d:2b:12","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"e776e277-f662-4f88-9257-95067b1a1173","ip_address":"172.20.0.10"}],"project_id":"8a5bffe2e191455ab1ac2087d1820597","port_security_enabled":true,"security_groups":["1856b85a-cd0f-4057-85a3-5b0743a051dc"],"binding:vnic_type":"normal","allowed_address_pairs":[],"extra_dhcp_opts":[],"description":"","tags":[],"created_at":"2021-06-08T12:20:56Z","updated_at":"2021-06-08T12:20:57Z","revision_number":1}}'
2021-06-08 12:21:02,284 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:test_update_port_with_multiple_ip_mac_address_pair): 201 POST http://10.222.0.44:9696/v2.0/ports 2.401s
2021-06-08 12:21:02,284 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"network_id": "b8603a02-94a4-4fdf-84cf-28e4cd736ef7", "name": "tempest-AllowedAddressPairTestJSON-1354873655"}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '739', 'x-openstack-request-id': 'req-5c18e0a7-cedc-4f21-bbf6-b43bd486b573', 'date': 'Tue, 08 Jun 2021 12:21:02 GMT', 'connection': 'close', 'status': '201', 'content-location': 'http://10.222.0.44:9696/v2.0/ports'}
        Body: b'{"port":{"id":"bd75cb9b-f19e-4390-9b0a-eaa0256f8f3d","name":"tempest-AllowedAddressPairTestJSON-1354873655","network_id":"b8603a02-94a4-4fdf-84cf-28e4cd736ef7","tenant_id":"8a5bffe2e191455ab1ac2087d1820597","mac_address":"fa:16:3e:9c:60:2e","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"e776e277-f662-4f88-9257-95067b1a1173","ip_address":"172.20.0.12"}],"project_id":"8a5bffe2e191455ab1ac2087d1820597","port_security_enabled":true,"security_groups":["1856b85a-cd0f-4057-85a3-5b0743a051dc"],"binding:vnic_type":"normal","allowed_address_pairs":[],"extra_dhcp_opts":[],"description":"","tags":[],"created_at":"2021-06-08T12:21:00Z","updated_at":"2021-06-08T12:21:01Z","revision_number":1}}'
2021-06-08 12:21:03,698 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:test_update_port_with_multiple_ip_mac_address_pair): 200 PUT http://10.222.0.44:9696/v2.0/ports/bd75cb9b-f19e-4390-9b0a-eaa0256f8f3d 1.412s
2021-06-08 12:21:03,698 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"allowed_address_pairs": [{"ip_address": "172.20.0.6", "mac_address": "fa:16:3e:f7:ce:1c"}, {"ip_address": "172.20.0.10", "mac_address": "fa:16:3e:5d:2b:12"}]}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '891', 'x-openstack-request-id': 'req-8443b56b-b956-4ae9-b10c-ecbcf4e5d291', 'date': 'Tue, 08 Jun 2021 12:21:03 GMT', 'connection': 'close', 'status': '200', 'content-location': 'http://10.222.0.44:9696/v2.0/ports/bd7
    5cb9b-f19e-4390-9b0a-eaa0256f8f3d'}
        Body: b'{"port":{"id":"bd75cb9b-f19e-4390-9b0a-eaa0256f8f3d","name":"tempest-AllowedAddressPairTestJSON-1354873655","network_id":"b8603a02-94a4-4fdf-84cf-28e4cd736ef7","tenant_id":"8a5bffe2e191455ab1ac2087d1820597","mac_address":"fa:16:3e:9c:60:2e","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"e776e277-f662-4f88-9257-95067b1a1173","ip_address":"172.20.0.12"}],"allowed_address_pairs":[{"mac_address":"fa:16:3e:5d:2b:12","ip_address":"172.20.0.10","active":true},{"mac_address":"fa:16:3e:f7:ce:1c","ip_address":"172.20.0.6","active":true}],"extra_dhcp_opts":[],"security_groups":["1856b85a-cd0f-4057-85a3-5b0743a051dc"],"description":"","binding:vnic_type":"normal","port_security_enabled":true,"tags":[],"created_at":"2021-06-08T12:21:00Z","updated_at":"2021-06-08T12:21:02Z","revision_number":2,"project_id":"8a5bffe2e191455ab1ac2087d1820597"}}'
2021-06-08 12:21:04,906 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:_run_cleanups): 204 DELETE http://10.222.0.44:9696/v2.0/ports/bd75cb9b-f19e-4390-9b0a-eaa0256f8f3d 1.207s
2021-06-08 12:21:04,906 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-length': '0', 'x-openstack-request-id': 'req-15996f1d-b7b6-48ee-8a3c-e92847439dfa', 'date': 'Tue, 08 Jun 2021 12:21:04 GMT', 'connection': 'close', 'status': '204', 'content-location': 'http://10.222.0.44:9696/v2.0/ports/bd75cb9b-f19e-4390-9b0a-eaa0256f8f3d'}
        Body: b''
2021-06-08 12:21:05,170 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:_run_cleanups): 404 GET http://10.222.0.44:9696/v2.0/ports/bd75cb9b-f19e-4390-9b0a-eaa0256f8f3d 0.263s
2021-06-08 12:21:05,171 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-type': 'application/json', 'content-length': '132', 'x-openstack-request-id': 'req-6ccfdf0c-4856-4798-b7b5-4870a0460495', 'date': 'Tue, 08 Jun 2021 12:21:05 GMT', 'connection': 'close', 'status': '404', 'content-location': 'http://10.222.0.44:9696/v2.0/ports/bd75cb9b-f19e-4390-9b0a-eaa0256f8f3d'}
        Body: b'{"NeutronError": {"type": "PortNotFound", "message": "Port bd75cb9b-f19e-4390-9b0a-eaa0256f8f3d could not be found.", "detail": ""}}'
2021-06-08 12:21:08,831 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:_run_cleanups): 204 DELETE http://10.222.0.44:9696/v2.0/ports/2ef03f27-fc41-4c42-a8c3-3f317a22948a 3.660s
2021-06-08 12:21:08,832 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-length': '0', 'x-openstack-request-id': 'req-dd02f0f9-4d70-48e5-aeb0-bf9df85926a6', 'date': 'Tue, 08 Jun 2021 12:21:08 GMT', 'connection': 'close', 'status': '204', 'content-location': 'http://10.222.0.44:9696/v2.0/ports/2ef03f27-fc41-4c42-a8c3-3f317a22948a'}
        Body: b''
2021-06-08 12:21:08,979 107895 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:_run_cleanups): 404 GET http://10.222.0.44:9696/v2.0/ports/2ef03f27-fc41-4c42-a8c3-3f317a22948a 0.146s
2021-06-08 12:21:08,979 107895 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-type': 'application/json', 'content-length': '132', 'x-openstack-request-id': 'req-a13690ba-000e-4359-a5ba-c245b9bab40b', 'date': 'Tue, 08 Jun 2021 12:21:08 GMT', 'connection': 'close', 'status': '404', 'content-location': 'http://10.222.0.44:9696/v2.0/ports/2ef03f27-fc41-4c42-a8c3-3f317a22948a'}
        Body: b'{"NeutronError"
    : {"type": "PortNotFound", "message": "Port 2ef03f27-fc41-4c42-a8c3-3f317a22948a could not be found.", "detail": ""}}'



======
Totals
======
Ran: 282 tests in 1153.0541 sec.
 - Passed: 271
 - Skipped: 5
 - Expected Fail: 0
 - Unexpected Success: 0
 - Failed: 6
Sum of execute time for each test: 4033.5586 sec.

==============
Worker Balance
==============
 - Worker 0 (36 tests) => 0:07:44.716226
 - Worker 1 (21 tests) => 0:04:51.161891
 - Worker 2 (32 tests) => 0:08:02.192920
 - Worker 3 (19 tests) => 0:03:34.515413
 - Worker 4 (34 tests) => 0:17:10.854228
 - Worker 5 (55 tests) => 0:11:14.968979
 - Worker 6 (47 tests) => 0:06:11.688935
 - Worker 7 (38 tests) => 0:19:10.503812
{0} tempest.api.compute.admin.test_servers_negative.ServersAdminNegativeTestJSON.test_resize_server_using_overlimit_ram [0.363336s] ... ok
{0} tempest.api.compute.admin.test_servers_negative.ServersAdminNegativeTestJSON.test_resize_server_using_overlimit_vcpus [0.325465s] ... ok
{0} tempest.api.compute.servers.test_delete_server.DeleteServersTestJSON.test_delete_server_while_in_verify_resize_state [48.900119s] ... ok
{0} tempest.api.compute.servers.test_disk_config.ServerDiskConfigTestJSON.test_resize_server_from_auto_to_manual [49.016286s] ... ok
{0} tempest.api.compute.servers.test_disk_config.ServerDiskConfigTestJSON.test_resize_server_from_manual_to_auto [47.675648s] ... ok
{0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_confirm [25.960119s] ... ok
{0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_confirm_from_stopped [78.017637s] ... ok
{0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_revert [84.773240s] ... ok
{0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_revert_with_volume_attached [144.295697s] ... ok
{0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_nonexistent_server [0.485473s] ... ok
{0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_non_existent_flavor [0.571037s] ... ok
{0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_null_flavor [0.476412s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6Test.test_create_delete_subnet_all_attributes [1.449091s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6Test.test_create_delete_subnet_with_allocation_pools [1.456514s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6Test.test_create_delete_subnet_with_default_gw [0.982176s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6Test.test_delete_network_with_subnet [1.769359s] ... ok
{0} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_router_add_gateway_net_not_external_returns_400 [1.482151s] ... ok
{0} tempest.scenario.test_encrypted_cinder_volumes.TestEncryptedCinderVolumes.test_encrypted_cinder_volumes_cryptsetup [38.219829s] ... ok
{0} tempest.scenario.test_encrypted_cinder_volumes.TestEncryptedCinderVolumes.test_encrypted_cinder_volumes_luks [34.272385s] ... ok
{0} tempest.scenario.test_minimum_basic.TestMinimumBasicScenario.test_minimum_basic_scenario [122.709799s] ... ok
{0} tempest.scenario.test_network_advanced_server_ops.TestNetworkAdvancedServerOps.test_server_connectivity_pause_unpause [66.686172s] ... ok
{0} tempest.scenario.test_network_advanced_server_ops.TestNetworkAdvancedServerOps.test_server_connectivity_reboot [104.708411s] ... ok
{0} tempest.scenario.test_network_advanced_server_ops.TestNetworkAdvancedServerOps.test_server_connectivity_resize [109.948333s] ... ok
{0} tempest.scenario.test_network_advanced_server_ops.TestNetworkAdvancedServerOps.test_server_connectivity_stop_start [117.932433s] ... ok
{0} tempest.scenario.test_network_advanced_server_ops.TestNetworkAdvancedServerOps.test_server_connectivity_suspend_resume [69.041997s] ... ok
{0} tempest.scenario.test_shelve_instance.TestShelveInstance.test_shelve_instance [258.724146s] ... ok
{0} tempest.scenario.test_shelve_instance.TestShelveInstance.test_shelve_volume_backed_instance [262.919152s] ... ok
{0} tempest.scenario.test_snapshot_pattern.TestSnapshotPattern.test_snapshot_pattern [286.323925s] ... ok

======
Totals
======
Ran: 28 tests in 2178.6542 sec.
 - Passed: 28
 - Skipped: 0
 - Expected Fail: 0
 - Unexpected Success: 0
 - Failed: 0
Sum of execute time for each test: 1959.4863 sec.

==============
Worker Balance
==============
 - Worker 0 (28 tests) => 0:36:18.654161
tempest.api.network.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON.test_update_port_with_address_pair[id-9599b337-272c-47fd-b3cf-509414414ac4]
tempest.api.network.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON.test_update_port_with_cidr_address_pair[id-4d6d178f-34f6-4bff-a01c-0a2f8fe909e4]
tempest.api.network.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON.test_update_port_with_multiple_ip_mac_address_pair[id-b3f20091-6cd5-472b-8487-3516137df933]
tempest.api.network.test_allowed_address_pair.AllowedAddressPairTestJSON.test_update_port_with_address_pair[id-9599b337-272c-47fd-b3cf-509414414ac4]
tempest.api.network.test_allowed_address_pair.AllowedAddressPairTestJSON.test_update_port_with_cidr_address_pair[id-4d6d178f-34f6-4bff-a01c-0a2f8fe909e4]
tempest.api.network.test_allowed_address_pair.AllowedAddressPairTestJSON.test_update_port_with_multiple_ip_mac_address_pair[id-b3f20091-6cd5-472b-8487-3516137df933]
~
Exit code: 1