/opt/stack/tempest ~
Initializing stestr
all-plugin create: /opt/stack/tempest/.tox/all-plugin
all-plugin installdeps: -chttps://releases.openstack.org/constraints/upper/master, -r/opt/stack/tempest/requirements.txt
all-plugin develop-inst: /opt/stack/tempest
all-plugin installed: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead,  from cryptography.utils import int_from_bytes,/usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead,  from cryptography.utils import int_from_bytes,alembic==1.6.5,amqp==5.0.6,aniso8601==9.0.1,appdirs==1.4.4,attrs==21.2.0,Automat==0.8.0,automaton==2.3.0,Babel==2.9.1,bcrypt==3.2.0,beautifulsoup4==4.9.3,blinker==1.4,boto3==1.17.90,botocore==1.20.90,cachetools==4.2.2,castellan==3.8.0,certifi==2021.5.30,cffi==1.14.5,chardet==4.0.0,-e git+https://opendev.org/openstack/cinder@d5f0e51879c03654db4bf89564695e01af593350#egg=cinder,click==8.0.1,cliff==3.8.0,cmd2==2.0.1,colorama==0.4.4,command-not-found==0.3,configobj==5.0.6,configshell-fb==1.1.25,constantly==15.1.0,cryptography==3.4.7,cursive==0.2.2,dbus-python==1.2.16,debtcollector==2.2.0,decorator==4.4.2,defusedxml==0.7.1,distlib==0.3.2,distro==1.4.0,distro-info===0.23ubuntu1,dnspython==1.16.0,dogpile.cache==1.1.3,elementpath==2.2.2,entrypoints==0.3,etcd3==0.12.0,etcd3gw==0.2.5,eventlet==0.30.2,extras==1.0.0,fasteners==0.14.1,filelock==3.0.12,fixtures==3.0.0,Flask==2.0.1,Flask-RESTful==0.3.9,future==0.18.2,futurist==2.3.0,-e git+https://opendev.org/openstack/glance@4f20e5007f3cef4b2406051744356ee56c1d3c25#egg=glance,glance-store==2.5.0,google-api-core==1.30.0,google-api-python-client==2.8.0,google-auth==1.30.2,google-auth-httplib2==0.1.0,googleapis-common-protos==1.53.0,greenlet==1.1.0,grpcio==1.38.0,httplib2==0.19.1,hyperlink==19.0.0,idna==2.10,importlib-metadata==1.5.0,importlib-resources==5.1.4,incremental==16.10.1,iso8601==0.1.14,itsdangerous==2.0.1,Jinja2==3.0.1,jmespath==0.10.0,jsonpatch==1.32,jsonpointer==2.1,jsonschema==3.2.0,keyring==18.0.1,-e git+https://opendev.org/openstack/keystone@252733dce7ae7d335b982d36e96b64e7a29d4ef2#egg=keystone,keystoneauth1==4.3.1,keystonemiddleware==9.3.0,kombu==5.1.0,language-selector==0.1,lazr.uri==1.0.3,linecache2==1.0.0,logutils==0.3.5,lxml==4.6.3,Mako==1.1.4,MarkupSafe==2.0.1,microversion-parse==1.0.1,monotonic==1.6,more-itertools==4.2.0,msgpack==1.0.2,munch==2.5.0,mysqlclient==1.4.4,netaddr==0.8.0,netifaces==0.11.0,-e git+https://opendev.org/openstack/networking-hyperv@a913cc69ace39c8e738ae823ae3bad1bcaa2da73#egg=networking_hyperv,networkx==2.5.1,-e git+http://10.106.1.39/p/openstack/neutron@e27785d20831bc40ba255c7af921d0d39d40f475#egg=neutron,neutron-lib==2.11.0,-e git+https://opendev.org/openstack/nova@d64edd3da2336a5c7c8f69cced45272cbaf638a9#egg=nova,numpy==1.20.3,oauth2client==4.1.3,oauthlib==3.1.1,-e git+https://opendev.org/openstack/placement.git@7e0f288dd4dab3e06f892f34839ba90600e5d360#egg=openstack_placement,openstacksdk==0.57.0,os-brick==4.4.0,os-client-config==2.1.0,os-ken==2.0.0,os-resource-classes==1.0.0,os-service-types==1.7.0,os-testr==2.0.0,os-traits==2.5.0,os-vif==2.5.0,os-win==5.4.0,os-xenapi==0.3.4,osc-lib==2.4.0,osc-placement==3.0.0,oslo.cache==2.8.0,oslo.concurrency==4.4.0,oslo.config==8.7.0,oslo.context==3.3.0,oslo.db==9.0.0,oslo.i18n==5.0.1,oslo.log==4.5.0,oslo.messaging==12.8.0,oslo.middleware==4.2.0,oslo.policy==3.8.0,oslo.privsep==2.5.0,oslo.reports==2.2.0,oslo.rootwrap==6.2.0,oslo.serialization==4.1.0,oslo.service==2.5.0,oslo.upgradecheck==1.4.0,oslo.utils==4.9.0,oslo.versionedobjects==2.4.0,oslo.vmware==3.9.0,osprofiler==3.4.1,ovs==2.13.3,ovsdbapp==1.10.0,packaging==20.9,paramiko==2.7.2,passlib==1.7.4,Paste==3.5.0,PasteDeploy==2.1.1,pbr==5.6.0,pcp==5.0,pecan==1.3.3,pexpect==4.6.0,pluggy==0.13.1,prettytable==0.7.2,protobuf==3.17.3,psutil==5.8.0,py==1.10.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycadf==3.1.1,pycparser==2.20,pydot==1.4.2,pyeclib==1.6.0,Pygments==2.3.1,PyGObject==3.36.0,PyHamcrest==1.9.0,pyinotify==0.9.6,PyJWT==2.1.0,pymacaroons==0.13.0,PyMySQL==1.0.2,PyNaCl==1.4.0,pyOpenSSL==20.0.1,pyparsing==2.4.7,pyperclip==1.8.2,pypowervm==1.1.26,pyroute2==0.6.4,pyroute2.core==0.6.4,pyroute2.ethtool==0.6.4,pyroute2.ipdb==0.6.4,pyroute2.ipset==0.6.4,pyroute2.ndb==0.6.4,pyroute2.nftables==0.6.4,pyroute2.nslink==0.6.4,pyrsistent==0.15.5,pysaml2==7.0.1,pyserial==3.4,python-apt==2.0.0+ubuntu0.20.4.4,python-barbicanclient==5.1.0,python-cinderclient==7.4.0,python-dateutil==2.8.1,python-debian===0.1.36ubuntu1,python-designateclient==4.3.0,python-editor==1.0.4,python-glanceclient==3.3.0,python-keystoneclient==4.2.0,python-memcached==1.59,python-mimeparse==1.6.0,python-neutronclient==7.5.0,python-novaclient==17.5.0,python-openstackclient==5.5.0,python-subunit==1.4.0,python-swiftclient==3.12.0,pytz==2021.1,pyudev==0.22.0,PyYAML==5.4.1,repoze.lru==0.7,requests==2.25.1,requests-unixsocket==0.2.0,requestsexceptions==1.4.0,retrying==1.3.3,rfc3986==1.5.0,Routes==2.5.1,rsa==4.7.2,rtslib-fb==2.1.74,s3transfer==0.4.2,scrypt==0.8.18,SecretStorage==2.3.1,setproctitle==1.2.2,simplegeneric==0.8.1,simplejson==3.17.2,six==1.16.0,sortedcontainers==2.1.0,sos==4.1,soupsieve==2.2.1,SQLAlchemy==1.4.15,sqlalchemy-migrate==0.13.0,sqlparse==0.4.1,ssh-import-id==5.10,statsd==3.3.0,stestr==3.2.0,stevedore==3.3.0,suds-jurko==0.6,-e git+https://opendev.org/openstack/swift@1a5b42da9e43f4fef16ceba9eb19aec9344d7132#egg=swift,systemd-python==234,tabulate==0.8.9,targetcli-fb==2.1.51,taskflow==4.6.0,-e git+https://opendev.org/openstack/tempest@aafb5900e7450316e44541655e0ecd5575a69d73#egg=tempest,Tempita==0.5.2,tenacity==6.3.1,testresources==2.0.1,testscenarios==0.5.0,testtools==2.4.0,toml==0.10.2,tooz==2.9.0,tox==3.23.1,traceback2==1.4.0,ufw==0.36,unattended-upgrades==0.1,unittest2==1.1.0,uritemplate==3.0.1,urllib3==1.26.5,urwid==2.0.1,vine==5.0.0,virtualenv==20.4.7,voluptuous==0.12.1,wadllib==1.3.3,waitress==2.0.0,warlock==1.3.3,wcwidth==0.2.5,WebOb==1.8.7,websockify==0.9.0,WebTest==2.0.35,Werkzeug==2.0.1,wrapt==1.12.1,WSME==0.10.1,xattr==0.9.7,xmlschema==1.6.3,yappi==1.3.2,zipp==3.4.1,zope.interface==4.7.1,zstd==1.5.0.2,zVMCloudConnector==1.4.1
___________________________________ summary ____________________________________
  all-plugin: skipped tests
  congratulations :)
{0} tempest.api.network.admin.test_metering_extensions.MeteringIpV6TestJSON.test_create_delete_metering_label_rule_with_filters [0.395801s] ... ok
{0} tempest.api.network.admin.test_metering_extensions.MeteringIpV6TestJSON.test_create_delete_metering_label_with_filters [1.022065s] ... ok
{0} tempest.api.network.admin.test_metering_extensions.MeteringIpV6TestJSON.test_list_metering_label_rules [0.014424s] ... ok
{0} tempest.api.network.admin.test_metering_extensions.MeteringIpV6TestJSON.test_list_metering_labels [0.016461s] ... ok
{0} tempest.api.network.admin.test_metering_extensions.MeteringIpV6TestJSON.test_show_metering_label [0.114499s] ... ok
{0} tempest.api.network.admin.test_metering_extensions.MeteringIpV6TestJSON.test_show_metering_label_rule [0.016518s] ... ok
{4} tempest.api.network.admin.test_external_network_extension.ExternalNetworksTestJSON.test_create_external_network [3.044852s] ... ok
{3} tempest.api.network.admin.test_ports.PortsAdminExtendedAttrsIpV6TestJSON.test_create_port_binding_ext_attr [7.476619s] ... ok
{0} tempest.api.network.admin.test_metering_extensions.MeteringTestJSON.test_create_delete_metering_label_rule_with_filters [1.800238s] ... ok
{5} tempest.api.network.test_allowed_address_pair.AllowedAddressPairTestJSON.test_create_list_port_with_address_pair [7.504664s] ... ok
{0} tempest.api.network.admin.test_metering_extensions.MeteringTestJSON.test_create_delete_metering_label_with_filters [1.953454s] ... ok
{0} tempest.api.network.admin.test_metering_extensions.MeteringTestJSON.test_list_metering_label_rules [0.096224s] ... ok
{0} tempest.api.network.admin.test_metering_extensions.MeteringTestJSON.test_list_metering_labels [0.178685s] ... ok
{0} tempest.api.network.admin.test_metering_extensions.MeteringTestJSON.test_show_metering_label [0.203571s] ... ok
{0} tempest.api.network.admin.test_metering_extensions.MeteringTestJSON.test_show_metering_label_rule [0.135707s] ... ok
{3} tempest.api.network.admin.test_ports.PortsAdminExtendedAttrsIpV6TestJSON.test_list_ports_binding_ext_attr [13.533756s] ... ok
{5} tempest.api.network.test_allowed_address_pair.AllowedAddressPairTestJSON.test_update_port_with_address_pair [8.589725s] ... FAILED

Captured traceback:
~~~~~~~~~~~~~~~~~~~
    Traceback (most recent call last):

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 105, in test_update_port_with_address_pair
    self._update_port_with_address(self.ip_address)

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 100, in _update_port_with_address
    self.assertCountEqual(allowed_address_pair, allowed_address_pairs)

      File "/usr/lib/python3.8/unittest/case.py", line 1272, in assertCountEqual
    self.fail(msg)

      File "/opt/stack/tempest/.tox/venv/lib/python3.8/site-packages/unittest2/case.py", line 690, in fail
    raise self.failureException(msg)

    AssertionError: Element counts were not equal:
First has 1, Second has 0:  {'mac_address': 'fa:16:3e:fa:12:e7', 'ip_address': '172.20.0.5', 'active': True}
First has 0, Second has 1:  {'ip_address': '172.20.0.5', 'mac_address': 'fa:16:3e:fa:12:e7'}


Captured pythonlogging:
~~~~~~~~~~~~~~~~~~~~~~~
    2021-06-10 16:17:20,111 107847 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:test_update_port_with_address_pair): 201 POST http://10.222.0.23:9696/v2.0/ports 3.821s
2021-06-10 16:17:20,112 107847 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"network_id": "7d34dfe2-85c4-4cf2-8f3f-a68ac0006b21", "name": "tempest-AllowedAddressPairTestJSON-45217565"}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '737', 'x-openstack-request-id': 'req-0db5f0c4-9700-48e5-8418-ba6ebbf6ba74', 'date': 'Thu, 10 Jun 2021 16:17:20 GMT', 'connection': 'close', 'status': '201', 'content-location': 'http://10.222.0.23:9696/v2.0/ports'}
        Body: b'{"port":{"id":"a76bc757-7d9d-4f32-af01-5b86f403c8f6","name":"tempest-AllowedAddressPairTestJSON-45217565","network_id":"7d34dfe2-85c4-4cf2-8f3f-a68ac0006b21","tenant_id":"ac0f2d19bc534865b0c65be3bebb9a74","mac_address":"fa:16:3e:04:af:ad","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"cbfb220e-74af-4332-9c2a-8c895635d878","ip_address":"172.20.0.10"}],"project_id":"ac0f2d19bc534865b0c65be3bebb9a74","port_security_enabled":true,"security_groups":["20267a1e-7654-4788-9652-9cbb8f865e8f"],"binding:vnic_type":"normal","allowed_address_pairs":[],"extra_dhcp_opts":[],"description":"","tags":[],"created_at":"2021-06-10T16:17:17Z","updated_at":"2021-06-10T16:17:18Z","revision_number":1}}'
2021-06-10 16:17:21,854 107847 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:test_update_port_with_address_pair): 200 PUT http://10.222.0.23:9696/v2.0/ports/a76bc757-7d9d-4f32-af01-5b86f403c8f6 1.741s
2021-06-10 16:17:21,854 107847 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"allowed_address_pairs": [{"ip_address": "172.20.0.5", "mac_address": "fa:16:3e:fa:12:e7"}]}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '812', 'x-openstack-request-id': 'req-ca976f24-9e2a-4e8c-81f7-f274f88502f1', 'date': 'Thu, 10 Jun 2021 16:17:21 GMT', 'connection': 'close', 'status': '200', 'content-location': 'http://10.222.0.23:9696/v2.0/ports/a76bc757-7d9d-4f32-af01-5b86f403c8f6'}
        Body: b'{"port":{"id":"a76bc757-7d9d-4f32-af01-5b86f403c8f6","name":"tempest-AllowedAddressPairTestJSON-45217565","network_id":"7d34dfe2-85c4-4cf2-8f3f-a68ac0006b21","tenant_id":"ac0f2d19bc534865b0c65be3bebb9a74","mac_address":"fa:16:3e:04:af:ad","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"cbfb220e-74af-4332-9c2a-8c895635d878","ip_address":"172.20.0.10"}],"allowed_address_pairs":[{"mac_address":"fa:16:3e:fa:12:e7","ip_address":"172.20.0.5","active":true}],"extra_dhcp_opts":[],"security_groups":["20267a1e-7654-4788-9652-9cbb8f865e8f"],"description":"","binding:vnic_type":"normal","port_security_enabled":true,"tags":[],"created_at":"2021-06-10T16:17:17Z","updated_at":"2021-06-10T16:17:21Z","revision_number":2,"project_id":"ac0f2d19bc534865b0c65be3bebb9a74"}}'
2021-06-10 16:17:24,442 107847 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:_run_cleanups): 204 DELETE http://10.222.0.23:9696/v2.0/ports/a76bc757-7d9d-4f32-af01-5b86f403c8f6 2.574s
2021-06-10 16:17:24,442 107847 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-length': '0', 'x-openstack-request-id': 'req-7f10a4a6-35b4-4070-9f8d-eff67d014da9', 'date': 'Thu, 10 Jun 2021 16:17:24 GMT', 'connection': 'close', 'status': '204', 'content-location': 'http://10.222.0.23:9696/v2.0/ports/a76bc757-7d9d-4f32-af01-5b86f403c8f6'}
        Body: b''
2021-06-10 16:17:24,878 107847 INFO     [tempest.lib.common.rest_client] Request (AllowedAdd
    ressPairTestJSON:_run_cleanups): 404 GET http://10.222.0.23:9696/v2.0/ports/a76bc757-7d9d-4f32-af01-5b86f403c8f6 0.435s
2021-06-10 16:17:24,878 107847 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-type': 'application/json', 'content-length': '132', 'x-openstack-request-id': 'req-7ef1b45b-c33e-46ae-a8f8-96639f47b8fc', 'date': 'Thu, 10 Jun 2021 16:17:24 GMT', 'connection': 'close', 'status': '404', 'content-location': 'http://10.222.0.23:9696/v2.0/ports/a76bc757-7d9d-4f32-af01-5b86f403c8f6'}
        Body: b'{"NeutronError": {"type": "PortNotFound", "message": "Port a76bc757-7d9d-4f32-af01-5b86f403c8f6 could not be found.", "detail": ""}}'

{4} tempest.api.network.admin.test_external_network_extension.ExternalNetworksTestJSON.test_delete_external_networks_with_floating_ip [20.246109s] ... ok
{2} tempest.api.network.admin.test_routers.RoutersIpV6AdminTest.test_create_router_set_gateway_with_fixed_ip [30.336181s] ... ok
{3} tempest.api.network.admin.test_ports.PortsAdminExtendedAttrsIpV6TestJSON.test_show_port_binding_ext_attr [3.590787s] ... ok
{2} tempest.api.network.admin.test_routers.RoutersIpV6AdminTest.test_create_router_setting_project_id [1.901170s] ... ok
{4} tempest.api.network.admin.test_external_network_extension.ExternalNetworksTestJSON.test_list_external_networks [2.510418s] ... ok
{4} tempest.api.network.admin.test_external_network_extension.ExternalNetworksTestJSON.test_show_external_networks_attribute [5.067543s] ... ok
{5} tempest.api.network.test_allowed_address_pair.AllowedAddressPairTestJSON.test_update_port_with_cidr_address_pair [11.251651s] ... FAILED

Captured traceback:
~~~~~~~~~~~~~~~~~~~
    Traceback (most recent call last):

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 110, in test_update_port_with_cidr_address_pair
    self._update_port_with_address(str(self.cidr))

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 100, in _update_port_with_address
    self.assertCountEqual(allowed_address_pair, allowed_address_pairs)

      File "/usr/lib/python3.8/unittest/case.py", line 1272, in assertCountEqual
    self.fail(msg)

      File "/opt/stack/tempest/.tox/venv/lib/python3.8/site-packages/unittest2/case.py", line 690, in fail
    raise self.failureException(msg)

    AssertionError: Element counts were not equal:
First has 1, Second has 0:  {'mac_address': 'fa:16:3e:fa:12:e7', 'ip_address': '172.20.0.0/16', 'active': True}
First has 0, Second has 1:  {'ip_address': '172.20.0.0/16', 'mac_address': 'fa:16:3e:fa:12:e7'}


Captured pythonlogging:
~~~~~~~~~~~~~~~~~~~~~~~
    2021-06-10 16:17:28,877 107847 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:test_update_port_with_cidr_address_pair): 201 POST http://10.222.0.23:9696/v2.0/ports 3.997s
2021-06-10 16:17:28,878 107847 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"network_id": "7d34dfe2-85c4-4cf2-8f3f-a68ac0006b21", "name": "tempest-AllowedAddressPairTestJSON-735834357"}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '737', 'x-openstack-request-id': 'req-0bbbc856-7939-49ae-9b54-26650531f28c', 'date': 'Thu, 10 Jun 2021 16:17:28 GMT', 'connection': 'close', 'status': '201', 'content-location': 'http://10.222.0.23:9696/v2.0/ports'}
        Body: b'{"port":{"id":"b25886b7-4e4a-4004-979e-9da4d7864893","name":"tempest-AllowedAddressPairTestJSON-735834357","network_id":"7d34dfe2-85c4-4cf2-8f3f-a68ac0006b21","tenant_id":"ac0f2d19bc534865b0c65be3bebb9a74","mac_address":"fa:16:3e:0f:62:42","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"cbfb220e-74af-4332-9c2a-8c895635d878","ip_address":"172.20.0.4"}],"project_id":"ac0f2d19bc534865b0c65be3bebb9a74","port_security_enabled":true,"security_groups":["20267a1e-7654-4788-9652-9cbb8f865e8f"],"binding:vnic_type":"normal","allowed_address_pairs":[],"extra_dhcp_opts":[],"description":"","tags":[],"created_at":"2021-06-10T16:17:25Z","updated_at":"2021-06-10T16:17:26Z","revision_number":1}}'
2021-06-10 16:17:32,155 107847 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:test_update_port_with_cidr_address_pair): 200 PUT http://10.222.0.23:9696/v2.0/ports/b25886b7-4e4a-4004-979e-9da4d7864893 3.277s
2021-06-10 16:17:32,155 107847 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"allowed_address_pairs": [{"ip_address": "172.20.0.0/16", "mac_address": "fa:16:3e:fa:12:e7"}]}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '815', 'x-openstack-request-id': 'req-41d565fd-8070-4b5a-985d-0b87979ac3a1', 'date': 'Thu, 10 Jun 2021 16:17:32 GMT', 'connection': 'close', 'status': '200', 'content-location': 'http://10.222.0.23:9696/v2.0/ports/b25886b7-4e4a-4004-979e-9da4d7864893'}
        Body: b'{"port":{"id":"b25886b7-4e4a-4004-979e-9da4d7864893","name":"tempest-AllowedAddressPairTestJSON-735834357","network_id":"7d34dfe2-85c4-4cf2-8f3f-a68ac0006b21","tenant_id":"ac0f2d19bc534865b0c65be3bebb9a74","mac_address":"fa:16:3e:0f:62:42","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"cbfb220e-74af-4332-9c2a-8c895635d878","ip_address":"172.20.0.4"}],"allowed_address_pairs":[{"mac_address":"fa:16:3e:fa:12:e7","ip_address":"172.20.0.0/16","active":true}],"extra_dhcp_opts":[],"security_groups":["20267a1e-7654-4788-9652-9cbb8f865e8f"],"description":"","binding:vnic_type":"normal","port_security_enabled":true,"tags":[],"created_at":"2021-06-10T16:17:25Z","updated_at":"2021-06-10T16:17:30Z","revision_number":2,"project_id":"ac0f2d19bc534865b0c65be3bebb9a74"}}'
2021-06-10 16:17:35,923 107847 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:_run_cleanups): 204 DELETE http://10.222.0.23:9696/v2.0/ports/b25886b7-4e4a-4004-979e-9da4d7864893 3.767s
2021-06-10 16:17:35,923 107847 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-length': '0', 'x-openstack-request-id': 'req-4d155ba5-1000-4dfe-9ede-25875cd316fc', 'date': 'Thu, 10 Jun 2021 16:17:35 GMT', 'connection': 'close', 'status': '204', 'content-location': 'http://10.222.0.23:9696/v2.0/ports/b25886b7-4e4a-4004-979e-9da4d7864893'}
        Body: b''
2021-06-10 16:17:36,130 107847 INFO     [tempest.lib.common.rest_client] Re
    quest (AllowedAddressPairTestJSON:_run_cleanups): 404 GET http://10.222.0.23:9696/v2.0/ports/b25886b7-4e4a-4004-979e-9da4d7864893 0.206s
2021-06-10 16:17:36,131 107847 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-type': 'application/json', 'content-length': '132', 'x-openstack-request-id': 'req-8477b4b2-36c2-453e-8a97-7fe3c3389933', 'date': 'Thu, 10 Jun 2021 16:17:36 GMT', 'connection': 'close', 'status': '404', 'content-location': 'http://10.222.0.23:9696/v2.0/ports/b25886b7-4e4a-4004-979e-9da4d7864893'}
        Body: b'{"NeutronError": {"type": "PortNotFound", "message": "Port b25886b7-4e4a-4004-979e-9da4d7864893 could not be found.", "detail": ""}}'

{3} tempest.api.network.admin.test_ports.PortsAdminExtendedAttrsIpV6TestJSON.test_update_port_binding_ext_attr [12.054599s] ... ok
{4} tempest.api.network.admin.test_external_network_extension.ExternalNetworksTestJSON.test_update_external_network [6.884103s] ... ok
{2} tempest.api.network.admin.test_routers.RoutersIpV6AdminTest.test_create_router_with_default_snat_value [14.148605s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6Test.test_create_delete_subnet_with_dhcp_enabled [17.965650s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6Test.test_create_delete_subnet_with_gw [4.040606s] ... ok
{5} tempest.api.network.test_allowed_address_pair.AllowedAddressPairTestJSON.test_update_port_with_multiple_ip_mac_address_pair [20.786379s] ... FAILED

Captured traceback:
~~~~~~~~~~~~~~~~~~~
    Traceback (most recent call last):

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 129, in test_update_port_with_multiple_ip_mac_address_pair
    self._update_port_with_address(

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 100, in _update_port_with_address
    self.assertCountEqual(allowed_address_pair, allowed_address_pairs)

      File "/usr/lib/python3.8/unittest/case.py", line 1272, in assertCountEqual
    self.fail(msg)

      File "/opt/stack/tempest/.tox/venv/lib/python3.8/site-packages/unittest2/case.py", line 690, in fail
    raise self.failureException(msg)

    AssertionError: Element counts were not equal:
First has 1, Second has 0:  {'mac_address': 'fa:16:3e:b9:23:13', 'ip_address': '172.20.0.14', 'active': True}
First has 1, Second has 0:  {'mac_address': 'fa:16:3e:fa:12:e7', 'ip_address': '172.20.0.5', 'active': True}
First has 0, Second has 1:  {'ip_address': '172.20.0.5', 'mac_address': 'fa:16:3e:fa:12:e7'}
First has 0, Second has 1:  {'ip_address': '172.20.0.14', 'mac_address': 'fa:16:3e:b9:23:13'}


Captured pythonlogging:
~~~~~~~~~~~~~~~~~~~~~~~
    2021-06-10 16:17:43,419 107847 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:test_update_port_with_multiple_ip_mac_address_pair): 201 POST http://10.222.0.23:9696/v2.0/ports 7.286s
2021-06-10 16:17:43,419 107847 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"network_id": "7d34dfe2-85c4-4cf2-8f3f-a68ac0006b21", "name": "tempest-AllowedAddressPairTestJSON-2065946621"}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '739', 'x-openstack-request-id': 'req-a2eb175f-9aa4-48c2-b5bf-de368aebcafa', 'date': 'Thu, 10 Jun 2021 16:17:43 GMT', 'connection': 'close', 'status': '201', 'content-location': 'http://10.222.0.23:9696/v2.0/ports'}
        Body: b'{"port":{"id":"e1d2dd3f-8677-43cc-b845-0b713b0ad83e","name":"tempest-AllowedAddressPairTestJSON-2065946621","network_id":"7d34dfe2-85c4-4cf2-8f3f-a68ac0006b21","tenant_id":"ac0f2d19bc534865b0c65be3bebb9a74","mac_address":"fa:16:3e:b9:23:13","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"cbfb220e-74af-4332-9c2a-8c895635d878","ip_address":"172.20.0.14"}],"project_id":"ac0f2d19bc534865b0c65be3bebb9a74","port_security_enabled":true,"security_groups":["20267a1e-7654-4788-9652-9cbb8f865e8f"],"binding:vnic_type":"normal","allowed_address_pairs":[],"extra_dhcp_opts":[],"description":"","tags":[],"created_at":"2021-06-10T16:17:37Z","updated_at":"2021-06-10T16:17:39Z","revision_number":1}}'
2021-06-10 16:17:49,680 107847 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:test_update_port_with_multiple_ip_mac_address_pair): 201 POST http://10.222.0.23:9696/v2.0/ports 6.260s
2021-06-10 16:17:49,680 107847 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"network_id": "7d34dfe2-85c4-4cf2-8f3f-a68ac0006b21", "name": "tempest-AllowedAddressPairTestJSON-1524610772"}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '739', 'x-openstack-request-id': 'req-cc66a95c-8126-450a-9985-d213fa18d96b', 'date': 'Thu, 10 Jun 2021 16:17:49 GMT', 'connection': 'close', 'status': '201', 'content-location': 'http://10.222.0.23:9696/v2.0/ports'}
        Body: b'{"port":{"id":"5bb74d1d-9981-4f77-a087-499d82b3b60c","name":"tempest-AllowedAddressPairTestJSON-1524610772","network_id":"7d34dfe2-85c4-4cf2-8f3f-a68ac0006b21","tenant_id":"ac0f2d19bc534865b0c65be3bebb9a74","mac_address":"fa:16:3e:88:92:6b","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"cbfb220e-74af-4332-9c2a-8c895635d878","ip_address":"172.20.0.13"}],"project_id":"ac0f2d19bc534865b0c65be3bebb9a74","port_security_enabled":true,"security_groups":["20267a1e-7654-4788-9652-9cbb8f865e8f"],"binding:vnic_type":"normal","allowed_address_pairs":[],"extra_dhcp_opts":[],"description":"","tags":[],"created_at":"2021-06-10T16:17:45Z","updated_at":"2021-06-10T16:17:45Z","revision_number":1}}'
2021-06-10 16:17:52,433 107847 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:test_update_port_with_multiple_ip_mac_address_pair): 200 PUT http://10.222.0.23:9696/v2.0/ports/5bb74d1d-9981-4f77-a087-499d82b3b60c 2.752s
2021-06-10 16:17:52,433 107847 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"allowed_address_pairs": [{"ip_address": "172.20.0.5", "mac_address": "fa:16:3e:fa:12:e7"}, {"ip_address": "172.20.0.14", "mac_address": "fa:16:3e:b9:23:13"}]}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '891', 'x-openstack-request-id': 'req-90eada8f-92f5-4773-8e03-5890308179f8', 'date': 'Thu, 10 Jun 2021 16:17:52 GMT', 'connection': 'close', 'status': '200', 'content-location': 'http://10.222.0.23:9696/v2.0/ports/5bb
    74d1d-9981-4f77-a087-499d82b3b60c'}
        Body: b'{"port":{"id":"5bb74d1d-9981-4f77-a087-499d82b3b60c","name":"tempest-AllowedAddressPairTestJSON-1524610772","network_id":"7d34dfe2-85c4-4cf2-8f3f-a68ac0006b21","tenant_id":"ac0f2d19bc534865b0c65be3bebb9a74","mac_address":"fa:16:3e:88:92:6b","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"cbfb220e-74af-4332-9c2a-8c895635d878","ip_address":"172.20.0.13"}],"allowed_address_pairs":[{"mac_address":"fa:16:3e:b9:23:13","ip_address":"172.20.0.14","active":true},{"mac_address":"fa:16:3e:fa:12:e7","ip_address":"172.20.0.5","active":true}],"extra_dhcp_opts":[],"security_groups":["20267a1e-7654-4788-9652-9cbb8f865e8f"],"description":"","binding:vnic_type":"normal","port_security_enabled":true,"tags":[],"created_at":"2021-06-10T16:17:45Z","updated_at":"2021-06-10T16:17:51Z","revision_number":2,"project_id":"ac0f2d19bc534865b0c65be3bebb9a74"}}'
2021-06-10 16:17:54,844 107847 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:_run_cleanups): 204 DELETE http://10.222.0.23:9696/v2.0/ports/5bb74d1d-9981-4f77-a087-499d82b3b60c 2.410s
2021-06-10 16:17:54,844 107847 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-length': '0', 'x-openstack-request-id': 'req-30f68030-7876-415c-9f87-5eff7412876f', 'date': 'Thu, 10 Jun 2021 16:17:54 GMT', 'connection': 'close', 'status': '204', 'content-location': 'http://10.222.0.23:9696/v2.0/ports/5bb74d1d-9981-4f77-a087-499d82b3b60c'}
        Body: b''
2021-06-10 16:17:54,966 107847 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:_run_cleanups): 404 GET http://10.222.0.23:9696/v2.0/ports/5bb74d1d-9981-4f77-a087-499d82b3b60c 0.121s
2021-06-10 16:17:54,967 107847 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-type': 'application/json', 'content-length': '132', 'x-openstack-request-id': 'req-5adf0863-98e7-412a-a615-518ee2b080ba', 'date': 'Thu, 10 Jun 2021 16:17:54 GMT', 'connection': 'close', 'status': '404', 'content-location': 'http://10.222.0.23:9696/v2.0/ports/5bb74d1d-9981-4f77-a087-499d82b3b60c'}
        Body: b'{"NeutronError": {"type": "PortNotFound", "message": "Port 5bb74d1d-9981-4f77-a087-499d82b3b60c could not be found.", "detail": ""}}'
2021-06-10 16:17:56,858 107847 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:_run_cleanups): 204 DELETE http://10.222.0.23:9696/v2.0/ports/e1d2dd3f-8677-43cc-b845-0b713b0ad83e 1.891s
2021-06-10 16:17:56,859 107847 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-length': '0', 'x-openstack-request-id': 'req-5700a751-dae1-480d-947e-0349d9b3ad26', 'date': 'Thu, 10 Jun 2021 16:17:56 GMT', 'connection': 'close', 'status': '204', 'content-location': 'http://10.222.0.23:9696/v2.0/ports/e1d2dd3f-8677-43cc-b845-0b713b0ad83e'}
        Body: b''
2021-06-10 16:17:56,918 107847 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:_run_cleanups): 404 GET http://10.222.0.23:9696/v2.0/ports/e1d2dd3f-8677-43cc-b845-0b713b0ad83e 0.059s
2021-06-10 16:17:56,918 107847 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-type': 'application/json', 'content-length': '132', 'x-openstack-request-id': 'req-98f9085e-fa8d-4b02-becd-9a34dc2d7c8a', 'date': 'Thu, 10 Jun 2021 16:17:56 GMT', 'connection': 'close', 'status': '404', 'content-location': 'http://10.222.0.23:9696/v2.0/ports/e1d2dd3f-8677-43cc-b845-0b713b0ad83e'}
        Body: b'{"NeutronError"
    : {"type": "PortNotFound", "message": "Port e1d2dd3f-8677-43cc-b845-0b713b0ad83e could not be found.", "detail": ""}}'

{4} tempest.api.network.admin.test_external_networks_negative.ExternalNetworksAdminNegativeTestJSON.test_create_port_with_precreated_floatingip_as_fixed_ip [11.050455s] ... ok
{2} tempest.api.network.admin.test_routers.RoutersIpV6AdminTest.test_create_router_with_snat_explicit [21.264765s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6Test.test_create_delete_subnet_with_gw_and_allocation_pools [10.505391s] ... ok
{3} tempest.api.network.admin.test_routers.RoutersAdminTest.test_create_router_set_gateway_with_fixed_ip [20.385460s] ... ok
{4} tempest.api.network.admin.test_routers_dvr.RoutersTestDVR.test_centralized_router_creation [1.931756s] ... ok
{3} tempest.api.network.admin.test_routers.RoutersAdminTest.test_create_router_setting_project_id [2.661225s] ... ok
{4} tempest.api.network.admin.test_routers_dvr.RoutersTestDVR.test_centralized_router_update_to_dvr [5.661205s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6Test.test_create_delete_subnet_with_host_routes_and_dns_nameservers [10.539714s] ... ok
{4} tempest.api.network.admin.test_routers_dvr.RoutersTestDVR.test_distributed_router_creation [1.171374s] ... ok
{2} tempest.api.network.admin.test_routers.RoutersIpV6AdminTest.test_update_router_reset_gateway_without_snat [16.788884s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6Test.test_create_delete_subnet_without_gateway [4.292811s] ... ok
{5} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_bulk_port [9.836062s] ... ok
{3} tempest.api.network.admin.test_routers.RoutersAdminTest.test_create_router_with_default_snat_value [10.106962s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6Test.test_create_list_subnet_with_no_gw64_one_network [6.143358s] ... ok
{2} tempest.api.network.admin.test_routers.RoutersIpV6AdminTest.test_update_router_set_gateway [9.500614s] ... ok
{4} tempest.api.network.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON.test_create_list_port_with_address_pair [4.821097s] ... ok
{5} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools [12.890882s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6Test.test_create_update_delete_network_subnet [8.754919s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6Test.test_create_update_network_description [2.563040s] ... ok
{2} tempest.api.network.admin.test_routers.RoutersIpV6AdminTest.test_update_router_set_gateway_with_snat_explicit [9.661719s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6Test.test_external_network_visibility [0.614794s] ... ok
{4} tempest.api.network.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON.test_update_port_with_address_pair [7.226505s] ... FAILED

Captured traceback:
~~~~~~~~~~~~~~~~~~~
    Traceback (most recent call last):

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 105, in test_update_port_with_address_pair
    self._update_port_with_address(self.ip_address)

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 100, in _update_port_with_address
    self.assertCountEqual(allowed_address_pair, allowed_address_pairs)

      File "/usr/lib/python3.8/unittest/case.py", line 1272, in assertCountEqual
    self.fail(msg)

      File "/opt/stack/tempest/.tox/venv/lib/python3.8/site-packages/unittest2/case.py", line 690, in fail
    raise self.failureException(msg)

    AssertionError: Element counts were not equal:
First has 1, Second has 0:  {'mac_address': 'fa:16:3e:0c:19:86', 'ip_address': '2001:db8::285', 'active': True}
First has 0, Second has 1:  {'ip_address': '2001:db8::285', 'mac_address': 'fa:16:3e:0c:19:86'}


Captured pythonlogging:
~~~~~~~~~~~~~~~~~~~~~~~
    2021-06-10 16:18:34,002 107846 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:test_update_port_with_address_pair): 201 POST http://10.222.0.23:9696/v2.0/ports 2.536s
2021-06-10 16:18:34,002 107846 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"network_id": "761488b1-e6ea-4fa0-8b46-c363f1d0c503", "name": "tempest-AllowedAddressPairIpV6TestJSON-893704550"}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '743', 'x-openstack-request-id': 'req-3934138c-26d4-44ba-9503-7be0caef49eb', 'date': 'Thu, 10 Jun 2021 16:18:34 GMT', 'connection': 'close', 'status': '201', 'content-location': 'http://10.222.0.23:9696/v2.0/ports'}
        Body: b'{"port":{"id":"30602475-9f66-4338-b5e7-b7ec4c791dd6","name":"tempest-AllowedAddressPairIpV6TestJSON-893704550","network_id":"761488b1-e6ea-4fa0-8b46-c363f1d0c503","tenant_id":"4d39a0d7deed44f5b85309038a983c91","mac_address":"fa:16:3e:72:fa:8c","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"cae2756a-16b0-4204-bb55-2195a0ce325e","ip_address":"2001:db8::92"}],"project_id":"4d39a0d7deed44f5b85309038a983c91","port_security_enabled":true,"security_groups":["2dd0b0d8-2676-44e2-9c24-c5770612c7c4"],"binding:vnic_type":"normal","allowed_address_pairs":[],"extra_dhcp_opts":[],"description":"","tags":[],"created_at":"2021-06-10T16:18:32Z","updated_at":"2021-06-10T16:18:32Z","revision_number":1}}'
2021-06-10 16:18:36,081 107846 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:test_update_port_with_address_pair): 200 PUT http://10.222.0.23:9696/v2.0/ports/30602475-9f66-4338-b5e7-b7ec4c791dd6 2.078s
2021-06-10 16:18:36,081 107846 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"allowed_address_pairs": [{"ip_address": "2001:db8::285", "mac_address": "fa:16:3e:0c:19:86"}]}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '821', 'x-openstack-request-id': 'req-4e8d5b5e-adbb-4e07-9722-177aa80fd6ea', 'date': 'Thu, 10 Jun 2021 16:18:36 GMT', 'connection': 'close', 'status': '200', 'content-location': 'http://10.222.0.23:9696/v2.0/ports/30602475-9f66-4338-b5e7-b7ec4c791dd6'}
        Body: b'{"port":{"id":"30602475-9f66-4338-b5e7-b7ec4c791dd6","name":"tempest-AllowedAddressPairIpV6TestJSON-893704550","network_id":"761488b1-e6ea-4fa0-8b46-c363f1d0c503","tenant_id":"4d39a0d7deed44f5b85309038a983c91","mac_address":"fa:16:3e:72:fa:8c","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"cae2756a-16b0-4204-bb55-2195a0ce325e","ip_address":"2001:db8::92"}],"allowed_address_pairs":[{"mac_address":"fa:16:3e:0c:19:86","ip_address":"2001:db8::285","active":true}],"extra_dhcp_opts":[],"security_groups":["2dd0b0d8-2676-44e2-9c24-c5770612c7c4"],"description":"","binding:vnic_type":"normal","port_security_enabled":true,"tags":[],"created_at":"2021-06-10T16:18:32Z","updated_at":"2021-06-10T16:18:35Z","revision_number":2,"project_id":"4d39a0d7deed44f5b85309038a983c91"}}'
2021-06-10 16:18:38,580 107846 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:_run_cleanups): 204 DELETE http://10.222.0.23:9696/v2.0/ports/30602475-9f66-4338-b5e7-b7ec4c791dd6 2.496s
2021-06-10 16:18:38,580 107846 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-length': '0', 'x-openstack-request-id': 'req-44dcef3c-c2c1-4955-bf43-c00f60ece066', 'date': 'Thu, 10 Jun 2021 16:18:38 GMT', 'connection': 'close', 'status': '204', 'content-location': 'http://10.222.0.23:9696/v2.0/ports/30602475-9f66-4338-b5e7-b7ec4c791dd6'}
        Body: b''
2021-06-10 16:18:38,690 107846 INFO     [tempest.lib.comm
    on.rest_client] Request (AllowedAddressPairIpV6TestJSON:_run_cleanups): 404 GET http://10.222.0.23:9696/v2.0/ports/30602475-9f66-4338-b5e7-b7ec4c791dd6 0.109s
2021-06-10 16:18:38,690 107846 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-type': 'application/json', 'content-length': '132', 'x-openstack-request-id': 'req-08fdd8a7-3801-479f-896b-b07dfc50e5de', 'date': 'Thu, 10 Jun 2021 16:18:38 GMT', 'connection': 'close', 'status': '404', 'content-location': 'http://10.222.0.23:9696/v2.0/ports/30602475-9f66-4338-b5e7-b7ec4c791dd6'}
        Body: b'{"NeutronError": {"type": "PortNotFound", "message": "Port 30602475-9f66-4338-b5e7-b7ec4c791dd6 could not be found.", "detail": ""}}'

{0} tempest.api.network.test_networks.NetworksIpV6Test.test_list_networks [0.376493s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6Test.test_list_networks_fields [0.320936s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6Test.test_list_subnets [0.146950s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6Test.test_list_subnets_fields [0.144918s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6Test.test_show_network [0.221378s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6Test.test_show_network_fields [0.330207s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6Test.test_show_subnet [0.128894s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6Test.test_show_subnet_fields [0.254101s] ... ok
{3} tempest.api.network.admin.test_routers.RoutersAdminTest.test_create_router_with_snat_explicit [21.359038s] ... ok
{4} tempest.api.network.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON.test_update_port_with_cidr_address_pair [6.035068s] ... FAILED

Captured traceback:
~~~~~~~~~~~~~~~~~~~
    Traceback (most recent call last):

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 110, in test_update_port_with_cidr_address_pair
    self._update_port_with_address(str(self.cidr))

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 100, in _update_port_with_address
    self.assertCountEqual(allowed_address_pair, allowed_address_pairs)

      File "/usr/lib/python3.8/unittest/case.py", line 1272, in assertCountEqual
    self.fail(msg)

      File "/opt/stack/tempest/.tox/venv/lib/python3.8/site-packages/unittest2/case.py", line 690, in fail
    raise self.failureException(msg)

    AssertionError: Element counts were not equal:
First has 1, Second has 0:  {'mac_address': 'fa:16:3e:0c:19:86', 'ip_address': '2001:db8::/48', 'active': True}
First has 0, Second has 1:  {'ip_address': '2001:db8::/48', 'mac_address': 'fa:16:3e:0c:19:86'}


Captured pythonlogging:
~~~~~~~~~~~~~~~~~~~~~~~
    2021-06-10 16:18:41,249 107846 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:test_update_port_with_cidr_address_pair): 201 POST http://10.222.0.23:9696/v2.0/ports 2.557s
2021-06-10 16:18:41,249 107846 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"network_id": "761488b1-e6ea-4fa0-8b46-c363f1d0c503", "name": "tempest-AllowedAddressPairIpV6TestJSON-1776996997"}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '745', 'x-openstack-request-id': 'req-96993bbf-d696-453f-b4ca-260cc97bb413', 'date': 'Thu, 10 Jun 2021 16:18:41 GMT', 'connection': 'close', 'status': '201', 'content-location': 'http://10.222.0.23:9696/v2.0/ports'}
        Body: b'{"port":{"id":"33bfaa36-0cd9-4e99-907a-8f84db248b82","name":"tempest-AllowedAddressPairIpV6TestJSON-1776996997","network_id":"761488b1-e6ea-4fa0-8b46-c363f1d0c503","tenant_id":"4d39a0d7deed44f5b85309038a983c91","mac_address":"fa:16:3e:b2:fe:25","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"cae2756a-16b0-4204-bb55-2195a0ce325e","ip_address":"2001:db8::18f"}],"project_id":"4d39a0d7deed44f5b85309038a983c91","port_security_enabled":true,"security_groups":["2dd0b0d8-2676-44e2-9c24-c5770612c7c4"],"binding:vnic_type":"normal","allowed_address_pairs":[],"extra_dhcp_opts":[],"description":"","tags":[],"created_at":"2021-06-10T16:18:39Z","updated_at":"2021-06-10T16:18:39Z","revision_number":1}}'
2021-06-10 16:18:43,274 107846 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:test_update_port_with_cidr_address_pair): 200 PUT http://10.222.0.23:9696/v2.0/ports/33bfaa36-0cd9-4e99-907a-8f84db248b82 2.024s
2021-06-10 16:18:43,275 107846 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"allowed_address_pairs": [{"ip_address": "2001:db8::/48", "mac_address": "fa:16:3e:0c:19:86"}]}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '823', 'x-openstack-request-id': 'req-c00d3af3-7e8d-4d81-84b2-772d8ca43e5b', 'date': 'Thu, 10 Jun 2021 16:18:43 GMT', 'connection': 'close', 'status': '200', 'content-location': 'http://10.222.0.23:9696/v2.0/ports/33bfaa36-0cd9-4e99-907a-8f84db248b82'}
        Body: b'{"port":{"id":"33bfaa36-0cd9-4e99-907a-8f84db248b82","name":"tempest-AllowedAddressPairIpV6TestJSON-1776996997","network_id":"761488b1-e6ea-4fa0-8b46-c363f1d0c503","tenant_id":"4d39a0d7deed44f5b85309038a983c91","mac_address":"fa:16:3e:b2:fe:25","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"cae2756a-16b0-4204-bb55-2195a0ce325e","ip_address":"2001:db8::18f"}],"allowed_address_pairs":[{"mac_address":"fa:16:3e:0c:19:86","ip_address":"2001:db8::/48","active":true}],"extra_dhcp_opts":[],"security_groups":["2dd0b0d8-2676-44e2-9c24-c5770612c7c4"],"description":"","binding:vnic_type":"normal","port_security_enabled":true,"tags":[],"created_at":"2021-06-10T16:18:39Z","updated_at":"2021-06-10T16:18:42Z","revision_number":2,"project_id":"4d39a0d7deed44f5b85309038a983c91"}}'
2021-06-10 16:18:44,680 107846 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:_run_cleanups): 204 DELETE http://10.222.0.23:9696/v2.0/ports/33bfaa36-0cd9-4e99-907a-8f84db248b82 1.404s
2021-06-10 16:18:44,680 107846 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-length': '0', 'x-openstack-request-id': 'req-c00bdd86-8601-4acd-8060-2ed127d95519', 'date': 'Thu, 10 Jun 2021 16:18:44 GMT', 'connection': 'close', 'status': '204', 'content-location': 'http://10.222.0.23:9696/v2.0/ports/33bfaa36-0cd9-4e99-907a-8f84db248b82'}
        Body: b''
2021-06-10 16:18:44,726 107846 INFO     [t
    empest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:_run_cleanups): 404 GET http://10.222.0.23:9696/v2.0/ports/33bfaa36-0cd9-4e99-907a-8f84db248b82 0.045s
2021-06-10 16:18:44,726 107846 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-type': 'application/json', 'content-length': '132', 'x-openstack-request-id': 'req-12f5f59e-06f5-4997-a87b-add147b0fa0c', 'date': 'Thu, 10 Jun 2021 16:18:44 GMT', 'connection': 'close', 'status': '404', 'content-location': 'http://10.222.0.23:9696/v2.0/ports/33bfaa36-0cd9-4e99-907a-8f84db248b82'}
        Body: b'{"NeutronError": {"type": "PortNotFound", "message": "Port 33bfaa36-0cd9-4e99-907a-8f84db248b82 could not be found.", "detail": ""}}'

{5} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups [11.870832s] ... ok
{2} tempest.api.network.admin.test_routers.RoutersIpV6AdminTest.test_update_router_set_gateway_without_snat [8.405739s] ... ok
{6} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus [0.741727s] ... ok
{6} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details [0.000578s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6Test.test_update_subnet_gw_dns_host_routes_dhcp [8.264952s] ... ok
{1} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus [0.784345s] ... ok
{1} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details [0.000616s] ... ok
{5} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_show_delete_port_user_defined_mac [3.808224s] ... ok
{3} tempest.api.network.admin.test_routers.RoutersAdminTest.test_update_router_reset_gateway_without_snat [12.729920s] ... ok
{4} tempest.api.network.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON.test_update_port_with_multiple_ip_mac_address_pair [13.938559s] ... FAILED

Captured traceback:
~~~~~~~~~~~~~~~~~~~
    Traceback (most recent call last):

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 129, in test_update_port_with_multiple_ip_mac_address_pair
    self._update_port_with_address(

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 100, in _update_port_with_address
    self.assertCountEqual(allowed_address_pair, allowed_address_pairs)

      File "/usr/lib/python3.8/unittest/case.py", line 1272, in assertCountEqual
    self.fail(msg)

      File "/opt/stack/tempest/.tox/venv/lib/python3.8/site-packages/unittest2/case.py", line 690, in fail
    raise self.failureException(msg)

    AssertionError: Element counts were not equal:
First has 1, Second has 0:  {'mac_address': 'fa:16:3e:0c:19:86', 'ip_address': '2001:db8::285', 'active': True}
First has 1, Second has 0:  {'mac_address': 'fa:16:3e:27:ac:8a', 'ip_address': '2001:db8::10f', 'active': True}
First has 0, Second has 1:  {'ip_address': '2001:db8::285', 'mac_address': 'fa:16:3e:0c:19:86'}
First has 0, Second has 1:  {'ip_address': '2001:db8::10f', 'mac_address': 'fa:16:3e:27:ac:8a'}


Captured pythonlogging:
~~~~~~~~~~~~~~~~~~~~~~~
    2021-06-10 16:18:47,622 107846 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:test_update_port_with_multiple_ip_mac_address_pair): 201 POST http://10.222.0.23:9696/v2.0/ports 2.894s
2021-06-10 16:18:47,623 107846 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"network_id": "761488b1-e6ea-4fa0-8b46-c363f1d0c503", "name": "tempest-AllowedAddressPairIpV6TestJSON-286246298"}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '744', 'x-openstack-request-id': 'req-4587b2f2-8594-44a6-bfba-c315cf1ed189', 'date': 'Thu, 10 Jun 2021 16:18:47 GMT', 'connection': 'close', 'status': '201', 'content-location': 'http://10.222.0.23:9696/v2.0/ports'}
        Body: b'{"port":{"id":"0a31381f-3ff3-44f9-b81b-b051ed5fa052","name":"tempest-AllowedAddressPairIpV6TestJSON-286246298","network_id":"761488b1-e6ea-4fa0-8b46-c363f1d0c503","tenant_id":"4d39a0d7deed44f5b85309038a983c91","mac_address":"fa:16:3e:27:ac:8a","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"cae2756a-16b0-4204-bb55-2195a0ce325e","ip_address":"2001:db8::10f"}],"project_id":"4d39a0d7deed44f5b85309038a983c91","port_security_enabled":true,"security_groups":["2dd0b0d8-2676-44e2-9c24-c5770612c7c4"],"binding:vnic_type":"normal","allowed_address_pairs":[],"extra_dhcp_opts":[],"description":"","tags":[],"created_at":"2021-06-10T16:18:45Z","updated_at":"2021-06-10T16:18:46Z","revision_number":1}}'
2021-06-10 16:18:50,597 107846 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:test_update_port_with_multiple_ip_mac_address_pair): 201 POST http://10.222.0.23:9696/v2.0/ports 2.974s
2021-06-10 16:18:50,598 107846 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"network_id": "761488b1-e6ea-4fa0-8b46-c363f1d0c503", "name": "tempest-AllowedAddressPairIpV6TestJSON-901688900"}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '744', 'x-openstack-request-id': 'req-2abb5129-00e5-452a-a658-aca0f7632fe6', 'date': 'Thu, 10 Jun 2021 16:18:50 GMT', 'connection': 'close', 'status': '201', 'content-location': 'http://10.222.0.23:9696/v2.0/ports'}
        Body: b'{"port":{"id":"0bd7dfe6-992d-4996-a809-be608e42cfb7","name":"tempest-AllowedAddressPairIpV6TestJSON-901688900","network_id":"761488b1-e6ea-4fa0-8b46-c363f1d0c503","tenant_id":"4d39a0d7deed44f5b85309038a983c91","mac_address":"fa:16:3e:12:af:6d","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"cae2756a-16b0-4204-bb55-2195a0ce325e","ip_address":"2001:db8::213"}],"project_id":"4d39a0d7deed44f5b85309038a983c91","port_security_enabled":true,"security_groups":["2dd0b0d8-2676-44e2-9c24-c5770612c7c4"],"binding:vnic_type":"normal","allowed_address_pairs":[],"extra_dhcp_opts":[],"description":"","tags":[],"created_at":"2021-06-10T16:18:48Z","updated_at":"2021-06-10T16:18:49Z","revision_number":1}}'
2021-06-10 16:18:54,021 107846 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:test_update_port_with_multiple_ip_mac_address_pair): 200 PUT http://10.222.0.23:9696/v2.0/ports/0bd7dfe6-992d-4996-a809-be608e42cfb7 3.423s
2021-06-10 16:18:54,021 107846 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"allowed_address_pairs": [{"ip_address": "2001:db8::285", "mac_address": "fa:16:3e:0c:19:86"}, {"ip_address": "2001:db8::10f", "mac_address": "fa:16:3e:27:ac:8a"}]}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '901', 'x-openstack-request-id': 'req-4e6b9658-5017-402f-afa3-12bbc227e437', 'date': 'Thu, 10 Jun 2021 16:18:54 GMT', 'connection': 'close', 'status': '200', 'content-location': 'http:
    //10.222.0.23:9696/v2.0/ports/0bd7dfe6-992d-4996-a809-be608e42cfb7'}
        Body: b'{"port":{"id":"0bd7dfe6-992d-4996-a809-be608e42cfb7","name":"tempest-AllowedAddressPairIpV6TestJSON-901688900","network_id":"761488b1-e6ea-4fa0-8b46-c363f1d0c503","tenant_id":"4d39a0d7deed44f5b85309038a983c91","mac_address":"fa:16:3e:12:af:6d","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"cae2756a-16b0-4204-bb55-2195a0ce325e","ip_address":"2001:db8::213"}],"allowed_address_pairs":[{"mac_address":"fa:16:3e:0c:19:86","ip_address":"2001:db8::285","active":true},{"mac_address":"fa:16:3e:27:ac:8a","ip_address":"2001:db8::10f","active":true}],"extra_dhcp_opts":[],"security_groups":["2dd0b0d8-2676-44e2-9c24-c5770612c7c4"],"description":"","binding:vnic_type":"normal","port_security_enabled":true,"tags":[],"created_at":"2021-06-10T16:18:48Z","updated_at":"2021-06-10T16:18:52Z","revision_number":2,"project_id":"4d39a0d7deed44f5b85309038a983c91"}}'
2021-06-10 16:18:56,418 107846 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:_run_cleanups): 204 DELETE http://10.222.0.23:9696/v2.0/ports/0bd7dfe6-992d-4996-a809-be608e42cfb7 2.395s
2021-06-10 16:18:56,418 107846 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-length': '0', 'x-openstack-request-id': 'req-b51912c5-fb48-496d-96a6-c9fc02ad2979', 'date': 'Thu, 10 Jun 2021 16:18:56 GMT', 'connection': 'close', 'status': '204', 'content-location': 'http://10.222.0.23:9696/v2.0/ports/0bd7dfe6-992d-4996-a809-be608e42cfb7'}
        Body: b''
2021-06-10 16:18:56,559 107846 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:_run_cleanups): 404 GET http://10.222.0.23:9696/v2.0/ports/0bd7dfe6-992d-4996-a809-be608e42cfb7 0.141s
2021-06-10 16:18:56,560 107846 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-type': 'application/json', 'content-length': '132', 'x-openstack-request-id': 'req-63317b29-67b6-4c74-83ff-df2932d64851', 'date': 'Thu, 10 Jun 2021 16:18:56 GMT', 'connection': 'close', 'status': '404', 'content-location': 'http://10.222.0.23:9696/v2.0/ports/0bd7dfe6-992d-4996-a809-be608e42cfb7'}
        Body: b'{"NeutronError": {"type": "PortNotFound", "message": "Port 0bd7dfe6-992d-4996-a809-be608e42cfb7 could not be found.", "detail": ""}}'
2021-06-10 16:18:58,453 107846 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:_run_cleanups): 204 DELETE http://10.222.0.23:9696/v2.0/ports/0a31381f-3ff3-44f9-b81b-b051ed5fa052 1.892s
2021-06-10 16:18:58,453 107846 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-length': '0', 'x-openstack-request-id': 'req-707751d5-3de4-4d63-9e03-2f55b06df736', 'date': 'Thu, 10 Jun 2021 16:18:58 GMT', 'connection': 'close', 'status': '204', 'content-location': 'http://10.222.0.23:9696/v2.0/ports/0a31381f-3ff3-44f9-b81b-b051ed5fa052'}
        Body: b''
2021-06-10 16:18:58,666 107846 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:_run_cleanups): 404 GET http://10.222.0.23:9696/v2.0/ports/0a31381f-3ff3-44f9-b81b-b051ed5fa052 0.212s
2021-06-10 16:18:58,666 107846 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-type': 'application/json', 'content-length': '132', 'x-openstack-request-id': 'req-a2d7ac1f-4d08-4d2c-a8ce-c4c59ca57ba5', 'date': 'Thu, 10 Jun 2021 16:18:58 GMT', 'connection': 'close', 'status': '404', 'content-location': 'http://10.222.0.23:9696/v2.0/ports/0a31381f-3f
    f3-44f9-b81b-b051ed5fa052'}
        Body: b'{"NeutronError": {"type": "PortNotFound", "message": "Port 0a31381f-3ff3-44f9-b81b-b051ed5fa052 could not be found.", "detail": ""}}'

{5} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port [8.422159s] ... ok
{0} tempest.api.network.test_service_providers.ServiceProvidersTest.test_service_providers_list [0.218533s] ... ok
{2} tempest.api.network.admin.test_routers.RoutersIpV6AdminTest.test_update_router_unset_gateway [18.998976s] ... ok
{3} tempest.api.network.admin.test_routers.RoutersAdminTest.test_update_router_set_gateway [12.473596s] ... ok
{7} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server [26.835172s] ... ok
{2} tempest.api.network.admin.test_routers_negative.RoutersAdminNegativeIpV6Test.test_router_set_gateway_used_ip_returns_409 [10.122390s] ... ok
{3} tempest.api.network.admin.test_routers.RoutersAdminTest.test_update_router_set_gateway_with_snat_explicit [14.410902s] ... ok
{7} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_pause_unpause_server [9.604472s] ... ok
{5} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_port_with_second_ip [29.852082s] ... ok
{5} tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports [0.550639s] ... ok
{4} tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_delete_slaac_subnet_with_ports [12.573845s] ... ok
{5} tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports_fields [0.758652s] ... ok
{3} tempest.api.network.admin.test_routers.RoutersAdminTest.test_update_router_set_gateway_without_snat [9.457134s] ... ok
{0} tempest.api.network.test_tags.TagsExtTest.test_create_check_list_and_delete_tags [13.177809s] ... ok
{4} tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_delete_stateless_subnet_with_ports [10.250647s] ... ok
{2} tempest.api.network.admin.test_routers_negative.RoutersAdminNegativeTest.test_router_set_gateway_used_ip_returns_409 [10.582182s] ... ok
{6} tempest.api.network.admin.test_dhcp_agent_scheduler.DHCPAgentSchedulersTestJSON.test_add_remove_network_from_dhcp_agent [7.279034s] ... ok
{6} tempest.api.network.admin.test_dhcp_agent_scheduler.DHCPAgentSchedulersTestJSON.test_list_dhcp_agent_hosting_network [0.053708s] ... ok
{6} tempest.api.network.admin.test_dhcp_agent_scheduler.DHCPAgentSchedulersTestJSON.test_list_networks_hosted_by_one_dhcp [1.004225s] ... ok
{0} tempest.api.network.test_tags.TagsExtTest.test_update_and_delete_all_tags [11.427587s] ... ok
{3} tempest.api.network.admin.test_routers.RoutersAdminTest.test_update_router_unset_gateway [13.737158s] ... ok
{4} tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_delete_subnet_with_v6_attributes_slaac [9.658543s] ... ok
{5} tempest.api.network.test_ports.PortsIpV6TestJSON.test_port_list_filter_by_ip [20.356366s] ... ok
{4} tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_delete_subnet_with_v6_attributes_stateful [10.895478s] ... ok
{2} tempest.api.network.test_extra_dhcp_options.ExtraDHCPOptionsTestJSON.test_create_list_port_with_extra_dhcp_options [5.647346s] ... ok
{2} tempest.api.network.test_extra_dhcp_options.ExtraDHCPOptionsTestJSON.test_update_show_port_with_extra_dhcp_options [1.609981s] ... ok
{5} tempest.api.network.test_ports.PortsIpV6TestJSON.test_port_list_filter_by_ip_substr [14.660847s] ... ok
{0} tempest.api.network.test_tags.TagsTest.test_create_list_show_update_delete_tags [4.237923s] ... ok
{6} tempest.api.network.admin.test_ports.PortsAdminExtendedAttrsTestJSON.test_create_port_binding_ext_attr [7.586460s] ... ok
{1} tempest.api.network.admin.test_floating_ips_admin_actions.FloatingIPAdminTestJSON.test_create_list_show_floating_ip_with_tenant_id_by_admin [15.447053s] ... ok
{3} tempest.api.network.test_extra_dhcp_options.ExtraDHCPOptionsIpV6TestJSON.test_create_list_port_with_extra_dhcp_options [6.308906s] ... ok
{4} tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_delete_subnet_with_v6_attributes_stateless [10.236517s] ... ok
{3} tempest.api.network.test_extra_dhcp_options.ExtraDHCPOptionsIpV6TestJSON.test_update_show_port_with_extra_dhcp_options [1.852521s] ... ok
{6} tempest.api.network.admin.test_ports.PortsAdminExtendedAttrsTestJSON.test_list_ports_binding_ext_attr [5.803121s] ... ok
{6} tempest.api.network.admin.test_ports.PortsAdminExtendedAttrsTestJSON.test_show_port_binding_ext_attr [4.871226s] ... ok
{2} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_network [5.643605s] ... ok
{3} tempest.api.network.test_networks_negative.NetworksNegativeTestJSON.test_create_port_on_non_existent_network [0.366660s] ... ok
{3} tempest.api.network.test_networks_negative.NetworksNegativeTestJSON.test_delete_non_existent_network [0.094363s] ... ok
{3} tempest.api.network.test_networks_negative.NetworksNegativeTestJSON.test_delete_non_existent_port [0.066069s] ... ok
{3} tempest.api.network.test_networks_negative.NetworksNegativeTestJSON.test_delete_non_existent_subnet [0.113651s] ... ok
{3} tempest.api.network.test_networks_negative.NetworksNegativeTestJSON.test_show_non_existent_network [0.053945s] ... ok
{3} tempest.api.network.test_networks_negative.NetworksNegativeTestJSON.test_show_non_existent_port [0.124940s] ... ok
{3} tempest.api.network.test_networks_negative.NetworksNegativeTestJSON.test_show_non_existent_subnet [0.124859s] ... ok
{3} tempest.api.network.test_networks_negative.NetworksNegativeTestJSON.test_update_non_existent_network [0.050262s] ... ok
{3} tempest.api.network.test_networks_negative.NetworksNegativeTestJSON.test_update_non_existent_port [0.065147s] ... ok
{3} tempest.api.network.test_networks_negative.NetworksNegativeTestJSON.test_update_non_existent_subnet [0.067697s] ... ok
{1} tempest.api.network.admin.test_floating_ips_admin_actions.FloatingIPAdminTestJSON.test_list_floating_ips_from_admin_and_nonadmin [15.789790s] ... ok
{6} tempest.api.network.admin.test_ports.PortsAdminExtendedAttrsTestJSON.test_update_port_binding_ext_attr [8.106344s] ... ok
{4} tempest.api.network.test_routers_negative.DvrRoutersNegativeTest.test_router_create_tenant_distributed_returns_forbidden [0.471096s] ... ok
{5} tempest.api.network.test_ports.PortsIpV6TestJSON.test_port_list_filter_by_router_id [24.494823s] ... ok
{5} tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port [0.097279s] ... ok
{5} tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port_fields [0.085233s] ... ok
{2} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_port [11.970341s] ... ok
{4} tempest.api.network.test_versions.NetworksApiDiscovery.test_api_version_resources [0.027227s] ... ok
{6} tempest.api.network.admin.test_quotas.QuotasTest.test_quotas [1.723008s] ... ok
{7} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard [66.295294s] ... ok
{4} tempest.api.network.test_versions.NetworksApiDiscovery.test_show_api_v2_details [0.540770s] ... ok
{6} tempest.api.network.admin.test_quotas.QuotasTest.test_show_quota_details [1.888338s] ... ok
{2} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_subnet [10.570527s] ... ok
{6} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_network [7.800305s] ... ok
{5} tempest.api.network.test_ports.PortsIpV6TestJSON.test_update_port_with_security_group_and_extra_attributes [22.729731s] ... ok
{7} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server [24.235699s] ... ok
{3} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_add_router_interfaces_on_overlapping_subnets_returns_400 [25.659521s] ... ok
{3} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_delete_non_existent_router_returns_404 [0.133112s] ... ok
{6} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_port [12.600120s] ... ok
{3} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_router_add_gateway_invalid_network_returns_404 [1.241531s] ... ok
{1} tempest.api.network.admin.test_negative_quotas.QuotasNegativeTest.test_network_quota_exceeding [8.793364s] ... ok
{7} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_suspend_resume_server [9.597107s] ... ok
{1} tempest.api.network.test_agent_management_negative.AgentManagementNegativeTest.test_list_agents_non_admin [0.342152s] ... ok
{6} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_subnet [12.063392s] ... ok
{3} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_router_remove_interface_in_use_returns_409 [14.504806s] ... ok
{3} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_show_non_existent_router_returns_404 [0.172948s] ... ok
{3} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_update_non_existent_router_returns_404 [0.175117s] ... ok
{5} tempest.api.network.test_ports.PortsIpV6TestJSON.test_update_port_with_two_security_groups_and_extra_attributes [28.121959s] ... ok
{2} tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces [35.207345s] ... ok
{3} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_additional_default_security_group_fails [0.708593s] ... ok
{3} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_duplicate_security_group_rule_fails [5.739857s] ... ok
{3} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_ethertype [2.043298s] ... ok
{3} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_protocol [1.645378s] ... ok
{7} tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions [2.096067s] ... ok
{3} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_remote_ip_prefix [2.165637s] ... ok
{5} tempest.api.network.test_ports.PortsTestJSON.test_create_bulk_port [8.412210s] ... ok
{2} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id [19.631186s] ... ok
{3} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_invalid_ports [5.175242s] ... ok
{1} tempest.api.network.test_dhcp_ipv6.NetworksTestDHCPv6.test_dhcp_stateful [30.122043s] ... ok
{3} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_remote_groupid [3.124226s] ... ok
{3} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_security_group [0.267920s] ... ok
{5} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools [11.998378s] ... ok
{3} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_remote_ip_and_group [6.851798s] ... ok
{3} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_update_name_default [2.149182s] ... ok
{3} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_delete_non_existent_security_group [0.068335s] ... ok
{3} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group [0.134670s] ... ok
{3} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group_rule [0.184000s] ... ok
{3} tempest.scenario.test_network_advanced_server_ops.TestNetworkAdvancedServerOps.test_server_connectivity_cold_migration ... SKIPPED: Less than 2 compute nodes, skipping multinode tests.
{3} tempest.scenario.test_network_advanced_server_ops.TestNetworkAdvancedServerOps.test_server_connectivity_cold_migration_revert ... SKIPPED: Less than 2 compute nodes, skipping multinode tests.
{3} tempest.scenario.test_network_advanced_server_ops.TestNetworkAdvancedServerOps.test_server_connectivity_live_migration ... SKIPPED: Less than 2 compute nodes, skipping multinode tests.
{2} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id [21.671890s] ... ok
{5} tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups [14.589669s] ... ok
{6} tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces [42.125014s] ... ok
{5} tempest.api.network.test_ports.PortsTestJSON.test_create_show_delete_port_user_defined_mac [9.474548s] ... ok
{1} tempest.api.network.test_dhcp_ipv6.NetworksTestDHCPv6.test_dhcp_stateful_fixedips [32.319596s] ... ok
{7} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address [14.092817s] ... ok
{2} tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router [16.738853s] ... ok
{5} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port [6.109139s] ... ok
{1} tempest.api.network.test_dhcp_ipv6.NetworksTestDHCPv6.test_dhcp_stateful_fixedips_duplicate [13.448027s] ... ok
{1} tempest.api.network.test_dhcp_ipv6.NetworksTestDHCPv6.test_dhcp_stateful_fixedips_outrange [7.359559s] ... ok
{6} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id [29.877106s] ... ok
{7} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip [26.971797s] ... ok
{2} tempest.api.network.test_routers.RoutersIpV6Test.test_router_interface_port_update_with_fixed_ip [29.128462s] ... ok
{5} tempest.api.network.test_ports.PortsTestJSON.test_create_update_port_with_second_ip [32.871779s] ... ok
{5} tempest.api.network.test_ports.PortsTestJSON.test_list_ports [0.362023s] ... ok
{5} tempest.api.network.test_ports.PortsTestJSON.test_list_ports_fields [0.326038s] ... ok
{6} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id [29.326485s] ... ok
{7} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_update_floatingip_with_port_multiple_ip_address [23.887209s] ... ok
{1} tempest.api.network.test_dhcp_ipv6.NetworksTestDHCPv6.test_dhcp_stateful_router [36.649544s] ... ok
{5} tempest.api.network.test_ports.PortsTestJSON.test_port_list_filter_by_ip [24.758993s] ... ok
{6} tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router [17.629382s] ... ok
{7} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_floating_ip_delete_port [15.385663s] ... ok
{5} tempest.api.network.test_ports.PortsTestJSON.test_port_list_filter_by_ip_substr [14.685108s] ... ok
{0} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_connectivity_between_vms_on_different_networks [221.467102s] ... ok
{0} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_hotplug_nic ... SKIPPED: NIC hotplug not available
{6} tempest.api.network.test_routers.RoutersTest.test_router_interface_port_update_with_fixed_ip [30.255446s] ... ok
{5} tempest.api.network.test_ports.PortsTestJSON.test_port_list_filter_by_router_id [30.654451s] ... ok
{5} tempest.api.network.test_ports.PortsTestJSON.test_show_port [0.422997s] ... ok
{5} tempest.api.network.test_ports.PortsTestJSON.test_show_port_fields [0.206401s] ... ok
{1} tempest.api.network.test_dhcp_ipv6.NetworksTestDHCPv6.test_dhcpv6_64_subnets [74.965411s] ... ok
{7} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_floating_ip_update_different_router [64.121138s] ... ok
{5} tempest.api.network.test_ports.PortsTestJSON.test_update_port_with_security_group_and_extra_attributes [24.166117s] ... ok
{1} tempest.api.network.test_dhcp_ipv6.NetworksTestDHCPv6.test_dhcpv6_invalid_options [6.073208s] ... ok
{2} tempest.api.network.test_routers.RoutersIpV6Test.test_update_delete_extra_route [106.936970s] ... ok
{2} tempest.api.network.test_routers.RoutersIpV6Test.test_update_router_admin_state [2.457489s] ... ok
{2} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group [5.498813s] ... ok
{2} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_security_group_rule_with_additional_args [3.346373s] ... ok
{3} tempest.scenario.test_network_advanced_server_ops.TestNetworkAdvancedServerOps.test_server_connectivity_rebuild [177.767933s] ... ok
{5} tempest.api.network.test_ports.PortsTestJSON.test_update_port_with_two_security_groups_and_extra_attributes [28.977537s] ... ok
{1} tempest.api.network.test_dhcp_ipv6.NetworksTestDHCPv6.test_dhcpv6_stateless_eui64 [26.073212s] ... ok
{2} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_security_group_rule_with_icmp_type_code [8.168753s] ... ok
{2} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_security_group_rule_with_protocol_integer_value [4.472803s] ... ok
{2} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_security_group_rule_with_remote_group_id [5.126240s] ... ok
{5} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group [3.320817s] ... ok
{2} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_security_group_rule_with_remote_ip_prefix [2.101608s] ... ok
{7} tempest.api.network.test_floating_ips_negative.FloatingIPNegativeTestJSON.test_associate_floatingip_port_ext_net_unreachable [5.324763s] ... ok
{5} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_additional_args [2.933263s] ... ok
{7} tempest.api.network.test_floating_ips_negative.FloatingIPNegativeTestJSON.test_create_floatingip_in_private_network [0.411883s] ... ok
{1} tempest.api.network.test_dhcp_ipv6.NetworksTestDHCPv6.test_dhcpv6_stateless_no_ra [16.089474s] ... ok
{2} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule [4.724084s] ... ok
{2} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups [0.091168s] ... ok
{7} tempest.api.network.test_floating_ips_negative.FloatingIPNegativeTestJSON.test_create_floatingip_with_port_ext_net_unreachable [3.873509s] ... ok
{1} tempest.api.network.test_dhcp_ipv6.NetworksTestDHCPv6.test_dhcpv6_stateless_no_ra_no_dhcp [5.327139s] ... ok
{5} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_icmp_type_code [7.460783s] ... ok
{5} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_protocol_integer_value [2.846312s] ... ok
{6} tempest.api.network.test_routers.RoutersTest.test_update_delete_extra_route [94.370275s] ... ok
{5} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_group_id [5.356443s] ... ok
{5} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_ip_prefix [1.200345s] ... ok
{6} tempest.api.network.test_routers.RoutersTest.test_update_router_admin_state [4.373517s] ... ok
{5} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule [4.563580s] ... ok
{5} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups [0.289751s] ... ok
{5} tempest.api.network.test_security_groups_negative.NegativeSecGroupIPv6Test.test_create_additional_default_security_group_fails [0.224803s] ... ok
{5} tempest.api.network.test_security_groups_negative.NegativeSecGroupIPv6Test.test_create_duplicate_security_group_rule_fails [2.298811s] ... ok
{7} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_all_attributes [7.686515s] ... ok
{5} tempest.api.network.test_security_groups_negative.NegativeSecGroupIPv6Test.test_create_security_group_rule_with_bad_ethertype [1.419241s] ... ok
{5} tempest.api.network.test_security_groups_negative.NegativeSecGroupIPv6Test.test_create_security_group_rule_with_bad_protocol [1.367150s] ... ok
{5} tempest.api.network.test_security_groups_negative.NegativeSecGroupIPv6Test.test_create_security_group_rule_with_bad_remote_ip_prefix [1.028695s] ... ok
{5} tempest.api.network.test_security_groups_negative.NegativeSecGroupIPv6Test.test_create_security_group_rule_with_invalid_ports [1.610480s] ... ok
{7} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_allocation_pools [5.998230s] ... ok
{5} tempest.api.network.test_security_groups_negative.NegativeSecGroupIPv6Test.test_create_security_group_rule_with_non_existent_remote_groupid [1.928000s] ... ok
{5} tempest.api.network.test_security_groups_negative.NegativeSecGroupIPv6Test.test_create_security_group_rule_with_non_existent_security_group [0.618448s] ... ok
{0} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_mtu_sized_frames [126.511050s] ... ok
{5} tempest.api.network.test_security_groups_negative.NegativeSecGroupIPv6Test.test_create_security_group_rule_with_remote_ip_and_group [3.683848s] ... ok
{7} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_dhcp_enabled [5.976900s] ... ok
{5} tempest.api.network.test_security_groups_negative.NegativeSecGroupIPv6Test.test_create_security_group_rule_wrong_ip_prefix_version [1.451111s] ... ok
{7} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw [1.623233s] ... ok
{5} tempest.api.network.test_security_groups_negative.NegativeSecGroupIPv6Test.test_create_security_group_update_name_default [1.890522s] ... ok
{5} tempest.api.network.test_security_groups_negative.NegativeSecGroupIPv6Test.test_delete_non_existent_security_group [0.033459s] ... ok
{5} tempest.api.network.test_security_groups_negative.NegativeSecGroupIPv6Test.test_show_non_existent_security_group [0.021462s] ... ok
{5} tempest.api.network.test_security_groups_negative.NegativeSecGroupIPv6Test.test_show_non_existent_security_group_rule [0.033289s] ... ok
{1} tempest.api.network.test_dhcp_ipv6.NetworksTestDHCPv6.test_dhcpv6_two_subnets [39.643255s] ... ok
{7} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw_and_allocation_pools [5.911797s] ... ok
{7} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_host_routes_and_dns_nameservers [7.044541s] ... ok
{7} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_without_gateway [3.466285s] ... ok
{7} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet [5.134727s] ... ok
{7} tempest.api.network.test_networks.NetworksTest.test_create_update_network_description [1.035521s] ... ok
{7} tempest.api.network.test_networks.NetworksTest.test_delete_network_with_subnet [1.577987s] ... ok
{7} tempest.api.network.test_networks.NetworksTest.test_external_network_visibility [0.310181s] ... ok
{7} tempest.api.network.test_networks.NetworksTest.test_list_networks [0.240683s] ... ok
{7} tempest.api.network.test_networks.NetworksTest.test_list_networks_fields [0.268555s] ... ok
{7} tempest.api.network.test_networks.NetworksTest.test_list_subnets [0.135546s] ... ok
{7} tempest.api.network.test_networks.NetworksTest.test_list_subnets_fields [0.137231s] ... ok
{7} tempest.api.network.test_networks.NetworksTest.test_show_network [0.247709s] ... ok
{7} tempest.api.network.test_networks.NetworksTest.test_show_network_fields [0.268568s] ... ok
{7} tempest.api.network.test_networks.NetworksTest.test_show_subnet [0.078284s] ... ok
{7} tempest.api.network.test_networks.NetworksTest.test_show_subnet_fields [0.110512s] ... ok
{7} tempest.api.network.test_networks.NetworksTest.test_update_subnet_gw_dns_host_routes_dhcp [7.106338s] ... ok
{1} tempest.api.network.test_routers_negative.RoutersNegativeIpV6Test.test_add_router_interfaces_on_overlapping_subnets_returns_400 [19.102305s] ... ok
{1} tempest.api.network.test_routers_negative.RoutersNegativeIpV6Test.test_delete_non_existent_router_returns_404 [0.084007s] ... ok
{1} tempest.api.network.test_routers_negative.RoutersNegativeIpV6Test.test_router_add_gateway_invalid_network_returns_404 [0.476192s] ... ok
{1} tempest.api.network.test_routers_negative.RoutersNegativeIpV6Test.test_router_add_gateway_net_not_external_returns_400 [2.833766s] ... ok
{7} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools [1.387562s] ... ok
{1} tempest.api.network.test_routers_negative.RoutersNegativeIpV6Test.test_router_remove_interface_in_use_returns_409 [6.439213s] ... ok
{1} tempest.api.network.test_routers_negative.RoutersNegativeIpV6Test.test_show_non_existent_router_returns_404 [0.073716s] ... ok
{1} tempest.api.network.test_routers_negative.RoutersNegativeIpV6Test.test_update_non_existent_router_returns_404 [0.071601s] ... ok
{1} tempest.scenario.test_server_advanced_ops.TestServerAdvancedOps.test_server_sequence_suspend_resume [30.582458s] ... ok
{0} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops [152.463208s] ... ok
{0} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_port_security_macspoofing_port ... SKIPPED: NIC hotplug not available
{0} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_preserve_preexisting_port [52.744385s] ... ok
{0} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_router_rescheduling [78.746267s] ... ok
{0} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_subnet_details [192.526663s] ... ok
{5} tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern [440.587600s] ... ok
{0} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_update_instance_port_admin_state [101.838783s] ... ok
{0} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_update_router_admin_state [66.471596s] ... ok

==============================
Failed 6 tests - output below:
==============================

tempest.api.network.test_allowed_address_pair.AllowedAddressPairTestJSON.test_update_port_with_address_pair[id-9599b337-272c-47fd-b3cf-509414414ac4]
----------------------------------------------------------------------------------------------------------------------------------------------------

Captured traceback:
~~~~~~~~~~~~~~~~~~~
    Traceback (most recent call last):

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 105, in test_update_port_with_address_pair
    self._update_port_with_address(self.ip_address)

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 100, in _update_port_with_address
    self.assertCountEqual(allowed_address_pair, allowed_address_pairs)

      File "/usr/lib/python3.8/unittest/case.py", line 1272, in assertCountEqual
    self.fail(msg)

      File "/opt/stack/tempest/.tox/venv/lib/python3.8/site-packages/unittest2/case.py", line 690, in fail
    raise self.failureException(msg)

    AssertionError: Element counts were not equal:
First has 1, Second has 0:  {'mac_address': 'fa:16:3e:fa:12:e7', 'ip_address': '172.20.0.5', 'active': True}
First has 0, Second has 1:  {'ip_address': '172.20.0.5', 'mac_address': 'fa:16:3e:fa:12:e7'}


Captured pythonlogging:
~~~~~~~~~~~~~~~~~~~~~~~
    2021-06-10 16:17:20,111 107847 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:test_update_port_with_address_pair): 201 POST http://10.222.0.23:9696/v2.0/ports 3.821s
2021-06-10 16:17:20,112 107847 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"network_id": "7d34dfe2-85c4-4cf2-8f3f-a68ac0006b21", "name": "tempest-AllowedAddressPairTestJSON-45217565"}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '737', 'x-openstack-request-id': 'req-0db5f0c4-9700-48e5-8418-ba6ebbf6ba74', 'date': 'Thu, 10 Jun 2021 16:17:20 GMT', 'connection': 'close', 'status': '201', 'content-location': 'http://10.222.0.23:9696/v2.0/ports'}
        Body: b'{"port":{"id":"a76bc757-7d9d-4f32-af01-5b86f403c8f6","name":"tempest-AllowedAddressPairTestJSON-45217565","network_id":"7d34dfe2-85c4-4cf2-8f3f-a68ac0006b21","tenant_id":"ac0f2d19bc534865b0c65be3bebb9a74","mac_address":"fa:16:3e:04:af:ad","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"cbfb220e-74af-4332-9c2a-8c895635d878","ip_address":"172.20.0.10"}],"project_id":"ac0f2d19bc534865b0c65be3bebb9a74","port_security_enabled":true,"security_groups":["20267a1e-7654-4788-9652-9cbb8f865e8f"],"binding:vnic_type":"normal","allowed_address_pairs":[],"extra_dhcp_opts":[],"description":"","tags":[],"created_at":"2021-06-10T16:17:17Z","updated_at":"2021-06-10T16:17:18Z","revision_number":1}}'
2021-06-10 16:17:21,854 107847 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:test_update_port_with_address_pair): 200 PUT http://10.222.0.23:9696/v2.0/ports/a76bc757-7d9d-4f32-af01-5b86f403c8f6 1.741s
2021-06-10 16:17:21,854 107847 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"allowed_address_pairs": [{"ip_address": "172.20.0.5", "mac_address": "fa:16:3e:fa:12:e7"}]}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '812', 'x-openstack-request-id': 'req-ca976f24-9e2a-4e8c-81f7-f274f88502f1', 'date': 'Thu, 10 Jun 2021 16:17:21 GMT', 'connection': 'close', 'status': '200', 'content-location': 'http://10.222.0.23:9696/v2.0/ports/a76bc757-7d9d-4f32-af01-5b86f403c8f6'}
        Body: b'{"port":{"id":"a76bc757-7d9d-4f32-af01-5b86f403c8f6","name":"tempest-AllowedAddressPairTestJSON-45217565","network_id":"7d34dfe2-85c4-4cf2-8f3f-a68ac0006b21","tenant_id":"ac0f2d19bc534865b0c65be3bebb9a74","mac_address":"fa:16:3e:04:af:ad","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"cbfb220e-74af-4332-9c2a-8c895635d878","ip_address":"172.20.0.10"}],"allowed_address_pairs":[{"mac_address":"fa:16:3e:fa:12:e7","ip_address":"172.20.0.5","active":true}],"extra_dhcp_opts":[],"security_groups":["20267a1e-7654-4788-9652-9cbb8f865e8f"],"description":"","binding:vnic_type":"normal","port_security_enabled":true,"tags":[],"created_at":"2021-06-10T16:17:17Z","updated_at":"2021-06-10T16:17:21Z","revision_number":2,"project_id":"ac0f2d19bc534865b0c65be3bebb9a74"}}'
2021-06-10 16:17:24,442 107847 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:_run_cleanups): 204 DELETE http://10.222.0.23:9696/v2.0/ports/a76bc757-7d9d-4f32-af01-5b86f403c8f6 2.574s
2021-06-10 16:17:24,442 107847 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-length': '0', 'x-openstack-request-id': 'req-7f10a4a6-35b4-4070-9f8d-eff67d014da9', 'date': 'Thu, 10 Jun 2021 16:17:24 GMT', 'connection': 'close', 'status': '204', 'content-location': 'http://10.222.0.23:9696/v2.0/ports/a76bc757-7d9d-4f32-af01-5b86f403c8f6'}
        Body: b''
2021-06-10 16:17:24,878 107847 INFO     [tempest.lib.common.rest_client] Request (AllowedAdd
    ressPairTestJSON:_run_cleanups): 404 GET http://10.222.0.23:9696/v2.0/ports/a76bc757-7d9d-4f32-af01-5b86f403c8f6 0.435s
2021-06-10 16:17:24,878 107847 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-type': 'application/json', 'content-length': '132', 'x-openstack-request-id': 'req-7ef1b45b-c33e-46ae-a8f8-96639f47b8fc', 'date': 'Thu, 10 Jun 2021 16:17:24 GMT', 'connection': 'close', 'status': '404', 'content-location': 'http://10.222.0.23:9696/v2.0/ports/a76bc757-7d9d-4f32-af01-5b86f403c8f6'}
        Body: b'{"NeutronError": {"type": "PortNotFound", "message": "Port a76bc757-7d9d-4f32-af01-5b86f403c8f6 could not be found.", "detail": ""}}'


tempest.api.network.test_allowed_address_pair.AllowedAddressPairTestJSON.test_update_port_with_cidr_address_pair[id-4d6d178f-34f6-4bff-a01c-0a2f8fe909e4]
---------------------------------------------------------------------------------------------------------------------------------------------------------

Captured traceback:
~~~~~~~~~~~~~~~~~~~
    Traceback (most recent call last):

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 110, in test_update_port_with_cidr_address_pair
    self._update_port_with_address(str(self.cidr))

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 100, in _update_port_with_address
    self.assertCountEqual(allowed_address_pair, allowed_address_pairs)

      File "/usr/lib/python3.8/unittest/case.py", line 1272, in assertCountEqual
    self.fail(msg)

      File "/opt/stack/tempest/.tox/venv/lib/python3.8/site-packages/unittest2/case.py", line 690, in fail
    raise self.failureException(msg)

    AssertionError: Element counts were not equal:
First has 1, Second has 0:  {'mac_address': 'fa:16:3e:fa:12:e7', 'ip_address': '172.20.0.0/16', 'active': True}
First has 0, Second has 1:  {'ip_address': '172.20.0.0/16', 'mac_address': 'fa:16:3e:fa:12:e7'}


Captured pythonlogging:
~~~~~~~~~~~~~~~~~~~~~~~
    2021-06-10 16:17:28,877 107847 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:test_update_port_with_cidr_address_pair): 201 POST http://10.222.0.23:9696/v2.0/ports 3.997s
2021-06-10 16:17:28,878 107847 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"network_id": "7d34dfe2-85c4-4cf2-8f3f-a68ac0006b21", "name": "tempest-AllowedAddressPairTestJSON-735834357"}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '737', 'x-openstack-request-id': 'req-0bbbc856-7939-49ae-9b54-26650531f28c', 'date': 'Thu, 10 Jun 2021 16:17:28 GMT', 'connection': 'close', 'status': '201', 'content-location': 'http://10.222.0.23:9696/v2.0/ports'}
        Body: b'{"port":{"id":"b25886b7-4e4a-4004-979e-9da4d7864893","name":"tempest-AllowedAddressPairTestJSON-735834357","network_id":"7d34dfe2-85c4-4cf2-8f3f-a68ac0006b21","tenant_id":"ac0f2d19bc534865b0c65be3bebb9a74","mac_address":"fa:16:3e:0f:62:42","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"cbfb220e-74af-4332-9c2a-8c895635d878","ip_address":"172.20.0.4"}],"project_id":"ac0f2d19bc534865b0c65be3bebb9a74","port_security_enabled":true,"security_groups":["20267a1e-7654-4788-9652-9cbb8f865e8f"],"binding:vnic_type":"normal","allowed_address_pairs":[],"extra_dhcp_opts":[],"description":"","tags":[],"created_at":"2021-06-10T16:17:25Z","updated_at":"2021-06-10T16:17:26Z","revision_number":1}}'
2021-06-10 16:17:32,155 107847 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:test_update_port_with_cidr_address_pair): 200 PUT http://10.222.0.23:9696/v2.0/ports/b25886b7-4e4a-4004-979e-9da4d7864893 3.277s
2021-06-10 16:17:32,155 107847 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"allowed_address_pairs": [{"ip_address": "172.20.0.0/16", "mac_address": "fa:16:3e:fa:12:e7"}]}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '815', 'x-openstack-request-id': 'req-41d565fd-8070-4b5a-985d-0b87979ac3a1', 'date': 'Thu, 10 Jun 2021 16:17:32 GMT', 'connection': 'close', 'status': '200', 'content-location': 'http://10.222.0.23:9696/v2.0/ports/b25886b7-4e4a-4004-979e-9da4d7864893'}
        Body: b'{"port":{"id":"b25886b7-4e4a-4004-979e-9da4d7864893","name":"tempest-AllowedAddressPairTestJSON-735834357","network_id":"7d34dfe2-85c4-4cf2-8f3f-a68ac0006b21","tenant_id":"ac0f2d19bc534865b0c65be3bebb9a74","mac_address":"fa:16:3e:0f:62:42","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"cbfb220e-74af-4332-9c2a-8c895635d878","ip_address":"172.20.0.4"}],"allowed_address_pairs":[{"mac_address":"fa:16:3e:fa:12:e7","ip_address":"172.20.0.0/16","active":true}],"extra_dhcp_opts":[],"security_groups":["20267a1e-7654-4788-9652-9cbb8f865e8f"],"description":"","binding:vnic_type":"normal","port_security_enabled":true,"tags":[],"created_at":"2021-06-10T16:17:25Z","updated_at":"2021-06-10T16:17:30Z","revision_number":2,"project_id":"ac0f2d19bc534865b0c65be3bebb9a74"}}'
2021-06-10 16:17:35,923 107847 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:_run_cleanups): 204 DELETE http://10.222.0.23:9696/v2.0/ports/b25886b7-4e4a-4004-979e-9da4d7864893 3.767s
2021-06-10 16:17:35,923 107847 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-length': '0', 'x-openstack-request-id': 'req-4d155ba5-1000-4dfe-9ede-25875cd316fc', 'date': 'Thu, 10 Jun 2021 16:17:35 GMT', 'connection': 'close', 'status': '204', 'content-location': 'http://10.222.0.23:9696/v2.0/ports/b25886b7-4e4a-4004-979e-9da4d7864893'}
        Body: b''
2021-06-10 16:17:36,130 107847 INFO     [tempest.lib.common.rest_client] Re
    quest (AllowedAddressPairTestJSON:_run_cleanups): 404 GET http://10.222.0.23:9696/v2.0/ports/b25886b7-4e4a-4004-979e-9da4d7864893 0.206s
2021-06-10 16:17:36,131 107847 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-type': 'application/json', 'content-length': '132', 'x-openstack-request-id': 'req-8477b4b2-36c2-453e-8a97-7fe3c3389933', 'date': 'Thu, 10 Jun 2021 16:17:36 GMT', 'connection': 'close', 'status': '404', 'content-location': 'http://10.222.0.23:9696/v2.0/ports/b25886b7-4e4a-4004-979e-9da4d7864893'}
        Body: b'{"NeutronError": {"type": "PortNotFound", "message": "Port b25886b7-4e4a-4004-979e-9da4d7864893 could not be found.", "detail": ""}}'


tempest.api.network.test_allowed_address_pair.AllowedAddressPairTestJSON.test_update_port_with_multiple_ip_mac_address_pair[id-b3f20091-6cd5-472b-8487-3516137df933]
--------------------------------------------------------------------------------------------------------------------------------------------------------------------

Captured traceback:
~~~~~~~~~~~~~~~~~~~
    Traceback (most recent call last):

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 129, in test_update_port_with_multiple_ip_mac_address_pair
    self._update_port_with_address(

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 100, in _update_port_with_address
    self.assertCountEqual(allowed_address_pair, allowed_address_pairs)

      File "/usr/lib/python3.8/unittest/case.py", line 1272, in assertCountEqual
    self.fail(msg)

      File "/opt/stack/tempest/.tox/venv/lib/python3.8/site-packages/unittest2/case.py", line 690, in fail
    raise self.failureException(msg)

    AssertionError: Element counts were not equal:
First has 1, Second has 0:  {'mac_address': 'fa:16:3e:b9:23:13', 'ip_address': '172.20.0.14', 'active': True}
First has 1, Second has 0:  {'mac_address': 'fa:16:3e:fa:12:e7', 'ip_address': '172.20.0.5', 'active': True}
First has 0, Second has 1:  {'ip_address': '172.20.0.5', 'mac_address': 'fa:16:3e:fa:12:e7'}
First has 0, Second has 1:  {'ip_address': '172.20.0.14', 'mac_address': 'fa:16:3e:b9:23:13'}


Captured pythonlogging:
~~~~~~~~~~~~~~~~~~~~~~~
    2021-06-10 16:17:43,419 107847 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:test_update_port_with_multiple_ip_mac_address_pair): 201 POST http://10.222.0.23:9696/v2.0/ports 7.286s
2021-06-10 16:17:43,419 107847 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"network_id": "7d34dfe2-85c4-4cf2-8f3f-a68ac0006b21", "name": "tempest-AllowedAddressPairTestJSON-2065946621"}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '739', 'x-openstack-request-id': 'req-a2eb175f-9aa4-48c2-b5bf-de368aebcafa', 'date': 'Thu, 10 Jun 2021 16:17:43 GMT', 'connection': 'close', 'status': '201', 'content-location': 'http://10.222.0.23:9696/v2.0/ports'}
        Body: b'{"port":{"id":"e1d2dd3f-8677-43cc-b845-0b713b0ad83e","name":"tempest-AllowedAddressPairTestJSON-2065946621","network_id":"7d34dfe2-85c4-4cf2-8f3f-a68ac0006b21","tenant_id":"ac0f2d19bc534865b0c65be3bebb9a74","mac_address":"fa:16:3e:b9:23:13","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"cbfb220e-74af-4332-9c2a-8c895635d878","ip_address":"172.20.0.14"}],"project_id":"ac0f2d19bc534865b0c65be3bebb9a74","port_security_enabled":true,"security_groups":["20267a1e-7654-4788-9652-9cbb8f865e8f"],"binding:vnic_type":"normal","allowed_address_pairs":[],"extra_dhcp_opts":[],"description":"","tags":[],"created_at":"2021-06-10T16:17:37Z","updated_at":"2021-06-10T16:17:39Z","revision_number":1}}'
2021-06-10 16:17:49,680 107847 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:test_update_port_with_multiple_ip_mac_address_pair): 201 POST http://10.222.0.23:9696/v2.0/ports 6.260s
2021-06-10 16:17:49,680 107847 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"network_id": "7d34dfe2-85c4-4cf2-8f3f-a68ac0006b21", "name": "tempest-AllowedAddressPairTestJSON-1524610772"}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '739', 'x-openstack-request-id': 'req-cc66a95c-8126-450a-9985-d213fa18d96b', 'date': 'Thu, 10 Jun 2021 16:17:49 GMT', 'connection': 'close', 'status': '201', 'content-location': 'http://10.222.0.23:9696/v2.0/ports'}
        Body: b'{"port":{"id":"5bb74d1d-9981-4f77-a087-499d82b3b60c","name":"tempest-AllowedAddressPairTestJSON-1524610772","network_id":"7d34dfe2-85c4-4cf2-8f3f-a68ac0006b21","tenant_id":"ac0f2d19bc534865b0c65be3bebb9a74","mac_address":"fa:16:3e:88:92:6b","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"cbfb220e-74af-4332-9c2a-8c895635d878","ip_address":"172.20.0.13"}],"project_id":"ac0f2d19bc534865b0c65be3bebb9a74","port_security_enabled":true,"security_groups":["20267a1e-7654-4788-9652-9cbb8f865e8f"],"binding:vnic_type":"normal","allowed_address_pairs":[],"extra_dhcp_opts":[],"description":"","tags":[],"created_at":"2021-06-10T16:17:45Z","updated_at":"2021-06-10T16:17:45Z","revision_number":1}}'
2021-06-10 16:17:52,433 107847 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:test_update_port_with_multiple_ip_mac_address_pair): 200 PUT http://10.222.0.23:9696/v2.0/ports/5bb74d1d-9981-4f77-a087-499d82b3b60c 2.752s
2021-06-10 16:17:52,433 107847 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"allowed_address_pairs": [{"ip_address": "172.20.0.5", "mac_address": "fa:16:3e:fa:12:e7"}, {"ip_address": "172.20.0.14", "mac_address": "fa:16:3e:b9:23:13"}]}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '891', 'x-openstack-request-id': 'req-90eada8f-92f5-4773-8e03-5890308179f8', 'date': 'Thu, 10 Jun 2021 16:17:52 GMT', 'connection': 'close', 'status': '200', 'content-location': 'http://10.222.0.23:9696/v2.0/ports/5bb
    74d1d-9981-4f77-a087-499d82b3b60c'}
        Body: b'{"port":{"id":"5bb74d1d-9981-4f77-a087-499d82b3b60c","name":"tempest-AllowedAddressPairTestJSON-1524610772","network_id":"7d34dfe2-85c4-4cf2-8f3f-a68ac0006b21","tenant_id":"ac0f2d19bc534865b0c65be3bebb9a74","mac_address":"fa:16:3e:88:92:6b","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"cbfb220e-74af-4332-9c2a-8c895635d878","ip_address":"172.20.0.13"}],"allowed_address_pairs":[{"mac_address":"fa:16:3e:b9:23:13","ip_address":"172.20.0.14","active":true},{"mac_address":"fa:16:3e:fa:12:e7","ip_address":"172.20.0.5","active":true}],"extra_dhcp_opts":[],"security_groups":["20267a1e-7654-4788-9652-9cbb8f865e8f"],"description":"","binding:vnic_type":"normal","port_security_enabled":true,"tags":[],"created_at":"2021-06-10T16:17:45Z","updated_at":"2021-06-10T16:17:51Z","revision_number":2,"project_id":"ac0f2d19bc534865b0c65be3bebb9a74"}}'
2021-06-10 16:17:54,844 107847 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:_run_cleanups): 204 DELETE http://10.222.0.23:9696/v2.0/ports/5bb74d1d-9981-4f77-a087-499d82b3b60c 2.410s
2021-06-10 16:17:54,844 107847 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-length': '0', 'x-openstack-request-id': 'req-30f68030-7876-415c-9f87-5eff7412876f', 'date': 'Thu, 10 Jun 2021 16:17:54 GMT', 'connection': 'close', 'status': '204', 'content-location': 'http://10.222.0.23:9696/v2.0/ports/5bb74d1d-9981-4f77-a087-499d82b3b60c'}
        Body: b''
2021-06-10 16:17:54,966 107847 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:_run_cleanups): 404 GET http://10.222.0.23:9696/v2.0/ports/5bb74d1d-9981-4f77-a087-499d82b3b60c 0.121s
2021-06-10 16:17:54,967 107847 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-type': 'application/json', 'content-length': '132', 'x-openstack-request-id': 'req-5adf0863-98e7-412a-a615-518ee2b080ba', 'date': 'Thu, 10 Jun 2021 16:17:54 GMT', 'connection': 'close', 'status': '404', 'content-location': 'http://10.222.0.23:9696/v2.0/ports/5bb74d1d-9981-4f77-a087-499d82b3b60c'}
        Body: b'{"NeutronError": {"type": "PortNotFound", "message": "Port 5bb74d1d-9981-4f77-a087-499d82b3b60c could not be found.", "detail": ""}}'
2021-06-10 16:17:56,858 107847 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:_run_cleanups): 204 DELETE http://10.222.0.23:9696/v2.0/ports/e1d2dd3f-8677-43cc-b845-0b713b0ad83e 1.891s
2021-06-10 16:17:56,859 107847 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-length': '0', 'x-openstack-request-id': 'req-5700a751-dae1-480d-947e-0349d9b3ad26', 'date': 'Thu, 10 Jun 2021 16:17:56 GMT', 'connection': 'close', 'status': '204', 'content-location': 'http://10.222.0.23:9696/v2.0/ports/e1d2dd3f-8677-43cc-b845-0b713b0ad83e'}
        Body: b''
2021-06-10 16:17:56,918 107847 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairTestJSON:_run_cleanups): 404 GET http://10.222.0.23:9696/v2.0/ports/e1d2dd3f-8677-43cc-b845-0b713b0ad83e 0.059s
2021-06-10 16:17:56,918 107847 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-type': 'application/json', 'content-length': '132', 'x-openstack-request-id': 'req-98f9085e-fa8d-4b02-becd-9a34dc2d7c8a', 'date': 'Thu, 10 Jun 2021 16:17:56 GMT', 'connection': 'close', 'status': '404', 'content-location': 'http://10.222.0.23:9696/v2.0/ports/e1d2dd3f-8677-43cc-b845-0b713b0ad83e'}
        Body: b'{"NeutronError"
    : {"type": "PortNotFound", "message": "Port e1d2dd3f-8677-43cc-b845-0b713b0ad83e could not be found.", "detail": ""}}'


tempest.api.network.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON.test_update_port_with_address_pair[id-9599b337-272c-47fd-b3cf-509414414ac4]
--------------------------------------------------------------------------------------------------------------------------------------------------------

Captured traceback:
~~~~~~~~~~~~~~~~~~~
    Traceback (most recent call last):

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 105, in test_update_port_with_address_pair
    self._update_port_with_address(self.ip_address)

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 100, in _update_port_with_address
    self.assertCountEqual(allowed_address_pair, allowed_address_pairs)

      File "/usr/lib/python3.8/unittest/case.py", line 1272, in assertCountEqual
    self.fail(msg)

      File "/opt/stack/tempest/.tox/venv/lib/python3.8/site-packages/unittest2/case.py", line 690, in fail
    raise self.failureException(msg)

    AssertionError: Element counts were not equal:
First has 1, Second has 0:  {'mac_address': 'fa:16:3e:0c:19:86', 'ip_address': '2001:db8::285', 'active': True}
First has 0, Second has 1:  {'ip_address': '2001:db8::285', 'mac_address': 'fa:16:3e:0c:19:86'}


Captured pythonlogging:
~~~~~~~~~~~~~~~~~~~~~~~
    2021-06-10 16:18:34,002 107846 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:test_update_port_with_address_pair): 201 POST http://10.222.0.23:9696/v2.0/ports 2.536s
2021-06-10 16:18:34,002 107846 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"network_id": "761488b1-e6ea-4fa0-8b46-c363f1d0c503", "name": "tempest-AllowedAddressPairIpV6TestJSON-893704550"}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '743', 'x-openstack-request-id': 'req-3934138c-26d4-44ba-9503-7be0caef49eb', 'date': 'Thu, 10 Jun 2021 16:18:34 GMT', 'connection': 'close', 'status': '201', 'content-location': 'http://10.222.0.23:9696/v2.0/ports'}
        Body: b'{"port":{"id":"30602475-9f66-4338-b5e7-b7ec4c791dd6","name":"tempest-AllowedAddressPairIpV6TestJSON-893704550","network_id":"761488b1-e6ea-4fa0-8b46-c363f1d0c503","tenant_id":"4d39a0d7deed44f5b85309038a983c91","mac_address":"fa:16:3e:72:fa:8c","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"cae2756a-16b0-4204-bb55-2195a0ce325e","ip_address":"2001:db8::92"}],"project_id":"4d39a0d7deed44f5b85309038a983c91","port_security_enabled":true,"security_groups":["2dd0b0d8-2676-44e2-9c24-c5770612c7c4"],"binding:vnic_type":"normal","allowed_address_pairs":[],"extra_dhcp_opts":[],"description":"","tags":[],"created_at":"2021-06-10T16:18:32Z","updated_at":"2021-06-10T16:18:32Z","revision_number":1}}'
2021-06-10 16:18:36,081 107846 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:test_update_port_with_address_pair): 200 PUT http://10.222.0.23:9696/v2.0/ports/30602475-9f66-4338-b5e7-b7ec4c791dd6 2.078s
2021-06-10 16:18:36,081 107846 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"allowed_address_pairs": [{"ip_address": "2001:db8::285", "mac_address": "fa:16:3e:0c:19:86"}]}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '821', 'x-openstack-request-id': 'req-4e8d5b5e-adbb-4e07-9722-177aa80fd6ea', 'date': 'Thu, 10 Jun 2021 16:18:36 GMT', 'connection': 'close', 'status': '200', 'content-location': 'http://10.222.0.23:9696/v2.0/ports/30602475-9f66-4338-b5e7-b7ec4c791dd6'}
        Body: b'{"port":{"id":"30602475-9f66-4338-b5e7-b7ec4c791dd6","name":"tempest-AllowedAddressPairIpV6TestJSON-893704550","network_id":"761488b1-e6ea-4fa0-8b46-c363f1d0c503","tenant_id":"4d39a0d7deed44f5b85309038a983c91","mac_address":"fa:16:3e:72:fa:8c","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"cae2756a-16b0-4204-bb55-2195a0ce325e","ip_address":"2001:db8::92"}],"allowed_address_pairs":[{"mac_address":"fa:16:3e:0c:19:86","ip_address":"2001:db8::285","active":true}],"extra_dhcp_opts":[],"security_groups":["2dd0b0d8-2676-44e2-9c24-c5770612c7c4"],"description":"","binding:vnic_type":"normal","port_security_enabled":true,"tags":[],"created_at":"2021-06-10T16:18:32Z","updated_at":"2021-06-10T16:18:35Z","revision_number":2,"project_id":"4d39a0d7deed44f5b85309038a983c91"}}'
2021-06-10 16:18:38,580 107846 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:_run_cleanups): 204 DELETE http://10.222.0.23:9696/v2.0/ports/30602475-9f66-4338-b5e7-b7ec4c791dd6 2.496s
2021-06-10 16:18:38,580 107846 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-length': '0', 'x-openstack-request-id': 'req-44dcef3c-c2c1-4955-bf43-c00f60ece066', 'date': 'Thu, 10 Jun 2021 16:18:38 GMT', 'connection': 'close', 'status': '204', 'content-location': 'http://10.222.0.23:9696/v2.0/ports/30602475-9f66-4338-b5e7-b7ec4c791dd6'}
        Body: b''
2021-06-10 16:18:38,690 107846 INFO     [tempest.lib.comm
    on.rest_client] Request (AllowedAddressPairIpV6TestJSON:_run_cleanups): 404 GET http://10.222.0.23:9696/v2.0/ports/30602475-9f66-4338-b5e7-b7ec4c791dd6 0.109s
2021-06-10 16:18:38,690 107846 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-type': 'application/json', 'content-length': '132', 'x-openstack-request-id': 'req-08fdd8a7-3801-479f-896b-b07dfc50e5de', 'date': 'Thu, 10 Jun 2021 16:18:38 GMT', 'connection': 'close', 'status': '404', 'content-location': 'http://10.222.0.23:9696/v2.0/ports/30602475-9f66-4338-b5e7-b7ec4c791dd6'}
        Body: b'{"NeutronError": {"type": "PortNotFound", "message": "Port 30602475-9f66-4338-b5e7-b7ec4c791dd6 could not be found.", "detail": ""}}'


tempest.api.network.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON.test_update_port_with_cidr_address_pair[id-4d6d178f-34f6-4bff-a01c-0a2f8fe909e4]
-------------------------------------------------------------------------------------------------------------------------------------------------------------

Captured traceback:
~~~~~~~~~~~~~~~~~~~
    Traceback (most recent call last):

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 110, in test_update_port_with_cidr_address_pair
    self._update_port_with_address(str(self.cidr))

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 100, in _update_port_with_address
    self.assertCountEqual(allowed_address_pair, allowed_address_pairs)

      File "/usr/lib/python3.8/unittest/case.py", line 1272, in assertCountEqual
    self.fail(msg)

      File "/opt/stack/tempest/.tox/venv/lib/python3.8/site-packages/unittest2/case.py", line 690, in fail
    raise self.failureException(msg)

    AssertionError: Element counts were not equal:
First has 1, Second has 0:  {'mac_address': 'fa:16:3e:0c:19:86', 'ip_address': '2001:db8::/48', 'active': True}
First has 0, Second has 1:  {'ip_address': '2001:db8::/48', 'mac_address': 'fa:16:3e:0c:19:86'}


Captured pythonlogging:
~~~~~~~~~~~~~~~~~~~~~~~
    2021-06-10 16:18:41,249 107846 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:test_update_port_with_cidr_address_pair): 201 POST http://10.222.0.23:9696/v2.0/ports 2.557s
2021-06-10 16:18:41,249 107846 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"network_id": "761488b1-e6ea-4fa0-8b46-c363f1d0c503", "name": "tempest-AllowedAddressPairIpV6TestJSON-1776996997"}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '745', 'x-openstack-request-id': 'req-96993bbf-d696-453f-b4ca-260cc97bb413', 'date': 'Thu, 10 Jun 2021 16:18:41 GMT', 'connection': 'close', 'status': '201', 'content-location': 'http://10.222.0.23:9696/v2.0/ports'}
        Body: b'{"port":{"id":"33bfaa36-0cd9-4e99-907a-8f84db248b82","name":"tempest-AllowedAddressPairIpV6TestJSON-1776996997","network_id":"761488b1-e6ea-4fa0-8b46-c363f1d0c503","tenant_id":"4d39a0d7deed44f5b85309038a983c91","mac_address":"fa:16:3e:b2:fe:25","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"cae2756a-16b0-4204-bb55-2195a0ce325e","ip_address":"2001:db8::18f"}],"project_id":"4d39a0d7deed44f5b85309038a983c91","port_security_enabled":true,"security_groups":["2dd0b0d8-2676-44e2-9c24-c5770612c7c4"],"binding:vnic_type":"normal","allowed_address_pairs":[],"extra_dhcp_opts":[],"description":"","tags":[],"created_at":"2021-06-10T16:18:39Z","updated_at":"2021-06-10T16:18:39Z","revision_number":1}}'
2021-06-10 16:18:43,274 107846 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:test_update_port_with_cidr_address_pair): 200 PUT http://10.222.0.23:9696/v2.0/ports/33bfaa36-0cd9-4e99-907a-8f84db248b82 2.024s
2021-06-10 16:18:43,275 107846 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"allowed_address_pairs": [{"ip_address": "2001:db8::/48", "mac_address": "fa:16:3e:0c:19:86"}]}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '823', 'x-openstack-request-id': 'req-c00d3af3-7e8d-4d81-84b2-772d8ca43e5b', 'date': 'Thu, 10 Jun 2021 16:18:43 GMT', 'connection': 'close', 'status': '200', 'content-location': 'http://10.222.0.23:9696/v2.0/ports/33bfaa36-0cd9-4e99-907a-8f84db248b82'}
        Body: b'{"port":{"id":"33bfaa36-0cd9-4e99-907a-8f84db248b82","name":"tempest-AllowedAddressPairIpV6TestJSON-1776996997","network_id":"761488b1-e6ea-4fa0-8b46-c363f1d0c503","tenant_id":"4d39a0d7deed44f5b85309038a983c91","mac_address":"fa:16:3e:b2:fe:25","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"cae2756a-16b0-4204-bb55-2195a0ce325e","ip_address":"2001:db8::18f"}],"allowed_address_pairs":[{"mac_address":"fa:16:3e:0c:19:86","ip_address":"2001:db8::/48","active":true}],"extra_dhcp_opts":[],"security_groups":["2dd0b0d8-2676-44e2-9c24-c5770612c7c4"],"description":"","binding:vnic_type":"normal","port_security_enabled":true,"tags":[],"created_at":"2021-06-10T16:18:39Z","updated_at":"2021-06-10T16:18:42Z","revision_number":2,"project_id":"4d39a0d7deed44f5b85309038a983c91"}}'
2021-06-10 16:18:44,680 107846 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:_run_cleanups): 204 DELETE http://10.222.0.23:9696/v2.0/ports/33bfaa36-0cd9-4e99-907a-8f84db248b82 1.404s
2021-06-10 16:18:44,680 107846 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-length': '0', 'x-openstack-request-id': 'req-c00bdd86-8601-4acd-8060-2ed127d95519', 'date': 'Thu, 10 Jun 2021 16:18:44 GMT', 'connection': 'close', 'status': '204', 'content-location': 'http://10.222.0.23:9696/v2.0/ports/33bfaa36-0cd9-4e99-907a-8f84db248b82'}
        Body: b''
2021-06-10 16:18:44,726 107846 INFO     [t
    empest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:_run_cleanups): 404 GET http://10.222.0.23:9696/v2.0/ports/33bfaa36-0cd9-4e99-907a-8f84db248b82 0.045s
2021-06-10 16:18:44,726 107846 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-type': 'application/json', 'content-length': '132', 'x-openstack-request-id': 'req-12f5f59e-06f5-4997-a87b-add147b0fa0c', 'date': 'Thu, 10 Jun 2021 16:18:44 GMT', 'connection': 'close', 'status': '404', 'content-location': 'http://10.222.0.23:9696/v2.0/ports/33bfaa36-0cd9-4e99-907a-8f84db248b82'}
        Body: b'{"NeutronError": {"type": "PortNotFound", "message": "Port 33bfaa36-0cd9-4e99-907a-8f84db248b82 could not be found.", "detail": ""}}'


tempest.api.network.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON.test_update_port_with_multiple_ip_mac_address_pair[id-b3f20091-6cd5-472b-8487-3516137df933]
------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Captured traceback:
~~~~~~~~~~~~~~~~~~~
    Traceback (most recent call last):

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 129, in test_update_port_with_multiple_ip_mac_address_pair
    self._update_port_with_address(

      File "/opt/stack/tempest/tempest/api/network/test_allowed_address_pair.py", line 100, in _update_port_with_address
    self.assertCountEqual(allowed_address_pair, allowed_address_pairs)

      File "/usr/lib/python3.8/unittest/case.py", line 1272, in assertCountEqual
    self.fail(msg)

      File "/opt/stack/tempest/.tox/venv/lib/python3.8/site-packages/unittest2/case.py", line 690, in fail
    raise self.failureException(msg)

    AssertionError: Element counts were not equal:
First has 1, Second has 0:  {'mac_address': 'fa:16:3e:0c:19:86', 'ip_address': '2001:db8::285', 'active': True}
First has 1, Second has 0:  {'mac_address': 'fa:16:3e:27:ac:8a', 'ip_address': '2001:db8::10f', 'active': True}
First has 0, Second has 1:  {'ip_address': '2001:db8::285', 'mac_address': 'fa:16:3e:0c:19:86'}
First has 0, Second has 1:  {'ip_address': '2001:db8::10f', 'mac_address': 'fa:16:3e:27:ac:8a'}


Captured pythonlogging:
~~~~~~~~~~~~~~~~~~~~~~~
    2021-06-10 16:18:47,622 107846 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:test_update_port_with_multiple_ip_mac_address_pair): 201 POST http://10.222.0.23:9696/v2.0/ports 2.894s
2021-06-10 16:18:47,623 107846 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"network_id": "761488b1-e6ea-4fa0-8b46-c363f1d0c503", "name": "tempest-AllowedAddressPairIpV6TestJSON-286246298"}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '744', 'x-openstack-request-id': 'req-4587b2f2-8594-44a6-bfba-c315cf1ed189', 'date': 'Thu, 10 Jun 2021 16:18:47 GMT', 'connection': 'close', 'status': '201', 'content-location': 'http://10.222.0.23:9696/v2.0/ports'}
        Body: b'{"port":{"id":"0a31381f-3ff3-44f9-b81b-b051ed5fa052","name":"tempest-AllowedAddressPairIpV6TestJSON-286246298","network_id":"761488b1-e6ea-4fa0-8b46-c363f1d0c503","tenant_id":"4d39a0d7deed44f5b85309038a983c91","mac_address":"fa:16:3e:27:ac:8a","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"cae2756a-16b0-4204-bb55-2195a0ce325e","ip_address":"2001:db8::10f"}],"project_id":"4d39a0d7deed44f5b85309038a983c91","port_security_enabled":true,"security_groups":["2dd0b0d8-2676-44e2-9c24-c5770612c7c4"],"binding:vnic_type":"normal","allowed_address_pairs":[],"extra_dhcp_opts":[],"description":"","tags":[],"created_at":"2021-06-10T16:18:45Z","updated_at":"2021-06-10T16:18:46Z","revision_number":1}}'
2021-06-10 16:18:50,597 107846 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:test_update_port_with_multiple_ip_mac_address_pair): 201 POST http://10.222.0.23:9696/v2.0/ports 2.974s
2021-06-10 16:18:50,598 107846 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"network_id": "761488b1-e6ea-4fa0-8b46-c363f1d0c503", "name": "tempest-AllowedAddressPairIpV6TestJSON-901688900"}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '744', 'x-openstack-request-id': 'req-2abb5129-00e5-452a-a658-aca0f7632fe6', 'date': 'Thu, 10 Jun 2021 16:18:50 GMT', 'connection': 'close', 'status': '201', 'content-location': 'http://10.222.0.23:9696/v2.0/ports'}
        Body: b'{"port":{"id":"0bd7dfe6-992d-4996-a809-be608e42cfb7","name":"tempest-AllowedAddressPairIpV6TestJSON-901688900","network_id":"761488b1-e6ea-4fa0-8b46-c363f1d0c503","tenant_id":"4d39a0d7deed44f5b85309038a983c91","mac_address":"fa:16:3e:12:af:6d","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"cae2756a-16b0-4204-bb55-2195a0ce325e","ip_address":"2001:db8::213"}],"project_id":"4d39a0d7deed44f5b85309038a983c91","port_security_enabled":true,"security_groups":["2dd0b0d8-2676-44e2-9c24-c5770612c7c4"],"binding:vnic_type":"normal","allowed_address_pairs":[],"extra_dhcp_opts":[],"description":"","tags":[],"created_at":"2021-06-10T16:18:48Z","updated_at":"2021-06-10T16:18:49Z","revision_number":1}}'
2021-06-10 16:18:54,021 107846 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:test_update_port_with_multiple_ip_mac_address_pair): 200 PUT http://10.222.0.23:9696/v2.0/ports/0bd7dfe6-992d-4996-a809-be608e42cfb7 3.423s
2021-06-10 16:18:54,021 107846 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: {"port": {"allowed_address_pairs": [{"ip_address": "2001:db8::285", "mac_address": "fa:16:3e:0c:19:86"}, {"ip_address": "2001:db8::10f", "mac_address": "fa:16:3e:27:ac:8a"}]}}
    Response - Headers: {'content-type': 'application/json', 'content-length': '901', 'x-openstack-request-id': 'req-4e6b9658-5017-402f-afa3-12bbc227e437', 'date': 'Thu, 10 Jun 2021 16:18:54 GMT', 'connection': 'close', 'status': '200', 'content-location': 'http:
    //10.222.0.23:9696/v2.0/ports/0bd7dfe6-992d-4996-a809-be608e42cfb7'}
        Body: b'{"port":{"id":"0bd7dfe6-992d-4996-a809-be608e42cfb7","name":"tempest-AllowedAddressPairIpV6TestJSON-901688900","network_id":"761488b1-e6ea-4fa0-8b46-c363f1d0c503","tenant_id":"4d39a0d7deed44f5b85309038a983c91","mac_address":"fa:16:3e:12:af:6d","admin_state_up":true,"status":"DOWN","device_id":"","device_owner":"","fixed_ips":[{"subnet_id":"cae2756a-16b0-4204-bb55-2195a0ce325e","ip_address":"2001:db8::213"}],"allowed_address_pairs":[{"mac_address":"fa:16:3e:0c:19:86","ip_address":"2001:db8::285","active":true},{"mac_address":"fa:16:3e:27:ac:8a","ip_address":"2001:db8::10f","active":true}],"extra_dhcp_opts":[],"security_groups":["2dd0b0d8-2676-44e2-9c24-c5770612c7c4"],"description":"","binding:vnic_type":"normal","port_security_enabled":true,"tags":[],"created_at":"2021-06-10T16:18:48Z","updated_at":"2021-06-10T16:18:52Z","revision_number":2,"project_id":"4d39a0d7deed44f5b85309038a983c91"}}'
2021-06-10 16:18:56,418 107846 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:_run_cleanups): 204 DELETE http://10.222.0.23:9696/v2.0/ports/0bd7dfe6-992d-4996-a809-be608e42cfb7 2.395s
2021-06-10 16:18:56,418 107846 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-length': '0', 'x-openstack-request-id': 'req-b51912c5-fb48-496d-96a6-c9fc02ad2979', 'date': 'Thu, 10 Jun 2021 16:18:56 GMT', 'connection': 'close', 'status': '204', 'content-location': 'http://10.222.0.23:9696/v2.0/ports/0bd7dfe6-992d-4996-a809-be608e42cfb7'}
        Body: b''
2021-06-10 16:18:56,559 107846 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:_run_cleanups): 404 GET http://10.222.0.23:9696/v2.0/ports/0bd7dfe6-992d-4996-a809-be608e42cfb7 0.141s
2021-06-10 16:18:56,560 107846 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-type': 'application/json', 'content-length': '132', 'x-openstack-request-id': 'req-63317b29-67b6-4c74-83ff-df2932d64851', 'date': 'Thu, 10 Jun 2021 16:18:56 GMT', 'connection': 'close', 'status': '404', 'content-location': 'http://10.222.0.23:9696/v2.0/ports/0bd7dfe6-992d-4996-a809-be608e42cfb7'}
        Body: b'{"NeutronError": {"type": "PortNotFound", "message": "Port 0bd7dfe6-992d-4996-a809-be608e42cfb7 could not be found.", "detail": ""}}'
2021-06-10 16:18:58,453 107846 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:_run_cleanups): 204 DELETE http://10.222.0.23:9696/v2.0/ports/0a31381f-3ff3-44f9-b81b-b051ed5fa052 1.892s
2021-06-10 16:18:58,453 107846 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-length': '0', 'x-openstack-request-id': 'req-707751d5-3de4-4d63-9e03-2f55b06df736', 'date': 'Thu, 10 Jun 2021 16:18:58 GMT', 'connection': 'close', 'status': '204', 'content-location': 'http://10.222.0.23:9696/v2.0/ports/0a31381f-3ff3-44f9-b81b-b051ed5fa052'}
        Body: b''
2021-06-10 16:18:58,666 107846 INFO     [tempest.lib.common.rest_client] Request (AllowedAddressPairIpV6TestJSON:_run_cleanups): 404 GET http://10.222.0.23:9696/v2.0/ports/0a31381f-3ff3-44f9-b81b-b051ed5fa052 0.212s
2021-06-10 16:18:58,666 107846 DEBUG    [tempest.lib.common.rest_client] Request - Headers: {'Content-Type': 'application/json', 'Accept': 'application/json', 'X-Auth-Token': '<omitted>'}
        Body: None
    Response - Headers: {'content-type': 'application/json', 'content-length': '132', 'x-openstack-request-id': 'req-a2d7ac1f-4d08-4d2c-a8ce-c4c59ca57ba5', 'date': 'Thu, 10 Jun 2021 16:18:58 GMT', 'connection': 'close', 'status': '404', 'content-location': 'http://10.222.0.23:9696/v2.0/ports/0a31381f-3f
    f3-44f9-b81b-b051ed5fa052'}
        Body: b'{"NeutronError": {"type": "PortNotFound", "message": "Port 0a31381f-3ff3-44f9-b81b-b051ed5fa052 could not be found.", "detail": ""}}'



======
Totals
======
Ran: 282 tests in 1188.3504 sec.
 - Passed: 271
 - Skipped: 5
 - Expected Fail: 0
 - Unexpected Success: 0
 - Failed: 6
Sum of execute time for each test: 4100.9670 sec.

==============
Worker Balance
==============
 - Worker 0 (44 tests) => 0:19:46.064804
 - Worker 1 (25 tests) => 0:08:37.687017
 - Worker 2 (31 tests) => 0:08:27.794599
 - Worker 3 (48 tests) => 0:07:59.895788
 - Worker 4 (21 tests) => 0:03:31.249999
 - Worker 5 (57 tests) => 0:16:49.317909
 - Worker 6 (21 tests) => 0:06:49.623453
 - Worker 7 (35 tests) => 0:07:52.793261
{0} tempest.api.compute.admin.test_servers_negative.ServersAdminNegativeTestJSON.test_resize_server_using_overlimit_ram [0.411919s] ... ok
{0} tempest.api.compute.admin.test_servers_negative.ServersAdminNegativeTestJSON.test_resize_server_using_overlimit_vcpus [0.361850s] ... ok
{0} tempest.api.compute.servers.test_delete_server.DeleteServersTestJSON.test_delete_server_while_in_verify_resize_state [48.441279s] ... ok
{0} tempest.api.compute.servers.test_disk_config.ServerDiskConfigTestJSON.test_resize_server_from_auto_to_manual [47.092171s] ... ok
{0} tempest.api.compute.servers.test_disk_config.ServerDiskConfigTestJSON.test_resize_server_from_manual_to_auto [43.879000s] ... ok
{0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_confirm [25.570591s] ... ok
{0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_confirm_from_stopped [83.014534s] ... ok
{0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_revert [81.521943s] ... ok
{0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_revert_with_volume_attached [142.776836s] ... ok
{0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_nonexistent_server [0.503501s] ... ok
{0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_non_existent_flavor [0.592927s] ... ok
{0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_null_flavor [0.500721s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6Test.test_create_delete_subnet_all_attributes [1.813794s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6Test.test_create_delete_subnet_with_allocation_pools [1.843942s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6Test.test_create_delete_subnet_with_default_gw [0.945674s] ... ok
{0} tempest.api.network.test_networks.NetworksIpV6Test.test_delete_network_with_subnet [2.314788s] ... ok
{0} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_router_add_gateway_net_not_external_returns_400 [1.253188s] ... ok
{0} tempest.scenario.test_encrypted_cinder_volumes.TestEncryptedCinderVolumes.test_encrypted_cinder_volumes_cryptsetup [37.177506s] ... ok
{0} tempest.scenario.test_encrypted_cinder_volumes.TestEncryptedCinderVolumes.test_encrypted_cinder_volumes_luks [38.390239s] ... ok
{0} tempest.scenario.test_minimum_basic.TestMinimumBasicScenario.test_minimum_basic_scenario [123.233311s] ... ok
{0} tempest.scenario.test_network_advanced_server_ops.TestNetworkAdvancedServerOps.test_server_connectivity_pause_unpause [65.243655s] ... ok
{0} tempest.scenario.test_network_advanced_server_ops.TestNetworkAdvancedServerOps.test_server_connectivity_reboot [102.700042s] ... ok
{0} tempest.scenario.test_network_advanced_server_ops.TestNetworkAdvancedServerOps.test_server_connectivity_resize [107.458732s] ... ok
{0} tempest.scenario.test_network_advanced_server_ops.TestNetworkAdvancedServerOps.test_server_connectivity_stop_start [118.654691s] ... ok
{0} tempest.scenario.test_network_advanced_server_ops.TestNetworkAdvancedServerOps.test_server_connectivity_suspend_resume [74.888743s] ... ok
{0} tempest.scenario.test_shelve_instance.TestShelveInstance.test_shelve_instance [260.383726s] ... ok
{0} tempest.scenario.test_shelve_instance.TestShelveInstance.test_shelve_volume_backed_instance [284.005226s] ... ok
{0} tempest.scenario.test_snapshot_pattern.TestSnapshotPattern.test_snapshot_pattern [304.019754s] ... ok

======
Totals
======
Ran: 28 tests in 2223.7864 sec.
 - Passed: 28
 - Skipped: 0
 - Expected Fail: 0
 - Unexpected Success: 0
 - Failed: 0
Sum of execute time for each test: 1998.9943 sec.

==============
Worker Balance
==============
 - Worker 0 (28 tests) => 0:37:03.786357
tempest.api.network.test_allowed_address_pair.AllowedAddressPairTestJSON.test_update_port_with_address_pair[id-9599b337-272c-47fd-b3cf-509414414ac4]
tempest.api.network.test_allowed_address_pair.AllowedAddressPairTestJSON.test_update_port_with_cidr_address_pair[id-4d6d178f-34f6-4bff-a01c-0a2f8fe909e4]
tempest.api.network.test_allowed_address_pair.AllowedAddressPairTestJSON.test_update_port_with_multiple_ip_mac_address_pair[id-b3f20091-6cd5-472b-8487-3516137df933]
tempest.api.network.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON.test_update_port_with_address_pair[id-9599b337-272c-47fd-b3cf-509414414ac4]
tempest.api.network.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON.test_update_port_with_cidr_address_pair[id-4d6d178f-34f6-4bff-a01c-0a2f8fe909e4]
tempest.api.network.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON.test_update_port_with_multiple_ip_mac_address_pair[id-b3f20091-6cd5-472b-8487-3516137df933]
~
Exit code: 1