/opt/stack/tempest ~
Initializing stestr
all-plugin create: /opt/stack/tempest/.tox/all-plugin
all-plugin installdeps: -chttps://releases.openstack.org/constraints/upper/master, -r/opt/stack/tempest/requirements.txt
all-plugin develop-inst: /opt/stack/tempest
all-plugin installed: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead,  from cryptography.utils import int_from_bytes,/usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead,  from cryptography.utils import int_from_bytes,alembic==1.7.6,amqp==5.0.9,aniso8601==9.0.1,appdirs==1.4.4,attrs==21.4.0,Automat==0.8.0,automaton==2.5.0,autopage==0.5.0,bcrypt==3.2.0,beautifulsoup4==4.10.0,blinker==1.4,boto3==1.21.7,botocore==1.24.7,cachetools==5.0.0,castellan==3.10.1,certifi==2019.11.28,cffi==1.15.0,chardet==3.0.4,charset-normalizer==2.0.12,-e git+https://opendev.org/openstack/cinder@9a8f86732131c4c5b4b647514496155598faf561#egg=cinder,click==8.0.4,cliff==3.10.1,cmd2==2.4.0,colorama==0.4.3,command-not-found==0.3,configobj==5.0.6,configshell-fb==1.1.25,constantly==15.1.0,cryptography==36.0.1,cursive==0.2.2,dbus-python==1.2.16,debtcollector==2.4.0,decorator==5.1.1,defusedxml==0.7.1,distlib==0.3.4,distro==1.4.0,distro-info===0.23ubuntu1,dnspython==2.1.0,dogpile.cache==1.1.5,elementpath==2.4.0,entrypoints==0.3,etcd3==0.12.0,etcd3gw==1.0.1,eventlet==0.33.0,extras==1.0.0,fasteners==0.17.3,filelock==3.6.0,fixtures==3.0.0,Flask==2.0.3,Flask-RESTful==0.3.9,future==0.18.2,futurist==2.4.0,-e git+https://opendev.org/openstack/glance@c99c3af4ff6a642417846852d5b7d89f9607782b#egg=glance,glance-store==3.0.0,google-api-core==2.5.0,google-api-python-client==2.38.0,google-auth==2.6.0,google-auth-httplib2==0.1.0,googleapis-common-protos==1.55.0,greenlet==1.1.2,grpcio==1.44.0,httplib2==0.20.4,hyperlink==19.0.0,idna==3.3,importlib-metadata==4.11.1,importlib-resources==5.4.0,incremental==16.10.1,iso8601==1.0.2,itsdangerous==2.1.0,Jinja2==3.0.3,jmespath==0.10.0,jsonpatch==1.32,jsonpointer==2.2,jsonschema==3.2.0,keyring==18.0.1,-e git+https://opendev.org/openstack/keystone@0eba22f331f5e998d5cdee2039e8f14772e78e5e#egg=keystone,keystoneauth1==4.5.0,keystonemiddleware==9.4.0,kombu==5.2.3,language-selector==0.1,lazr.uri==1.0.3,logutils==0.3.5,lxml==4.8.0,Mako==1.1.6,MarkupSafe==2.1.0,microversion-parse==1.0.1,more-itertools==4.2.0,msgpack==1.0.3,munch==2.5.0,mysqlclient==1.4.4,netaddr==0.8.0,netifaces==0.11.0,-e git+https://opendev.org/openstack/networking-hyperv@d7cb6e603ecb408cc5dd17052037e777fcc00bd7#egg=networking_hyperv,networkx==2.6.3,-e git+http://10.106.1.39/p/openstack/neutron@f23fd856c7ca00f32b7127049e14e03a773e484b#egg=neutron,neutron-lib==2.20.0,-e git+https://opendev.org/openstack/nova@60094e663c30fd11bb0b1c6923de9e5056adf8be#egg=nova,numpy==1.22.2,oauth2client==4.1.3,oauthlib==3.2.0,-e git+https://opendev.org/openstack/placement.git@ff0f2dda7755dfee15af353348bd121e0965fa8c#egg=openstack_placement,openstacksdk==0.61.0,os-brick==5.2.0,os-client-config==2.1.0,os-ken==2.3.1,os-resource-classes==1.1.0,os-service-types==1.7.0,os-testr==2.0.1,os-traits==2.7.0,os-vif==2.7.1,os-win==5.6.0,osc-lib==2.5.0,osc-placement==3.2.0,oslo.cache==2.10.1,oslo.concurrency==4.5.0,oslo.config==8.8.0,oslo.context==4.1.0,oslo.db==11.2.0,oslo.i18n==5.1.0,oslo.limit==1.5.0,oslo.log==4.6.1,oslo.messaging==12.13.0,oslo.metrics==0.4.0,oslo.middleware==4.5.1,oslo.policy==3.11.0,oslo.privsep==2.7.0,oslo.reports==2.3.0,oslo.rootwrap==6.3.1,oslo.serialization==4.3.0,oslo.service==2.8.0,oslo.upgradecheck==1.5.0,oslo.utils==4.12.2,oslo.versionedobjects==2.6.0,oslo.vmware==3.10.0,osprofiler==3.4.2,ovs==2.16.0,ovsdbapp==1.15.1,packaging==21.3,paramiko==2.8.1,passlib==1.7.4,Paste==3.5.0,PasteDeploy==2.1.1,pbr==5.8.1,pcp==5.0,pecan==1.4.1,pexpect==4.6.0,platformdirs==2.5.1,pluggy==1.0.0,prettytable==3.1.1,prometheus-client==0.13.1,protobuf==3.19.4,psutil==5.9.0,py==1.11.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycadf==3.1.1,pycparser==2.21,pydot==1.4.2,pyeclib==1.6.0,Pygments==2.3.1,PyGObject==3.36.0,PyHamcrest==1.9.0,pyinotify==0.9.6,PyJWT==2.3.0,pymacaroons==0.13.0,PyMySQL==1.0.2,PyNaCl==1.5.0,pyOpenSSL==22.0.0,pyparsing==3.0.7,pyperclip==1.8.2,pyroute2==0.6.7,pyroute2.core==0.6.7,pyroute2.ethtool==0.6.7,pyroute2.ipdb==0.6.7,pyroute2.ipset==0.6.7,pyroute2.ndb==0.6.7,pyroute2.nftables==0.6.7,pyroute2.nslink==0.6.7,pyrsistent==0.15.5,pysaml2==7.1.1,pyserial==3.4,python-apt==2.0.0+ubuntu0.20.4.4,python-barbicanclient==5.3.0,python-cinderclient==8.3.0,python-dateutil==2.8.2,python-debian===0.1.36ubuntu1,python-designateclient==4.5.0,python-glanceclient==3.6.0,python-keystoneclient==4.4.0,python-memcached==1.59,python-neutronclient==7.8.0,python-novaclient==17.7.0,python-openstackclient==5.8.0,python-subunit==1.4.0,python-swiftclient==3.13.1,pytz==2021.3,pyudev==0.23.2,PyYAML==6.0,repoze.lru==0.7,requests==2.27.1,requests-unixsocket==0.2.0,requestsexceptions==1.4.0,retrying==1.3.3,rfc3986==1.5.0,Routes==2.5.1,rsa==4.8,rtslib-fb==2.1.74,s3transfer==0.5.2,scrypt==0.8.20,SecretStorage==2.3.1,setproctitle==1.2.2,simplegeneric==0.8.1,simplejson==3.17.6,six==1.16.0,sortedcontainers==2.4.0,sos==4.1,soupsieve==2.3.1,SQLAlchemy==1.4.31,sqlalchemy-migrate==0.13.0,sqlparse==0.4.2,ssh-import-id==5.10,statsd==3.3.0,stestr==3.2.1,stevedore==3.5.0,suds-community==1.0.0,-e git+https://opendev.org/openstack/swift@014c98e853b86fc44312d879bec12099be6e22d0#egg=swift,systemd-python==234,tabulate==0.8.9,targetcli-fb==2.1.51,taskflow==4.6.4,-e git+https://opendev.org/openstack/tempest@6853f8da03b7bcf1ccd15ec1e3cb6590bf09cbf1#egg=tempest,Tempita==0.5.2,tenacity==6.3.1,testresources==2.0.1,testscenarios==0.5.0,testtools==2.5.0,toml==0.10.2,tooz==2.10.1,tox==3.24.5,ufw==0.36,unattended-upgrades==0.1,uritemplate==4.1.1,urllib3==1.26.8,urwid==2.0.1,vine==5.0.0,virtualenv==20.13.2,voluptuous==0.12.2,wadllib==1.3.3,waitress==2.0.0,warlock==1.3.3,wcwidth==0.2.5,WebOb==1.8.7,websockify==0.10.0,WebTest==3.0.0,Werkzeug==2.0.3,wrapt==1.13.3,WSME==0.11.0,xattr==0.9.9,xmlschema==1.9.2,yappi==1.3.3,zipp==3.7.0,zope.interface==4.7.1,zstd==1.5.1.0
___________________________________ summary ____________________________________
  all-plugin: skipped tests
  congratulations :)
{1} tempest.api.network.admin.test_metering_extensions.MeteringTestJSON.test_create_delete_metering_label_rule_with_filters [1.245431s] ... ok
{1} tempest.api.network.admin.test_metering_extensions.MeteringTestJSON.test_create_delete_metering_label_with_filters [2.104369s] ... ok
{1} tempest.api.network.admin.test_metering_extensions.MeteringTestJSON.test_list_metering_label_rules [0.056147s] ... ok
{3} tempest.api.network.admin.test_metering_extensions.MeteringIpV6TestJSON.test_create_delete_metering_label_rule_with_filters [0.970505s] ... ok
{1} tempest.api.network.admin.test_metering_extensions.MeteringTestJSON.test_list_metering_labels [0.190251s] ... ok
{1} tempest.api.network.admin.test_metering_extensions.MeteringTestJSON.test_show_metering_label [0.238034s] ... ok
{1} tempest.api.network.admin.test_metering_extensions.MeteringTestJSON.test_show_metering_label_rule [0.043862s] ... ok
{3} tempest.api.network.admin.test_metering_extensions.MeteringIpV6TestJSON.test_create_delete_metering_label_with_filters [1.392501s] ... ok
{3} tempest.api.network.admin.test_metering_extensions.MeteringIpV6TestJSON.test_list_metering_label_rules [0.038160s] ... ok
{5} tempest.api.network.admin.test_external_network_extension.ExternalNetworksTestJSON.test_create_external_network [3.339846s] ... ok
{3} tempest.api.network.admin.test_metering_extensions.MeteringIpV6TestJSON.test_list_metering_labels [0.086150s] ... ok
{3} tempest.api.network.admin.test_metering_extensions.MeteringIpV6TestJSON.test_show_metering_label [0.101317s] ... ok
{3} tempest.api.network.admin.test_metering_extensions.MeteringIpV6TestJSON.test_show_metering_label_rule [0.031316s] ... ok
{4} tempest.api.network.admin.test_negative_quotas.QuotasNegativeTest.test_network_quota_exceeding [10.241956s] ... ok
{6} tempest.api.network.admin.test_external_networks_negative.ExternalNetworksAdminNegativeTestJSON.test_create_port_with_precreated_floatingip_as_fixed_ip [11.569969s] ... ok
{1} tempest.api.network.test_agent_management_negative.AgentManagementNegativeTest.test_list_agents_non_admin [1.163783s] ... ok
{5} tempest.api.network.admin.test_external_network_extension.ExternalNetworksTestJSON.test_delete_external_networks_with_floating_ip [11.639511s] ... ok
{7} tempest.api.network.admin.test_dhcp_agent_scheduler.DHCPAgentSchedulersTestJSON.test_add_remove_network_from_dhcp_agent [7.698487s] ... ok
{7} tempest.api.network.admin.test_dhcp_agent_scheduler.DHCPAgentSchedulersTestJSON.test_list_dhcp_agent_hosting_network [0.199915s] ... ok
{3} tempest.api.network.admin.test_quotas.QuotasTest.test_quotas [2.141298s] ... ok
{7} tempest.api.network.admin.test_dhcp_agent_scheduler.DHCPAgentSchedulersTestJSON.test_list_networks_hosted_by_one_dhcp [0.505368s] ... ok
{3} tempest.api.network.admin.test_quotas.QuotasTest.test_show_quota_details [1.141577s] ... ok
{5} tempest.api.network.admin.test_external_network_extension.ExternalNetworksTestJSON.test_list_external_networks [2.512112s] ... ok
{5} tempest.api.network.admin.test_external_network_extension.ExternalNetworksTestJSON.test_show_external_networks_attribute [2.014972s] ... ok
{5} tempest.api.network.admin.test_external_network_extension.ExternalNetworksTestJSON.test_update_external_network [3.294565s] ... ok
{4} tempest.api.network.admin.test_routers_negative.RoutersAdminNegativeTest.test_router_set_gateway_used_ip_returns_409 [5.517644s] ... ok
{6} tempest.api.network.admin.test_ports.PortsAdminExtendedAttrsTestJSON.test_create_port_binding_ext_attr [6.620209s] ... ok
{1} tempest.api.network.test_extra_dhcp_options.ExtraDHCPOptionsTestJSON.test_create_list_port_with_extra_dhcp_options [4.230481s] ... ok
{1} tempest.api.network.test_extra_dhcp_options.ExtraDHCPOptionsTestJSON.test_update_show_port_with_extra_dhcp_options [1.732734s] ... ok
{7} tempest.api.network.admin.test_routers_dvr.RoutersTestDVR.test_centralized_router_creation [1.553385s] ... ok
{3} tempest.api.network.admin.test_routers_negative.RoutersAdminNegativeIpV6Test.test_router_set_gateway_used_ip_returns_409 [11.642419s] ... ok
{6} tempest.api.network.admin.test_ports.PortsAdminExtendedAttrsTestJSON.test_list_ports_binding_ext_attr [11.834674s] ... ok
{7} tempest.api.network.admin.test_routers_dvr.RoutersTestDVR.test_centralized_router_update_to_dvr [5.225053s] ... ok
{1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_additional_default_security_group_fails [0.249082s] ... ok
{6} tempest.api.network.admin.test_ports.PortsAdminExtendedAttrsTestJSON.test_show_port_binding_ext_attr [1.912697s] ... ok
{7} tempest.api.network.admin.test_routers_dvr.RoutersTestDVR.test_distributed_router_creation [1.477705s] ... ok
{1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_duplicate_security_group_rule_fails [3.538297s] ... ok
{6} tempest.api.network.admin.test_ports.PortsAdminExtendedAttrsTestJSON.test_update_port_binding_ext_attr [3.597284s] ... ok
{1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_ethertype [1.784318s] ... ok
{1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_protocol [1.316368s] ... ok
{1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_remote_ip_prefix [1.077844s] ... ok
{1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_invalid_ports [2.327955s] ... ok
{6} tempest.api.network.test_networks_negative.NetworksNegativeTestJSON.test_create_port_on_non_existent_network [0.360859s] ... ok
{6} tempest.api.network.test_networks_negative.NetworksNegativeTestJSON.test_delete_non_existent_network [0.109123s] ... ok
{6} tempest.api.network.test_networks_negative.NetworksNegativeTestJSON.test_delete_non_existent_port [0.165949s] ... ok
{6} tempest.api.network.test_networks_negative.NetworksNegativeTestJSON.test_delete_non_existent_subnet [0.078962s] ... ok
{6} tempest.api.network.test_networks_negative.NetworksNegativeTestJSON.test_show_non_existent_network [0.050233s] ... ok
{6} tempest.api.network.test_networks_negative.NetworksNegativeTestJSON.test_show_non_existent_port [0.053855s] ... ok
{6} tempest.api.network.test_networks_negative.NetworksNegativeTestJSON.test_show_non_existent_subnet [0.067820s] ... ok
{6} tempest.api.network.test_networks_negative.NetworksNegativeTestJSON.test_update_non_existent_network [0.050546s] ... ok
{6} tempest.api.network.test_networks_negative.NetworksNegativeTestJSON.test_update_non_existent_port [0.046934s] ... ok
{6} tempest.api.network.test_networks_negative.NetworksNegativeTestJSON.test_update_non_existent_subnet [0.178580s] ... ok
{5} tempest.api.network.admin.test_routers.RoutersIpV6AdminTest.test_create_router_set_gateway_with_fixed_ip [19.113531s] ... ok
{3} tempest.api.network.test_extra_dhcp_options.ExtraDHCPOptionsIpV6TestJSON.test_create_list_port_with_extra_dhcp_options [3.310675s] ... ok
{1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_remote_groupid [3.056637s] ... ok
{4} tempest.api.network.test_dhcp_ipv6.NetworksTestDHCPv6.test_dhcp_stateful [21.407320s] ... ok
{1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_security_group [0.345362s] ... ok
{3} tempest.api.network.test_extra_dhcp_options.ExtraDHCPOptionsIpV6TestJSON.test_update_show_port_with_extra_dhcp_options [2.021992s] ... ok
{5} tempest.api.network.admin.test_routers.RoutersIpV6AdminTest.test_create_router_setting_project_id [3.749735s] ... ok
{1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_remote_ip_and_group [3.349331s] ... ok
{7} tempest.api.network.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON.test_create_list_port_with_address_pair [4.829186s] ... ok
{1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_update_name_default [2.291462s] ... ok
{1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_delete_non_existent_security_group [0.083419s] ... ok
{1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group [0.059056s] ... ok
{1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group_rule [0.079743s] ... ok
{7} tempest.api.network.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON.test_update_port_with_address_pair [6.584456s] ... ok
{1} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools [2.391222s] ... ok
{5} tempest.api.network.admin.test_routers.RoutersIpV6AdminTest.test_create_router_with_default_snat_value [10.703189s] ... ok
{7} tempest.api.network.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON.test_update_port_with_cidr_address_pair [5.114705s] ... ok
{6} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_bulk_port [9.673600s] ... ok
{3} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_all_attributes [6.726403s] ... ok
{4} tempest.api.network.test_dhcp_ipv6.NetworksTestDHCPv6.test_dhcp_stateful_fixedips [22.507028s] ... ok
{7} tempest.api.network.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON.test_update_port_with_multiple_ip_mac_address_pair [10.557922s] ... ok
{6} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools [9.358019s] ... ok
{3} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_allocation_pools [7.529516s] ... ok
{5} tempest.api.network.admin.test_routers.RoutersIpV6AdminTest.test_create_router_with_snat_explicit [16.768172s] ... ok
{4} tempest.api.network.test_dhcp_ipv6.NetworksTestDHCPv6.test_dhcp_stateful_fixedips_duplicate [11.270743s] ... ok
{3} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_dhcp_enabled [8.659251s] ... ok
{4} tempest.api.network.test_dhcp_ipv6.NetworksTestDHCPv6.test_dhcp_stateful_fixedips_outrange [4.279613s] ... ok
{3} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw [4.047360s] ... ok
{6} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups [13.827761s] ... ok
{5} tempest.api.network.admin.test_routers.RoutersIpV6AdminTest.test_update_router_reset_gateway_without_snat [10.961079s] ... ok
{3} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw_and_allocation_pools [6.698263s] ... ok
{6} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_show_delete_port_user_defined_mac [6.815033s] ... ok
{6} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port [3.611428s] ... ok
{3} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_host_routes_and_dns_nameservers [7.612597s] ... ok
{5} tempest.api.network.admin.test_routers.RoutersIpV6AdminTest.test_update_router_set_gateway [14.481770s] ... ok
{4} tempest.api.network.test_dhcp_ipv6.NetworksTestDHCPv6.test_dhcp_stateful_router [21.292106s] ... ok
{3} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_without_gateway [5.526608s] ... ok
{5} tempest.api.network.admin.test_routers.RoutersIpV6AdminTest.test_update_router_set_gateway_with_snat_explicit [9.429073s] ... ok
{3} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet [7.462962s] ... ok
{3} tempest.api.network.test_networks.NetworksTest.test_create_update_network_description [1.832567s] ... ok
{6} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_port_with_second_ip [20.026954s] ... ok
{6} tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports [0.308268s] ... ok
{6} tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports_fields [0.172556s] ... ok
{7} tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces [39.506462s] ... ok
{3} tempest.api.network.test_networks.NetworksTest.test_delete_network_with_subnet [7.666508s] ... ok
{3} tempest.api.network.test_networks.NetworksTest.test_external_network_visibility [0.497993s] ... ok
{5} tempest.api.network.admin.test_routers.RoutersIpV6AdminTest.test_update_router_set_gateway_without_snat [12.939111s] ... ok
{3} tempest.api.network.test_networks.NetworksTest.test_list_networks [0.465887s] ... ok
{3} tempest.api.network.test_networks.NetworksTest.test_list_networks_fields [0.383266s] ... ok
{3} tempest.api.network.test_networks.NetworksTest.test_list_subnets [0.125890s] ... ok
{3} tempest.api.network.test_networks.NetworksTest.test_list_subnets_fields [0.128329s] ... ok
{3} tempest.api.network.test_networks.NetworksTest.test_show_network [0.383923s] ... ok
{3} tempest.api.network.test_networks.NetworksTest.test_show_network_fields [0.246431s] ... ok
{3} tempest.api.network.test_networks.NetworksTest.test_show_subnet [0.159325s] ... ok
{3} tempest.api.network.test_networks.NetworksTest.test_show_subnet_fields [0.137778s] ... ok
{6} tempest.api.network.test_ports.PortsIpV6TestJSON.test_port_list_filter_by_ip [12.184085s] ... ok
{2} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus [75.423214s] ... ok
{2} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details [0.000591s] ... ok
{0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus [72.222285s] ... ok
{0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details [0.000736s] ... ok
{3} tempest.api.network.test_networks.NetworksTest.test_update_subnet_gw_dns_host_routes_dhcp [6.505847s] ... ok
{5} tempest.api.network.admin.test_routers.RoutersIpV6AdminTest.test_update_router_unset_gateway [10.318544s] ... ok
{7} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id [22.356889s] ... ok
{4} tempest.api.network.test_dhcp_ipv6.NetworksTestDHCPv6.test_dhcpv6_64_subnets [39.218809s] ... ok
{6} tempest.api.network.test_ports.PortsIpV6TestJSON.test_port_list_filter_by_ip_substr [15.874798s] ... ok
{4} tempest.api.network.test_dhcp_ipv6.NetworksTestDHCPv6.test_dhcpv6_invalid_options [2.792425s] ... ok
{3} tempest.api.network.test_ports.PortsTestJSON.test_create_bulk_port [11.053670s] ... ok
{7} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id [17.668744s] ... ok
{2} tempest.api.network.admin.test_ports.PortsAdminExtendedAttrsIpV6TestJSON.test_create_port_binding_ext_attr [5.586803s] ... ok
{6} tempest.api.network.test_ports.PortsIpV6TestJSON.test_port_list_filter_by_router_id [18.107069s] ... ok
{6} tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port [0.168638s] ... ok
{6} tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port_fields [0.159152s] ... ok
{4} tempest.api.network.test_dhcp_ipv6.NetworksTestDHCPv6.test_dhcpv6_stateless_eui64 [17.683068s] ... ok
{2} tempest.api.network.admin.test_ports.PortsAdminExtendedAttrsIpV6TestJSON.test_list_ports_binding_ext_attr [6.840644s] ... ok
{3} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools [13.059117s] ... ok
{2} tempest.api.network.admin.test_ports.PortsAdminExtendedAttrsIpV6TestJSON.test_show_port_binding_ext_attr [3.502215s] ... ok
{7} tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router [14.445415s] ... ok
{5} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address [12.172744s] ... ok
{2} tempest.api.network.admin.test_ports.PortsAdminExtendedAttrsIpV6TestJSON.test_update_port_binding_ext_attr [3.422466s] ... ok
{3} tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups [12.605479s] ... ok
{6} tempest.api.network.test_ports.PortsIpV6TestJSON.test_update_port_with_security_group_and_extra_attributes [21.189341s] ... ok
{4} tempest.api.network.test_dhcp_ipv6.NetworksTestDHCPv6.test_dhcpv6_stateless_no_ra [20.232238s] ... ok
{3} tempest.api.network.test_ports.PortsTestJSON.test_create_show_delete_port_user_defined_mac [5.163571s] ... ok
{4} tempest.api.network.test_dhcp_ipv6.NetworksTestDHCPv6.test_dhcpv6_stateless_no_ra_no_dhcp [7.156990s] ... ok
{3} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port [5.650331s] ... ok
{7} tempest.api.network.test_routers.RoutersTest.test_router_interface_port_update_with_fixed_ip [21.912030s] ... ok
{5} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip [22.357823s] ... ok
{2} tempest.api.network.admin.test_routers.RoutersAdminTest.test_create_router_set_gateway_with_fixed_ip [23.179036s] ... ok
{6} tempest.api.network.test_ports.PortsIpV6TestJSON.test_update_port_with_two_security_groups_and_extra_attributes [23.282336s] ... ok
{2} tempest.api.network.admin.test_routers.RoutersAdminTest.test_create_router_setting_project_id [1.675866s] ... ok
{3} tempest.api.network.test_ports.PortsTestJSON.test_create_update_port_with_second_ip [16.133180s] ... ok
{3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports [0.436051s] ... ok
{3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports_fields [1.694016s] ... ok
{6} tempest.api.network.test_versions.NetworksApiDiscovery.test_api_version_resources [0.106617s] ... ok
{6} tempest.api.network.test_versions.NetworksApiDiscovery.test_show_api_v2_details [0.319851s] ... ok
{2} tempest.api.network.admin.test_routers.RoutersAdminTest.test_create_router_with_default_snat_value [16.433845s] ... ok
{5} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_update_floatingip_with_port_multiple_ip_address [31.853442s] ... ok
{0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server [21.226402s] ... ok
{3} tempest.api.network.test_ports.PortsTestJSON.test_port_list_filter_by_ip [26.086071s] ... ok
{0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_pause_unpause_server [10.027637s] ... ok
{5} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_floating_ip_delete_port [23.961561s] ... ok
{2} tempest.api.network.admin.test_routers.RoutersAdminTest.test_create_router_with_snat_explicit [28.226446s] ... ok
{4} tempest.api.network.test_dhcp_ipv6.NetworksTestDHCPv6.test_dhcpv6_two_subnets [64.574740s] ... ok
{3} tempest.api.network.test_ports.PortsTestJSON.test_port_list_filter_by_ip_substr [21.892731s] ... ok
{4} tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions [1.588835s] ... ok
{2} tempest.api.network.admin.test_routers.RoutersAdminTest.test_update_router_reset_gateway_without_snat [17.959825s] ... ok
{2} tempest.api.network.admin.test_routers.RoutersAdminTest.test_update_router_set_gateway [10.686038s] ... ok
{3} tempest.api.network.test_ports.PortsTestJSON.test_port_list_filter_by_router_id [21.341308s] ... ok
{3} tempest.api.network.test_ports.PortsTestJSON.test_show_port [0.166071s] ... ok
{3} tempest.api.network.test_ports.PortsTestJSON.test_show_port_fields [0.089236s] ... ok
{4} tempest.api.network.test_floating_ips_negative.FloatingIPNegativeTestJSON.test_associate_floatingip_port_ext_net_unreachable [6.020575s] ... ok
{4} tempest.api.network.test_floating_ips_negative.FloatingIPNegativeTestJSON.test_create_floatingip_in_private_network [0.942794s] ... ok
{5} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_floating_ip_update_different_router [36.709166s] ... ok
{7} tempest.api.network.test_routers.RoutersTest.test_update_delete_extra_route [94.171583s] ... ok
{4} tempest.api.network.test_floating_ips_negative.FloatingIPNegativeTestJSON.test_create_floatingip_with_port_ext_net_unreachable [3.767742s] ... ok
{2} tempest.api.network.admin.test_routers.RoutersAdminTest.test_update_router_set_gateway_with_snat_explicit [9.614941s] ... ok
{7} tempest.api.network.test_routers.RoutersTest.test_update_router_admin_state [4.050402s] ... ok
{3} tempest.api.network.test_ports.PortsTestJSON.test_update_port_with_security_group_and_extra_attributes [16.304912s] ... ok
{7} tempest.api.network.test_routers_negative.DvrRoutersNegativeTest.test_router_create_tenant_distributed_returns_forbidden [0.192920s] ... ok
{2} tempest.api.network.admin.test_routers.RoutersAdminTest.test_update_router_set_gateway_without_snat [11.261723s] ... ok
{7} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group [2.931487s] ... ok
{1} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_connectivity_between_vms_on_different_networks [246.970164s] ... ok
{1} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_hotplug_nic ... SKIPPED: NIC hotplug not available
{7} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_additional_args [4.252043s] ... ok
{5} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_network [3.802779s] ... ok
{2} tempest.api.network.admin.test_routers.RoutersAdminTest.test_update_router_unset_gateway [12.373649s] ... ok
{3} tempest.api.network.test_ports.PortsTestJSON.test_update_port_with_two_security_groups_and_extra_attributes [18.534588s] ... ok
{7} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_icmp_type_code [8.118596s] ... ok
{5} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_port [9.167057s] ... ok
{7} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_protocol_integer_value [4.408969s] ... ok
{7} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_group_id [7.538721s] ... ok
{4} tempest.api.network.test_routers_negative.RoutersNegativeIpV6Test.test_add_router_interfaces_on_overlapping_subnets_returns_400 [25.348311s] ... ok
{4} tempest.api.network.test_routers_negative.RoutersNegativeIpV6Test.test_delete_non_existent_router_returns_404 [0.087976s] ... ok
{5} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_subnet [13.290845s] ... ok
{4} tempest.api.network.test_routers_negative.RoutersNegativeIpV6Test.test_router_add_gateway_invalid_network_returns_404 [0.571688s] ... ok
{7} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_ip_prefix [4.331616s] ... ok
{3} tempest.api.network.test_tags.TagsTest.test_create_list_show_update_delete_tags [7.400647s] ... ok
{2} tempest.api.network.test_networks.NetworksIpV6Test.test_create_delete_subnet_with_dhcp_enabled [7.713894s] ... ok
{4} tempest.api.network.test_routers_negative.RoutersNegativeIpV6Test.test_router_add_gateway_net_not_external_returns_400 [4.328777s] ... ok
{2} tempest.api.network.test_networks.NetworksIpV6Test.test_create_delete_subnet_with_gw [1.723474s] ... ok
{7} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule [5.182773s] ... ok
{7} tempest.api.network.test_security_groups.SecGroupTest.test_delete_security_group_clear_associated_rules [1.788820s] ... ok
{7} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups [0.114958s] ... ok
{5} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group [3.317595s] ... ok
{2} tempest.api.network.test_networks.NetworksIpV6Test.test_create_delete_subnet_with_gw_and_allocation_pools [5.018866s] ... ok
{4} tempest.api.network.test_routers_negative.RoutersNegativeIpV6Test.test_router_remove_interface_in_use_returns_409 [6.732334s] ... ok
{5} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_security_group_rule_with_additional_args [1.805422s] ... ok
{4} tempest.api.network.test_routers_negative.RoutersNegativeIpV6Test.test_show_non_existent_router_returns_404 [0.087580s] ... ok
{4} tempest.api.network.test_routers_negative.RoutersNegativeIpV6Test.test_update_non_existent_router_returns_404 [0.098695s] ... ok
{2} tempest.api.network.test_networks.NetworksIpV6Test.test_create_delete_subnet_with_host_routes_and_dns_nameservers [1.953715s] ... ok
{5} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_security_group_rule_with_icmp_type_code [3.960209s] ... ok
{2} tempest.api.network.test_networks.NetworksIpV6Test.test_create_delete_subnet_without_gateway [4.050657s] ... ok
{5} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_security_group_rule_with_protocol_integer_value [2.148049s] ... ok
{2} tempest.api.network.test_networks.NetworksIpV6Test.test_create_list_subnet_with_no_gw64_one_network [3.464782s] ... ok
{5} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_security_group_rule_with_remote_group_id [3.627623s] ... ok
{5} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_security_group_rule_with_remote_ip_prefix [1.334856s] ... ok
{5} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule [2.940054s] ... ok
{2} tempest.api.network.test_networks.NetworksIpV6Test.test_create_update_delete_network_subnet [5.999027s] ... ok
{5} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_delete_security_group_clear_associated_rules [1.613032s] ... ok
{5} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups [0.103047s] ... ok
{2} tempest.api.network.test_networks.NetworksIpV6Test.test_create_update_network_description [1.237180s] ... ok
{2} tempest.api.network.test_networks.NetworksIpV6Test.test_external_network_visibility [0.672201s] ... ok
{2} tempest.api.network.test_networks.NetworksIpV6Test.test_list_networks [0.322753s] ... ok
{2} tempest.api.network.test_networks.NetworksIpV6Test.test_list_networks_fields [0.206266s] ... ok
{2} tempest.api.network.test_networks.NetworksIpV6Test.test_list_subnets [0.104713s] ... ok
{2} tempest.api.network.test_networks.NetworksIpV6Test.test_list_subnets_fields [0.114628s] ... ok
{2} tempest.api.network.test_networks.NetworksIpV6Test.test_show_network [0.234162s] ... ok
{2} tempest.api.network.test_networks.NetworksIpV6Test.test_show_network_fields [0.263350s] ... ok
{2} tempest.api.network.test_networks.NetworksIpV6Test.test_show_subnet [0.108248s] ... ok
{2} tempest.api.network.test_networks.NetworksIpV6Test.test_show_subnet_fields [0.145531s] ... ok
{2} tempest.api.network.test_networks.NetworksIpV6Test.test_update_subnet_gw_dns_host_routes_dhcp [4.211553s] ... ok
{4} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_add_router_interfaces_on_overlapping_subnets_returns_400 [10.788915s] ... ok
{4} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_delete_non_existent_router_returns_404 [0.095990s] ... ok
{4} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_router_add_gateway_invalid_network_returns_404 [0.763636s] ... ok
{5} tempest.api.network.test_tags.TagsExtTest.test_create_check_list_and_delete_tags [5.340947s] ... ok
{4} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_router_remove_interface_in_use_returns_409 [4.174749s] ... ok
{4} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_show_non_existent_router_returns_404 [0.056519s] ... ok
{4} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_update_non_existent_router_returns_404 [0.052575s] ... ok
{5} tempest.api.network.test_tags.TagsExtTest.test_update_and_delete_all_tags [3.228923s] ... ok
{2} tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_delete_slaac_subnet_with_ports [2.111364s] ... ok
{2} tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_delete_stateless_subnet_with_ports [2.211642s] ... ok
{2} tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_delete_subnet_with_v6_attributes_slaac [2.271213s] ... ok
{2} tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_delete_subnet_with_v6_attributes_stateful [2.159761s] ... ok
{0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard [148.072929s] ... ok
{2} tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_delete_subnet_with_v6_attributes_stateless [2.417394s] ... ok
{2} tempest.api.network.test_security_groups_negative.NegativeSecGroupIPv6Test.test_create_additional_default_security_group_fails [0.095193s] ... ok
{2} tempest.api.network.test_security_groups_negative.NegativeSecGroupIPv6Test.test_create_duplicate_security_group_rule_fails [0.885742s] ... ok
{2} tempest.api.network.test_security_groups_negative.NegativeSecGroupIPv6Test.test_create_security_group_rule_with_bad_ethertype [0.318165s] ... ok
{2} tempest.api.network.test_security_groups_negative.NegativeSecGroupIPv6Test.test_create_security_group_rule_with_bad_protocol [0.304616s] ... ok
{2} tempest.api.network.test_security_groups_negative.NegativeSecGroupIPv6Test.test_create_security_group_rule_with_bad_remote_ip_prefix [0.339254s] ... ok
{2} tempest.api.network.test_security_groups_negative.NegativeSecGroupIPv6Test.test_create_security_group_rule_with_invalid_ports [0.535661s] ... ok
{2} tempest.api.network.test_security_groups_negative.NegativeSecGroupIPv6Test.test_create_security_group_rule_with_non_existent_remote_groupid [0.422689s] ... ok
{2} tempest.api.network.test_security_groups_negative.NegativeSecGroupIPv6Test.test_create_security_group_rule_with_non_existent_security_group [0.050644s] ... ok
{2} tempest.api.network.test_security_groups_negative.NegativeSecGroupIPv6Test.test_create_security_group_rule_with_remote_ip_and_group [0.653386s] ... ok
{2} tempest.api.network.test_security_groups_negative.NegativeSecGroupIPv6Test.test_create_security_group_rule_wrong_ip_prefix_version [0.396501s] ... ok
{2} tempest.api.network.test_security_groups_negative.NegativeSecGroupIPv6Test.test_create_security_group_update_name_default [0.306205s] ... ok
{2} tempest.api.network.test_security_groups_negative.NegativeSecGroupIPv6Test.test_delete_non_existent_security_group [0.016907s] ... ok
{2} tempest.api.network.test_security_groups_negative.NegativeSecGroupIPv6Test.test_show_non_existent_security_group [0.016705s] ... ok
{2} tempest.api.network.test_security_groups_negative.NegativeSecGroupIPv6Test.test_show_non_existent_security_group_rule [0.014100s] ... ok
{2} tempest.api.network.test_service_providers.ServiceProvidersTest.test_service_providers_list [0.098378s] ... ok
{0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server [17.807464s] ... ok
{0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_suspend_resume_server [4.829880s] ... ok
{0} tempest.api.network.admin.test_floating_ips_admin_actions.FloatingIPAdminTestJSON.test_create_list_show_floating_ip_with_tenant_id_by_admin [3.419503s] ... ok
{0} tempest.api.network.admin.test_floating_ips_admin_actions.FloatingIPAdminTestJSON.test_list_floating_ips_from_admin_and_nonadmin [2.679938s] ... ok
{0} tempest.api.network.test_allowed_address_pair.AllowedAddressPairTestJSON.test_create_list_port_with_address_pair [1.680832s] ... ok
{0} tempest.api.network.test_allowed_address_pair.AllowedAddressPairTestJSON.test_update_port_with_address_pair [1.845067s] ... ok
{1} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_mtu_sized_frames [140.065232s] ... ok
{0} tempest.api.network.test_allowed_address_pair.AllowedAddressPairTestJSON.test_update_port_with_cidr_address_pair [1.992454s] ... ok
{0} tempest.api.network.test_allowed_address_pair.AllowedAddressPairTestJSON.test_update_port_with_multiple_ip_mac_address_pair [3.447709s] ... ok
{0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_network [2.144380s] ... ok
{0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_port [2.271810s] ... ok
{0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_subnet [5.179887s] ... ok
{0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces [13.166275s] ... ok
{0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id [6.861746s] ... ok
{0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id [6.453920s] ... ok
{0} tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router [3.713732s] ... ok
{0} tempest.api.network.test_routers.RoutersIpV6Test.test_router_interface_port_update_with_fixed_ip [6.091115s] ... ok
{0} tempest.api.network.test_routers.RoutersIpV6Test.test_update_delete_extra_route [25.964504s] ... ok
{0} tempest.api.network.test_routers.RoutersIpV6Test.test_update_router_admin_state [1.285894s] ... ok
{0} tempest.scenario.test_network_advanced_server_ops.TestNetworkAdvancedServerOps.test_server_connectivity_cold_migration ... SKIPPED: Less than 2 compute nodes, skipping multinode tests.
{0} tempest.scenario.test_network_advanced_server_ops.TestNetworkAdvancedServerOps.test_server_connectivity_cold_migration_revert ... SKIPPED: Less than 2 compute nodes, skipping multinode tests.
{0} tempest.scenario.test_network_advanced_server_ops.TestNetworkAdvancedServerOps.test_server_connectivity_live_migration ... SKIPPED: Less than 2 compute nodes, skipping multinode tests.
{1} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops [216.472205s] ... ok
{1} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_port_security_macspoofing_port ... SKIPPED: NIC hotplug not available
{1} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_preserve_preexisting_port [50.006453s] ... ok
{0} tempest.scenario.test_network_advanced_server_ops.TestNetworkAdvancedServerOps.test_server_connectivity_rebuild [205.599459s] ... ok
{6} tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern [517.692628s] ... ok
{1} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_router_rescheduling [110.625303s] ... ok
{1} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_subnet_details [227.987453s] ... ok
{1} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_update_instance_port_admin_state [131.685453s] ... ok