/opt/stack/tempest ~
Initializing stestr
all-plugin create: /opt/stack/tempest/.tox/all-plugin
all-plugin installdeps: -chttps://releases.openstack.org/constraints/upper/master, -r/opt/stack/tempest/requirements.txt
all-plugin develop-inst: /opt/stack/tempest
all-plugin installed: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead,  from cryptography.utils import int_from_bytes,/usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead,  from cryptography.utils import int_from_bytes,alembic==1.7.6,amqp==5.0.9,aniso8601==9.0.1,appdirs==1.4.4,attrs==21.4.0,Automat==0.8.0,automaton==2.5.0,autopage==0.5.0,bcrypt==3.2.0,beautifulsoup4==4.10.0,blinker==1.4,boto3==1.21.7,botocore==1.24.7,cachetools==5.0.0,castellan==3.10.1,certifi==2019.11.28,cffi==1.15.0,chardet==3.0.4,charset-normalizer==2.0.12,-e git+https://opendev.org/openstack/cinder@b49fb59a6b9d0bbd416774e4a9ea74cd320b7a44#egg=cinder,click==8.0.4,cliff==3.10.1,cmd2==2.4.0,colorama==0.4.3,command-not-found==0.3,configobj==5.0.6,configshell-fb==1.1.25,constantly==15.1.0,cryptography==36.0.1,cursive==0.2.2,dbus-python==1.2.16,debtcollector==2.4.0,decorator==5.1.1,defusedxml==0.7.1,distlib==0.3.4,distro==1.4.0,distro-info===0.23ubuntu1,dnspython==2.1.0,dogpile.cache==1.1.5,elementpath==2.4.0,entrypoints==0.3,etcd3==0.12.0,etcd3gw==1.0.1,eventlet==0.33.0,extras==1.0.0,fasteners==0.17.3,filelock==3.6.0,fixtures==3.0.0,Flask==2.0.3,Flask-RESTful==0.3.9,future==0.18.2,futurist==2.4.0,-e git+https://opendev.org/openstack/glance@7af4d971fc87b9d8ce31f8a79bae5bffa65e64a0#egg=glance,glance-store==3.0.0,google-api-core==2.5.0,google-api-python-client==2.38.0,google-auth==2.6.0,google-auth-httplib2==0.1.0,googleapis-common-protos==1.55.0,greenlet==1.1.2,grpcio==1.44.0,httplib2==0.20.4,hyperlink==19.0.0,idna==3.3,importlib-metadata==4.11.1,importlib-resources==5.4.0,incremental==16.10.1,iso8601==1.0.2,itsdangerous==2.1.0,Jinja2==3.0.3,jmespath==0.10.0,jsonpatch==1.32,jsonpointer==2.2,jsonschema==3.2.0,keyring==18.0.1,-e git+https://opendev.org/openstack/keystone@0eba22f331f5e998d5cdee2039e8f14772e78e5e#egg=keystone,keystoneauth1==4.4.0,keystonemiddleware==9.4.0,kombu==5.2.3,language-selector==0.1,lazr.uri==1.0.3,logutils==0.3.5,lxml==4.8.0,Mako==1.1.6,MarkupSafe==2.1.0,microversion-parse==1.0.1,more-itertools==4.2.0,msgpack==1.0.3,munch==2.5.0,mysqlclient==1.4.4,netaddr==0.8.0,netifaces==0.11.0,-e git+https://opendev.org/openstack/networking-hyperv@7619f8c9974dcceeb4f04b43c30564a753c357ec#egg=networking_hyperv,networkx==2.6.3,-e git+https://opendev.org/openstack/neutron@480c643dd94512606baab02bf26a90c9ab855c55#egg=neutron,neutron-lib==2.20.0,-e git+http://10.106.1.39/p/openstack/nova@f845f08bc1fc46468d8e547f0f3a764414dd7f03#egg=nova,numpy==1.22.2,oauth2client==4.1.3,oauthlib==3.2.0,-e git+https://opendev.org/openstack/placement.git@ff0f2dda7755dfee15af353348bd121e0965fa8c#egg=openstack_placement,openstacksdk==0.61.0,os-brick==5.2.0,os-client-config==2.1.0,os-ken==2.3.1,os-resource-classes==1.1.0,os-service-types==1.7.0,os-testr==2.0.1,os-traits==2.7.0,os-vif==2.7.1,os-win==5.6.0,osc-lib==2.5.0,osc-placement==3.2.0,oslo.cache==2.10.1,oslo.concurrency==4.5.0,oslo.config==8.8.0,oslo.context==4.1.0,oslo.db==11.2.0,oslo.i18n==5.1.0,oslo.limit==1.5.0,oslo.log==4.6.1,oslo.messaging==12.13.0,oslo.metrics==0.4.0,oslo.middleware==4.5.1,oslo.policy==3.11.0,oslo.privsep==2.7.0,oslo.reports==2.3.0,oslo.rootwrap==6.3.1,oslo.serialization==4.3.0,oslo.service==2.8.0,oslo.upgradecheck==1.5.0,oslo.utils==4.12.2,oslo.versionedobjects==2.6.0,oslo.vmware==3.10.0,osprofiler==3.4.2,ovs==2.16.0,ovsdbapp==1.15.1,packaging==21.3,paramiko==2.8.1,passlib==1.7.4,Paste==3.5.0,PasteDeploy==2.1.1,pbr==5.8.1,pcp==5.0,pecan==1.4.1,pexpect==4.6.0,platformdirs==2.5.1,pluggy==1.0.0,prettytable==3.1.1,prometheus-client==0.13.1,protobuf==3.19.4,psutil==5.9.0,py==1.11.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycadf==3.1.1,pycparser==2.21,pydot==1.4.2,pyeclib==1.6.0,Pygments==2.3.1,PyGObject==3.36.0,PyHamcrest==1.9.0,pyinotify==0.9.6,PyJWT==2.3.0,pymacaroons==0.13.0,PyMySQL==1.0.2,PyNaCl==1.5.0,pyOpenSSL==22.0.0,pyparsing==3.0.7,pyperclip==1.8.2,pyroute2==0.6.7,pyroute2.core==0.6.7,pyroute2.ethtool==0.6.7,pyroute2.ipdb==0.6.7,pyroute2.ipset==0.6.7,pyroute2.ndb==0.6.7,pyroute2.nftables==0.6.7,pyroute2.nslink==0.6.7,pyrsistent==0.15.5,pysaml2==7.1.1,pyserial==3.4,python-apt==2.0.0+ubuntu0.20.4.4,python-barbicanclient==5.3.0,python-cinderclient==8.3.0,python-dateutil==2.8.2,python-debian===0.1.36ubuntu1,python-designateclient==4.5.0,python-glanceclient==3.6.0,python-keystoneclient==4.4.0,python-memcached==1.59,python-neutronclient==7.8.0,python-novaclient==17.7.0,python-openstackclient==5.7.0,python-subunit==1.4.0,python-swiftclient==3.13.1,pytz==2021.3,pyudev==0.23.2,PyYAML==6.0,repoze.lru==0.7,requests==2.27.1,requests-unixsocket==0.2.0,requestsexceptions==1.4.0,retrying==1.3.3,rfc3986==1.5.0,Routes==2.5.1,rsa==4.8,rtslib-fb==2.1.74,s3transfer==0.5.2,scrypt==0.8.20,SecretStorage==2.3.1,setproctitle==1.2.2,simplegeneric==0.8.1,simplejson==3.17.6,six==1.16.0,sortedcontainers==2.4.0,sos==4.1,soupsieve==2.3.1,SQLAlchemy==1.4.31,sqlalchemy-migrate==0.13.0,sqlparse==0.4.2,ssh-import-id==5.10,statsd==3.3.0,stestr==3.2.1,stevedore==3.5.0,suds-community==1.0.0,-e git+https://opendev.org/openstack/swift@3ff3076ce6648937993e90334b7a9f532b06806c#egg=swift,systemd-python==234,tabulate==0.8.9,targetcli-fb==2.1.51,taskflow==4.6.4,-e git+https://opendev.org/openstack/tempest@914b096dfd6b829ea963d537aaa1db6c12bd28f2#egg=tempest,Tempita==0.5.2,tenacity==6.3.1,testresources==2.0.1,testscenarios==0.5.0,testtools==2.5.0,toml==0.10.2,tooz==2.10.1,tox==3.24.5,ufw==0.36,unattended-upgrades==0.1,uritemplate==4.1.1,urllib3==1.26.8,urwid==2.0.1,vine==5.0.0,virtualenv==20.13.2,voluptuous==0.12.2,wadllib==1.3.3,waitress==2.0.0,warlock==1.3.3,wcwidth==0.2.5,WebOb==1.8.7,websockify==0.10.0,WebTest==3.0.0,Werkzeug==2.0.3,wrapt==1.13.3,WSME==0.11.0,xattr==0.9.9,xmlschema==1.9.2,yappi==1.3.3,zipp==3.7.0,zope.interface==4.7.1,zstd==1.5.1.0
___________________________________ summary ____________________________________
  all-plugin: skipped tests
  congratulations :)
{0} setUpClass (tempest.api.compute.admin.test_fixed_ips.FixedIPsTestJson) ... SKIPPED: FixedIPsTestJson skipped as neutron is available
{0} setUpClass (tempest.api.compute.admin.test_fixed_ips_negative.FixedIPsNegativeTestJson) ... SKIPPED: FixedIPsNegativeTestJson skipped as neutron is available
{7} setUpClass (tempest.api.compute.admin.test_agents.AgentsAdminTestJSON) ... SKIPPED: The os-agents API is not supported.
{0} tempest.api.compute.admin.test_flavors_extra_specs.FlavorsExtraSpecsTestJSON.test_flavor_non_admin_get_all_keys [0.551696s] ... ok
{4} setUpClass (tempest.api.compute.admin.test_auto_allocate_network.AutoAllocateNetworkTest) ... SKIPPED: Found shared networks: [{'id': 'a6410304-c817-4d12-9e5e-ff89cd06c6fe', 'name': 'shared', 'tenant_id': '320252105bf441c1836c5ac872355c11', 'admin_state_up': True, 'mtu': 1500, 'status': 'ACTIVE', 'subnets': ['5fb28991-52c0-45aa-8186-da69a5349feb'], 'shared': True, 'availability_zone_hints': [], 'availability_zones': ['nova'], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2022-03-05T10:09:22Z', 'updated_at': '2022-03-05T10:09:25Z', 'revision_number': 2, 'project_id': '320252105bf441c1836c5ac872355c11'}]
{0} tempest.api.compute.admin.test_flavors_extra_specs.FlavorsExtraSpecsTestJSON.test_flavor_non_admin_get_specific_key [1.568340s] ... ok
{7} tempest.api.compute.admin.test_flavors.FlavorsAdminTestJSON.test_create_flavor_using_string_ram [1.283614s] ... ok
{7} tempest.api.compute.admin.test_flavors.FlavorsAdminTestJSON.test_create_flavor_verify_entry_in_list_details [1.179210s] ... ok
{3} tempest.api.compute.admin.test_aggregates.AggregatesAdminTestV241.test_create_update_show_aggregate_add_remove_host [2.442326s] ... ok
{0} tempest.api.compute.admin.test_flavors_extra_specs.FlavorsExtraSpecsTestJSON.test_flavor_set_get_update_show_unset_keys [1.624480s] ... ok
{6} tempest.api.compute.admin.test_flavors_access.FlavorsAccessTestJSON.test_flavor_access_add_remove [3.361014s] ... ok
{7} tempest.api.compute.admin.test_flavors.FlavorsAdminTestJSON.test_create_flavor_with_int_id [0.417047s] ... ok
{6} tempest.api.compute.admin.test_flavors_access.FlavorsAccessTestJSON.test_flavor_access_list_with_private_flavor [0.569348s] ... ok
{7} tempest.api.compute.admin.test_flavors.FlavorsAdminTestJSON.test_create_flavor_with_none_id [0.454488s] ... ok
{7} tempest.api.compute.admin.test_flavors.FlavorsAdminTestJSON.test_create_flavor_with_uuid_id [0.866168s] ... ok
{7} tempest.api.compute.admin.test_flavors.FlavorsAdminTestJSON.test_create_list_flavor_without_extra_data [1.116832s] ... ok
{7} tempest.api.compute.admin.test_flavors.FlavorsAdminTestJSON.test_create_server_with_non_public_flavor [0.546182s] ... ok
{7} tempest.api.compute.admin.test_flavors.FlavorsAdminTestJSON.test_is_public_string_variations [0.858891s] ... ok
{7} tempest.api.compute.admin.test_flavors.FlavorsAdminTestJSON.test_list_non_public_flavor [0.399222s] ... ok
{7} tempest.api.compute.admin.test_flavors.FlavorsAdminTestJSON.test_list_public_flavor_with_other_user [0.312735s] ... ok
{3} tempest.api.compute.admin.test_availability_zone.AZAdminV2TestJSON.test_get_availability_zone_list [0.660722s] ... ok
{3} tempest.api.compute.admin.test_availability_zone.AZAdminV2TestJSON.test_get_availability_zone_list_detail [0.417939s] ... ok
{6} tempest.api.compute.admin.test_hosts_negative.HostsAdminNegativeTestJSON.test_list_hosts_with_non_admin_user [0.355969s] ... ok
{6} tempest.api.compute.admin.test_hosts_negative.HostsAdminNegativeTestJSON.test_reboot_host_with_non_admin_user [0.034717s] ... ok
{6} tempest.api.compute.admin.test_hosts_negative.HostsAdminNegativeTestJSON.test_reboot_nonexistent_host [0.071445s] ... ok
{6} tempest.api.compute.admin.test_hosts_negative.HostsAdminNegativeTestJSON.test_show_host_detail_with_non_admin_user [0.016485s] ... ok
{6} tempest.api.compute.admin.test_hosts_negative.HostsAdminNegativeTestJSON.test_show_host_detail_with_nonexistent_hostname [0.093358s] ... ok
{6} tempest.api.compute.admin.test_hosts_negative.HostsAdminNegativeTestJSON.test_shutdown_host_with_non_admin_user [0.043247s] ... ok
{6} tempest.api.compute.admin.test_hosts_negative.HostsAdminNegativeTestJSON.test_shutdown_nonexistent_host [0.049563s] ... ok
{6} tempest.api.compute.admin.test_hosts_negative.HostsAdminNegativeTestJSON.test_startup_host_with_non_admin_user [0.031236s] ... ok
{6} tempest.api.compute.admin.test_hosts_negative.HostsAdminNegativeTestJSON.test_startup_nonexistent_host [0.022624s] ... ok
{6} tempest.api.compute.admin.test_hosts_negative.HostsAdminNegativeTestJSON.test_update_host_with_invalid_maintenance_mode [0.012127s] ... ok
{6} tempest.api.compute.admin.test_hosts_negative.HostsAdminNegativeTestJSON.test_update_host_with_invalid_status [0.011947s] ... ok
{6} tempest.api.compute.admin.test_hosts_negative.HostsAdminNegativeTestJSON.test_update_host_with_non_admin_user [0.015313s] ... ok
{6} tempest.api.compute.admin.test_hosts_negative.HostsAdminNegativeTestJSON.test_update_host_without_param [0.018366s] ... ok
{6} tempest.api.compute.admin.test_hosts_negative.HostsAdminNegativeTestJSON.test_update_nonexistent_host [0.049891s] ... ok
{7} tempest.api.compute.admin.test_flavors_microversions.FlavorsV255TestJSON.test_crud_flavor [2.705741s] ... ok
{3} tempest.api.compute.admin.test_availability_zone_negative.AZAdminNegativeTestJSON.test_get_availability_zone_list_detail_with_non_admin_user [0.551307s] ... ok
{6} tempest.api.compute.admin.test_hypervisor.HypervisorAdminTestJSON.test_get_hypervisor_list [0.597529s] ... ok
{6} tempest.api.compute.admin.test_hypervisor.HypervisorAdminTestJSON.test_get_hypervisor_list_details [0.247866s] ... ok
{6} tempest.api.compute.admin.test_hypervisor.HypervisorAdminTestJSON.test_get_hypervisor_show_details [0.502791s] ... ok
{6} tempest.api.compute.admin.test_hypervisor.HypervisorAdminTestJSON.test_get_hypervisor_stats [0.083418s] ... ok
{7} tempest.api.compute.admin.test_hypervisor.HypervisorAdminUnderV252Test.test_get_hypervisor_show_servers [0.470160s] ... ok
{6} tempest.api.compute.admin.test_hypervisor.HypervisorAdminTestJSON.test_get_hypervisor_uptime [0.828351s] ... ok
{7} tempest.api.compute.admin.test_hypervisor.HypervisorAdminUnderV252Test.test_search_hypervisor [0.474239s] ... ok
{3} tempest.api.compute.admin.test_hypervisor.HypervisorAdminV228Test.test_get_list_hypervisor_details [0.781942s] ... ok
{7} tempest.api.compute.admin.test_hypervisor.HypervisorAdminV253TestBase.test_list_show_detail_hypervisors [1.164311s] ... ok
{6} tempest.api.compute.admin.test_quotas.QuotaClassesAdmin257Test.test_update_default_quotas [1.440053s] ... ok
{7} tempest.api.compute.admin.test_hypervisor_negative.HypervisorAdminNegativeUnderV252Test.test_search_hypervisor_with_non_admin_user [0.799673s] ... ok
{4} tempest.api.compute.admin.test_delete_server.DeleteServersAdminTestJSON.test_admin_delete_servers_of_others [42.356259s] ... ok
{7} tempest.api.compute.admin.test_hypervisor_negative.HypervisorAdminNegativeUnderV252Test.test_search_nonexistent_hypervisor [0.175024s] ... ok
{1} tempest.api.compute.admin.test_aggregates.AggregatesAdminTestJSON.test_aggregate_add_host_create_server_with_az [44.530013s] ... ok
{7} tempest.api.compute.admin.test_hypervisor_negative.HypervisorAdminNegativeUnderV252Test.test_show_servers_with_non_admin_user [0.704915s] ... ok
{7} tempest.api.compute.admin.test_hypervisor_negative.HypervisorAdminNegativeUnderV252Test.test_show_servers_with_nonexistent_hypervisor [0.437791s] ... ok
{6} tempest.api.compute.admin.test_quotas.QuotasAdminTestJSON.test_delete_quota [2.319492s] ... ok
{1} tempest.api.compute.admin.test_aggregates.AggregatesAdminTestJSON.test_aggregate_add_host_get_details [1.957288s] ... ok
{6} tempest.api.compute.admin.test_quotas.QuotasAdminTestJSON.test_get_default_quotas [0.816909s] ... ok
{1} tempest.api.compute.admin.test_aggregates.AggregatesAdminTestJSON.test_aggregate_add_host_list [1.063726s] ... ok
{1} tempest.api.compute.admin.test_aggregates.AggregatesAdminTestJSON.test_aggregate_add_remove_host [0.789732s] ... ok
{1} tempest.api.compute.admin.test_aggregates.AggregatesAdminTestJSON.test_aggregate_create_delete [0.729130s] ... ok
{5} tempest.api.compute.admin.test_aggregates_negative.AggregatesAdminNegativeTestJSON.test_aggregate_add_existent_host [49.089184s] ... ok
{1} tempest.api.compute.admin.test_aggregates.AggregatesAdminTestJSON.test_aggregate_create_delete_with_az [2.130366s] ... ok
{5} tempest.api.compute.admin.test_aggregates_negative.AggregatesAdminNegativeTestJSON.test_aggregate_add_host_as_user [1.765174s] ... ok
{5} tempest.api.compute.admin.test_aggregates_negative.AggregatesAdminNegativeTestJSON.test_aggregate_add_non_exist_host [0.258373s] ... ok
{5} tempest.api.compute.admin.test_aggregates_negative.AggregatesAdminNegativeTestJSON.test_aggregate_create_aggregate_name_length_exceeds_255 [0.040830s] ... ok
{5} tempest.api.compute.admin.test_aggregates_negative.AggregatesAdminNegativeTestJSON.test_aggregate_create_aggregate_name_length_less_than_1 [0.024003s] ... ok
{5} tempest.api.compute.admin.test_aggregates_negative.AggregatesAdminNegativeTestJSON.test_aggregate_create_as_user [0.027977s] ... ok
{1} tempest.api.compute.admin.test_aggregates.AggregatesAdminTestJSON.test_aggregate_create_update_metadata_get_details [0.441575s] ... ok
{5} tempest.api.compute.admin.test_aggregates_negative.AggregatesAdminNegativeTestJSON.test_aggregate_create_with_existent_aggregate_name [0.175454s] ... ok
{5} tempest.api.compute.admin.test_aggregates_negative.AggregatesAdminNegativeTestJSON.test_aggregate_delete_as_user [0.156404s] ... ok
{5} tempest.api.compute.admin.test_aggregates_negative.AggregatesAdminNegativeTestJSON.test_aggregate_delete_with_invalid_id [0.039368s] ... ok
{6} tempest.api.compute.admin.test_quotas.QuotasAdminTestJSON.test_get_updated_quotas [4.984582s] ... ok
{5} tempest.api.compute.admin.test_aggregates_negative.AggregatesAdminNegativeTestJSON.test_aggregate_get_details_as_user [0.146792s] ... ok
{5} tempest.api.compute.admin.test_aggregates_negative.AggregatesAdminNegativeTestJSON.test_aggregate_get_details_with_invalid_id [0.150325s] ... ok
{5} tempest.api.compute.admin.test_aggregates_negative.AggregatesAdminNegativeTestJSON.test_aggregate_list_as_user [0.220609s] ... ok
{7} tempest.api.compute.admin.test_instance_usage_audit_log.InstanceUsageAuditLogTestJSON.test_get_instance_usage_audit_log [0.277819s] ... ok
{1} tempest.api.compute.admin.test_aggregates.AggregatesAdminTestJSON.test_aggregate_create_update_with_az [1.261656s] ... ok
{7} tempest.api.compute.admin.test_instance_usage_audit_log.InstanceUsageAuditLogTestJSON.test_list_instance_usage_audit_logs [0.385589s] ... ok
{1} tempest.api.compute.admin.test_aggregates.AggregatesAdminTestJSON.test_aggregate_create_verify_entry_in_list [0.692839s] ... ok
{6} tempest.api.compute.admin.test_quotas.QuotasAdminTestJSON.test_update_all_quota_resources_for_tenant [1.730945s] ... ok
{5} tempest.api.compute.admin.test_aggregates_negative.AggregatesAdminNegativeTestJSON.test_aggregate_remove_host_as_user [1.455479s] ... ok
{5} tempest.api.compute.admin.test_aggregates_negative.AggregatesAdminNegativeTestJSON.test_aggregate_remove_nonexistent_host [0.262907s] ... ok
{3} tempest.api.compute.floating_ips.test_floating_ips_actions_negative.FloatingIPsNegativeTestJSON.test_allocate_floating_ip_from_nonexistent_pool [0.078966s] ... ok
{3} tempest.api.compute.floating_ips.test_floating_ips_actions_negative.FloatingIPsNegativeTestJSON.test_delete_nonexistent_floating_ip [0.088552s] ... ok
{7} tempest.api.compute.admin.test_keypairs_v210.KeyPairsV210TestJSON.test_admin_manage_keypairs_for_other_users [2.486535s] ... ok
{1} tempest.api.compute.admin.test_flavors_extra_specs.FlavorMetadataValidation.test_flavor_update_with_custom_namespace [0.846368s] ... ok
{6} tempest.api.compute.admin.test_quotas.QuotasAdminTestV236.test_get_updated_quotas [4.502023s] ... ok
{5} tempest.api.compute.admin.test_quotas.QuotaClassesAdminTestJSON.test_update_default_quotas [5.436420s] ... ok
{4} tempest.api.compute.admin.test_delete_server.DeleteServersAdminTestJSON.test_delete_server_while_in_error_state [25.929987s] ... ok
{1} tempest.api.compute.admin.test_flavors_extra_specs_negative.FlavorsExtraSpecsNegativeTestJSON.test_flavor_get_nonexistent_key [0.260306s] ... ok
{1} tempest.api.compute.admin.test_flavors_extra_specs_negative.FlavorsExtraSpecsNegativeTestJSON.test_flavor_non_admin_set_keys [0.059600s] ... ok
{7} tempest.api.compute.admin.test_networks.NetworksTest.test_get_network [1.289649s] ... ok
{1} tempest.api.compute.admin.test_flavors_extra_specs_negative.FlavorsExtraSpecsNegativeTestJSON.test_flavor_non_admin_unset_keys [0.149776s] ... ok
{1} tempest.api.compute.admin.test_flavors_extra_specs_negative.FlavorsExtraSpecsNegativeTestJSON.test_flavor_non_admin_update_specific_key [0.100455s] ... ok
{1} tempest.api.compute.admin.test_flavors_extra_specs_negative.FlavorsExtraSpecsNegativeTestJSON.test_flavor_unset_nonexistent_key [0.026545s] ... ok
{1} tempest.api.compute.admin.test_flavors_extra_specs_negative.FlavorsExtraSpecsNegativeTestJSON.test_flavor_update_mismatch_key [0.022020s] ... ok
{1} tempest.api.compute.admin.test_flavors_extra_specs_negative.FlavorsExtraSpecsNegativeTestJSON.test_flavor_update_more_key [0.016860s] ... ok
{7} tempest.api.compute.admin.test_networks.NetworksTest.test_list_all_networks [0.249194s] ... ok
{7} tempest.api.compute.admin.test_quotas_negative.QuotasSecurityGroupAdminNegativeTest.test_security_groups_exceed_limit ... SKIPPED: Skipped until bug: https://launchpad.net/bugs/1186354 is resolved.
{7} tempest.api.compute.admin.test_quotas_negative.QuotasSecurityGroupAdminNegativeTest.test_security_groups_rules_exceed_limit ... SKIPPED: Skipped until bug: https://launchpad.net/bugs/1186354 is resolved.
{7} setUpClass (tempest.api.compute.certificates.test_certificates.CertificatesV2TestJSON) ... SKIPPED: Nova cert is not available
{5} tempest.api.compute.admin.test_quotas_negative.QuotasAdminNegativeTest.test_create_server_when_cpu_quota_is_full [4.594967s] ... ok
{7} tempest.api.compute.images.test_image_metadata_negative.ImagesMetadataNegativeTestJSON.test_delete_nonexistent_image_metadata_item [0.723078s] ... ok
{7} tempest.api.compute.images.test_image_metadata_negative.ImagesMetadataNegativeTestJSON.test_get_nonexistent_image_metadata_item [0.426750s] ... ok
{4} tempest.api.compute.admin.test_flavors_access_negative.FlavorsAccessNegativeTestJSON.test_add_flavor_access_duplicate [4.136976s] ... ok
{7} tempest.api.compute.images.test_image_metadata_negative.ImagesMetadataNegativeTestJSON.test_list_nonexistent_image_metadata [0.141983s] ... ok
{1} tempest.api.compute.admin.test_flavors_microversions.FlavorsV261TestJSON.test_crud_flavor [5.272370s] ... ok
{7} tempest.api.compute.images.test_image_metadata_negative.ImagesMetadataNegativeTestJSON.test_set_nonexistent_image_metadata [0.449621s] ... ok
{3} tempest.api.compute.floating_ips.test_list_floating_ips.FloatingIPDetailsTestJSON.test_get_floating_ip_details [4.094815s] ... ok
{7} tempest.api.compute.images.test_image_metadata_negative.ImagesMetadataNegativeTestJSON.test_set_nonexistent_image_metadata_item [0.986769s] ... ok
{7} tempest.api.compute.images.test_image_metadata_negative.ImagesMetadataNegativeTestJSON.test_update_nonexistent_image_metadata [0.692484s] ... ok
{5} tempest.api.compute.admin.test_quotas_negative.QuotasAdminNegativeTest.test_create_server_when_instances_quota_is_full [3.161842s] ... ok
{4} tempest.api.compute.admin.test_flavors_access_negative.FlavorsAccessNegativeTestJSON.test_flavor_access_list_with_public_flavor [2.578928s] ... ok
{3} tempest.api.compute.floating_ips.test_list_floating_ips.FloatingIPDetailsTestJSON.test_list_floating_ip_pools [1.472157s] ... ok
{3} tempest.api.compute.floating_ips.test_list_floating_ips.FloatingIPDetailsTestJSON.test_list_floating_ips [0.676856s] ... ok
{4} tempest.api.compute.admin.test_flavors_access_negative.FlavorsAccessNegativeTestJSON.test_flavor_non_admin_add [1.421453s] ... ok
{0} tempest.api.compute.admin.test_volumes_negative.VolumesAdminNegativeTest.test_update_attached_volume_with_nonexistent_volume_in_body [48.588912s] ... ok
{5} tempest.api.compute.admin.test_quotas_negative.QuotasAdminNegativeTest.test_create_server_when_memory_quota_is_full [4.028208s] ... ok
{7} tempest.api.compute.images.test_images_negative.ImagesDeleteNegativeTestJSON.test_delete_image_blank_id [1.249501s] ... ok
{5} tempest.api.compute.admin.test_quotas_negative.QuotasAdminNegativeTest.test_update_quota_normal_user [0.403269s] ... ok
{1} tempest.api.compute.admin.test_hypervisor_negative.HypervisorAdminNegativeTestJSON.test_get_hypervisor_list_details_with_non_admin_user [0.513871s] ... ok
{7} tempest.api.compute.images.test_images_negative.ImagesDeleteNegativeTestJSON.test_delete_image_negative_image_id [0.738351s] ... ok
{1} tempest.api.compute.admin.test_hypervisor_negative.HypervisorAdminNegativeTestJSON.test_get_hypervisor_list_with_non_admin_user [0.836787s] ... ok
{7} tempest.api.compute.images.test_images_negative.ImagesDeleteNegativeTestJSON.test_delete_image_non_hex_string_id [0.634304s] ... ok
{1} tempest.api.compute.admin.test_hypervisor_negative.HypervisorAdminNegativeTestJSON.test_get_hypervisor_stats_with_non_admin_user [0.358206s] ... ok
{7} tempest.api.compute.images.test_images_negative.ImagesDeleteNegativeTestJSON.test_delete_image_with_id_over_character_limit [0.180498s] ... ok
{4} tempest.api.compute.admin.test_flavors_access_negative.FlavorsAccessNegativeTestJSON.test_flavor_non_admin_remove [4.531798s] ... ok
{0} tempest.api.compute.admin.test_volumes_negative.VolumesAdminNegativeTest.test_update_attached_volume_with_nonexistent_volume_in_uri [4.678472s] ... ok
{7} tempest.api.compute.images.test_images_negative.ImagesDeleteNegativeTestJSON.test_delete_image_with_invalid_image_id [0.458719s] ... ok
{1} tempest.api.compute.admin.test_hypervisor_negative.HypervisorAdminNegativeTestJSON.test_get_hypervisor_uptime_with_non_admin_user [0.564906s] ... ok
{7} tempest.api.compute.images.test_images_negative.ImagesDeleteNegativeTestJSON.test_delete_non_existent_image [0.445154s] ... ok
{1} tempest.api.compute.admin.test_hypervisor_negative.HypervisorAdminNegativeTestJSON.test_get_nonexistent_hypervisor_uptime [0.454044s] ... ok
{1} tempest.api.compute.admin.test_hypervisor_negative.HypervisorAdminNegativeTestJSON.test_show_hypervisor_with_non_admin_user [0.895252s] ... ok
{1} tempest.api.compute.admin.test_hypervisor_negative.HypervisorAdminNegativeTestJSON.test_show_nonexistent_hypervisor [0.160647s] ... ok
{4} tempest.api.compute.admin.test_flavors_access_negative.FlavorsAccessNegativeTestJSON.test_remove_flavor_access_not_found [1.982655s] ... ok
{6} tempest.api.compute.admin.test_server_diagnostics_negative.ServerDiagnosticsNegativeTest.test_get_server_diagnostics_by_non_admin [19.562462s] ... ok
{1} tempest.api.compute.admin.test_instance_usage_audit_log_negative.InstanceUsageAuditLogNegativeTestJSON.test_get_instance_usage_audit_logs_with_invalid_time [0.804876s] ... ok
{1} tempest.api.compute.admin.test_instance_usage_audit_log_negative.InstanceUsageAuditLogNegativeTestJSON.test_instance_usage_audit_logs_with_nonadmin_user [1.934571s] ... ok
{4} setUpClass (tempest.api.compute.admin.test_floating_ips_bulk.FloatingIPsBulkAdminTestJSON) ... SKIPPED: nova-network is gone
{5} tempest.api.compute.admin.test_security_groups.SecurityGroupsTestAdminJSON.test_list_security_groups_list_all_tenants_filter [12.270861s] ... ok
{4} tempest.api.compute.admin.test_hosts.HostsAdminTestJSON.test_list_hosts [0.932269s] ... ok
{4} tempest.api.compute.admin.test_hosts.HostsAdminTestJSON.test_list_hosts_with_a_blank_zone [0.627167s] ... ok
{4} tempest.api.compute.admin.test_hosts.HostsAdminTestJSON.test_list_hosts_with_nonexistent_zone [0.335586s] ... ok
{4} tempest.api.compute.admin.test_hosts.HostsAdminTestJSON.test_list_hosts_with_zone [0.144521s] ... ok
{4} tempest.api.compute.admin.test_hosts.HostsAdminTestJSON.test_show_host_detail [0.501029s] ... ok
{0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor [0.279408s] ... ok
{4} tempest.api.compute.admin.test_live_migration.LiveMigrationRemoteConsolesV26Test.test_live_migration_serial_console ... SKIPPED: Serial console not supported.
{7} tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_list_security_groups_by_server [27.403497s] ... ok
{0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors [0.927566s] ... ok
{0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_detailed_filter_by_min_disk [0.370404s] ... ok
{0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_detailed_filter_by_min_ram [0.065824s] ... ok
{0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_detailed_limit_results [0.058327s] ... ok
{0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_detailed_using_marker [0.264238s] ... ok
{0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_filter_by_min_disk [0.284102s] ... ok
{7} tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_group_create_get_delete [1.305793s] ... ok
{0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_filter_by_min_ram [0.301270s] ... ok
{0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_limit_results [0.237207s] ... ok
{0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_using_marker [0.085510s] ... ok
{0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_with_detail [0.345526s] ... ok
{7} tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete [3.238749s] ... ok
{0} tempest.api.compute.limits.test_absolute_limits_negative.AbsoluteLimitsNegativeTestJSON.test_max_metadata_exceed_limit [0.758206s] ... ok
{3} tempest.api.compute.images.test_images_oneserver_negative.ImagesOneServerNegativeTestJSON.test_create_image_specify_invalid_metadata [1.102143s] ... ok
{3} tempest.api.compute.images.test_images_oneserver_negative.ImagesOneServerNegativeTestJSON.test_create_image_specify_metadata_over_limits [1.575297s] ... ok
{4} tempest.api.compute.admin.test_quotas.QuotasAdminTestV257.test_get_updated_quotas [3.974826s] ... ok
{3} tempest.api.compute.images.test_images_oneserver_negative.ImagesOneServerNegativeTestJSON.test_create_image_specify_name_over_character_limit [2.953404s] ... ok
{0} tempest.api.compute.security_groups.test_security_group_rules_negative.SecurityGroupRulesNegativeTestJSON.test_create_security_group_rule_duplicate [3.696973s] ... ok
{0} tempest.api.compute.security_groups.test_security_group_rules_negative.SecurityGroupRulesNegativeTestJSON.test_create_security_group_rule_with_invalid_from_port [0.865377s] ... ok
{0} tempest.api.compute.security_groups.test_security_group_rules_negative.SecurityGroupRulesNegativeTestJSON.test_create_security_group_rule_with_invalid_id [0.017646s] ... ok
{4} tempest.api.compute.admin.test_services_negative.ServicesAdminNegativeTestJSON.test_get_service_by_invalid_params [0.304171s] ... ok
{4} tempest.api.compute.admin.test_services_negative.ServicesAdminNegativeTestJSON.test_get_service_by_invalid_service_and_valid_host [0.110890s] ... ok
{0} tempest.api.compute.security_groups.test_security_group_rules_negative.SecurityGroupRulesNegativeTestJSON.test_create_security_group_rule_with_invalid_ip_protocol [0.470778s] ... ok
{4} tempest.api.compute.admin.test_services_negative.ServicesAdminNegativeTestJSON.test_get_service_with_valid_service_and_invalid_host [0.183780s] ... ok
{4} tempest.api.compute.admin.test_services_negative.ServicesAdminNegativeTestJSON.test_list_services_with_non_admin_user [0.287877s] ... ok
{0} tempest.api.compute.security_groups.test_security_group_rules_negative.SecurityGroupRulesNegativeTestJSON.test_create_security_group_rule_with_invalid_port_range [1.273017s] ... ok
{0} tempest.api.compute.security_groups.test_security_group_rules_negative.SecurityGroupRulesNegativeTestJSON.test_create_security_group_rule_with_invalid_to_port [1.210572s] ... ok
{0} tempest.api.compute.security_groups.test_security_group_rules_negative.SecurityGroupRulesNegativeTestJSON.test_create_security_group_rule_with_non_existent_id [0.581436s] ... ok
{6} tempest.api.compute.admin.test_servers.ServersAdminTestJSON.test_create_server_with_scheduling_hint [13.829551s] ... ok
{4} setUpClass (tempest.api.compute.admin.test_volume_swap.TestMultiAttachVolumeSwap) ... SKIPPED: Volume multi-attach is not available.
{0} tempest.api.compute.security_groups.test_security_group_rules_negative.SecurityGroupRulesNegativeTestJSON.test_delete_security_group_rule_with_non_existent_id [0.688794s] ... ok
{6} tempest.api.compute.admin.test_servers.ServersAdminTestJSON.test_list_servers_by_admin [0.935071s] ... ok
{6} tempest.api.compute.admin.test_servers.ServersAdminTestJSON.test_list_servers_by_admin_with_all_tenants [1.939020s] ... ok
{4} tempest.api.compute.images.test_image_metadata.ImagesMetadataTestJSON.test_delete_image_metadata_item [2.378209s] ... ok
{6} tempest.api.compute.admin.test_servers.ServersAdminTestJSON.test_list_servers_by_admin_with_specified_tenant [2.053281s] ... ok
{6} tempest.api.compute.admin.test_servers.ServersAdminTestJSON.test_list_servers_detailed_filter_by_invalid_status [0.701949s] ... ok
{2} tempest.api.compute.admin.test_create_server.ServersWithSpecificFlavorTestJSON.test_verify_created_server_ephemeral_disk [124.114634s] ... ok
{4} tempest.api.compute.images.test_image_metadata.ImagesMetadataTestJSON.test_get_image_metadata_item [1.084511s] ... ok
{4} tempest.api.compute.images.test_image_metadata.ImagesMetadataTestJSON.test_list_image_metadata [0.763540s] ... ok
{6} tempest.api.compute.admin.test_servers.ServersAdminTestJSON.test_list_servers_filter_by_error_status [1.281858s] ... ok
{6} tempest.api.compute.admin.test_servers.ServersAdminTestJSON.test_list_servers_filter_by_exist_host [2.031739s] ... ok
{4} tempest.api.compute.images.test_image_metadata.ImagesMetadataTestJSON.test_set_image_metadata [2.338946s] ... ok
{4} tempest.api.compute.images.test_image_metadata.ImagesMetadataTestJSON.test_set_image_metadata_item [3.437131s] ... ok
{4} tempest.api.compute.images.test_image_metadata.ImagesMetadataTestJSON.test_update_image_metadata [1.322934s] ... ok
{7} tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_server_security_groups [32.194659s] ... ok
{5} tempest.api.compute.admin.test_servers_on_multinodes.ServersOnMultiNodesTest.test_create_server_with_scheduler_hint_group_affinity [27.459823s] ... ok
{7} tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_update_security_groups [1.416142s] ... ok
{3} tempest.api.compute.images.test_images_oneserver_negative.ImagesOneServerNegativeTestJSON.test_create_second_image_when_first_image_is_being_saved [33.785759s] ... ok
{7} tempest.api.compute.security_groups.test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_delete_nonexistent_security_group [0.884491s] ... ok
{0} tempest.api.compute.servers.test_instance_actions.InstanceActionsV221TestJSON.test_get_list_deleted_instance_actions [28.739884s] ... ok
{7} tempest.api.compute.security_groups.test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_delete_security_group_without_passing_id [0.777046s] ... ok
{1} tempest.api.compute.admin.test_migrations.MigrationsAdminTest.test_cold_migration [71.790400s] ... ok
{1} tempest.api.compute.admin.test_migrations.MigrationsAdminTest.test_list_migrations [0.552201s] ... ok
{7} tempest.api.compute.security_groups.test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_delete_the_default_security_group [1.266281s] ... ok
{7} tempest.api.compute.security_groups.test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_security_group_create_with_duplicate_name ... SKIPPED: Neutron allows duplicate names for security groups
{7} tempest.api.compute.security_groups.test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_security_group_create_with_invalid_group_description ... SKIPPED: Skipped until bug: https://launchpad.net/bugs/1161411 is resolved.
{7} tempest.api.compute.security_groups.test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_security_group_create_with_invalid_group_name ... SKIPPED: Skipped until bug: https://launchpad.net/bugs/1161411 is resolved.
{7} tempest.api.compute.security_groups.test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_security_group_get_nonexistent_group [0.746459s] ... ok
{7} tempest.api.compute.security_groups.test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_update_non_existent_security_group [0.608382s] ... ok
{7} tempest.api.compute.security_groups.test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_update_security_group_with_invalid_sg_des ... SKIPPED: Neutron does not check the security group description
{7} tempest.api.compute.security_groups.test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_update_security_group_with_invalid_sg_id ... SKIPPED: Neutron does not check the security group ID
{7} tempest.api.compute.security_groups.test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_update_security_group_with_invalid_sg_name ... SKIPPED: Neutron does not check the security group name
{5} tempest.api.compute.admin.test_servers_on_multinodes.ServersOnMultiNodesTest.test_create_server_with_scheduler_hint_group_anti_affinity [22.518977s] ... ok
{3} tempest.api.compute.images.test_images_oneserver_negative.ImagesOneServerNegativeTestJSON.test_delete_image_that_is_not_yet_active [34.160105s] ... ok
{5} tempest.api.compute.admin.test_servers_on_multinodes.ServersOnMultiNodesTest.test_create_servers_on_different_hosts [25.059371s] ... ok
{0} tempest.api.compute.servers.test_instance_actions_negative.InstanceActionsNegativeTestJSON.test_get_instance_action_invalid_request [0.646212s] ... ok
{0} tempest.api.compute.servers.test_instance_actions_negative.InstanceActionsNegativeTestJSON.test_list_instance_actions_non_existent_server [0.154266s] ... ok
{6} tempest.api.compute.admin.test_servers.ServersAdminTestJSON.test_rebuild_server_in_error_state [65.714320s] ... ok
{6} tempest.api.compute.admin.test_servers.ServersAdminTestJSON.test_reset_network_inject_network_info ... SKIPPED: The resetNetwork server action is not supported.
{3} tempest.api.compute.images.test_list_image_filters_negative.ListImageFiltersNegativeTestJSON.test_get_nonexistent_image [0.535216s] ... ok
{6} tempest.api.compute.admin.test_servers.ServersAdminTestJSON.test_reset_state_server [1.236616s] ... ok
{2} tempest.api.compute.admin.test_live_migration.LiveAutoBlockMigrationV225Test.test_live_block_migration [46.330612s] ... ok
{5} tempest.api.compute.admin.test_servers_on_multinodes.ServersOnMultiNodesTest.test_create_servers_on_different_hosts_with_list_of_servers [24.706104s] ... ok
{6} tempest.api.compute.admin.test_simple_tenant_usage_negative.TenantUsagesNegativeTestJSON.test_get_usage_tenant_with_empty_tenant_id [0.865432s] ... ok
{6} tempest.api.compute.admin.test_simple_tenant_usage_negative.TenantUsagesNegativeTestJSON.test_get_usage_tenant_with_invalid_date [0.379691s] ... ok
{6} tempest.api.compute.admin.test_simple_tenant_usage_negative.TenantUsagesNegativeTestJSON.test_list_usage_all_tenants_with_non_admin_user [0.533098s] ... ok
{0} tempest.api.compute.servers.test_server_metadata_negative.ServerMetadataNegativeTestJSON.test_create_server_metadata_blank_key [0.518136s] ... ok
{0} tempest.api.compute.servers.test_server_metadata_negative.ServerMetadataNegativeTestJSON.test_delete_metadata_non_existent_server ... SKIPPED: Metadata is read-only on non-Xen-based deployments.
{0} tempest.api.compute.servers.test_server_metadata_negative.ServerMetadataNegativeTestJSON.test_list_server_metadata_non_existent_server [0.487860s] ... ok
{0} tempest.api.compute.servers.test_server_metadata_negative.ServerMetadataNegativeTestJSON.test_metadata_items_limit ... SKIPPED: Metadata is read-only on non-Xen-based deployments.
{0} tempest.api.compute.servers.test_server_metadata_negative.ServerMetadataNegativeTestJSON.test_server_create_metadata_key_too_long [1.131437s] ... ok
{0} tempest.api.compute.servers.test_server_metadata_negative.ServerMetadataNegativeTestJSON.test_server_metadata_non_existent_server [0.038965s] ... ok
{0} tempest.api.compute.servers.test_server_metadata_negative.ServerMetadataNegativeTestJSON.test_set_metadata_invalid_key ... SKIPPED: Metadata is read-only on non-Xen-based deployments.
{0} tempest.api.compute.servers.test_server_metadata_negative.ServerMetadataNegativeTestJSON.test_set_metadata_non_existent_server ... SKIPPED: Metadata is read-only on non-Xen-based deployments.
{0} tempest.api.compute.servers.test_server_metadata_negative.ServerMetadataNegativeTestJSON.test_set_server_metadata_blank_key ... SKIPPED: Metadata is read-only on non-Xen-based deployments.
{0} tempest.api.compute.servers.test_server_metadata_negative.ServerMetadataNegativeTestJSON.test_set_server_metadata_missing_metadata ... SKIPPED: Metadata is read-only on non-Xen-based deployments.
{0} tempest.api.compute.servers.test_server_metadata_negative.ServerMetadataNegativeTestJSON.test_update_metadata_non_existent_server ... SKIPPED: Metadata is read-only on non-Xen-based deployments.
{0} tempest.api.compute.servers.test_server_metadata_negative.ServerMetadataNegativeTestJSON.test_update_metadata_with_blank_key ... SKIPPED: Metadata is read-only on non-Xen-based deployments.