/opt/stack/tempest ~
Initializing stestr
all-plugin create: /opt/stack/tempest/.tox/all-plugin
all-plugin installdeps: -chttps://releases.openstack.org/constraints/upper/master, -r/opt/stack/tempest/requirements.txt
all-plugin develop-inst: /opt/stack/tempest
all-plugin installed: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead,  from cryptography.utils import int_from_bytes,/usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead,  from cryptography.utils import int_from_bytes,alembic==1.6.5,amqp==5.0.6,aniso8601==9.0.1,appdirs==1.4.4,attrs==21.2.0,Automat==0.8.0,automaton==2.3.0,Babel==2.9.1,backports.entry-points-selectable==1.1.0,bcrypt==3.2.0,beautifulsoup4==4.9.3,blinker==1.4,boto3==1.18.18,botocore==1.21.18,cachetools==4.2.2,castellan==3.9.0,certifi==2021.5.30,cffi==1.14.6,chardet==3.0.4,charset-normalizer==2.0.4,-e git+https://opendev.org/openstack/cinder@98b49d05726b848fefd51d90af5abffa6f1d842d#egg=cinder,click==8.0.1,cliff==3.8.0,cmd2==2.1.2,colorama==0.4.4,command-not-found==0.3,configobj==5.0.6,configshell-fb==1.1.25,constantly==15.1.0,cryptography==3.4.7,cursive==0.2.2,dbus-python==1.2.16,debtcollector==2.2.0,decorator==5.0.9,defusedxml==0.7.1,distlib==0.3.2,distro==1.4.0,distro-info===0.23ubuntu1,dnspython==1.16.0,dogpile.cache==1.1.3,elementpath==2.2.3,entrypoints==0.3,etcd3==0.12.0,etcd3gw==1.0.0,eventlet==0.31.1,extras==1.0.0,fasteners==0.14.1,filelock==3.0.12,fixtures==3.0.0,Flask==2.0.1,Flask-RESTful==0.3.9,future==0.18.2,futurist==2.3.0,-e git+https://opendev.org/openstack/glance@d9b8023410348e769f8a69c168461126ce7ff6fc#egg=glance,glance-store==2.6.0,google-api-core==1.31.1,google-api-python-client==2.15.0,google-auth==1.34.0,google-auth-httplib2==0.1.0,googleapis-common-protos==1.53.0,greenlet==1.1.1,grpcio==1.39.0,httplib2==0.19.1,hyperlink==19.0.0,idna==3.2,importlib-metadata==1.5.0,importlib-resources==5.2.2,incremental==16.10.1,iso8601==0.1.16,itsdangerous==2.0.1,Jinja2==3.0.1,jmespath==0.10.0,jsonpatch==1.32,jsonpointer==2.1,jsonschema==3.2.0,keyring==18.0.1,-e git+https://opendev.org/openstack/keystone@d1c7759f487612d6069ac076ad314e572a71ed24#egg=keystone,keystoneauth1==4.3.1,keystonemiddleware==9.3.0,kombu==5.1.0,language-selector==0.1,lazr.uri==1.0.3,linecache2==1.0.0,logutils==0.3.5,lxml==4.6.3,Mako==1.1.4,MarkupSafe==2.0.1,microversion-parse==1.0.1,monotonic==1.6,more-itertools==4.2.0,msgpack==1.0.2,munch==2.5.0,mysqlclient==1.4.4,netaddr==0.8.0,netifaces==0.11.0,-e git+https://opendev.org/openstack/networking-hyperv@2329562d274b953851603f09f59b140b21a898b4#egg=networking_hyperv,networkx==2.6.2,-e git+https://opendev.org/openstack/neutron@578f74ca8782badfa6251f438c3cfd3e8fd10009#egg=neutron,neutron-lib==2.13.0,-e git+http://10.106.1.39/p/openstack/nova@4375cd19496f00a59b519c9a5b3218ada5008851#egg=nova,numpy==1.21.1,oauth2client==4.1.3,oauthlib==3.1.1,-e git+https://opendev.org/openstack/placement.git@36aba336b15a913a3d8bc3d5441fbb4c6feb38c5#egg=openstack_placement,openstacksdk==0.58.0,os-brick==4.4.0,os-client-config==2.1.0,os-ken==2.0.0,os-resource-classes==1.1.0,os-service-types==1.7.0,os-testr==2.0.0,os-traits==2.5.0,os-vif==2.5.0,os-win==5.4.0,os-xenapi==0.3.4,osc-lib==2.4.1,osc-placement==3.0.1,oslo.cache==2.8.1,oslo.concurrency==4.4.0,oslo.config==8.7.1,oslo.context==3.3.0,oslo.db==10.0.0,oslo.i18n==5.0.1,oslo.limit==1.4.0,oslo.log==4.6.0,oslo.messaging==12.8.0,oslo.middleware==4.3.0,oslo.policy==3.8.1,oslo.privsep==2.6.0,oslo.reports==2.3.0,oslo.rootwrap==6.3.0,oslo.serialization==4.1.0,oslo.service==2.6.0,oslo.upgradecheck==1.4.0,oslo.utils==4.9.2,oslo.versionedobjects==2.4.0,oslo.vmware==3.9.0,osprofiler==3.4.1,ovs==2.13.3,ovsdbapp==1.11.0,packaging==21.0,paramiko==2.7.2,passlib==1.7.4,Paste==3.5.0,PasteDeploy==2.1.1,pbr==5.6.0,pcp==5.0,pecan==1.3.3,pexpect==4.6.0,platformdirs==2.2.0,pluggy==0.13.1,prettytable==0.7.2,protobuf==3.17.3,psutil==5.8.0,py==1.10.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycadf==3.1.1,pycparser==2.20,pydot==1.4.2,pyeclib==1.6.0,Pygments==2.3.1,PyGObject==3.36.0,PyHamcrest==1.9.0,pyinotify==0.9.6,PyJWT==2.1.0,pymacaroons==0.13.0,PyMySQL==1.0.2,PyNaCl==1.4.0,pyOpenSSL==20.0.1,pyparsing==2.4.7,pyperclip==1.8.2,pypowervm==1.1.26,pyroute2==0.6.4,pyroute2.core==0.6.4,pyroute2.ethtool==0.6.4,pyroute2.ipdb==0.6.4,pyroute2.ipset==0.6.4,pyroute2.ndb==0.6.4,pyroute2.nftables==0.6.4,pyroute2.nslink==0.6.4,pyrsistent==0.15.5,pysaml2==7.0.1,pyserial==3.4,python-apt==2.0.0+ubuntu0.20.4.4,python-barbicanclient==5.1.0,python-cinderclient==8.0.0,python-dateutil==2.8.2,python-debian===0.1.36ubuntu1,python-designateclient==4.3.0,python-editor==1.0.4,python-glanceclient==3.4.0,python-keystoneclient==4.2.0,python-memcached==1.59,python-neutronclient==7.5.0,python-novaclient==17.5.0,python-openstackclient==5.5.0,python-subunit==1.4.0,python-swiftclient==3.12.0,pytz==2021.1,pyudev==0.22.0,PyYAML==5.4.1,repoze.lru==0.7,requests==2.26.0,requests-unixsocket==0.2.0,requestsexceptions==1.4.0,retrying==1.3.3,rfc3986==1.5.0,Routes==2.5.1,rsa==4.7.2,rtslib-fb==2.1.74,s3transfer==0.5.0,scrypt==0.8.18,SecretStorage==2.3.1,setproctitle==1.2.2,simplegeneric==0.8.1,simplejson==3.17.3,six==1.16.0,sortedcontainers==2.1.0,sos==4.1,soupsieve==2.2.1,SQLAlchemy==1.4.22,sqlalchemy-migrate==0.13.0,sqlparse==0.4.1,ssh-import-id==5.10,statsd==3.3.0,stestr==3.2.0,stevedore==3.3.0,suds-jurko==0.6,-e git+https://opendev.org/openstack/swift@901d2e15b7fa7c7a923b885cd4d369d063357075#egg=swift,systemd-python==234,tabulate==0.8.9,targetcli-fb==2.1.51,taskflow==4.6.1,-e git+https://opendev.org/openstack/tempest@d771c95ee83aa63a15919bea0f60fd3795b3ba70#egg=tempest,Tempita==0.5.2,tenacity==6.3.1,testresources==2.0.1,testscenarios==0.5.0,testtools==2.5.0,toml==0.10.2,tooz==2.9.0,tox==3.24.1,traceback2==1.4.0,ufw==0.36,unattended-upgrades==0.1,unittest2==1.1.0,uritemplate==3.0.1,urllib3==1.26.6,urwid==2.0.1,vine==5.0.0,virtualenv==20.7.2,voluptuous==0.12.1,wadllib==1.3.3,waitress==2.0.0,warlock==1.3.3,wcwidth==0.2.5,WebOb==1.8.7,websockify==0.10.0,WebTest==2.0.35,Werkzeug==2.0.1,wrapt==1.12.1,WSME==0.11.0,xattr==0.9.7,xmlschema==1.7.0,yappi==1.3.2,zipp==3.5.0,zope.interface==4.7.1,zstd==1.5.0.2,zVMCloudConnector==1.4.1
___________________________________ summary ____________________________________
  all-plugin: skipped tests
  congratulations :)
{7} setUpClass (tempest.api.compute.admin.test_agents.AgentsAdminTestJSON) ... SKIPPED: The os-agents API is not supported.
{1} setUpClass (tempest.api.compute.admin.test_auto_allocate_network.AutoAllocateNetworkTest) ... SKIPPED: Found shared networks: [{'id': 'c61418c7-ed65-4c18-9bf1-1882716bbb1f', 'name': 'shared', 'tenant_id': 'eebb8b77187b40ffb5ab4ea8b8f71fb6', 'admin_state_up': True, 'mtu': 1500, 'status': 'ACTIVE', 'subnets': ['f7dd44d8-92fc-4676-8d22-ec4a0a0088ce'], 'shared': True, 'availability_zone_hints': [], 'availability_zones': ['nova'], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2021-08-11T18:38:46Z', 'updated_at': '2021-08-11T18:38:49Z', 'revision_number': 2, 'project_id': 'eebb8b77187b40ffb5ab4ea8b8f71fb6'}]
{2} tempest.api.compute.admin.test_availability_zone.AZAdminV2TestJSON.test_get_availability_zone_list [2.031347s] ... ok
{2} tempest.api.compute.admin.test_availability_zone.AZAdminV2TestJSON.test_get_availability_zone_list_detail [1.705736s] ... ok
{5} tempest.api.compute.admin.test_flavors_extra_specs_negative.FlavorsExtraSpecsNegativeTestJSON.test_flavor_get_nonexistent_key [1.118993s] ... ok
{5} tempest.api.compute.admin.test_flavors_extra_specs_negative.FlavorsExtraSpecsNegativeTestJSON.test_flavor_non_admin_set_keys [0.428328s] ... ok
{5} tempest.api.compute.admin.test_flavors_extra_specs_negative.FlavorsExtraSpecsNegativeTestJSON.test_flavor_non_admin_unset_keys [1.038180s] ... ok
{5} tempest.api.compute.admin.test_flavors_extra_specs_negative.FlavorsExtraSpecsNegativeTestJSON.test_flavor_non_admin_update_specific_key [1.385021s] ... ok
{5} tempest.api.compute.admin.test_flavors_extra_specs_negative.FlavorsExtraSpecsNegativeTestJSON.test_flavor_unset_nonexistent_key [0.349003s] ... ok
{5} tempest.api.compute.admin.test_flavors_extra_specs_negative.FlavorsExtraSpecsNegativeTestJSON.test_flavor_update_mismatch_key [0.131652s] ... ok
{7} tempest.api.compute.admin.test_flavors_microversions.FlavorsV261TestJSON.test_crud_flavor [5.725428s] ... ok
{5} tempest.api.compute.admin.test_flavors_extra_specs_negative.FlavorsExtraSpecsNegativeTestJSON.test_flavor_update_more_key [0.639789s] ... ok
{2} tempest.api.compute.admin.test_flavors.FlavorsAdminTestJSON.test_create_flavor_using_string_ram [0.963914s] ... ok
{2} tempest.api.compute.admin.test_flavors.FlavorsAdminTestJSON.test_create_flavor_verify_entry_in_list_details [0.260111s] ... ok
{2} tempest.api.compute.admin.test_flavors.FlavorsAdminTestJSON.test_create_flavor_with_int_id [0.233696s] ... ok
{2} tempest.api.compute.admin.test_flavors.FlavorsAdminTestJSON.test_create_flavor_with_none_id [0.245493s] ... ok
{2} tempest.api.compute.admin.test_flavors.FlavorsAdminTestJSON.test_create_flavor_with_uuid_id [0.849308s] ... ok
{2} tempest.api.compute.admin.test_flavors.FlavorsAdminTestJSON.test_create_list_flavor_without_extra_data [1.559807s] ... ok
{2} tempest.api.compute.admin.test_flavors.FlavorsAdminTestJSON.test_create_server_with_non_public_flavor [0.368407s] ... ok
{2} tempest.api.compute.admin.test_flavors.FlavorsAdminTestJSON.test_is_public_string_variations [3.666373s] ... ok
{2} tempest.api.compute.admin.test_flavors.FlavorsAdminTestJSON.test_list_non_public_flavor [2.671051s] ... ok
{2} tempest.api.compute.admin.test_flavors.FlavorsAdminTestJSON.test_list_public_flavor_with_other_user [0.587398s] ... ok
{5} tempest.api.compute.admin.test_quotas.QuotasAdminTestJSON.test_delete_quota [3.007703s] ... ok
{5} tempest.api.compute.admin.test_quotas.QuotasAdminTestJSON.test_get_default_quotas [0.646083s] ... ok
{7} setUpClass (tempest.api.compute.admin.test_floating_ips_bulk.FloatingIPsBulkAdminTestJSON) ... SKIPPED: nova-network is gone
{7} tempest.api.compute.admin.test_hosts.HostsAdminTestJSON.test_list_hosts [0.265870s] ... ok
{7} tempest.api.compute.admin.test_hosts.HostsAdminTestJSON.test_list_hosts_with_a_blank_zone [0.112407s] ... ok
{7} tempest.api.compute.admin.test_hosts.HostsAdminTestJSON.test_list_hosts_with_nonexistent_zone [0.185098s] ... ok
{5} tempest.api.compute.admin.test_quotas.QuotasAdminTestJSON.test_get_updated_quotas [4.508082s] ... ok
{5} tempest.api.compute.admin.test_quotas.QuotasAdminTestJSON.test_update_all_quota_resources_for_tenant [2.134908s] ... ok
{2} tempest.api.compute.admin.test_flavors_microversions.FlavorsV255TestJSON.test_crud_flavor [1.026932s] ... ok
{2} tempest.api.compute.admin.test_hosts_negative.HostsAdminNegativeTestJSON.test_list_hosts_with_non_admin_user [0.135501s] ... ok
{2} tempest.api.compute.admin.test_hosts_negative.HostsAdminNegativeTestJSON.test_reboot_host_with_non_admin_user [0.208110s] ... ok
{2} tempest.api.compute.admin.test_hosts_negative.HostsAdminNegativeTestJSON.test_reboot_nonexistent_host [0.140905s] ... ok
{2} tempest.api.compute.admin.test_hosts_negative.HostsAdminNegativeTestJSON.test_show_host_detail_with_non_admin_user [0.033659s] ... ok
{2} tempest.api.compute.admin.test_hosts_negative.HostsAdminNegativeTestJSON.test_show_host_detail_with_nonexistent_hostname [0.036997s] ... ok
{2} tempest.api.compute.admin.test_hosts_negative.HostsAdminNegativeTestJSON.test_shutdown_host_with_non_admin_user [0.024682s] ... ok
{2} tempest.api.compute.admin.test_hosts_negative.HostsAdminNegativeTestJSON.test_shutdown_nonexistent_host [0.033768s] ... ok
{2} tempest.api.compute.admin.test_hosts_negative.HostsAdminNegativeTestJSON.test_startup_host_with_non_admin_user [0.025040s] ... ok
{2} tempest.api.compute.admin.test_hosts_negative.HostsAdminNegativeTestJSON.test_startup_nonexistent_host [0.074680s] ... ok
{2} tempest.api.compute.admin.test_hosts_negative.HostsAdminNegativeTestJSON.test_update_host_with_invalid_maintenance_mode [0.012799s] ... ok
{2} tempest.api.compute.admin.test_hosts_negative.HostsAdminNegativeTestJSON.test_update_host_with_invalid_status [0.017846s] ... ok
{2} tempest.api.compute.admin.test_hosts_negative.HostsAdminNegativeTestJSON.test_update_host_with_non_admin_user [0.019253s] ... ok
{2} tempest.api.compute.admin.test_hosts_negative.HostsAdminNegativeTestJSON.test_update_host_without_param [0.018557s] ... ok
{2} tempest.api.compute.admin.test_hosts_negative.HostsAdminNegativeTestJSON.test_update_nonexistent_host [0.026124s] ... ok
{0} tempest.api.compute.admin.test_aggregates.AggregatesAdminTestJSON.test_aggregate_add_host_create_server_with_az [38.858903s] ... ok
{0} tempest.api.compute.admin.test_aggregates.AggregatesAdminTestJSON.test_aggregate_add_host_get_details [0.612631s] ... ok
{0} tempest.api.compute.admin.test_aggregates.AggregatesAdminTestJSON.test_aggregate_add_host_list [1.369153s] ... ok
{1} tempest.api.compute.admin.test_delete_server.DeleteServersAdminTestJSON.test_admin_delete_servers_of_others [39.532536s] ... ok
{2} tempest.api.compute.admin.test_hypervisor.HypervisorAdminTestJSON.test_get_hypervisor_list [0.274623s] ... ok
{0} tempest.api.compute.admin.test_aggregates.AggregatesAdminTestJSON.test_aggregate_add_remove_host [1.100841s] ... ok
{2} tempest.api.compute.admin.test_hypervisor.HypervisorAdminTestJSON.test_get_hypervisor_list_details [0.899725s] ... ok
{2} tempest.api.compute.admin.test_hypervisor.HypervisorAdminTestJSON.test_get_hypervisor_show_details [1.284496s] ... ok
{2} tempest.api.compute.admin.test_hypervisor.HypervisorAdminTestJSON.test_get_hypervisor_stats [0.158714s] ... ok
{0} tempest.api.compute.admin.test_aggregates.AggregatesAdminTestJSON.test_aggregate_create_delete [2.343512s] ... ok
{4} tempest.api.compute.admin.test_aggregates.AggregatesAdminTestV241.test_create_update_show_aggregate_add_remove_host [45.030915s] ... ok
{2} tempest.api.compute.admin.test_hypervisor.HypervisorAdminTestJSON.test_get_hypervisor_uptime [1.608582s] ... ok
{0} tempest.api.compute.admin.test_aggregates.AggregatesAdminTestJSON.test_aggregate_create_delete_with_az [1.638974s] ... ok
{7} tempest.api.compute.admin.test_hosts.HostsAdminTestJSON.test_list_hosts_with_zone [18.254098s] ... ok
{7} tempest.api.compute.admin.test_hosts.HostsAdminTestJSON.test_show_host_detail [0.906333s] ... ok
{0} tempest.api.compute.admin.test_aggregates.AggregatesAdminTestJSON.test_aggregate_create_update_metadata_get_details [1.215569s] ... ok
{0} tempest.api.compute.admin.test_aggregates.AggregatesAdminTestJSON.test_aggregate_create_update_with_az [0.460410s] ... ok
{0} tempest.api.compute.admin.test_aggregates.AggregatesAdminTestJSON.test_aggregate_create_verify_entry_in_list [0.350245s] ... ok
{2} tempest.api.compute.admin.test_hypervisor.HypervisorAdminUnderV252Test.test_get_hypervisor_show_servers [0.574888s] ... ok
{2} tempest.api.compute.admin.test_hypervisor.HypervisorAdminUnderV252Test.test_search_hypervisor [0.119658s] ... ok
{4} tempest.api.compute.admin.test_availability_zone_negative.AZAdminNegativeTestJSON.test_get_availability_zone_list_detail_with_non_admin_user [0.344570s] ... ok
{3} tempest.api.compute.admin.test_live_migration.LiveMigrationTest.test_live_block_migration [62.140563s] ... ok
{5} tempest.api.compute.admin.test_servers_negative.ServersAdminNegativeTestJSON.test_migrate_non_existent_server [0.957205s] ... ok
{7} tempest.api.compute.admin.test_quotas.QuotasAdminTestV236.test_get_updated_quotas [6.047229s] ... ok
{1} tempest.api.compute.admin.test_delete_server.DeleteServersAdminTestJSON.test_delete_server_while_in_error_state [20.373697s] ... ok
{2} tempest.api.compute.admin.test_hypervisor_negative.HypervisorAdminNegativeTestJSON.test_get_hypervisor_list_details_with_non_admin_user [1.254887s] ... ok
{2} tempest.api.compute.admin.test_hypervisor_negative.HypervisorAdminNegativeTestJSON.test_get_hypervisor_list_with_non_admin_user [0.129596s] ... ok
{2} tempest.api.compute.admin.test_hypervisor_negative.HypervisorAdminNegativeTestJSON.test_get_hypervisor_stats_with_non_admin_user [0.045400s] ... ok
{0} tempest.api.compute.admin.test_aggregates_negative.AggregatesAdminNegativeTestJSON.test_aggregate_add_existent_host [2.123853s] ... ok
{2} tempest.api.compute.admin.test_hypervisor_negative.HypervisorAdminNegativeTestJSON.test_get_hypervisor_uptime_with_non_admin_user [0.398320s] ... ok
{2} tempest.api.compute.admin.test_hypervisor_negative.HypervisorAdminNegativeTestJSON.test_get_nonexistent_hypervisor_uptime [0.121549s] ... ok
{2} tempest.api.compute.admin.test_hypervisor_negative.HypervisorAdminNegativeTestJSON.test_show_hypervisor_with_non_admin_user [0.643728s] ... ok
{0} tempest.api.compute.admin.test_aggregates_negative.AggregatesAdminNegativeTestJSON.test_aggregate_add_host_as_user [0.851946s] ... ok
{2} tempest.api.compute.admin.test_hypervisor_negative.HypervisorAdminNegativeTestJSON.test_show_nonexistent_hypervisor [0.103647s] ... ok
{0} tempest.api.compute.admin.test_aggregates_negative.AggregatesAdminNegativeTestJSON.test_aggregate_add_non_exist_host [0.381501s] ... ok
{0} tempest.api.compute.admin.test_aggregates_negative.AggregatesAdminNegativeTestJSON.test_aggregate_create_aggregate_name_length_exceeds_255 [0.017661s] ... ok
{0} tempest.api.compute.admin.test_aggregates_negative.AggregatesAdminNegativeTestJSON.test_aggregate_create_aggregate_name_length_less_than_1 [0.014545s] ... ok
{0} tempest.api.compute.admin.test_aggregates_negative.AggregatesAdminNegativeTestJSON.test_aggregate_create_as_user [0.015718s] ... ok
{0} tempest.api.compute.admin.test_aggregates_negative.AggregatesAdminNegativeTestJSON.test_aggregate_create_with_existent_aggregate_name [0.172089s] ... ok
{0} tempest.api.compute.admin.test_aggregates_negative.AggregatesAdminNegativeTestJSON.test_aggregate_delete_as_user [0.145972s] ... ok
{0} tempest.api.compute.admin.test_aggregates_negative.AggregatesAdminNegativeTestJSON.test_aggregate_delete_with_invalid_id [0.207625s] ... ok
{0} tempest.api.compute.admin.test_aggregates_negative.AggregatesAdminNegativeTestJSON.test_aggregate_get_details_as_user [0.793061s] ... ok
{0} tempest.api.compute.admin.test_aggregates_negative.AggregatesAdminNegativeTestJSON.test_aggregate_get_details_with_invalid_id [0.043905s] ... ok
{0} tempest.api.compute.admin.test_aggregates_negative.AggregatesAdminNegativeTestJSON.test_aggregate_list_as_user [0.045121s] ... ok
{4} tempest.api.compute.admin.test_flavors_access.FlavorsAccessTestJSON.test_flavor_access_add_remove [2.945168s] ... ok
{4} tempest.api.compute.admin.test_flavors_access.FlavorsAccessTestJSON.test_flavor_access_list_with_private_flavor [0.639848s] ... ok
{0} tempest.api.compute.admin.test_aggregates_negative.AggregatesAdminNegativeTestJSON.test_aggregate_remove_host_as_user [0.799612s] ... ok
{0} tempest.api.compute.admin.test_aggregates_negative.AggregatesAdminNegativeTestJSON.test_aggregate_remove_nonexistent_host [0.320439s] ... ok
{0} setUpClass (tempest.api.compute.admin.test_fixed_ips.FixedIPsTestJson) ... SKIPPED: FixedIPsTestJson skipped as neutron is available
{0} setUpClass (tempest.api.compute.admin.test_fixed_ips_negative.FixedIPsNegativeTestJson) ... SKIPPED: FixedIPsNegativeTestJson skipped as neutron is available
{2} tempest.api.compute.admin.test_instance_usage_audit_log.InstanceUsageAuditLogTestJSON.test_get_instance_usage_audit_log [0.679380s] ... ok
{2} tempest.api.compute.admin.test_instance_usage_audit_log.InstanceUsageAuditLogTestJSON.test_list_instance_usage_audit_logs [0.080162s] ... ok
{1} tempest.api.compute.admin.test_flavors_access_negative.FlavorsAccessNegativeTestJSON.test_add_flavor_access_duplicate [2.961497s] ... ok
{1} tempest.api.compute.admin.test_flavors_access_negative.FlavorsAccessNegativeTestJSON.test_flavor_access_list_with_public_flavor [0.551763s] ... ok
{4} tempest.api.compute.admin.test_flavors_extra_specs.FlavorsExtraSpecsTestJSON.test_flavor_non_admin_get_all_keys [0.393006s] ... ok
{4} tempest.api.compute.admin.test_flavors_extra_specs.FlavorsExtraSpecsTestJSON.test_flavor_non_admin_get_specific_key [0.085362s] ... ok
{1} tempest.api.compute.admin.test_flavors_access_negative.FlavorsAccessNegativeTestJSON.test_flavor_non_admin_add [0.516894s] ... ok
{0} tempest.api.compute.admin.test_instance_usage_audit_log_negative.InstanceUsageAuditLogNegativeTestJSON.test_get_instance_usage_audit_logs_with_invalid_time [0.204360s] ... ok
{0} tempest.api.compute.admin.test_instance_usage_audit_log_negative.InstanceUsageAuditLogNegativeTestJSON.test_instance_usage_audit_logs_with_nonadmin_user [0.606476s] ... ok
{4} tempest.api.compute.admin.test_flavors_extra_specs.FlavorsExtraSpecsTestJSON.test_flavor_set_get_update_show_unset_keys [1.156880s] ... ok
{1} tempest.api.compute.admin.test_flavors_access_negative.FlavorsAccessNegativeTestJSON.test_flavor_non_admin_remove [1.243376s] ... ok
{1} tempest.api.compute.admin.test_flavors_access_negative.FlavorsAccessNegativeTestJSON.test_remove_flavor_access_not_found [0.504247s] ... ok
{5} tempest.api.compute.admin.test_servers_negative.ServersAdminNegativeTestJSON.test_migrate_server_invalid_state [17.661679s] ... ok
{5} tempest.api.compute.admin.test_servers_negative.ServersAdminNegativeTestJSON.test_reset_state_server_invalid_state [0.020457s] ... ok
{5} tempest.api.compute.admin.test_servers_negative.ServersAdminNegativeTestJSON.test_reset_state_server_invalid_type [0.020240s] ... ok
{5} tempest.api.compute.admin.test_servers_negative.ServersAdminNegativeTestJSON.test_reset_state_server_nonexistent_server [0.020095s] ... ok
{4} tempest.api.compute.admin.test_hypervisor.HypervisorAdminV228Test.test_get_list_hypervisor_details [1.597166s] ... ok
{0} tempest.api.compute.admin.test_keypairs_v210.KeyPairsV210TestJSON.test_admin_manage_keypairs_for_other_users [5.048697s] ... ok
{1} tempest.api.compute.admin.test_live_migration.LiveMigrationRemoteConsolesV26Test.test_live_migration_serial_console ... SKIPPED: Serial console not supported.
{4} tempest.api.compute.admin.test_hypervisor_negative.HypervisorAdminNegativeUnderV252Test.test_search_hypervisor_with_non_admin_user [0.628950s] ... ok
{4} tempest.api.compute.admin.test_hypervisor_negative.HypervisorAdminNegativeUnderV252Test.test_search_nonexistent_hypervisor [0.049850s] ... ok
{4} tempest.api.compute.admin.test_hypervisor_negative.HypervisorAdminNegativeUnderV252Test.test_show_servers_with_non_admin_user [0.152877s] ... ok
{4} tempest.api.compute.admin.test_hypervisor_negative.HypervisorAdminNegativeUnderV252Test.test_show_servers_with_nonexistent_hypervisor [0.029295s] ... ok
{5} tempest.api.compute.flavors.test_flavors_negative.FlavorsV2NegativeTest.test_boot_with_low_ram [4.118641s] ... ok
{3} tempest.api.compute.admin.test_live_migration.LiveMigrationTest.test_live_block_migration_paused [40.966850s] ... ok
{1} tempest.api.compute.admin.test_networks.NetworksTest.test_get_network [1.847603s] ... ok
{1} tempest.api.compute.admin.test_networks.NetworksTest.test_list_all_networks [1.035393s] ... ok
{7} tempest.api.compute.admin.test_servers_on_multinodes.ServersOnMultiNodesTest.test_create_server_with_scheduler_hint_group_affinity [27.685832s] ... ok
{4} tempest.api.compute.admin.test_live_migration_negative.LiveMigrationNegativeTest.test_invalid_host_for_migration [27.443134s] ... ok
{2} tempest.api.compute.admin.test_live_migration.LiveAutoBlockMigrationV225Test.test_live_block_migration [45.001592s] ... ok
{5} tempest.api.compute.floating_ips.test_list_floating_ips.FloatingIPDetailsTestJSON.test_get_floating_ip_details [6.355153s] ... ok
{7} tempest.api.compute.admin.test_servers_on_multinodes.ServersOnMultiNodesTest.test_create_server_with_scheduler_hint_group_anti_affinity [24.204372s] ... ok
{5} tempest.api.compute.floating_ips.test_list_floating_ips.FloatingIPDetailsTestJSON.test_list_floating_ip_pools [0.485198s] ... ok
{5} tempest.api.compute.floating_ips.test_list_floating_ips.FloatingIPDetailsTestJSON.test_list_floating_ips [0.355684s] ... ok
{0} tempest.api.compute.admin.test_migrations.MigrationsAdminTest.test_cold_migration [55.050382s] ... ok
{0} tempest.api.compute.admin.test_migrations.MigrationsAdminTest.test_list_migrations [0.458697s] ... ok
{4} tempest.api.compute.admin.test_live_migration_negative.LiveMigrationNegativeTest.test_live_block_migration_suspended [23.571104s] ... ok
{7} tempest.api.compute.admin.test_servers_on_multinodes.ServersOnMultiNodesTest.test_create_servers_on_different_hosts [23.522545s] ... ok
{5} tempest.api.compute.floating_ips.test_list_floating_ips_negative.FloatingIPDetailsNegativeTestJSON.test_get_nonexistent_floating_ip_details [3.062868s] ... ok
{7} tempest.api.compute.admin.test_servers_on_multinodes.ServersOnMultiNodesTest.test_create_servers_on_different_hosts_with_list_of_servers [30.611738s] ... ok
{3} tempest.api.compute.admin.test_live_migration.LiveMigrationTest.test_live_block_migration_with_attached_volume [105.309632s] ... ok
{2} tempest.api.compute.admin.test_live_migration.LiveAutoBlockMigrationV225Test.test_live_block_migration_paused [82.291344s] ... ok
{7} tempest.api.compute.admin.test_servers_on_multinodes.ServersOnMultiNodesTest.test_create_servers_on_same_host [24.181769s] ... ok
{1} tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_changes_since [0.801797s] ... ok
{1} tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_name [0.468445s] ... ok
{1} tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_id [0.354188s] ... ok
{0} tempest.api.compute.admin.test_migrations.MigrationsAdminTest.test_list_migrations_in_flavor_resize_situation [82.671872s] ... ok
{1} tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_ref [0.516620s] ... ok
{4} tempest.api.compute.admin.test_servers.ServersAdminTestJSON.test_create_server_with_scheduling_hint [25.429893s] ... ok
{1} tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_status [0.727538s] ... ok
{1} tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_type [0.375907s] ... ok
{4} tempest.api.compute.admin.test_servers.ServersAdminTestJSON.test_list_servers_by_admin [0.714997s] ... ok
{1} tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_limit_results [0.612754s] ... ok
{1} tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_changes_since [0.678544s] ... ok
{4} tempest.api.compute.admin.test_servers.ServersAdminTestJSON.test_list_servers_by_admin_with_all_tenants [1.631440s] ... ok
{1} tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_name [0.690467s] ... ok
{1} tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_server_ref [0.499844s] ... ok
{1} tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_status [0.256335s] ... ok
{4} tempest.api.compute.admin.test_servers.ServersAdminTestJSON.test_list_servers_by_admin_with_specified_tenant [1.063331s] ... ok
{4} tempest.api.compute.admin.test_servers.ServersAdminTestJSON.test_list_servers_detailed_filter_by_invalid_status [0.394478s] ... ok
{1} tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_type [0.771195s] ... ok
{1} tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_limit_results [0.582996s] ... ok
{4} tempest.api.compute.admin.test_servers.ServersAdminTestJSON.test_list_servers_filter_by_error_status [3.828177s] ... ok
{4} tempest.api.compute.admin.test_servers.ServersAdminTestJSON.test_list_servers_filter_by_exist_host [2.128688s] ... ok
{5} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image [41.769265s] ... ok
{7} setUpClass (tempest.api.compute.admin.test_volume_swap.TestMultiAttachVolumeSwap) ... SKIPPED: Volume multi-attach is not available.
{7} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor [0.351476s] ... ok
{7} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors [0.161851s] ... ok
{7} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_detailed_filter_by_min_disk [0.090090s] ... ok
{7} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_detailed_filter_by_min_ram [0.105853s] ... ok
{7} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_detailed_limit_results [0.030909s] ... ok
{7} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_detailed_using_marker [0.096086s] ... ok
{7} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_filter_by_min_disk [0.081933s] ... ok
{7} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_filter_by_min_ram [0.096309s] ... ok
{7} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_limit_results [0.056195s] ... ok
{7} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_using_marker [0.777877s] ... ok
{7} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_with_detail [0.216359s] ... ok
{5} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name [34.975566s] ... ok
{2} tempest.api.compute.admin.test_live_migration.LiveAutoBlockMigrationV225Test.test_live_block_migration_with_attached_volume [88.826920s] ... ok
{0} tempest.api.compute.admin.test_migrations.MigrationsAdminTest.test_resize_server_revert_deleted_flavor [69.616282s] ... ok
{3} tempest.api.compute.admin.test_live_migration.LiveMigrationTest.test_volume_backed_live_migration [102.534392s] ... ok
{6} tempest.api.compute.admin.test_create_server.ServersWithSpecificFlavorTestJSON.test_verify_created_server_ephemeral_disk [291.513202s] ... ok
{5} tempest.api.compute.images.test_images_oneserver_negative.ImagesOneServerNegativeTestJSON.test_create_image_specify_invalid_metadata [1.315702s] ... ok
{5} tempest.api.compute.images.test_images_oneserver_negative.ImagesOneServerNegativeTestJSON.test_create_image_specify_metadata_over_limits [2.253022s] ... ok
{7} tempest.api.compute.floating_ips.test_floating_ips_actions_negative.FloatingIPsAssociationNegativeTestJSON.test_associate_ip_to_server_with_floating_ip [23.963346s] ... ok
{5} tempest.api.compute.images.test_images_oneserver_negative.ImagesOneServerNegativeTestJSON.test_create_image_specify_name_over_character_limit [7.356191s] ... ok
{7} tempest.api.compute.floating_ips.test_floating_ips_actions_negative.FloatingIPsAssociationNegativeTestJSON.test_associate_ip_to_server_without_passing_floating_ip [0.928977s] ... ok
{7} tempest.api.compute.floating_ips.test_floating_ips_actions_negative.FloatingIPsAssociationNegativeTestJSON.test_associate_nonexistent_floating_ip [0.795945s] ... ok
{7} tempest.api.compute.floating_ips.test_floating_ips_actions_negative.FloatingIPsAssociationNegativeTestJSON.test_dissociate_nonexistent_floating_ip [0.852212s] ... ok
{4} tempest.api.compute.admin.test_servers.ServersAdminTestJSON.test_rebuild_server_in_error_state [90.578880s] ... ok
{4} tempest.api.compute.admin.test_servers.ServersAdminTestJSON.test_reset_network_inject_network_info ... SKIPPED: The resetNetwork server action is not supported.
{4} tempest.api.compute.admin.test_servers.ServersAdminTestJSON.test_reset_state_server [4.340118s] ... ok
{7} tempest.api.compute.images.test_list_image_filters_negative.ListImageFiltersNegativeTestJSON.test_get_nonexistent_image [1.068395s] ... ok
{3} tempest.api.compute.admin.test_quotas.QuotaClassesAdminTestJSON.test_update_default_quotas [4.024447s] ... ok
{6} tempest.api.compute.admin.test_security_groups.SecurityGroupsTestAdminJSON.test_list_security_groups_list_all_tenants_filter [14.513075s] ... ok
{7} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create [4.284372s] ... ok
{4} tempest.api.compute.admin.test_services_negative.ServicesAdminNegativeTestJSON.test_get_service_by_invalid_params [1.880966s] ... ok
{4} tempest.api.compute.admin.test_services_negative.ServicesAdminNegativeTestJSON.test_get_service_by_invalid_service_and_valid_host [1.834968s] ... ok
{7} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create_with_optional_cidr [2.479769s] ... ok
{4} tempest.api.compute.admin.test_services_negative.ServicesAdminNegativeTestJSON.test_get_service_with_valid_service_and_invalid_host [1.085708s] ... ok
{4} tempest.api.compute.admin.test_services_negative.ServicesAdminNegativeTestJSON.test_list_services_with_non_admin_user [1.111382s] ... ok
{5} tempest.api.compute.images.test_images_oneserver_negative.ImagesOneServerNegativeTestJSON.test_create_second_image_when_first_image_is_being_saved [44.903949s] ... ok
{7} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create_with_optional_group_id [6.062367s] ... ok
{0} tempest.api.compute.admin.test_migrations.MigrationsAdminTest.test_revert_cold_migration [77.983872s] ... ok
{7} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_delete_when_peer_group_deleted [6.193736s] ... ok
{7} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list [2.824611s] ... ok
{3} tempest.api.compute.admin.test_server_diagnostics_negative.ServerDiagnosticsNegativeTest.test_get_server_diagnostics_by_non_admin [24.602350s] ... ok
{7} tempest.api.compute.servers.test_multiple_create_negative.MultipleCreateNegativeTestJSON.test_max_count_less_than_min_count [0.407695s] ... ok
{7} tempest.api.compute.servers.test_multiple_create_negative.MultipleCreateNegativeTestJSON.test_max_count_less_than_one [0.196891s] ... ok
{2} tempest.api.compute.admin.test_live_migration.LiveAutoBlockMigrationV225Test.test_volume_backed_live_migration [94.863978s] ... ok
{7} tempest.api.compute.servers.test_multiple_create_negative.MultipleCreateNegativeTestJSON.test_max_count_non_integer [0.458229s] ... ok
{7} tempest.api.compute.servers.test_multiple_create_negative.MultipleCreateNegativeTestJSON.test_min_count_less_than_one [0.636996s] ... ok
{7} tempest.api.compute.servers.test_multiple_create_negative.MultipleCreateNegativeTestJSON.test_min_count_non_integer [0.361547s] ... ok
{3} tempest.api.compute.admin.test_simple_tenant_usage_negative.TenantUsagesNegativeTestJSON.test_get_usage_tenant_with_empty_tenant_id [1.023839s] ... ok
{4} tempest.api.compute.admin.test_simple_tenant_usage.TenantUsagesTestJSON.test_get_usage_tenant [0.955188s] ... ok
{3} tempest.api.compute.admin.test_simple_tenant_usage_negative.TenantUsagesNegativeTestJSON.test_get_usage_tenant_with_invalid_date [0.841702s] ... ok
{4} tempest.api.compute.admin.test_simple_tenant_usage.TenantUsagesTestJSON.test_get_usage_tenant_with_non_admin_user [0.559727s] ... ok
{3} tempest.api.compute.admin.test_simple_tenant_usage_negative.TenantUsagesNegativeTestJSON.test_list_usage_all_tenants_with_non_admin_user [0.453427s] ... ok
{4} tempest.api.compute.admin.test_simple_tenant_usage.TenantUsagesTestJSON.test_list_usage_all_tenants [0.371689s] ... ok
{3} tempest.api.compute.images.test_image_metadata_negative.ImagesMetadataNegativeTestJSON.test_delete_nonexistent_image_metadata_item [0.925099s] ... ok
{3} tempest.api.compute.images.test_image_metadata_negative.ImagesMetadataNegativeTestJSON.test_get_nonexistent_image_metadata_item [0.206492s] ... ok
{3} tempest.api.compute.images.test_image_metadata_negative.ImagesMetadataNegativeTestJSON.test_list_nonexistent_image_metadata [0.218417s] ... ok
{5} tempest.api.compute.images.test_images_oneserver_negative.ImagesOneServerNegativeTestJSON.test_delete_image_that_is_not_yet_active [36.974160s] ... ok
{3} tempest.api.compute.images.test_image_metadata_negative.ImagesMetadataNegativeTestJSON.test_set_nonexistent_image_metadata [0.129610s] ... ok
{3} tempest.api.compute.images.test_image_metadata_negative.ImagesMetadataNegativeTestJSON.test_set_nonexistent_image_metadata_item [0.064037s] ... ok
{3} tempest.api.compute.images.test_image_metadata_negative.ImagesMetadataNegativeTestJSON.test_update_nonexistent_image_metadata [0.190112s] ... ok
{4} setUpClass (tempest.api.compute.admin.test_volumes_negative.UpdateMultiattachVolumeNegativeTest) ... SKIPPED: Volume multi-attach is not available.
{0} tempest.api.compute.admin.test_quotas.QuotasAdminTestV257.test_get_updated_quotas [4.621175s] ... ok
{0} tempest.api.compute.admin.test_quotas_negative.QuotasAdminNegativeTest.test_create_server_when_cpu_quota_is_full [5.819273s] ... ok
{5} tempest.api.compute.security_groups.test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_delete_nonexistent_security_group [1.525852s] ... ok
{5} tempest.api.compute.security_groups.test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_delete_security_group_without_passing_id [1.542658s] ... ok
{2} tempest.api.compute.admin.test_services_negative.ServicesAdminNegativeV253TestJSON.test_disable_log_reason_with_invalid_service_id [1.592000s] ... ok
{0} tempest.api.compute.admin.test_quotas_negative.QuotasAdminNegativeTest.test_create_server_when_instances_quota_is_full [6.531364s] ... ok
{2} tempest.api.compute.admin.test_services_negative.ServicesAdminNegativeV253TestJSON.test_disable_service_with_invalid_service_id [1.184134s] ... ok
{5} tempest.api.compute.security_groups.test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_delete_the_default_security_group [2.519084s] ... ok
{5} tempest.api.compute.security_groups.test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_security_group_create_with_duplicate_name ... SKIPPED: Neutron allows duplicate names for security groups
{5} tempest.api.compute.security_groups.test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_security_group_create_with_invalid_group_description ... SKIPPED: Skipped until bug: https://launchpad.net/bugs/1161411 is resolved.
{5} tempest.api.compute.security_groups.test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_security_group_create_with_invalid_group_name ... SKIPPED: Skipped until bug: https://launchpad.net/bugs/1161411 is resolved.
{2} tempest.api.compute.admin.test_services_negative.ServicesAdminNegativeV253TestJSON.test_enable_service_with_invalid_service_id [0.681892s] ... ok
{5} tempest.api.compute.security_groups.test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_security_group_get_nonexistent_group [0.281242s] ... ok
{5} tempest.api.compute.security_groups.test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_update_non_existent_security_group [0.172299s] ... ok
{5} tempest.api.compute.security_groups.test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_update_security_group_with_invalid_sg_des ... SKIPPED: Neutron does not check the security group description
{5} tempest.api.compute.security_groups.test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_update_security_group_with_invalid_sg_id ... SKIPPED: Neutron does not check the security group ID
{5} tempest.api.compute.security_groups.test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_update_security_group_with_invalid_sg_name ... SKIPPED: Neutron does not check the security group name
{2} tempest.api.compute.admin.test_services_negative.ServicesAdminNegativeV253TestJSON.test_get_service_by_invalid_params [0.897922s] ... ok
{0} tempest.api.compute.admin.test_quotas_negative.QuotasAdminNegativeTest.test_create_server_when_memory_quota_is_full [3.716968s] ... ok
{2} tempest.api.compute.admin.test_services_negative.ServicesAdminNegativeV253TestJSON.test_get_service_by_invalid_service_and_valid_host [1.505328s] ... ok
{0} tempest.api.compute.admin.test_quotas_negative.QuotasAdminNegativeTest.test_update_quota_normal_user [0.465155s] ... ok
{6} tempest.api.compute.floating_ips.test_floating_ips_actions.FloatingIPsAssociationTestJSON.test_associate_already_associated_floating_ip [40.454645s] ... ok
{2} tempest.api.compute.admin.test_services_negative.ServicesAdminNegativeV253TestJSON.test_get_service_with_valid_service_and_invalid_host [0.743537s] ... ok
{2} tempest.api.compute.admin.test_services_negative.ServicesAdminNegativeV253TestJSON.test_list_services_with_non_admin_user [0.717762s] ... ok
{0} tempest.api.compute.admin.test_quotas_negative.QuotasSecurityGroupAdminNegativeTest.test_security_groups_exceed_limit ... SKIPPED: Skipped until bug: https://launchpad.net/bugs/1186354 is resolved.
{0} tempest.api.compute.admin.test_quotas_negative.QuotasSecurityGroupAdminNegativeTest.test_security_groups_rules_exceed_limit ... SKIPPED: Skipped until bug: https://launchpad.net/bugs/1186354 is resolved.
{6} tempest.api.compute.floating_ips.test_floating_ips_actions.FloatingIPsAssociationTestJSON.test_associate_disassociate_floating_ip [13.077732s] ... ok
{0} tempest.api.compute.admin.test_services.ServicesAdminTestJSON.test_get_service_by_host_name [2.098993s] ... ok
{0} tempest.api.compute.admin.test_services.ServicesAdminTestJSON.test_get_service_by_service_binary_name [0.591579s] ... ok
{0} tempest.api.compute.admin.test_services.ServicesAdminTestJSON.test_list_services [0.184672s] ... ok
{0} setUpClass (tempest.api.compute.certificates.test_certificates.CertificatesV2TestJSON) ... SKIPPED: Nova cert is not available