/opt/stack/tempest ~
Initializing stestr
all-plugin create: /opt/stack/tempest/.tox/all-plugin
all-plugin installdeps: -chttps://releases.openstack.org/constraints/upper/master, -r/opt/stack/tempest/requirements.txt
all-plugin develop-inst: /opt/stack/tempest
all-plugin installed: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead,  from cryptography.utils import int_from_bytes,/usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead,  from cryptography.utils import int_from_bytes,alembic==1.6.5,amqp==5.0.6,aniso8601==9.0.1,appdirs==1.4.4,attrs==21.2.0,Automat==0.8.0,automaton==2.3.0,Babel==2.9.1,backports.entry-points-selectable==1.1.0,bcrypt==3.2.0,beautifulsoup4==4.9.3,blinker==1.4,boto3==1.18.18,botocore==1.21.18,cachetools==4.2.2,castellan==3.9.0,certifi==2021.5.30,cffi==1.14.6,chardet==3.0.4,charset-normalizer==2.0.4,-e git+https://opendev.org/openstack/cinder@98b49d05726b848fefd51d90af5abffa6f1d842d#egg=cinder,click==8.0.1,cliff==3.8.0,cmd2==2.1.2,colorama==0.4.4,command-not-found==0.3,configobj==5.0.6,configshell-fb==1.1.25,constantly==15.1.0,cryptography==3.4.7,cursive==0.2.2,dbus-python==1.2.16,debtcollector==2.2.0,decorator==5.0.9,defusedxml==0.7.1,distlib==0.3.2,distro==1.4.0,distro-info===0.23ubuntu1,dnspython==1.16.0,dogpile.cache==1.1.3,elementpath==2.2.3,entrypoints==0.3,etcd3==0.12.0,etcd3gw==1.0.0,eventlet==0.31.1,extras==1.0.0,fasteners==0.14.1,filelock==3.0.12,fixtures==3.0.0,Flask==2.0.1,Flask-RESTful==0.3.9,future==0.18.2,futurist==2.3.0,-e git+https://opendev.org/openstack/glance@d9b8023410348e769f8a69c168461126ce7ff6fc#egg=glance,glance-store==2.6.0,google-api-core==1.31.1,google-api-python-client==2.15.0,google-auth==1.34.0,google-auth-httplib2==0.1.0,googleapis-common-protos==1.53.0,greenlet==1.1.1,grpcio==1.39.0,httplib2==0.19.1,hyperlink==19.0.0,idna==3.2,importlib-metadata==1.5.0,importlib-resources==5.2.2,incremental==16.10.1,iso8601==0.1.16,itsdangerous==2.0.1,Jinja2==3.0.1,jmespath==0.10.0,jsonpatch==1.32,jsonpointer==2.1,jsonschema==3.2.0,keyring==18.0.1,-e git+https://opendev.org/openstack/keystone@d1c7759f487612d6069ac076ad314e572a71ed24#egg=keystone,keystoneauth1==4.3.1,keystonemiddleware==9.3.0,kombu==5.1.0,language-selector==0.1,lazr.uri==1.0.3,linecache2==1.0.0,logutils==0.3.5,lxml==4.6.3,Mako==1.1.4,MarkupSafe==2.0.1,microversion-parse==1.0.1,monotonic==1.6,more-itertools==4.2.0,msgpack==1.0.2,munch==2.5.0,mysqlclient==1.4.4,netaddr==0.8.0,netifaces==0.11.0,-e git+https://opendev.org/openstack/networking-hyperv@2329562d274b953851603f09f59b140b21a898b4#egg=networking_hyperv,networkx==2.6.2,-e git+https://opendev.org/openstack/neutron@578f74ca8782badfa6251f438c3cfd3e8fd10009#egg=neutron,neutron-lib==2.13.0,-e git+http://10.106.1.39/p/openstack/nova@e0cacaa397f8414871f1e2cd589928f9afc27dc7#egg=nova,numpy==1.21.1,oauth2client==4.1.3,oauthlib==3.1.1,-e git+https://opendev.org/openstack/placement.git@36aba336b15a913a3d8bc3d5441fbb4c6feb38c5#egg=openstack_placement,openstacksdk==0.58.0,os-brick==4.4.0,os-client-config==2.1.0,os-ken==2.0.0,os-resource-classes==1.1.0,os-service-types==1.7.0,os-testr==2.0.0,os-traits==2.5.0,os-vif==2.5.0,os-win==5.4.0,os-xenapi==0.3.4,osc-lib==2.4.1,osc-placement==3.0.1,oslo.cache==2.8.1,oslo.concurrency==4.4.0,oslo.config==8.7.1,oslo.context==3.3.0,oslo.db==10.0.0,oslo.i18n==5.0.1,oslo.limit==1.4.0,oslo.log==4.6.0,oslo.messaging==12.8.0,oslo.middleware==4.3.0,oslo.policy==3.8.1,oslo.privsep==2.6.0,oslo.reports==2.3.0,oslo.rootwrap==6.3.0,oslo.serialization==4.1.0,oslo.service==2.6.0,oslo.upgradecheck==1.4.0,oslo.utils==4.9.2,oslo.versionedobjects==2.4.0,oslo.vmware==3.9.0,osprofiler==3.4.1,ovs==2.13.3,ovsdbapp==1.11.0,packaging==21.0,paramiko==2.7.2,passlib==1.7.4,Paste==3.5.0,PasteDeploy==2.1.1,pbr==5.6.0,pcp==5.0,pecan==1.3.3,pexpect==4.6.0,platformdirs==2.2.0,pluggy==0.13.1,prettytable==0.7.2,protobuf==3.17.3,psutil==5.8.0,py==1.10.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycadf==3.1.1,pycparser==2.20,pydot==1.4.2,pyeclib==1.6.0,Pygments==2.3.1,PyGObject==3.36.0,PyHamcrest==1.9.0,pyinotify==0.9.6,PyJWT==2.1.0,pymacaroons==0.13.0,PyMySQL==1.0.2,PyNaCl==1.4.0,pyOpenSSL==20.0.1,pyparsing==2.4.7,pyperclip==1.8.2,pypowervm==1.1.26,pyroute2==0.6.4,pyroute2.core==0.6.4,pyroute2.ethtool==0.6.4,pyroute2.ipdb==0.6.4,pyroute2.ipset==0.6.4,pyroute2.ndb==0.6.4,pyroute2.nftables==0.6.4,pyroute2.nslink==0.6.4,pyrsistent==0.15.5,pysaml2==7.0.1,pyserial==3.4,python-apt==2.0.0+ubuntu0.20.4.4,python-barbicanclient==5.1.0,python-cinderclient==8.0.0,python-dateutil==2.8.2,python-debian===0.1.36ubuntu1,python-designateclient==4.3.0,python-editor==1.0.4,python-glanceclient==3.4.0,python-keystoneclient==4.2.0,python-memcached==1.59,python-neutronclient==7.5.0,python-novaclient==17.5.0,python-openstackclient==5.5.0,python-subunit==1.4.0,python-swiftclient==3.12.0,pytz==2021.1,pyudev==0.22.0,PyYAML==5.4.1,repoze.lru==0.7,requests==2.26.0,requests-unixsocket==0.2.0,requestsexceptions==1.4.0,retrying==1.3.3,rfc3986==1.5.0,Routes==2.5.1,rsa==4.7.2,rtslib-fb==2.1.74,s3transfer==0.5.0,scrypt==0.8.18,SecretStorage==2.3.1,setproctitle==1.2.2,simplegeneric==0.8.1,simplejson==3.17.3,six==1.16.0,sortedcontainers==2.1.0,sos==4.1,soupsieve==2.2.1,SQLAlchemy==1.4.22,sqlalchemy-migrate==0.13.0,sqlparse==0.4.1,ssh-import-id==5.10,statsd==3.3.0,stestr==3.2.0,stevedore==3.3.0,suds-jurko==0.6,-e git+https://opendev.org/openstack/swift@901d2e15b7fa7c7a923b885cd4d369d063357075#egg=swift,systemd-python==234,tabulate==0.8.9,targetcli-fb==2.1.51,taskflow==4.6.1,-e git+https://opendev.org/openstack/tempest@d771c95ee83aa63a15919bea0f60fd3795b3ba70#egg=tempest,Tempita==0.5.2,tenacity==6.3.1,testresources==2.0.1,testscenarios==0.5.0,testtools==2.5.0,toml==0.10.2,tooz==2.9.0,tox==3.24.1,traceback2==1.4.0,ufw==0.36,unattended-upgrades==0.1,unittest2==1.1.0,uritemplate==3.0.1,urllib3==1.26.6,urwid==2.0.1,vine==5.0.0,virtualenv==20.7.2,voluptuous==0.12.1,wadllib==1.3.3,waitress==2.0.0,warlock==1.3.3,wcwidth==0.2.5,WebOb==1.8.7,websockify==0.10.0,WebTest==2.0.35,Werkzeug==2.0.1,wrapt==1.12.1,WSME==0.11.0,xattr==0.9.7,xmlschema==1.7.0,yappi==1.3.2,zipp==3.5.0,zope.interface==4.7.1,zstd==1.5.0.2,zVMCloudConnector==1.4.1
___________________________________ summary ____________________________________
  all-plugin: skipped tests
  congratulations :)
{5} setUpClass (tempest.api.compute.admin.test_agents.AgentsAdminTestJSON) ... SKIPPED: The os-agents API is not supported.
{6} setUpClass (tempest.api.compute.admin.test_fixed_ips.FixedIPsTestJson) ... SKIPPED: FixedIPsTestJson skipped as neutron is available
{2} tempest.api.compute.admin.test_availability_zone.AZAdminV2TestJSON.test_get_availability_zone_list [1.315857s] ... ok
{2} tempest.api.compute.admin.test_availability_zone.AZAdminV2TestJSON.test_get_availability_zone_list_detail [0.098803s] ... ok
{3} tempest.api.compute.admin.test_hypervisor.HypervisorAdminTestJSON.test_get_hypervisor_list [0.716691s] ... ok
{3} tempest.api.compute.admin.test_hypervisor.HypervisorAdminTestJSON.test_get_hypervisor_list_details [0.358374s] ... ok
{3} tempest.api.compute.admin.test_hypervisor.HypervisorAdminTestJSON.test_get_hypervisor_show_details [0.129951s] ... ok
{3} tempest.api.compute.admin.test_hypervisor.HypervisorAdminTestJSON.test_get_hypervisor_stats [0.063817s] ... ok
{6} tempest.api.compute.admin.test_flavors_extra_specs_negative.FlavorsExtraSpecsNegativeTestJSON.test_flavor_get_nonexistent_key [0.479186s] ... ok
{6} tempest.api.compute.admin.test_flavors_extra_specs_negative.FlavorsExtraSpecsNegativeTestJSON.test_flavor_non_admin_set_keys [1.394681s] ... ok
{3} tempest.api.compute.admin.test_hypervisor.HypervisorAdminTestJSON.test_get_hypervisor_uptime [2.622910s] ... ok
{6} tempest.api.compute.admin.test_flavors_extra_specs_negative.FlavorsExtraSpecsNegativeTestJSON.test_flavor_non_admin_unset_keys [0.369048s] ... ok
{6} tempest.api.compute.admin.test_flavors_extra_specs_negative.FlavorsExtraSpecsNegativeTestJSON.test_flavor_non_admin_update_specific_key [0.109706s] ... ok
{6} tempest.api.compute.admin.test_flavors_extra_specs_negative.FlavorsExtraSpecsNegativeTestJSON.test_flavor_unset_nonexistent_key [0.040068s] ... ok
{6} tempest.api.compute.admin.test_flavors_extra_specs_negative.FlavorsExtraSpecsNegativeTestJSON.test_flavor_update_mismatch_key [0.016616s] ... ok
{6} tempest.api.compute.admin.test_flavors_extra_specs_negative.FlavorsExtraSpecsNegativeTestJSON.test_flavor_update_more_key [0.018728s] ... ok
{2} tempest.api.compute.admin.test_flavors_extra_specs.FlavorsExtraSpecsTestJSON.test_flavor_non_admin_get_all_keys [0.708364s] ... ok
{2} tempest.api.compute.admin.test_flavors_extra_specs.FlavorsExtraSpecsTestJSON.test_flavor_non_admin_get_specific_key [0.164794s] ... ok
{2} tempest.api.compute.admin.test_flavors_extra_specs.FlavorsExtraSpecsTestJSON.test_flavor_set_get_update_show_unset_keys [0.412607s] ... ok
{3} tempest.api.compute.admin.test_hypervisor_negative.HypervisorAdminNegativeUnderV252Test.test_search_hypervisor_with_non_admin_user [1.632387s] ... ok
{3} tempest.api.compute.admin.test_hypervisor_negative.HypervisorAdminNegativeUnderV252Test.test_search_nonexistent_hypervisor [0.097944s] ... ok
{3} tempest.api.compute.admin.test_hypervisor_negative.HypervisorAdminNegativeUnderV252Test.test_show_servers_with_non_admin_user [0.222330s] ... ok
{3} tempest.api.compute.admin.test_hypervisor_negative.HypervisorAdminNegativeUnderV252Test.test_show_servers_with_nonexistent_hypervisor [0.086224s] ... ok
{6} setUpClass (tempest.api.compute.admin.test_floating_ips_bulk.FloatingIPsBulkAdminTestJSON) ... SKIPPED: nova-network is gone
{2} tempest.api.compute.admin.test_keypairs_v210.KeyPairsV210TestJSON.test_admin_manage_keypairs_for_other_users [3.152005s] ... ok
{3} tempest.api.compute.admin.test_instance_usage_audit_log.InstanceUsageAuditLogTestJSON.test_get_instance_usage_audit_log [0.624626s] ... ok
{3} tempest.api.compute.admin.test_instance_usage_audit_log.InstanceUsageAuditLogTestJSON.test_list_instance_usage_audit_logs [0.251872s] ... ok
{6} tempest.api.compute.admin.test_hosts_negative.HostsAdminNegativeTestJSON.test_list_hosts_with_non_admin_user [0.539762s] ... ok
{6} tempest.api.compute.admin.test_hosts_negative.HostsAdminNegativeTestJSON.test_reboot_host_with_non_admin_user [0.014928s] ... ok
{6} tempest.api.compute.admin.test_hosts_negative.HostsAdminNegativeTestJSON.test_reboot_nonexistent_host [0.046903s] ... ok
{6} tempest.api.compute.admin.test_hosts_negative.HostsAdminNegativeTestJSON.test_show_host_detail_with_non_admin_user [0.024549s] ... ok
{6} tempest.api.compute.admin.test_hosts_negative.HostsAdminNegativeTestJSON.test_show_host_detail_with_nonexistent_hostname [0.027108s] ... ok
{6} tempest.api.compute.admin.test_hosts_negative.HostsAdminNegativeTestJSON.test_shutdown_host_with_non_admin_user [0.039389s] ... ok
{6} tempest.api.compute.admin.test_hosts_negative.HostsAdminNegativeTestJSON.test_shutdown_nonexistent_host [0.040716s] ... ok
{6} tempest.api.compute.admin.test_hosts_negative.HostsAdminNegativeTestJSON.test_startup_host_with_non_admin_user [0.021324s] ... ok
{6} tempest.api.compute.admin.test_hosts_negative.HostsAdminNegativeTestJSON.test_startup_nonexistent_host [0.024037s] ... ok
{6} tempest.api.compute.admin.test_hosts_negative.HostsAdminNegativeTestJSON.test_update_host_with_invalid_maintenance_mode [0.018314s] ... ok
{6} tempest.api.compute.admin.test_hosts_negative.HostsAdminNegativeTestJSON.test_update_host_with_invalid_status [0.017170s] ... ok
{6} tempest.api.compute.admin.test_hosts_negative.HostsAdminNegativeTestJSON.test_update_host_with_non_admin_user [0.015973s] ... ok
{6} tempest.api.compute.admin.test_hosts_negative.HostsAdminNegativeTestJSON.test_update_host_without_param [0.012752s] ... ok
{6} tempest.api.compute.admin.test_hosts_negative.HostsAdminNegativeTestJSON.test_update_nonexistent_host [0.037321s] ... ok
{6} tempest.api.compute.admin.test_quotas.QuotaClassesAdminTestJSON.test_update_default_quotas [1.474476s] ... ok
{4} tempest.api.compute.admin.test_aggregates.AggregatesAdminTestJSON.test_aggregate_add_host_create_server_with_az [39.556772s] ... ok
{1} tempest.api.compute.admin.test_aggregates_negative.AggregatesAdminNegativeTestJSON.test_aggregate_add_existent_host [40.044702s] ... ok
{1} tempest.api.compute.admin.test_aggregates_negative.AggregatesAdminNegativeTestJSON.test_aggregate_add_host_as_user [0.513853s] ... ok
{4} tempest.api.compute.admin.test_aggregates.AggregatesAdminTestJSON.test_aggregate_add_host_get_details [2.861445s] ... ok
{1} tempest.api.compute.admin.test_aggregates_negative.AggregatesAdminNegativeTestJSON.test_aggregate_add_non_exist_host [0.163409s] ... ok
{1} tempest.api.compute.admin.test_aggregates_negative.AggregatesAdminNegativeTestJSON.test_aggregate_create_aggregate_name_length_exceeds_255 [0.025158s] ... ok
{1} tempest.api.compute.admin.test_aggregates_negative.AggregatesAdminNegativeTestJSON.test_aggregate_create_aggregate_name_length_less_than_1 [0.109606s] ... ok
{1} tempest.api.compute.admin.test_aggregates_negative.AggregatesAdminNegativeTestJSON.test_aggregate_create_as_user [0.297019s] ... ok
{4} tempest.api.compute.admin.test_aggregates.AggregatesAdminTestJSON.test_aggregate_add_host_list [1.098050s] ... ok
{1} tempest.api.compute.admin.test_aggregates_negative.AggregatesAdminNegativeTestJSON.test_aggregate_create_with_existent_aggregate_name [0.682341s] ... ok
{1} tempest.api.compute.admin.test_aggregates_negative.AggregatesAdminNegativeTestJSON.test_aggregate_delete_as_user [0.723940s] ... ok
{4} tempest.api.compute.admin.test_aggregates.AggregatesAdminTestJSON.test_aggregate_add_remove_host [1.010724s] ... ok
{1} tempest.api.compute.admin.test_aggregates_negative.AggregatesAdminNegativeTestJSON.test_aggregate_delete_with_invalid_id [0.158669s] ... ok
{4} tempest.api.compute.admin.test_aggregates.AggregatesAdminTestJSON.test_aggregate_create_delete [0.348258s] ... ok
{1} tempest.api.compute.admin.test_aggregates_negative.AggregatesAdminNegativeTestJSON.test_aggregate_get_details_as_user [0.370178s] ... ok
{1} tempest.api.compute.admin.test_aggregates_negative.AggregatesAdminNegativeTestJSON.test_aggregate_get_details_with_invalid_id [0.093142s] ... ok
{1} tempest.api.compute.admin.test_aggregates_negative.AggregatesAdminNegativeTestJSON.test_aggregate_list_as_user [0.069607s] ... ok
{4} tempest.api.compute.admin.test_aggregates.AggregatesAdminTestJSON.test_aggregate_create_delete_with_az [0.392105s] ... ok
{4} tempest.api.compute.admin.test_aggregates.AggregatesAdminTestJSON.test_aggregate_create_update_metadata_get_details [0.157162s] ... ok
{0} tempest.api.compute.admin.test_aggregates.AggregatesAdminTestV241.test_create_update_show_aggregate_add_remove_host [44.673285s] ... ok
{4} tempest.api.compute.admin.test_aggregates.AggregatesAdminTestJSON.test_aggregate_create_update_with_az [0.441703s] ... ok
{5} tempest.api.compute.admin.test_delete_server.DeleteServersAdminTestJSON.test_admin_delete_servers_of_others [44.791124s] ... ok
{4} tempest.api.compute.admin.test_aggregates.AggregatesAdminTestJSON.test_aggregate_create_verify_entry_in_list [0.310947s] ... ok
{1} tempest.api.compute.admin.test_aggregates_negative.AggregatesAdminNegativeTestJSON.test_aggregate_remove_host_as_user [1.129752s] ... ok
{1} tempest.api.compute.admin.test_aggregates_negative.AggregatesAdminNegativeTestJSON.test_aggregate_remove_nonexistent_host [0.679268s] ... ok
{0} setUpClass (tempest.api.compute.admin.test_auto_allocate_network.AutoAllocateNetworkTest) ... SKIPPED: Found shared networks: [{'id': 'ba029c36-404a-4d64-8dcc-8c1e4aa9d9bd', 'name': 'shared', 'tenant_id': '3e7e21b6a359437a9d6c1c73c2e2fa82', 'admin_state_up': True, 'mtu': 1500, 'status': 'ACTIVE', 'subnets': ['ead2977f-b20c-49d6-9a40-e93812de375a'], 'shared': True, 'availability_zone_hints': [], 'availability_zones': ['nova'], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2021-08-11T18:42:31Z', 'updated_at': '2021-08-11T18:42:34Z', 'revision_number': 2, 'project_id': '3e7e21b6a359437a9d6c1c73c2e2fa82'}]
{0} tempest.api.compute.admin.test_availability_zone_negative.AZAdminNegativeTestJSON.test_get_availability_zone_list_detail_with_non_admin_user [0.923816s] ... ok
{1} tempest.api.compute.admin.test_flavors_microversions.FlavorsV261TestJSON.test_crud_flavor [4.987931s] ... ok
{0} setUpClass (tempest.api.compute.admin.test_fixed_ips_negative.FixedIPsNegativeTestJson) ... SKIPPED: FixedIPsNegativeTestJson skipped as neutron is available
{4} tempest.api.compute.admin.test_flavors_access_negative.FlavorsAccessNegativeTestJSON.test_add_flavor_access_duplicate [3.399202s] ... ok
{4} tempest.api.compute.admin.test_flavors_access_negative.FlavorsAccessNegativeTestJSON.test_flavor_access_list_with_public_flavor [0.248882s] ... ok
{4} tempest.api.compute.admin.test_flavors_access_negative.FlavorsAccessNegativeTestJSON.test_flavor_non_admin_add [0.560398s] ... ok
{0} tempest.api.compute.admin.test_flavors.FlavorsAdminTestJSON.test_create_flavor_using_string_ram [0.474390s] ... ok
{0} tempest.api.compute.admin.test_flavors.FlavorsAdminTestJSON.test_create_flavor_verify_entry_in_list_details [1.652137s] ... ok
{4} tempest.api.compute.admin.test_flavors_access_negative.FlavorsAccessNegativeTestJSON.test_flavor_non_admin_remove [1.913251s] ... ok
{0} tempest.api.compute.admin.test_flavors.FlavorsAdminTestJSON.test_create_flavor_with_int_id [0.479380s] ... ok
{1} tempest.api.compute.admin.test_hosts.HostsAdminTestJSON.test_list_hosts [0.386513s] ... ok
{1} tempest.api.compute.admin.test_hosts.HostsAdminTestJSON.test_list_hosts_with_a_blank_zone [0.060740s] ... ok
{0} tempest.api.compute.admin.test_flavors.FlavorsAdminTestJSON.test_create_flavor_with_none_id [0.499457s] ... ok
{4} tempest.api.compute.admin.test_flavors_access_negative.FlavorsAccessNegativeTestJSON.test_remove_flavor_access_not_found [0.775722s] ... ok
{1} tempest.api.compute.admin.test_hosts.HostsAdminTestJSON.test_list_hosts_with_nonexistent_zone [0.067782s] ... ok
{1} tempest.api.compute.admin.test_hosts.HostsAdminTestJSON.test_list_hosts_with_zone [0.141071s] ... ok
{0} tempest.api.compute.admin.test_flavors.FlavorsAdminTestJSON.test_create_flavor_with_uuid_id [0.247486s] ... ok
{1} tempest.api.compute.admin.test_hosts.HostsAdminTestJSON.test_show_host_detail [0.253290s] ... ok
{0} tempest.api.compute.admin.test_flavors.FlavorsAdminTestJSON.test_create_list_flavor_without_extra_data [0.866115s] ... ok
{0} tempest.api.compute.admin.test_flavors.FlavorsAdminTestJSON.test_create_server_with_non_public_flavor [0.263563s] ... ok
{0} tempest.api.compute.admin.test_flavors.FlavorsAdminTestJSON.test_is_public_string_variations [1.701273s] ... ok
{0} tempest.api.compute.admin.test_flavors.FlavorsAdminTestJSON.test_list_non_public_flavor [0.190683s] ... ok
{0} tempest.api.compute.admin.test_flavors.FlavorsAdminTestJSON.test_list_public_flavor_with_other_user [0.167021s] ... ok
{2} tempest.api.compute.admin.test_live_migration.LiveAutoBlockMigrationV225Test.test_live_block_migration [34.480857s] ... ok
{4} tempest.api.compute.admin.test_hypervisor.HypervisorAdminV228Test.test_get_list_hypervisor_details [0.753178s] ... ok
{5} tempest.api.compute.admin.test_delete_server.DeleteServersAdminTestJSON.test_delete_server_while_in_error_state [25.245776s] ... ok
{0} tempest.api.compute.admin.test_hypervisor_negative.HypervisorAdminNegativeTestJSON.test_get_hypervisor_list_details_with_non_admin_user [0.587884s] ... ok
{0} tempest.api.compute.admin.test_hypervisor_negative.HypervisorAdminNegativeTestJSON.test_get_hypervisor_list_with_non_admin_user [0.038545s] ... ok
{0} tempest.api.compute.admin.test_hypervisor_negative.HypervisorAdminNegativeTestJSON.test_get_hypervisor_stats_with_non_admin_user [0.031087s] ... ok
{3} tempest.api.compute.admin.test_live_migration.LiveMigrationTest.test_live_block_migration [37.004314s] ... ok
{0} tempest.api.compute.admin.test_hypervisor_negative.HypervisorAdminNegativeTestJSON.test_get_hypervisor_uptime_with_non_admin_user [0.850221s] ... ok
{0} tempest.api.compute.admin.test_hypervisor_negative.HypervisorAdminNegativeTestJSON.test_get_nonexistent_hypervisor_uptime [0.317703s] ... ok
{0} tempest.api.compute.admin.test_hypervisor_negative.HypervisorAdminNegativeTestJSON.test_show_hypervisor_with_non_admin_user [0.686436s] ... ok
{0} tempest.api.compute.admin.test_hypervisor_negative.HypervisorAdminNegativeTestJSON.test_show_nonexistent_hypervisor [0.024022s] ... ok
{6} tempest.api.compute.admin.test_servers_on_multinodes.ServersOnMultiNodesTest.test_create_server_with_scheduler_hint_group_affinity [24.285332s] ... ok
{0} tempest.api.compute.admin.test_instance_usage_audit_log_negative.InstanceUsageAuditLogNegativeTestJSON.test_get_instance_usage_audit_logs_with_invalid_time [0.558505s] ... ok
{5} tempest.api.compute.admin.test_flavors_access.FlavorsAccessTestJSON.test_flavor_access_add_remove [4.112522s] ... ok
{0} tempest.api.compute.admin.test_instance_usage_audit_log_negative.InstanceUsageAuditLogNegativeTestJSON.test_instance_usage_audit_logs_with_nonadmin_user [0.527216s] ... ok
{5} tempest.api.compute.admin.test_flavors_access.FlavorsAccessTestJSON.test_flavor_access_list_with_private_flavor [0.352488s] ... ok
{5} tempest.api.compute.admin.test_quotas.QuotasAdminTestV236.test_get_updated_quotas [3.350221s] ... ok
{5} tempest.api.compute.admin.test_quotas_negative.QuotasSecurityGroupAdminNegativeTest.test_security_groups_exceed_limit ... SKIPPED: Skipped until bug: https://launchpad.net/bugs/1186354 is resolved.
{5} tempest.api.compute.admin.test_quotas_negative.QuotasSecurityGroupAdminNegativeTest.test_security_groups_rules_exceed_limit ... SKIPPED: Skipped until bug: https://launchpad.net/bugs/1186354 is resolved.
{1} tempest.api.compute.admin.test_live_migration_negative.LiveMigrationNegativeTest.test_invalid_host_for_migration [24.853172s] ... ok
{4} tempest.api.compute.admin.test_servers_negative.ServersAdminNegativeTestJSON.test_migrate_non_existent_server [0.893518s] ... ok
{0} tempest.api.compute.admin.test_security_groups.SecurityGroupsTestAdminJSON.test_list_security_groups_list_all_tenants_filter [12.078384s] ... ok
{2} tempest.api.compute.admin.test_live_migration.LiveAutoBlockMigrationV225Test.test_live_block_migration_paused [35.528826s] ... ok
{6} tempest.api.compute.admin.test_servers_on_multinodes.ServersOnMultiNodesTest.test_create_server_with_scheduler_hint_group_anti_affinity [26.818883s] ... ok
{3} tempest.api.compute.admin.test_live_migration.LiveMigrationTest.test_live_block_migration_paused [33.512930s] ... ok
{1} tempest.api.compute.admin.test_live_migration_negative.LiveMigrationNegativeTest.test_live_block_migration_suspended [20.016854s] ... ok
{4} tempest.api.compute.admin.test_servers_negative.ServersAdminNegativeTestJSON.test_migrate_server_invalid_state [21.543568s] ... ok
{4} tempest.api.compute.admin.test_servers_negative.ServersAdminNegativeTestJSON.test_reset_state_server_invalid_state [0.014929s] ... ok
{4} tempest.api.compute.admin.test_servers_negative.ServersAdminNegativeTestJSON.test_reset_state_server_invalid_type [0.014201s] ... ok
{4} tempest.api.compute.admin.test_servers_negative.ServersAdminNegativeTestJSON.test_reset_state_server_nonexistent_server [0.034639s] ... ok
{6} tempest.api.compute.admin.test_servers_on_multinodes.ServersOnMultiNodesTest.test_create_servers_on_different_hosts [19.778291s] ... ok
{1} tempest.api.compute.admin.test_quotas.QuotasAdminTestJSON.test_delete_quota [1.258995s] ... ok
{1} tempest.api.compute.admin.test_quotas.QuotasAdminTestJSON.test_get_default_quotas [0.260665s] ... ok
{1} tempest.api.compute.admin.test_quotas.QuotasAdminTestJSON.test_get_updated_quotas [1.846034s] ... ok
{1} tempest.api.compute.admin.test_quotas.QuotasAdminTestJSON.test_update_all_quota_resources_for_tenant [1.897693s] ... ok
{5} tempest.api.compute.admin.test_servers.ServersAdminTestJSON.test_create_server_with_scheduling_hint [21.803038s] ... ok
{5} tempest.api.compute.admin.test_servers.ServersAdminTestJSON.test_list_servers_by_admin [0.510729s] ... ok
{5} tempest.api.compute.admin.test_servers.ServersAdminTestJSON.test_list_servers_by_admin_with_all_tenants [1.798433s] ... ok
{5} tempest.api.compute.admin.test_servers.ServersAdminTestJSON.test_list_servers_by_admin_with_specified_tenant [1.420860s] ... ok
{5} tempest.api.compute.admin.test_servers.ServersAdminTestJSON.test_list_servers_detailed_filter_by_invalid_status [0.529348s] ... ok
{6} tempest.api.compute.admin.test_servers_on_multinodes.ServersOnMultiNodesTest.test_create_servers_on_different_hosts_with_list_of_servers [22.693998s] ... ok
{5} tempest.api.compute.admin.test_servers.ServersAdminTestJSON.test_list_servers_filter_by_error_status [4.489094s] ... ok
{5} tempest.api.compute.admin.test_servers.ServersAdminTestJSON.test_list_servers_filter_by_exist_host [1.518772s] ... ok
{1} tempest.api.compute.admin.test_server_diagnostics_negative.ServerDiagnosticsNegativeTest.test_get_server_diagnostics_by_non_admin [19.805171s] ... ok
{6} tempest.api.compute.admin.test_servers_on_multinodes.ServersOnMultiNodesTest.test_create_servers_on_same_host [19.879299s] ... ok
{2} tempest.api.compute.admin.test_live_migration.LiveAutoBlockMigrationV225Test.test_live_block_migration_with_attached_volume [92.800813s] ... ok
{4} tempest.api.compute.floating_ips.test_floating_ips_actions.FloatingIPsAssociationTestJSON.test_associate_already_associated_floating_ip [37.320096s] ... ok
{3} tempest.api.compute.admin.test_live_migration.LiveMigrationTest.test_live_block_migration_with_attached_volume [98.589942s] ... ok
{4} tempest.api.compute.floating_ips.test_floating_ips_actions.FloatingIPsAssociationTestJSON.test_associate_disassociate_floating_ip [11.739286s] ... ok
{1} tempest.api.compute.floating_ips.test_floating_ips_actions_negative.FloatingIPsAssociationNegativeTestJSON.test_associate_ip_to_server_with_floating_ip [18.842297s] ... ok
{1} tempest.api.compute.floating_ips.test_floating_ips_actions_negative.FloatingIPsAssociationNegativeTestJSON.test_associate_ip_to_server_without_passing_floating_ip [0.474390s] ... ok
{6} tempest.api.compute.admin.test_services.ServicesAdminTestJSON.test_get_service_by_host_name [1.742920s] ... ok
{1} tempest.api.compute.floating_ips.test_floating_ips_actions_negative.FloatingIPsAssociationNegativeTestJSON.test_associate_nonexistent_floating_ip [0.508363s] ... ok
{6} tempest.api.compute.admin.test_services.ServicesAdminTestJSON.test_get_service_by_service_binary_name [0.508049s] ... ok
{1} tempest.api.compute.floating_ips.test_floating_ips_actions_negative.FloatingIPsAssociationNegativeTestJSON.test_dissociate_nonexistent_floating_ip [0.092842s] ... ok
{6} tempest.api.compute.admin.test_services.ServicesAdminTestJSON.test_list_services [0.093243s] ... ok
{6} tempest.api.compute.keypairs.test_keypairs_negative.KeyPairsNegativeTestJSON.test_create_keypair_invalid_name [0.465304s] ... ok
{6} tempest.api.compute.keypairs.test_keypairs_negative.KeyPairsNegativeTestJSON.test_create_keypair_when_public_key_bits_exceeds_maximum [0.076885s] ... ok
{6} tempest.api.compute.keypairs.test_keypairs_negative.KeyPairsNegativeTestJSON.test_create_keypair_with_duplicate_name [2.101047s] ... ok
{6} tempest.api.compute.keypairs.test_keypairs_negative.KeyPairsNegativeTestJSON.test_create_keypair_with_empty_name_string [0.461277s] ... ok
{6} tempest.api.compute.keypairs.test_keypairs_negative.KeyPairsNegativeTestJSON.test_create_keypair_with_empty_public_key [0.061976s] ... ok
{6} tempest.api.compute.keypairs.test_keypairs_negative.KeyPairsNegativeTestJSON.test_create_keypair_with_long_keynames [0.013895s] ... ok
{6} tempest.api.compute.keypairs.test_keypairs_negative.KeyPairsNegativeTestJSON.test_keypair_create_with_invalid_pub_key [0.072765s] ... ok
{6} tempest.api.compute.keypairs.test_keypairs_negative.KeyPairsNegativeTestJSON.test_keypair_delete_nonexistent_key [0.039407s] ... ok
{6} tempest.api.compute.limits.test_absolute_limits.AbsoluteLimitsTestJSON.test_absLimits_get [0.414921s] ... ok
{1} tempest.api.compute.images.test_image_metadata_negative.ImagesMetadataNegativeTestJSON.test_delete_nonexistent_image_metadata_item [0.362802s] ... ok
{1} tempest.api.compute.images.test_image_metadata_negative.ImagesMetadataNegativeTestJSON.test_get_nonexistent_image_metadata_item [0.146759s] ... ok
{1} tempest.api.compute.images.test_image_metadata_negative.ImagesMetadataNegativeTestJSON.test_list_nonexistent_image_metadata [0.073857s] ... ok
{1} tempest.api.compute.images.test_image_metadata_negative.ImagesMetadataNegativeTestJSON.test_set_nonexistent_image_metadata [0.152516s] ... ok
{1} tempest.api.compute.images.test_image_metadata_negative.ImagesMetadataNegativeTestJSON.test_set_nonexistent_image_metadata_item [0.073561s] ... ok
{1} tempest.api.compute.images.test_image_metadata_negative.ImagesMetadataNegativeTestJSON.test_update_nonexistent_image_metadata [0.067935s] ... ok
{4} tempest.api.compute.security_groups.test_security_group_rules_negative.SecurityGroupRulesNegativeTestJSON.test_create_security_group_rule_duplicate [2.496081s] ... ok
{5} tempest.api.compute.admin.test_servers.ServersAdminTestJSON.test_rebuild_server_in_error_state [85.843119s] ... ok
{5} tempest.api.compute.admin.test_servers.ServersAdminTestJSON.test_reset_network_inject_network_info ... SKIPPED: The resetNetwork server action is not supported.
{4} tempest.api.compute.security_groups.test_security_group_rules_negative.SecurityGroupRulesNegativeTestJSON.test_create_security_group_rule_with_invalid_from_port [1.327191s] ... ok
{4} tempest.api.compute.security_groups.test_security_group_rules_negative.SecurityGroupRulesNegativeTestJSON.test_create_security_group_rule_with_invalid_id [0.493359s] ... ok
{1} tempest.api.compute.images.test_images_negative.ImagesDeleteNegativeTestJSON.test_delete_image_blank_id [0.550651s] ... ok
{4} tempest.api.compute.security_groups.test_security_group_rules_negative.SecurityGroupRulesNegativeTestJSON.test_create_security_group_rule_with_invalid_ip_protocol [1.050566s] ... ok
{1} tempest.api.compute.images.test_images_negative.ImagesDeleteNegativeTestJSON.test_delete_image_negative_image_id [0.216758s] ... ok
{5} tempest.api.compute.admin.test_servers.ServersAdminTestJSON.test_reset_state_server [2.754160s] ... ok
{1} tempest.api.compute.images.test_images_negative.ImagesDeleteNegativeTestJSON.test_delete_image_non_hex_string_id [0.353194s] ... ok
{1} tempest.api.compute.images.test_images_negative.ImagesDeleteNegativeTestJSON.test_delete_image_with_id_over_character_limit [0.462207s] ... ok
{0} tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_changes_since [0.498720s] ... ok
{1} tempest.api.compute.images.test_images_negative.ImagesDeleteNegativeTestJSON.test_delete_image_with_invalid_image_id [0.365995s] ... ok
{4} tempest.api.compute.security_groups.test_security_group_rules_negative.SecurityGroupRulesNegativeTestJSON.test_create_security_group_rule_with_invalid_port_range [1.424930s] ... ok
{0} tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_name [0.417731s] ... ok
{1} tempest.api.compute.images.test_images_negative.ImagesDeleteNegativeTestJSON.test_delete_non_existent_image [0.404561s] ... ok
{0} tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_id [0.670862s] ... ok
{0} tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_ref [0.993989s] ... ok
{4} tempest.api.compute.security_groups.test_security_group_rules_negative.SecurityGroupRulesNegativeTestJSON.test_create_security_group_rule_with_invalid_to_port [2.429226s] ... ok
{0} tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_status [0.783200s] ... ok
{4} tempest.api.compute.security_groups.test_security_group_rules_negative.SecurityGroupRulesNegativeTestJSON.test_create_security_group_rule_with_non_existent_id [0.318950s] ... ok
{0} tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_type [0.255056s] ... ok
{4} tempest.api.compute.security_groups.test_security_group_rules_negative.SecurityGroupRulesNegativeTestJSON.test_delete_security_group_rule_with_non_existent_id [0.437775s] ... ok
{0} tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_limit_results [0.493163s] ... ok
{0} tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_changes_since [0.730706s] ... ok
{0} tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_name [0.482762s] ... ok
{0} tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_server_ref [1.072118s] ... ok
{1} tempest.api.compute.security_groups.test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_delete_nonexistent_security_group [0.859830s] ... ok
{0} tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_status [0.712207s] ... ok
{1} tempest.api.compute.security_groups.test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_delete_security_group_without_passing_id [0.381940s] ... ok
{0} tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_type [0.693178s] ... ok
{0} tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_limit_results [0.245908s] ... ok
{1} tempest.api.compute.security_groups.test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_delete_the_default_security_group [0.741245s] ... ok
{1} tempest.api.compute.security_groups.test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_security_group_create_with_duplicate_name ... SKIPPED: Neutron allows duplicate names for security groups
{1} tempest.api.compute.security_groups.test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_security_group_create_with_invalid_group_description ... SKIPPED: Skipped until bug: https://launchpad.net/bugs/1161411 is resolved.
{1} tempest.api.compute.security_groups.test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_security_group_create_with_invalid_group_name ... SKIPPED: Skipped until bug: https://launchpad.net/bugs/1161411 is resolved.
{1} tempest.api.compute.security_groups.test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_security_group_get_nonexistent_group [0.099050s] ... ok
{1} tempest.api.compute.security_groups.test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_update_non_existent_security_group [0.141201s] ... ok
{1} tempest.api.compute.security_groups.test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_update_security_group_with_invalid_sg_des ... SKIPPED: Neutron does not check the security group description
{1} tempest.api.compute.security_groups.test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_update_security_group_with_invalid_sg_id ... SKIPPED: Neutron does not check the security group ID
{1} tempest.api.compute.security_groups.test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_update_security_group_with_invalid_sg_name ... SKIPPED: Neutron does not check the security group name